The first US troops have started leaving Afghanistan on the same day President Joe Biden decided not to extend the August 31 evacuation deadline, two defense officials told CNN.