Yes, numbers are a problem but given thousands of years to introduce fresh genetics the possibility of establishing a viable population increases.

"The Stone Age did not end for lack of stone, and the Oil Age will end long before the world runs out of oil"

-- Sheikh Zaki Yamani