Many talented children don't have families financially capable of supporting them. Many families consider it an honor to have a child receive an offer to go to the temple. More than once, young Jedi have been rescued out of slavery, before deciding to stay on as a trainee-- or are orphaned. Younglings can come from any species, any race, any people or situation, provided they're willing and able to embrace the Jedi teachings.