Throughout the Books of Ezra and Nehemiah, lists of names of those who returned are given and they are all from the Tribes of Judah, Benjamin, and Levi.
We see however from verse 1-Chronicles 9:3 that there were people from other Tribes there. This is explained best by Nachmanides (Book of Redemption, chapter one)...
