Lets start from the beginning:
What religion? What language did he speak?
When did he come to America?
When did he pass away?
Did he marry in America?
The 1940 census is the latest out.
If he had social security numbers than his SS-5Form should have a place of birth as well as parents names.
You might look into a naturalization intent & petition, if he was naturalized citizen.