Your grandfather's SS-5Form http://ssdi.rootsweb.com
should have his place of birth, which you know but also include his parents names. His church baptismal record should contain his parents place of birth.
Take a look on 1930 census to see what it says for his parents as Na-naturalized, Al-alien or Pa-first paper and follow thru. Without a location, you can not proceed further.