My married name is Baltzer. My husband's branch of Baltzer's are from Omaha, NE.
As far as Dickeson, Ferguson, Gache, and Cameron goes. . . I don't have access to the Census records anymore but I think if I remember correctly they were listed as boarders. Sorry about that.
My thinking on Philadelphia was the John said he was born at see. I tried to see if I could find him as an infant on a ship registry, but no such luck. When I found a family where the dates were close I thought maybe it would be worth looking in to.
Hope you're able to piece some more together!