I've checked my Gorey files and have not found anything on Lewis Gorey. I did find a Peter Gorey and his wife Mary in the 1870 and 1880 Fond du Lac County, Wisconsin, censuses, spelled "Gory." You probably already have that information.
The 1870 shows Peter and Mary, both age 55 and born in Ireland, living on a farm in the town of Byron, with five children, John (age 25, b. Massachusetts), Ann (age 19, b. Wis.), Mary (age 16, b. Wis.), Peter (age 14, b. Wis.), and Margaret, age 12, b. Wis.). The 1880 census shows them in the town of Forest in Fond du Lac County. Shows Peter as age 67, Mary age 65, John age 30 (born in Mass.), and Mary age 25 (born in WI.). I hope this of some use to you.