Orleans Rootsweb (free!) shows Town of Ridgeway 1865 NY State Census:
JAMES, Delonzo age 60 Male born "Rensselaer" County 251-D1 James, Minerva L. 55 Wife "CT" (Connecticut)

Rensselaer County NY is east of the Hudson River across from Albany. The 1855 State Census says "Fulton County" for him (NOT Fulton City in Oswego County). Fulton County (northwest of Albany/Schenectady) was split off from Montgomery County in 1838. No children in home in 1865 but in 1855 all children born in Wayne County (east of Rochester). No relation, good luck.