I do not have anything on Pardon Lyon that is proof of relations, but suspect you are probably right. He is in Taylor in 1855, age 54, born in Vermont, resident 1 year with his 2nd wife, Ruby (Smith), age 34. She died in 1896 and was buried in Union Valley. He has 3 children there from 1st wife, Huldah M., 16; Joseph H., 14, both born Wayne County, NY; and Pardon H. Jr., age 10, b. Cortland County. Pardon Jr. was in the Civil War. Also there is Ruby's son, Luman B. Smith, 11. He is also buried in Union Valley. He is on Potter Hill in this census.
Sorry I could not help further.