I show an 1880 Federal Census record for a Henry H. Clary age 1 living in Meherrin, Brunswick, VA with an estimated birth year of 1879. His father is Charles age 40 and mother Eveline age 26 as well as a sister Dora A. Clary aged 2 and a 1 month old unnamed infant.

This doesn't match anything in my tree although I do have a branch from the Brunswick area so I'll be looking for a connection. I'll follow up with any more information I find.