This sounds very interesting to me since I am also a relative to Samuel Van Wagner, and once looked at the family you are describing as a possibility for Charles. Do you know anything about Charles E. Van Wagner? Or the rest of his family? all I know is what I was able to find on the 1850 and 1860 census reports. Also their were 3 Charles Van Wagner's who signed up in New York for the civil war, one died, one ended up in Tennessee and the other ended up in New Mexico were his widow Manuella collected his pension.
It seems like a very possible link dosen't it? Please let me know if you know anymore.
All the best