My wife is from this Vallee/Mulhall family. The John "Valley" in the following 1880 census record is likely the right guy after he deserted (as the story goes) his family and "went back to France". Well, maybe he stopped in Mississippi on the way! Note that he is the only person in his household and that he is married. I presume that being Catholic, he wouldn't have divorced. I'd like to have a scan of that Bible record!
1880 census District 2, Beat 2, Wayne, Mississippi
Birth Year <1826>, Birthplace FR, Age 54
Marital Status M <Married>, Race W <White>
Head of Household John VALLEY, Relation Self
Father's Birthplace FR, Mother's Birthplace FR