I have the parents of James Madison Nance as Thomas NANCE who marr. Ferabee I. YARBROUGH ...
Thomas' parents are Hudson NANCE and Elizabeth "Betsy" HUBBARD.
Hudson's parents are the others you looking to tie into and they are Thomas NANCE who marr. Nancy LANCASTER
(So the James you are looking for is the great grandchild of the Thomas you are looking for)
P.S. Not my line I research all Nances