Maybe they moved to Cherokee Co?
1880 Cherokee Co. TX
All African American
James Pitts [but someone corrected it to Fitts on the Census in Ancestry] b. TX, 40, farmer
Sarah, wife, b. TX, 25
James, b. TX, 16, works on farm
Robert, b. TX 12, works on farm
Lizzie, b. TX, 8
Nancy, b. TX, 6
Amena, b. TX, 1
John Wolfe, stepson, b. TX, 12, working out
Mary Johnson, b. AL, 20
Lutz or Letz Johnson, b. TX, 3
Felix, b. TX, 4/12ths
Unfortunately the Nocogdoches Genealogical Society has disbanded. The Nacogdoches Library, www.ci.ncogdoches.tx.us/library
might have some information about your family. Successful Searching!