I have Walter Capps, born about 1876 in east Texas, in my family tree. I wonder if he is the same as your Walter Capps.
Our Walter Capps is the son of Charles Capps (1857) and Mary Rogers (1858). Charles Capps married Mary Rogers in Cleveland County, AR on June 10, 1875. They migrated to east Texas between 1875 and 1880. They had a son, Walter. I have no further information on them after they migrated to east Texas.
Charles Capps is the son of William Ransom Capps (1819) and Mary Lane Capps. They had three children, Cora(1856), Charles(1857) and James(about 1859).
The name Charles King Capps is also interesting. The "King" name also occurs in our family, but I do not know the origin, nor how it fits.
I would like to share information if you believe there is a link to your Capps family. William Ransom Capps is my GGGrandfather.