Rachel,

I believe that Caswell Walker Bryant was the son of James Sidney Bryant (12/1/1815-2/6/1896) and Martha Ann Elizabeth Ellis (12/11/1825-8/25/1860) - one of their 12 children.

I have some confusion with James's second? wife Eliza Matheson, and I still can't find a thing on James' parentage, but the records are on my public tree if you are interested.