I know this is an old query, but I believe James was the son of Henry Allen Phifer and Mary Caroline Pierce. My grandmother, Etta Bullen, is his sister. The sister Jane you mentioned is probably Lillie Jane, wife to Wallace Rushing of Henry Co., TN. James Wiley had 3 sisters and 3 brothers. He eventually moved to Walker County, GA in the 1920's and had a large family, after marrying Rachel Lowery back in Benton County. His sister Mary Ann married a Lowery, Clinton, also and lived in a rock house built by my grandfather, Arthur Lee Bullen, down on Sulphur Creek Road. Also, Arthur Lee and Etta Bullen lived in Walker County, GA, in the 1920's, too, so that may be why he moved there.