I am also trying to decipher the relationships of my Franklin County Young ancestors to the other Young families there. One possibility for your Giles looking at the 1850 census is one at about 7 years old, son of Saunders Young and America. The township/district is not listed but this would be about the right age. There is another Giles of about the right age listed in the 1870 census, but he is listed living next to an older Giles, who must be his father, and they live next to Armisted, who is older and should be their father or brother, not sure. I think this is in Brown Hill district. My ancestor is Peter Young, and I have not been able to prove a connection to the others yet.
Good luck on your search. I am sure someone out there has desciphered all these FCVA Youngs. It is tough to do from Louisiana!