Hi Cindy,
The real pain here is that Ancestry.co.uk isn't presenting the views of the census for
Bringhurst 1871, and that means you can't just plod you way through the entire district.
Can I recommend investing in buying a copy of the birth certificate? from the public records office. James was born post 1837 so his birth will be registered.
I did that when trying to trace my great great grandparents, and it came up with the goods; father's name, mother's name and maiden name and usefully father's trade.
It opened up a fertile line of inquiry that was previously closed. Worth every penny of the seven quid it cost me!
Another point. The absence of a person from a place on a census does not mean they did not live there. They could have been somewhere else on that night (31/3/1871), and not everybody was discliplined about returning the details of overnight guests.
Andy