Thanks for the paragraph about James H Brown, this is definitely my great grandfather and it confirms the census information that I have. He's listed in Brunswick, Eau Claire county in the 1870 and 1880 US census, but had moved to Eau Claire Ward 3 by 1885 according to the Wisconsin State Census.
There are a couple of typos in the information from this book. James married Miss Anna Taft (not Faft) and their oldest daughter's name was Ella Marian (not Marion, which is the masculine version of this name).
I appreciate your help very much.