This sounds like the book by Barbara Birmingham -- I think that the title is History of the Dwyer Family.
I also think that I know your grandfather -- age in the 70s and lives in California?
The John Dwyer that you mention (1844-1925) is my ggfather (and your grandfather's). Harold and his brother Gerald lived with my grandmother as teens.
I'm out of town at the moment, so don't have the book or the genealogy database at my fingertips. I do have pretty much the complete information on this family, except for recent births, marriages, and deaths.
Tom