The death certificate mentioned in the last paragraph of my previous post gives the family's address as 39 Neptune Street, Lambeth. This is the address given for the family (widowed Henry and his children) in the 1901 census, so definitely confirms that the mother of his children was Eliza Ellen ATTRYDE.
I also found some Electoral Registers that confirmed that Henry TOWERTON lived at 39 Neptune Street (where he rented two unfurnished rooms) from at least 1893 to 1899.
Referring to the ATTRYDE family mentioned in a previous post and who are living a couple of doors down from Henry, I've checked this family on the previous (1871) census and they have a daughter called Eliza!
Checking the death indexes for any infant TOWERTONs dying c1896, the only one I could find was a Heurtly Victor TOWERTON whose death was registered in Wycombe in Dec 1896 (aged 0) and whose birth was registered in the same place in Mar 1896. It may be worth purchasing the death certificate.
Unfortunately, as I can find no record of Henry TOWERTON on the birth indexes or 1861/71 censuses, I can't see whether his family has any connection to the Wycombe area. Perhaps someone else can help???