There isn't much I can add to what you already know Simon but here are a couple of bits I found:
In the 1851 census is listed Edward Morris Goulston. He lived in the Tower Hamlets, Middlesex with wife Francis and a 9-yr-old son who's name I can't make out. He was a waxmaker born in Middlesex.
In the 1841 census he was in the Tower Hamlets, Mile End Middlesex with wife Francis. He was a 27-year-old black lead pencil maker. No children
I haven't been able to find their marriage record or anything more about them from before 1841. I'm pretty sure they had a son John in about 1843 who later became a wax maker as well. After Edward died (not sure exactly when) Fanny lived with John in the Tower Hamlets. They appear in the 1871 census there.