Hi Sharon
I also have Herbert Edward Atkins born 1863 Stepney,Middlesex in my tree he was married to my wifes great Aunt.I will explain & I hope you can follow the thread as it can be confusing.
Herbert married Charlotte Amelia Dalrymple 19 Oct 1889 Holy Trinity Mile End Old Town.They had 4 children Winifred Mabel b 1891-1960,Herbert Stanley b1893, Leslie Reginald b1895-1962 (canada) Charles Dalrymple b1897 these can be seen in the 1901 census with the family living in Beckenham Kent Herbert is shown as a widower, Charlotte died in 1899.
Eva Teresa Kape b 1873 High Wycombe,Bucks. She married John Thomas Newell b 1872 Cirencester in Lewisham in 1900 they had a son Wilfred John Newell b 1901-1980. I cant find any record as to what happened to John but Eva married Herbert Atkins 1905 at Lewisham, the new family & children appear in the 1911 census living in Lewisham.
Herbert & Eva had 2 children of there own, Louisa Agnes Mary b 1906, no trace can be found. and John Edward b 30 Mar 1908.
I hope you can understand all that if you want clarification on any points feel free to come back to me.
Regards
Peter.