So, it is still possible that the children were not his (perhaps orphans he agreed to bring to NS) or perhaps stepchildren. Maybe that is why we haven't been able trace them.
I guess he either married in NS or MD. My hunch, based on the ages of his known children, is MD area.
Vickie Elam White