My information shows the only children of Henry "Lighthorse Harry" Lee III to be:
Algernon Sidney (died in infancy)
Gen. Robert Edward
The only candidate for the father of your Harry, as far as I can tell, is Sidney Smith Lee, who is also the father of Gen. Fitzhugh Lee. Hope this helps.