I am not able to help you with the Lee/Lea family, but your Mary "Polly" Swift was Mary Street Swift, daughter of William Park Swift and his wife Sarah "Salley" Tate. I am very closely studying Sarah's mother as being Sarah Street, daughter of Hannah Waddy and John Street. I also have a strong hunch that your John Lea's mother was Mary Street, sister to Sarah Street Tate.
I am a descendant of Frances Tate Swift, also a daughter of William Park Swift and Sarah Tate. Frances Tate Swift married John Windsor Tapscott; one of their sons, Thomas Jefferson Tapscott married Elizabeth "Betty" Lea whom I believe to be connected to your Henry Lea's family.
Hannah Waddy was half-sister to Frances Waddy Swift, wife of William Swift, JR. William Swift and Frances Waddy were parents of William Park Swift.
As you can see, we have a lot to discuss.
Winston Salem, NC