The Whiteside connection is correct.

William R. Duvall had a sister Elizabeth who married Thomas Dwyer of Unity, MD. She died in 1854, and one son went to live with William R. to learn shoemaker trade.

Not sure at all how William R. and Elizabeth are related to other Duvalls in Maryland.