Doubtful that this couple married in "1806". Try the First Baptist Church, W. Park St. Albion. Vital records not mandated in NY State prior to about 1880 and don't exist (fire not to blame on this one). Fultonhistory.com shows "Baruch Beckwith & Co." dry goods in Palmyra NY in 1818.
There are also NY State censuses in 1855, 1865, 1875. Hoag Library in Albion (was "Swan Library") has local weekly microfilms. Good Luck!