Looking for more information on the Canadian line of Stanfords.

My grandfather Charles Stanford was born in 1909 in Vancouver BC, died 1982 in Oregon.
His father was Charles Stanford born 19 May 1882 in Toronto, d. 1986 in Washington. His wife was Margaret Whitley, b 1880 in NY, d unknown.
His father was William Stanford b. March 1851 in Toronto d.about 1930 prob in Toronto. His wife was Frances "Fannie" Frazer, b Nov 1955 in NYC and died 30 June 1929 in York, Canada.
His father was John born about 1819 most probably in Canada or England? His wife was Anna b 1820, d about 1880 in Canada - I believe her maiden name was Bramwell.

But I'm stuck here - our family had always thought that the Stanfords were more recent immigrants to Canada but from what I've found so far that isn't the case. I have some good census records and the like for after John Stanford but not found anywhere to go before him. Apart from the son William, there was also a daughter named Louisa b. about 1850 who married Miles Nichols.

Hoping theres some Canadian cousins out there.

many thanks

Elizabeth