Would the following be your family? From History of Toronto and County of York, Ontario. Vol. 2, published 1885 by C. Blackett Robinson, Township of King, page 385:

JAMES BELL was born in Scotland in 1810, and emigrated to Canada in
1831. He navigated the lake for a few years, and then bought a farm near
Guelph, which was at the time complete bush. He cleared his land with the
help of his son James ; by their united efforts it was soon under cultiva
tion. Mr. Bell s wife, whose maiden name was Mary Cairns, died the year
subsequent to their arrival in this country : two of their children are living
-James and Jane. Mr. Bell came to Canada without means, but has been
very successful : he is still living on the old place. James Bell, jun r, was
born in Scotland in 1827, and was only four years old when his father
brought him to Canada. He was married in 1854 to Miss Margaret
McCallum : they had five children, four of whom are living Duncan, Adam,
James, and Elizabeth. He is in religion a Presbyterian, and in politics a
Reformer. A fine large brick church stands on an acre of ground presented
by Mr. Bell.