See the 1891 Census for St. Margaret Parish, Kings Lynn, Norfolk (last page). This has the following family, which might be yours (ages are often very imprecise in the Census):
Stephen Riches, 43, head, b. N. Walsham, Norf., General Laborer
Harriet Riches, 41, wife, b. Walsingham, Norf.
Louisa Riches, 16, dau., b. Lincoln, Lincolnshire
William Riches, 13, son, b. Terrington, Norf.
Frances Riches, 10, dau., b. Wells, Norf.
Harriet Riches, 8, dau., b. Gaywood, Norf.
Charlotte J. Riches, 4, dau., b. West Lynn, Norf.
Stephen seems to have been an itinerant laborer, and thus moved around a lot. The Riches family was ancient and numerous in central Norfolk.