Use these links to aid in searching. By 1880 I think Asher Sr. & Polly are both dead. I couldn't find hiom in the Mich. 1870 census. THe children are spread out over the US.
Michigan Genealogical Death Indexing Systemhttp://www.mdch.state.mi.us/PHA/OSR/gendisx/search2.htm
1870 Michigan Census = Free sitehttp://envoy.libofmich.lib.mi.us/1870_census/
1880 US Census – The Mormon Church Files LDS (Free and searchable)
Look for 1880 US Census on the left side of screenhttp://www.familysearch.org/Eng/default.asp