Death records were not publicly recorded until 1913-14, so there is no official record. Your best bet is to look at newspapers of that time era or cemetery surveys.
In the 1880 Alleghany County census he was age 59 and lived in the Cherry Lane district which is just over the Blue Ridge mountains northwest Surry County.
Bob