My grandfather, James Inverarity, was born on 15th March 1864 at Briech Street, Rothes. He was the son of George Inverarity, a farm servant and Elspeth Milne. Unfotunately it was an illegitimate birth and there is no information on the certificate to help me and obviously no marriage certificate to take me back to the next generation. George is proving rather difficult to track down. The only possibility I have come across is one born in St. Vigeans near Arbroath in 1821 which would make him a sprighly 43 when my grandfather was born. Being a farm servant he obviously moved around and is difficult to pin down in census returns.
Does anyone have any information on George Inverarity or the hapless Elspeth Milne ?

Thanks !