I think I have found the line you are looking for in Saratoga. Seems to be the only Edward in Saratoga county in 1860 of that age.
Just one question.
You have Edward as born about 1858-1862.If he was he couldnt have been in the civil war as you have noted.
Just wanted to make sure you had the right Edward and that his wife was Ann before I continued that search. Dont want to lead you down the wrong path with it.