So I found a problem. The James Stewart whose parents are Absolum Stewart and Tabitha Clay is not the same James Stewart married to Edith/Eda Skidmore as some of the research others have done suggests. His parents were not Absolum and Tabitha. That James Stewart was born in 1804-1868 and I found a tombstone for him here: http://www.findagrave.com/cgi-bin/fg.cgi?page=gr&GRid=26...
. This could be some of the confusion on the dates of birth for James you are finding as some has confused the two Jameses and have mixed the history.
But you mention James being married to a Nancy above, married in 1843. Do you know Nancy's maiden name? That may help narrow down the search.
And let me see if I can recap of what you are 100% certain of.
James' parents were Absolum and Tabitha Clay Stewart. James was born in Virginia. James was married to a Nancy ? in 1843.
If we can back up to what we know for certain that will help backtrack us to find the correct James Stewart and we can fill in the gaps from there.