Some years ago, I had all of the Wilson entries pulled from the Tartaraghan and Milltown parish records from about 1825 to about 1860. Elsewhere, I found that you had listed James' birth date as 19 July 1832 in Tartaraghan. Unfortunately, his baptism does not appear in the records, so he may have been baptized elsewhere. However, I did find the baptism for several of the children in Milltown Parish:
11 May 1850 -- Margaret Jane, daughter of James (weaver) and Jane of Ballynarry (born 3 May 1850)
8 October 1854 -- Mary Ann, daughter of James (weaver) & Jane of Ballynarry (born 7 September 1854)
21 December 1856 -- Maria, daughter of James (weaver) and Jane of Ballynarry (born 26 November 1856)
13 March 1859 -- Sarah, daughter of James (weaver) and Jane of Ballynarry (born 20 January 1859).
This is the only couple names James & Jane who appear in the records, so assume they are yours; however, again, I was not able to find a marriage record for them. You might want to check the records in neighbouring parishes (ie, Killyman or Drumcree).
I did find a possible related marriage:
Jane Wilson of Tartaraghan married Alexander Kennedy of the same parish; 28 September 1838; witnesses: William Williamson & James Dillon.
Burial Records in Tartaraghan:
John Wilson, of Ballinary, buried 29 December 1846, aged 17 years
John Wilson, of Ballinary, buried 11 July 1847, aged 49 years
Other possible Wilson relatives (from Milltown Parish:
Anne Jane, daughter to Richard (mason) & Margaret, of Ballinary, born 8 October 1845, baptized 2 November 1845.
Richard, son to Richard (mason) & Margaret, of Ballynarry, born 14 April 1849, baptized 13 May 1849.
Anne, daughter to George (weaver) & Frances, of Ballynarry, born 18 September 1852, baptized 19 September 1852.
James, son to George (weaver) & Francis, of Ballynarry, born 17 January 1854, baptized 22 January 1854.
William, son to Richard (mason) & Margaret, of Ballynarry, born 26 August 1855, baptized 25 November 1855.
Mary, daughter to George (labourer) & Frances, of Ballynarry, born 15 September 1856, baptized 21 September 1856.
James, son to Richard (mason) & Margaret, of Ballynarry, born 21 October 1858, baptized 14 November 1858.
Elizabeth, daughter to George (weaver) & Frances, of Ballynarry, born 16 January 1859, baptized 24 November 1859.
David, son to David (weaver) & Sarah Wilson, of Ballynarry, born 22 October 1859, baptized 9 February 1860.
On the confirmation lists in Tartaraghan Church from Milltown Church Congregation:
John Wilson, aged 17, Ballynarry
James Wilson, aged 16, Ballynarry
(this might be your James, which would suggest a birth year of approx. 1829).
Confirmation Lists presented in Drumcree Church from Milltown Church Congregation:
John Wilson, aged 16, Ballynarry
David Wilson, aged 26, Ballynarry
Other marriages (Milltown):
19 April 1844
William John Wilson, Ballynarry, farm servant, married Sarah Wilson, Ballynarry; witnesses: Robert Wilson & William Bennison
22 August 1844
John Wilson, Ballynarry, farmer, married Maria Courtney, Derryadd; witnesses: John McClelland and Robert Courtney
Burial Records (Milltown) -- no Wilsons prior to 1862:
24 January 1865 -- Richard Wilson, Ballinarry, aged 46
?? June ?? -- James Wilson, Ballinary, aged 22
27 February 1884 - Sarah Wilson, Ballinarry, aged 20
11 August 1884 - Eliza Wilson, Ballinary, aged 23
2 November 1884 - Frances Wilson, Ballinary, aged 54
12 January 1889 - George Frances, Ballinary, aged 60