possibles:
A james age 16, born 1855 is shown in Hibbert in the LDS with father James and brothers Thomas 14 and John 8.
See also possible in 1881 census with wife Ellen and daughter Ellen Agusta.
Wild guess is this from St Columbans:
James ATKINSON St Columban parent mentioned at bap/birth of James 13 Aug 1854 / / 1 Aug 1854 approx. born 1 Aug 1854.
married to Judith Casey.
Might Judith Casey be the first wife you are looking for?
Merv.