It seems that all of this would have taken place after 1858. That early, the naturalization records might only say, "I renounce the King of England" or something like that. After 1906 they are much more informative. And it's not at all unusual for someone NOT to be naturalized, or even to start the process in one court and finish it in another state.
See:
Title Naturalization records of New York State /
Corr. ed.
Publisher Syracuse, N.Y. : New York State Council of Genealogical Organizations, 2001, c1999.
Paging 44 p. : ill., maps ; 28 cm.
Series Stmt New York State Council of Genealogical Organizations publication ; no. 1
Notes Includes bibliographical references (p. 5).
Subjects Naturalization records New York (State) Directories.
New York (State) Genealogy.
Other Names Austin, John D.
According to worldcat.org, 12 libraries in the nation own it.