I found this obituary for his wife, which provides his full name:
OLDEST RESIDENT OF CAPITAL DEAD
Mrs. Lucretia Jolly, 97, Had Never Traveled on a Railroad Train.
Baton Rouge, La., Jan. 26. Mrs. Lucretia Jolly, 97, native of Cincinnati, and Baton Rouge's oldest resident, died Friday morning at 2:45 o'clock in her residence, 1273 Main street, where she had lived the past sixty years. She was the wife of the late Henry William Jolly, who died about forty years ago. The couple came to Baton Rouge on a flatboat seeking a permanent home, shortly after they were married, in 1841. She was born October 26, 1820, as Lucretia Arons. When they settled here the home on Main street which they had erected and which stands now in the heart of the city was on the sparsely settled outskirts of the village of Baton Rouge. In all her 97 years, Mrs. Jolly never had traveled on a railroad train and had never seen New Orleans or place of interest nearer than that city. Her life was devoted to her family, some members of which are among this city's best known citizens. Mrs. Jolly is survived by a son, Charles H. Jolly, a well known local druggist; a daughter Miss Emily Jolly, who lived with her, and many grandchildren and great-grandchildren. The funeral was held Friday afternoon.
source: Times-Picayune (New Orleans, LA), Saturday, January 26, 1918