Wisconsin old Post offices list includes two references to "New Haven" one post office established Mar 13, 1865 was in Adams County, WI. discontinued 1881. The other was listed on Portage County Name changed from Warsaw 1851.
USGS Information Search indicates a "New Haven Township" in Adams County and a "New Haven Township" and "New Haven Cemetery" in Dunn County. Hope this helps with your search :-)