It seems unusual to ship orphans out of state due to a fire in an orphanage. I consulted page 283 of the out-of-print book titled, "Adoption Agencies, Orphanages and Maternity Homes--An Historical Directory." The WorldCat data base lists 147 libraries in the U.S. that have copies of the Directory.
Page 283 says institutions bearing the name Little Wanderers occur in Maine at Augusta, Caribou and Waterville. Also in Massachusetts at Boston and Pittsfield. Also in Connecticut, New York and Vermont. I picked Little Wanderers because I knew it involved more than one state.
You can read other parts of the Directory to check out orphanages in New York and New Hampshire. There are three entries for Poughkeepsie, NY: Catholic Charities, Children's Home of Poughkeepsie, and Dept. of Social Services of Dutchess County. None of them appear to have links to Maine.