The poor house and cemetery I think you are referring to was located in the North Hills area of Raleigh near Brooks Elementary School although I don't know the exact location. The house itself is long gone and I am not sure where the cemetery is. I tried to find it with no luck. The home that replaced this one was built in 1915 I think and it still stands on Whitaker Mill Rd. The cemetery to this home is behind Emmanuel Baptist Church however no graves are marked. Hope this helps.
Chris