After surveying and some online history research it seems very unlikely that this place was a manor (just a farmhouse) and likely tagged as one since it looked like one. 

I have now fixed the area for the manor and the surrounding area.