The way surrounding the site has the name Trematon Castle, but within it is a building with [addr:name=Higher Lodge] & [historic=manor] tags. Did they build a manor inside a castle?

Further, when looking at satellite imagery, a castle looking structure just 50 metres NE of the building doesn't seem to be included in the castle way, or the geometry is extremely outdated.

Trematon Castle: https://www.openstreetmap.org/way/335345484

Higher Lodge building: 
https://www.openstreetmap.org/way/1074851670 higher lodge