I don't see the northern half of the castle on any of the aerial imageries. Only Bing shows some light lines - and they are off the current walls (just as I wrote).

Besides, the central part of the castle is missing its walls. I mean, there are walls in the reality - but missing from the map.