kempelen
Hello, this "castle" does not necessarily mean something big or something you can visit, it's "A manor house was historically the main residence of the lord of the manor." (quote from wikipedia). So do you think then it may be there, just you didn't realize? We rarely demolish such buildings:

Ref: http://www.kastelyok-utazas.hu/Lap.php?cId=1194&kId=1194

https://www.kastelyok.com/adatlap.php?details=728