There are remains of earthworks inside an impressive moat, but no stone is left from the 12th century castle.