The first motte and bailey castle was erected at the end of the 11th century but was mainly destroyed in
1174. The outer bailey remains as a public park and some of the stone buildings were incorporated into the later structure. The castle was rebuilt in c. 1190 with fourty foot high walls, a strong gateway and 12 sixty foot high towers (one has collapsed) which are well preserved. It was used as a residence until the 17th century when a poorhouse was built inside the walls, later extended in 1729 - these are the buildings inside the castle. The poorhouse continued until 1839 after which the castle declined and some of the stone was removed.