It was built between 1123 and 1139 but fell into decline in the sixteenth century. All that now remains is one small, toppled portion of a wall in the north-east corner of the inner bailey.