Documentary evidence shows that a timber hall first existed on this site. The manor house was built by Robert de Reymes, a wealthy Suffolk merchant, starting in 1296, adjacent to the steep valley of the Cor Burn. At this time the building consisted of a two-storeyed hall house with a solar, dining hall and kitchen on the upper floor. In 1305 he obtained a licence to crenellate his property and added battlements and curtain walls. It was captured by the Scots in 1315 and again in 1346. In the middle of the 16th century it was renovated and in the middle of the 17th century it was converted into a farm. The building remained in use as a farm until 1966 but has since been restored to its medieval appearance. It is managed by English Heritage.