The house, which was built in the gothic style for George Woodford Thelluson, a wealthy banker, was completed in 1802. It was then acquired by Admiral Sir Charles Pole, 1st Baronet in 1812. The house passed to William Stuart, Pole's son-in-law, and then remained in the Stuart family until 1910 when it became the property of the banker J. P. Morgan, Jr..
After use during the Second World War as a home for Joseph P. Kennedy, Sr., the United States ambassador, the house became a teacher training college. It was later used as a residence by the University of Hertfordshire until 2003 after which it was re-developed into luxury flats.
- Farmer, Duncan (25 April 2011). "Four storeys, vast ceilings and an enormous master bedroom... but my 6,000 sq ft 'castle' is just not big enough". Daily Mail. London. Retrieved 2 April 2014.
- "Wall Hall (Aldenham Abbey)". Dicamillo Companion. Retrieved 7 April 2015.
- "Sir Charles Pole, 1st Baronet". Oxford Dictionary of National Biography. Retrieved 7 April 2015.
- "Thellusson and Pole families: Title deeds and map of Wall Hall Estate, Aldenham, 1550-1923". National Archives. Retrieved 7 April 2015.
- Khan, Mobeena (22 July 2009). "The 'Mansion'". Herts Memories (Hertfordshire County Council). Retrieved 2 April 2014.