The Mount was the polar opposite to The Valley, which was a sunken ground that was originally a chalk pit. The Mount was a more modest stadium, holding roughly 50,000 compared to The Valley's 75,000, and had an appearance like a fort owing to concrete pylons having to be raised to support the terraces which were erected on sloping ground (down hill). Despite being the largest ground in the world at the time apart from the newly completed Wembley Stadium, Charlton Athletic F.C. decided to move to The Mount for the 1923-24 season as they failed to fill The Valley with supporters. The Addicks also changed their kit colour to dark and light blue (the same as Catford South End) sparking rumours of a merger. The move to The Mount and the construction works to improve the terracing were almost entirely funded by Harry Isaacs, owner of The Dartmouth Hotel public house in Laleham Road adjacent to the park, who was a passionate racing and football fan and son of Sam Isaacs, founder of the UK's first table service Fish & Chip Restaurant chain. The 1923-24 season was one of the wettest on record and being far from their fan base in Charlton it meant that attendances were very poor throughout the season. Added to this, the concrete pylons supporting the stands began to slide into the mud taking a bankrupt Harry Isaacs with them, and The Addicks back to The Valley the next season.
Catford South End remained a modest local team who eventually fell into obscurity. The stadium proved too big for them and so they also decamped. The Mount thus became vacant and fell into disrepair and, by the 1950s, had been completely demolished. The land still remains as a grassed area within Mountsfield Park.