The ground was a field that was part of a recreational ground that was at the time called the Orphanage, having just changed their name from the Cremorne Gardens (named after the gardens in London and after which The Cremorne public house was named). Charles Blondin, the high wire artist, was reported to have performed in the gardens. They also provided the home ground for Mackenzie F.C. during the 1867 Youdan Cup.
The site is now thought to be occupied by the Highfield library.