It is the oldest surviving school building which is constructed for children of overseas parents living in Hong Kong. In 1900, Mr. Ho Tung (later Sir Robert) donated $15,000 to the Government to set up a school in Kowloon. The building was officially opened by the Governor, Blake on 19 April 1902.
The school was officially opened as a primary school for some 60 pupils but it was converted to be a secondary school for some 300 students in the mid 1930s. The school remained at this building until 1937 when it relocated to 2 Tin Kwong Road in Ho Man Tin. The school was closed August 1940 after children were ordered out of Hong Kong as World War II began to impact Hong Kong. The school reopened in the summer of 1946 and renamed King George V School in 1948.
The building is a typical Victorian structure, but was modified to adapt to local climatic conditions by adding wide verandas, high ceilings and pitched roofs.
The Family Welfare Association and Tsim Sha Tsui Kaifong Association had used the building after the Second World War. It now houses the Antiquities and Monuments Office after restoration.