The building was constructed before 1894 and was owned by Dona Carolina Cunha. Later the mansion was purchased by Hong Kong businessman Sir Robert Ho Tung in 1918 as a retreat and he lived there between 1941 and 1945. He died in 1955 and the building was presented to the Government for conversion to a public library in accordance with his will.
Sir Robert Ho Tung Library was officially opened in 1958 to the general public. In 2005, a new building was constructed near the back garden of the mansion, making the library the biggest public library in Macau.
^"Services Brochure." Macao Public Library. p. 18/20. Retrieved on April 18, 2017. "Office Addresses and Office Hours[...]Office of Macao Public Library Largo de Santo Agostinho, No. 3 (i.e. GF, old building of Sir Robert Ho Tung Library)[...]Macao ISBN Agency Largo de Santo Agostinho, No. 3 (i.e. 2/F, new building of Sir Robert Ho Tung Library)"