The first Government House that was built on this site was destroyed by a hurricane in 1817, before its completion. A second house, built of timber, was completed on the same spot in 1819. This house fell into disrepair, and was abandoned by 1865. Government House then relocated to a nearby disused military barracks.
Construction of the present brick-built Government House was started on the site of the previous house in 1894, and was completed a year later. It was originally used as the home and office of the Commissioners of Saint Lucia until 1958, then for the Administratiors of the island. From 1967, Government House was used by the Governors of Saint Lucia, and since Saint Lucia became an independent state in 1979 it has been used by Governors-General.