The mansion was built in 1760 and initially served as Jesuit College retreat from Trieste. In 1762, it was bought by the tradesmen Valentin Ruard and Josef Desselbrunner, who arranged the largest cloth factory of the Austrian Empire in it. After the factory became unprofitable, it was closed in 1803. From 1820 until the end of Yugoslavia, it was used by the military. In 1994 the building was declared a historical monument of Slovenia.