In 1626, Saka (German: Sackhof) was given as an estate by the Swedish king Gustavus Adolphus to the alderman of Narva Jürgen Leslie of Aberdeen, whose origins were Scottish but who had probably entered Swedish service during the time of the Thirty Years' War. The estate later passed into Baltic Germanvon Löwis of Menar family, and the current building was erected during the ownership of Oscar von Löwis of Menar, in 1862-1864. It was built in an accomplished Italian renaissance style, unusual for Estonian manor houses.
During the Soviet occupation of Estonia, the manor was used by Soviet military forces. During this time the manor and the park fell into disrepair. It was abandoned, looted and left in ruins after their departure, but has later been restored.