Both the building and the garden were built during the middle of thirteenth century by the Ilkhanate or a paramount chief of the Qashqai tribes of Pars. The original layout of the garden however, with its quadripartite Persian Paradise garden structure was most likely laid in eleventh century by the Seljuqs, and was then referred to as the "Bāq e Shāh" ("the king's garden" in Persian) and was much less complicated or ornamental.Cornelius de Bruyn, a traveller from the Netherlands, wrote a description of the gardens in the eighteenth century.
Over its 150 years the structure has been modified, restored or stylistically changed by various participants. The building faces south along the long axis. It was designed by a local architect, Haji Mohammad Hasan. The structure housed 32 rooms on two stories, decorated by tiles with poems from the poet Hafez written on them. The structure underwent renovation during the Zand and Qajar dynasties.