The current palace was built after the fire that affected it in 1285. The Viscounts of Rocabertí decided to move the location of the palace outside the walls. Towards the s. XIV The construction of the Gothic palace began, although it has few vestiges, as it has been restored several times. Many of the renovations were carried out in the 16th and 17th centuries. The interior was rebuilt in the 18th century and, from 1875, the last counts of Peralada commissioned a remodeling project from the French architect Grant. This period includes neo-medieval interventions, the garden, designed in 1877 by François Duvilliers, and communication with the grounds of the convent of Carmen — which had passed into the hands of the counts after the confiscation of 1835. The palace and convent were acquired in 1923 by the Barcelona financier Damià Mateu, who turned them into a private residence and museum. His successors have turned part of the palace into a museum and casino.