In 1536 Vasari invited him to Florence to assist in producing the decorations for the ceremonial entry of Charles V into Florence. The following year, in the reaction after Duke Alessandro's death, Gherardi was among those banished from Florence, so his work for Vasari was confined to projects outside Florence, until his banishment was lifted in 1554 and he was permitted to return. In the long interval he had painted the Visitation of Mary to Elizabeth for the church of San Domenico, Città di Castello; church decorations in San Sepolcro; and works for the Vitelli, who were long-term patrons. Gherardi, in the two years left to him, assisted Vasari in the Quartiere degli Elementi in Palazzo Vecchio. Vasari's main assistant after Gherardi's demise was Jan van der Straat, called Giovanni Stradano.