The chorus refers to actress Candy Darling and her friend Taffy, who the Rolling Stones had previously met at the Hotel Albert in New York City. According to Darling:
We met them in the Hotel Albert. We were on the floor above them and we dangled a bunch of grapes down on a string outside their window. You see, the Citadel is New York and the song is a message to us – Taffy and me.