This would be Saint Etienne's final release for Warner Bros. Follow up single "He's on the Phone" would be released on MCA Records, lifted from a dance compilation album called Life is a Dance. The US releases included a number of exclusive remixes - including an alternate album version (which was released as a bonus track on the US version of Tiger Bay), a Motiv-8 dub, and the On Tour In '94 dub.
The song bears a resemblance to the 70s disco hit More, More, More by Andrea True Connection. In particular, the phrasing of the "More More More" lyric "Ooh, how do you like your love?" is identical to the "Hug My Soul" lyric "Ooh, what are you dreaming of?", and both lyrics are the opening to each of their representative songs.
The UK release featured cover art involving a photograph of abandoned musical instruments. The US release features a photograph of the band.
The single was marketed with a surreal music video inspired by the French film La Bête (1975). In the video, Sarah Cracknell plays a young girl asleep with her stuffed toys; she dreams of being chased by a bear, but ultimately ends up having jelly and ice cream with him in his den.