"Stop Me If You Think You've Heard This One Before" was still released as a single in other countries, but its promotional video—which featured Morrissey plus a large number of Morrissey lookalikes—was used in the UK to promote "I Started Something I Couldn't Finish".
The track features an outtake during the fade-out at the end, with Morrissey asking "Okay Stephen [Street, the producer] shall we do that one again?"
British 7" and 12": "MURDER AT THE WOOL HALL"(X)STARRING SHERIDAN WHITESIDE / YOU ARE BELIEVING, YOU DO NOT WANT TO SLEEP
The Wool Hall was the recording studio in Bath where The Smiths had recorded their latest album Strangeways, Here We Come, but it also was where Morrissey, at the time of this single's release, was recording his first solo album Viva Hate. One of Morrissey's pseudonyms, Sheridan Whiteside is the title role in the play The Man Who Came to Dinner. The B-side etching is a reversal of "You are sleeping, you do not want to believe", a sample heard at the end of the Smiths song "Rubber Ring".