The b-side of the 7-inch single is "Heads Will Roll" and the b-sides of the 12-inch single are an expanded version called "Heads Will Roll (Summer Version)" and "The Original Cutter". While Hugh Jones produced the a-side, the b-sides were produced by Ian Broudie under the pseudonym Kingbird.
Primarily released as a single, "Never Stop" also appeared on the 12-inch mini-album "Echo and the Bunnymen". It was subsequently included on the 2003 remastered version of the Porcupine album as well as a number of compilation albums. "Never Stop (Discotheque)" was also used in the 2006 film The History Boys and was included on the subsequent soundtrack album.