Don't Stop is Billy Idol's first solo release. Released in the US in late 1981, it contained a version of Tommy James and the Shondells UK #1 "Mony Mony," that would become a hit as live version in 1987 and "Dancing with Myself," the latter of which had also been a moderate hit for Idol's former band Generation X. "Dancing With Myself" (from Generation X's last LP Kiss Me Deadly) was not re-recorded for the Don't Stop EP release but was simply remixed from Generation X's 6:05 extended release of the song and edited down to a 4:50 version, in which a drum solo and chorus section were removed. The song "Untouchables" however, another Generation X song written by Idol and also from Kiss Me Deadly, was re-recorded for Don't Stop.
The EP peaked at number 71 on the Billboard 200 and generated considerable anticipation for the full-length album Billy Idol, released the following year.