"Metronomically, we were a pretty accurate band. If we were speeding up or slowing down, it was by design. If you listen to the solo break on "There She Goes Again," it slows down—slower and slower and slower. And then when it comes back into the "bye-bye-byes" it's double the original tempo, a tremendous leap to twice the speed." —Sterling Morrison
There have been several notable covers of the song, including a B-side on the 1983 R.E.M. single "Radio Free Europe" (and as such appeared on their B-side compilation Dead Letter Office in 1987). It was also included as a bonus track on the 1993 re-release of R.E.M.'s 1983 album Murmur. In 1967 a band called the Electrical Banana did what is probably the first recorded cover of "There She Goes Again." The Velvet Underground album was released in March of 1967; in April the Electrical Banana covered the song, recording it in a tent in Vietnam and sending the master tape to a company in California to have 45 RPM records pressed (the subject of the HarperCollins book Rock 'N' Roll Soldier, 2009, by Dean Ellis Kohler & Susan VanHecke).