Nirvana released a cover titled "Jesus Doesn't Want Me for a Sunbeam" on their live acoustic album "MTV Unplugged in New York." Two more versions of this song were released on the 2004 box setWith the Lights Out. This included an acoustic version recorded in Europe in 1994, along with a live electric performance on the DVD section of the box-set. Another version was released on 2011 as a bonus track on the 20th anniversary edition of Nevermind.
On the version contained on the MTV Unplugged in New York album, Kurt Cobain refers to the song as: "a rendition of an old Christian song, I think. But we do it the Vaselines' way."