"Hold Me, Thrill Me, Kiss Me, Kill Me" has its origins in the sessions for the band's 1993 album, Zooropa. Bono described it as being about "being in a rock band" and "being a star". The song's title comes from a play on the classic song "Hold Me, Thrill Me, Kiss Me" and it is actually visible (along with the titles of other discarded demos) on the album cover of Zooropa, written in purple text.
U2's involvement with the soundtrack began when director Joel Schumacher attempted to create a cameo role for Bono as MacPhisto in Batman Forever, in which the character was intended to appear at a party scene. Although both tried to make the scene happen, they came to agree it was not suitable for the film. Instead, the band offered "Hold Me, Thrill Me, Kiss Me, Kill Me" as a contribution to the soundtrack.
The song was played live on every show of the PopMart Tour as part of the encore and appeared at all 94 of the tour's concerts. It was not played again until the 2010 leg of the U2 360° Tour, opening the second encore. From there, it remained a permanent part of the encore until the end of the tour in 2011.
The animatedmusic video to the song (interspersed with clips from the film) was directed by Kevin Godley and Maurice Linnane. It features the band performing in Gotham City, with Bono battling between two of his alter-egos from the Zoo TV Tour: "The Fly" and "MacPhisto." The band also chases the Batwing, using a yellow supercar and their guitars as flamethrowers. The animated sequence also features characters dressed as the Riddler, Dr Chase and Robin, in scenes similar to those in the movie.
At one brief point of the video, a neon sign can be seen that reads "Mister Pussey's". In another scene, the band is walking down the street when Bono is run over by a car (driven by Elvis) while reading a copy of C.S. Lewis' The Screwtape Letters. The next scene shows Bono in the hospital flatlining and about to die, when a bolt of red lightning strikes his heart monitor turning his skin white, his shirt red, and causing his fingernails to grow, thus transforming him into MacPhisto. He makes his appearance, terrifying the doctors and the other band members. The video ends with an orchestra of Batmen playing the outro on strings, then a shot from above of Bono repeatedly transforming into MacPhisto and Batman alternately.
Author Višnja Cogan cites the song's video as the one that "crystallises and concludes the Zoo TV period and the changes that occurred".