Let Me Rock You is the third album released by former KissdrummerPeter Criss. Due to poor sales for his previous album, Out of Control, Let Me Rock You was not released in the United States until 1998, when it was reissued on CD. The album was produced by Vini Poncia, who previously produced Criss's 1978 solo album (officially released as a Kiss album). Let Me Rock You features the song "Feels Like Heaven", written by Criss's former bandmate, Gene Simmons. Vinnie Cusano also co-wrote a song for the album; at the same year the album was released, Cusano became known as Vinnie Vincent when he replaced Kiss guitarist Ace Frehley. The album cover features Peter Criss for the first time without his Kiss makeup, as he didn't appear on the cover of his solo album Out of Control. One year later, Kiss also decided to take off their makeup for their Lick It Up album.