"I Hate Myself for Loving You" was released as the first single, backed with a live version of the Jett composition "Love Is Pain" (the original version of which appears on 1981's I Love Rock 'n Roll). "Little Liar" was the second single, backed with an obscure Jett/Laguna composition "What Can I Do for You", which had been recorded for a movie Jett was set to make in 1979 that was never completed. The song eventually turned up again on the Jett fan-club only CD 1979. For Record Store Day in 2015, the track was included on the limited edition (4000 split color vinyl) LP "The First Sessions" documenting the first several songs Joan wrote with Kenny Laguna, her newly acquired producer. This was to be the first of many Jett/Laguna collaborations, as they were inseparable from that moment in 1979 to the present day.
Two videos were shot for "Little Liar", the first, a concept video, feature a slightly confusing storyline with two Joans (one in white, one in black) interacting. After seeing the result of the first Little Liar video, Jett was unhappy with the silliness and visual translation so immediately shot a new live video (synced with the studio version of the song) for this track. The new video captured a more authentic feel with raw live shots combined with cutaways and studio shot closeups of Joan. It was a more stylized live video with Ziggy Stardust-like artistic flourishes.