The song was recorded over two dates at Western Recorders, both produced by Brian Wilson. Arranged by Brian Wilson, the instrumental track most likely was recorded on December 16, 1964, with Chuck Britz engineering. The vocals were most likely overdubbed at a session on January 15, 1965. On the verses it features the group singing in unison with Brian Wilson and Mike Love featured on lead vocals on the chorus. The backing vocals are provided by Brian, Carl & Dennis Wilson, Mike Love and Al Jardine. An A cappella mix of the song was released on the 2001 album Hawthorne, CA, allowing the listener to clearly hear the complex vocal arrangements and harmonies.
"Kiss Me, Baby" was released in April 1965 in the United States as the B-side of the band's second US number one hit, "Help Me, Rhonda". In the United Kingdom, the song was also released as the B-side of the "Help Me, Rhonda" single, which managed to chart at the number 27 position in Britain.