The distinctive guitar sound owes to Ronnie Wood's hybrid fingered-chord-riff / slide guitar solos played on an open-E tuned Zemaitis guitar. The song starts with a breakneck tempo that settles into a steady half-tempo groove, and then jumps back into a flashy double-time finale adorned with instrumental solo fills.
"Stay With Me" reached number 17 on the U.S. Billboard Hot 100, and peaked at number 13 on the Cash Box Top 100. The song also reached number 6 in the UK and number 4 in Canada.