"Let's Shake Hands" showcases the early garage punk sound of the band in its infancy. The single is backed with a cover of "Look Me Over Closely," a song written for Marlene Dietrich by folk musician Terry Gilkyson.
The first edition was 500 copies on clear red vinyl. A second edition of 1,000 copies was pressed on black vinyl in 2002. The cover for this repressing was a better quality version of the original photo. There was a "secret" third pressing in 2008 with a stenciled version of the original cover art by Dion Fischer. It was pressed on black vinyl and 1,000 hand-numbered copies were produced. Highly coveted among diehard fans, this 7" remains one of the rarest and priciest items in The White Stripes' entire discography.