"All the Rowboats" is the first single from Regina Spektor's sixth album What We Saw from the Cheap Seats. It was first released for streaming on February 27, 2012 and on the following day it was released for digital download. The song had been occasionally performed by Spektor in concerts since 2005. During concerts, Spektor would emulate a drum machine sound with her microphone.
A music video was released on YouTube on March 28, 2012. The video begins with Spektor being tied up on a rowboat which is cut off by a clip of a lighthouse. Later she appears on a dock. The video also contains clips of Spektor underwater, running down corridors as well as being crushed by closing walls. It utilizes stop-motion animation to animate the motion of the waves. It was directed by Adria Petty, daughter of musician Tom Petty, and Peter Sluszka.
The music video's Production Designer, Anthony Henderson, was nominated for the Best Art Direction in a Video award at the 2012 MTV Video Music Awards.