The song has a quick structure and oblique, seemingly nonsensical lyrics. It also possesses an unusual time signature. Based in 3/4, which has been used repeatedly by the band, it has two sporadic bars in 4/4 and a bridge in 5/4. While the song has no confirmed meaning it is commonly interpreted as being a message to slow down and take life easy, like the Tortoise from The Tortoise and the Hare.
It was ranked by Pitchfork Media to be the 54th best single of 2000-2004. The song "Baby Day" is included on the single as a b-side.
The music video for Who Could Win A Rabbit was directed by Danny Perez, who subsequently directed the Animal Collective visual album ODDSAC. The video features Avey Tare and Panda Bear as a rabbit and turtle respectively, racing each other in the same vein as Aesop's fable, The Tortoise and the Hare, while Geologist and Deakin are spectators of the race. The video ends with Panda Bear killing Tare and eating his bloody remains.