The video for the song features Dave Sheridan, who plays a deranged concertgoer who attempts to return a book to vocalist Anthony Kiedis, who left the book in his taxi in the video to "By the Way". The book he is returning to Kiedis is "Lexicon Devil: The Fast Times and Short Life of Darby Crash and the Germs", which is the biography of Darby Crash, the late frontman for the late 70's punk band The Germs and was written by Brendan Mullen. The music video was directed by longtime friend Dick Rude who also directed the video for "Catholic School Girls Rule" and the live DVD Off the Map.
The cover for the single is the same as the cover of the By the Way album, except the colours were reverted to normal, as they had been originally inverted on the cover of By the Way, and is the only single from By The Way with the arial font, font used in Freaky Styley, The Uplift Mofo Party Plan, Blood Sugar Sex Magik and Californication.
Contrary to popular belief, the B-Side "Slowly Deeply" was originally recorded in the Californication era sessions in 1998, it was not recorded for By the Way.