All Over the Place was The Bangles' first full length album for Columbia Records. Released in 1984, the sound is lively and shows more Bangles collaboration and fewer keyboard overdubs that were used later on their more commercially successful albums. Although the album was not a commercial success — peaking at #80 on the Billboard 200 albums chart — it gave them the chance to perform as an opening act for Cyndi Lauper and Huey Lewis and the News and brought the group to the attention of Prince, who would write "Manic Monday", their first hit.
"James" was originally sung by Peterson but her vocals were replaced by Hoffs' by the time the album was recorded. "Hero Takes a Fall" was given a subtle remix for its single release. It was backed by the non-album track "Where Were You When I Needed You", a cover of The Grass Roots tune. (This and the remixed version of "Hero Takes a Fall" were later included in the Bangles Greatest Hits album.)