The album liner notes by Dandelion Records's owner and executive producer, John Peel, indicate each song was recorded in a single live take with the band refusing to make any kind of overdubbing or technical treatment on the resulting sound. He narrates that on one occasion he asked them to run through a song a second time and the band members yelled "Bugger Off!, Peel'", which gave rise to the album's title.
Music website Allmusic gave Bugger Off! four out of five stars. Reviewer Dave Thompson highlights the authenticity and rawness of the band, and says the album expands the fierceness in their self-titled debut album, defining it as positively antisocial.