The song has been generally well received, with Lewis Corner of Digital Spy rating it "5 stars" and naming it a "speaker blowing tune".Zane Lowe named the single in his Hottest Record blog, calling it "Epic blockbuster dubstep". Amy Dawson of the Metro said that the track manages to "meld a feathery female vocal with a low-slung, wibbling beast of a chorus that should steamroller through stadiums".
The single "Guilt" made its first appearance on the UK chart on 1 May 2011, when it debuted at number 8. The single spent one week in the top 10, sliding to number 15 on its second official week in the chart. "Guilt" spent a total of seven weeks in the top 40, falling out on 19 June 2011. The single also reached peaks of number 2 and number 4 on the independent chart and dance chart respectively - although they have since been removed from archives.
The video for the song was first posted on YouTube on 25 March 2011. It was directed by Christian Larson. It features an exotic dancer, Lucy Cork, entertaining business-like clients in a futuristic club called Guilt to the beat of the song. It begins by following two customers into the club. The vocalist, Alana, is occasionally seen to be in the same club, and is intermittently cut to during the vocal parts of the song. The action focusses mostly around one exotic dancer with a facial covering. As the song hits its breakdown, we see an overhead shot of the futuristic city, before cutting back to the club, where the dancer asks a client (who wears sunglasses similar to those worn by the Nero members in the video for Me & You) in an unknown subtitled tongue "Do you want to see the special show?". The client nods, and the dance continues as the music reenters. The dancer displays extreme pole dancing moves as light begins to shine from her eyes. As the song ends, the clients jump to their feet, celebrating, and the dancer pulls her facial covering down to reveal a deformed mouth area and what appear to be fangs. A glass smashes and the camera zooms out past the Guilt sign on the door.