The song, originally a demo by Maiday called "The Only Thing I Need", was given to Wretch and the hook and first verse were re-created by Kumra. In an interview with Digital Spy he was asked if he was pleased with the response to his new single 'Don't Go', he said: "It's been good, I think. This third single isn't the easiest or most obvious choice, but I think it's starting to connect with people, which is all I want to do really. This type of sound is what I was known for making on my old CDs and mixtapes. I like heartfelt music, but I wanted to initially come out with something for the clubs and festivals."
A music video to accompany the release of "Don't Go" was first released onto YouTube on 11 July 2011, directed by Ben Newman with a total length of four minutes and one second. It was filmed next to the Thames River (Near London City Airport).
Robert Copsey of Digital Spy gave the song a positive review stating:
"Love drunk you and I would die sober/ I'm in this for forever and a day," he insists to his missus over minimal, plodding beats. While his bunny boiler tendencies might not be to everyone's taste, it's encouraging to hear there's more to him than the usual braggathons spouted by today's rap pack. "So don't go, don't leave/ Please stay with me/ You're the only thing I need to get by," guest vocalist Josh Kumra croons on the lighter-waving chorus; the result is not as instant as his previous offerings, but easily his most infectious yet.