On October 4, 2011, Varner appeared on BET's 106 & Park to premier the video for "Only Wanna Give It to You". While she was there she was asked how the J. Cole collaboration came to be, she explained: "We actually met in college. He went to St. John's and we had a mutual friend at my school and like two years later I saw him in the Sony building when I had just got signed and I bumped into him I was like 'Yo what's up what are you doing here?' and he's like 'Yo I just signed with Roc Nation' and I"m like 'Yo I just signed with J. Records… When it came time to do the lead single for my album he was the first person I thought of."
The music video, directed by Orson Whales, was filmed in New York City. On October 3, behind-the-scene photos surfaced onto the Internet. The video depicts the 22-year-old singer-songwriter shop for shoes, chase her leading man, cruise with her girlfriends in her yellow Jeep Wrangler, and appear with J. Cole as he raps his verse in the vibrant visuals. The video also featured a new and up-and-coming group called the "Tribe NYC", which is a collective group of talents who also pays homage to the late 1980s early 90s with their style. The video was released October 4, 2011, with Varner premiering it on BET's 106 & Park later that day.