"Beg, Steal or Borrow" has received positive reviews from music critics. The song received a "thumbs up" review from the American Noise website. Merchants of Rock described it as "very promising" written in the same vein of his then-latest single “You Are the Best Thing”.
The song debuted on the Billboard Rock Songs chart on 11 September 2010 at number 42. The following week it reached its peak position at number 34 remaining in the chart for the following 14 weeks. On 8 January 2011 the single re-entered the Rock Songs charts at number 50.