Up All Night garnered generally positive reception from music critics. At Metacritic, they assign a "weighted average" Metascore to albums based upon the reviews and ratings of selected independent reviewers, and the album score is a 67, which means it received "generally favorable" reviews.Stephen Thomas Erlewine of AllMusic gave it three stars, saying that it is "shameless in its attempt to win you over, and[…]that eager-to-please nature winds up ingratiating whether you like it or not." Giving it four-and-a-half stars out of five, Bobby Peacock of Roughstock praised Moore's voice and the production, saying that Moore "touches on so many country cornerstones[…] in a believable fashion." A positive review also came from Great American Country writer Daryl Addison, who said that it "carries a unique sound that fits somewhere between ramblin’ man storytelling, hook-driven contemporary country and atmospheric blue-collar rock."Country Standard Time's Michael Rampa was less favorable, criticizing the themes of some songs for "paying women with alcohol".
At Country Weekly, Jessica Nicholson gave a positive review of the album, remarking that "Kip's grainy, warm and confident vocal delivery ties the tales together into a believable tapestry.Brian Mansfield of USA Today rated the album two-and-a-half stars, observing that "Moore's blue-collar grit is welcome, but only on Reckless (Still Growin' Up) does he approach his heroes." At Billboard, they rated the album a 3.5 out of 5, stating that "Moore spends much of his debut album, Up All Night, outlining the pleasures to be had from hot women and cold beverages".Taste of Country's Billy Dukes rated the album four stars, writing that "Like Eric Church before him, this singer may struggle to find consistent mainstream success, but it’s not because of a lack of high-quality material." At PopMatters, Dave Heaton rated the album six out of ten discs, saying that "It’s still generic, but takes a somewhat different turn, which is true for the entire LP."