Kromer was hired by the New Orleans Saints in 2008 as the running backs coach, before becoming the offensive line coach the following season. Under his tenure as OL coach, the Saints sent five players to a combined nine Pro Bowls, and tied for the fewest sacks in the league with 96. Under Kromer, the Saints line twice won the Madden Most Valuable Protectors Award as the best offensive line in the league (in 2009 and 2011). Kromer filled in as the Saints' interim head coach for the first six games of the 2012 NFL season as Joe Vitt served his six-game suspension.
On January 16, 2013, Kromer was announced as the new offensive coordinator and offensive line coach for the Chicago Bears. He joined Marc Trestman's initial coaching staff, after working with Trestman in Oakland. In his first year, the Bears offense had the second-best scoring offense in the league with 445 points, behind the Denver Broncos, while finishing fifth with 4281 passing yards. The offense also broke team records in total yards (6,109), passing yards (4,450), passing touchdowns (32) and first downs (344). On February 12, 2014, offensive line assistant Pat Meyer was named offensive line coach while Kromer, who served as offensive coordinator and line coach in 2013, remained the offensive coordinator and continued to be involved in all aspects of the offense, including the line with an increased role with the passing game.
On January 17, 2015, the Buffalo Bills reached a two-year deal with Kromer to be the team's new offensive line coach. On July 12, Kromer was charged in Walton County, Florida with misdemeanorbattery following a confrontation with three boys who allegedly used Kromer's beach chairs without his permission. Shortly after the incident, he was placed on paid leave by the Bills. According to police, Kromer pushed one of the boys to the ground, punched him in the face, threw his fishing pole into the water and threatened to kill the boy's family if he reported the incident to the police. On July 31st 2015 charges against Kromer were dropped at the request of the complainants parents. On August 2, 2015, Kromer was suspended without pay for the first six games of the regular season.