In 1975 he became the head coach and athletic director at UNC Charlotte, where in three seasons he took the 49ers to one NIT championship game (1976) and to the NCAAFinal Four (1977). In 1977 he was named The Sporting News National Coach of the Year, the Sun Belt Coach of the Year, and Charlotte's "Citizen of the Year". In three seasons Rose's record at Charlotte was 72–18 (.800).
Rose left Charlotte for Purdue University in 1978 and led them to the Final Four in 1980, and is one of only ten coaches in NCAA history to take two different schools to the semifinals of the NCAA Tournament. Rose left Purdue after two seasons after compiling a 50–18 record and finished his coaching career at the University of South Florida.
Rose and his wife reside in Charlotte, North Carolina, where they attend nearly every Charlotte 49ers basketball game. On June 7, 2007, Rose was hired by the Charlotte Bobcats to be part of head coach Sam Vincent's staff. He has four grandchildren, Lee Rose; Kristi Rose; James Rose; and Alexzander Rose.
National champion Postseason invitational champion Conference regular season champion Conference regular season and conference tournament champion Division regular season champion Division regular season and conference tournament champion Conference tournament champion