His career coaching record at VMI was 8 wins, 5 losses, and 0 ties. This ranks him 15th at VMI in total wins and seventh at VMI in winning percentage. Roller played at VMI, where he was an All-Southernquarterback.
His father, Charles Summerville Roller was one of the founders of the Augusta Military Academy. Charles Summerville, Jr. also served as principal of that particular school later in his life.