Graber was a member of the Chiefs' staff for four seasons, working for head coach John Mackovic. He handled defensive quality control duties during his first year, while also helping defensive coordinator Bud Carson coach the defensive backs. In August 1984, Carson resigned and Graber took over coaching the secondary.
After a five-year hiatus from coaching, Graber was hired as the head coach of NFL Europe's Frankfurt Galaxy on September 18, 2000. He became the fourth coach in team history, succeeding Jack Elway (1991–1992), Ernie Stautner (1995–1997) and Dick Curl (1998–2000). In his first year at the helm, the Galaxy finished sixth in the league with a record of 3–7.