Baker was drafted in both the 1964 AFL and NFL drafts—the Pittsburgh Steelers selected him with their 3rd-round pick, while the New York Jets used their 6th-round pick to select him. Baker elected to sign with New York and played linebacker position for 141 games over 11 seasons (1964–1974). In 1979, he was hired as Vice Principal of the Chief Logan High School in Mifflin County, Pennsylvania. This period marked a time of trouble within the rebellious student body and, after one year, both Baker and the school's head principal resigned. He retired as principal of Tuscarora Junior High School in Mifflintown, Pennsylvania, in 2010.