Box arrived at Footscray from Cheltenham and made his VFL debut in 1951. He missed the entire 1952 season through injury before returning and playing his best football from 1953 onwards. Although he was used mainly as a centreman, Box played at centre half-forward in Footscray's 1954 premiership side. By winning the Brownlow Medal in 1956 he became the only Footscray premiership player to win the medal. The previous year he won his club's Best and Fairest award. He finished his career with Camberwell in the Victorian Football Association.