After leaving Albion in 1972 he took up the post of player-manager with Weymouth, with whom he remained until 1975. In November 1981, he was appointed chief coach of Cardiff City, taking over from Richie Morgan, who moved to a general manager's role. After a disastrous run of nine losses in fifteen games, both Williams and Morgan were sacked in February 1982, with Len Ashurst taking over at Ninian Park. Williams took several coaching jobs abroad including steering Finnish team RoPS to the quarter finals of the European Cup Winners' Cup. Later on in his career he served as the assistant manager of the Welsh national side under Bobby Gould.