Bayliss had an undistinguished career as a player making only a handful of appearances in the late 1920s for Luton, Mansfield and Southend. It was as a scout, however, that Bayliss made his name. He was considered an excellent judge of a player and focussed heavily on bringing young talent up through the youth and reserve teams.
His spell as manager came at a difficult time, following the end of the Second World War, and he struggled to manoeuvre in the transfer market. Bayliss was popular with the playing staff, a number of whom maintained a bedside vigil in the weeks leading up to his death in April 1947.
Although Bayliss had little time to develop his own team he laid down solid foundations for future managers by developing the youth squad.