Aylett had a brief cricketing career that he never fully pursued due to his interest in Australian rules football. He still played 11 first-class matches in the 1950s for domestic cricket side Victoria as a batsman, but was not successful, finishing with a poor batting average of just 16.
It is what he did later in his career however, as an administrator for the VFL (now known as the AFL) in the 1970s and 1980s, that he is most well known for. After holding the position of North Melbourne Football Club president in the 1970s he became president of the VFL and led the expansion of the VFL into the tough Sydney market, along with then-Sydney Swans president Geoffrey Edelsten.
Aylett signalled the end of his administration career after a final stint as North Melbourne Kangaroos president from 2001–2005.