A sprinter during his active athletics career, he was a 28-time national champion. He won two relay medals in two editions of the Universiade: a gold medal over 4 x 100 metres in 1963 and a silver medal over 4 x 400 metres in 1965. He participated in the 1964 Tokyo Olympics. He was part of the Budapest Honvéd sports club.
He started his television career in 1970 on Hungarian television. He led the sport section between 1990 and 1991.
He was a member of the IAAF Council from 1984 until 2001, and from 1991 until his death he was the General Secretary of the IAAF. During his years in the council, he still worked for the Hungarian Television as well. He was a key figure in helping Hungary host major athletics events; among the competitions held in the country were two editions of the IAAF World Indoor Championships, the 1994 IAAF World Cross Country Championships and the 1998 European Athletics Championships.
On October 7, 2006, the athletics stadium in Debrecen, Hungary was rededicated the István Gyulai Athletics Stadium in his honour. Five years after his death, the István Gyulai Memorial – Hungarian Athletics Grand Prix was launched in his honour, with his son Marton acting as meeting director.
His wife, middle-distance runner Olga Kazi, also competed at the Olympics for Hungary. Both his sons followed his steps in sports. The elder, Miklós Gyulai, a sprinter who was national champion and ran the 4x100 relay on the 2000 Sydney Olympics and the 4x100 relay final on the 2001 World Championships, later became the founding member of the Hungarian bobsleigh team, competing in 1994, 1998 and 2002 Winter Olympics. His younger son, Márton Gyulai is currently member of the Hungarian bobsleigh team. The idea of the boys trying themselves out in bobsleigh came from their father.