In 1998, at the age of nineteen, he joined the State Bank of Hyderabad to start his professional football career. Two years later, he was spotted by eminent football coach Mohd. Habib who brought him to the Indian premier division I-League club ITI Bangalore where he spent only one season and then moved to Air India. He was also the captain of the team and helped them to win the elite division of the Mumbai Football League. His consistent impressive performance caught the eye of the city rivals Mahindra United and they signed him for the 2003-04 season. He enjoyed his most successful club career spell with them by winning the Federation Cup, Indian Super Cup, elite division of the Mumbai Football League and President's Cup Championship at Maldives in a single season. He was also selected as the Best Player of the final for his extraordinary performance. After a great season with Mahindra United, Altaf decided to move to Churchill Brothers S.C. in Goa for one season and in the next season he joined Hindustan Aeronautics Limited S.C. of Bangalore. He played a pivotal role to win the Bangalore Super Division for the club. Following season Altaf moved to Kolkata in 2007 where he represented Prayag United S.C. (formerly known as Chirag United S.C.), Eastern Railway Sports Club & Mohammedan A.C. over the years.