At almost 29 years of age, he was brought to Atlético Madrid by their new coach Radomir Antić who knew Pantić well from his Partizan days. The move turned out to be a hit as Pantić's creative midfield presence provided the extra edge to Atlético side that won the La Liga/Copa del Rey double in the 1995/96 season. Pantić contributed with 10 goals in 41 appearances, and countless assists. He spent two more seasons in Madrid with a total of 18 goals in 106 matches in his career there, before moving on to Le Havre AC during summer 1998 for a season. In the summer of 1999, Pantić transferred back to Panionios where he spent the last two years of his playing career.
Pantić went back to Atlético Madrid as a coach in Atletico's youth system, working with kids 3 to 9 years of age in the club's training facility in Majadahonda. From there he moved up the ranks coaching different youth squads. He became head of the youth and developing squads at the club while managing certain squads at the same time. During the summer of 2011 Pantić became coach of Atlético Madrid B (Atlético Madrid reserve squad) after his great success with the youth and developing squads at the club and after just about missing out on being coach of the first team. He also plays for Atlético Madrid's Indoor-Soccer team, competing in the veteran league which comprises nine clubs that have won the La Liga title throughout history.