Ramzy began his career at the age of 10. A scout from Tersana club saw him and tried to persuade him to join the youth team in the club but his father Guda Ramzy – one of Al-Ahly's fans – refused to have his son join Tersana or Al-Zamalek clubs. So his father and his uncle took him to Al-Ahly, Captain Mustafa Hussein saw him and decided to put him in the youth club of the red castle. Step by step, Ramzy joined the youth national team at less than 17 years old; Captain Ahamad Rafat was his coach in this time.
Despite his young age, Ramzy's playing ability earned him a spot on Al-Ahly's first team. Captain Mahmoud El-Gohary also picked him for the Egyptian National Team's journey to the World Cup in Italy. That was the key of success for the 20-year-old player and soon he became Egypt's youngest professional.
In 1990, he started his professional career with the Swiss club Neuchâtel Xamax, as a centre-half. The Swiss nicknamed him "The Rock."
In summer 1994, Ramzy was the first Egyptian player in the Bundesliga as he joined the German Club SV Werder Bremen with a $1.5 million transfer fee to become the most expensive player in Egypt.
After the 1998 African Nations Cup, Ramzy joined the Red Devils of 1. FC Kaiserslautern with his mate in the Egyptian national team Samir Kamona and wore jersey number six. Ramzy was famous in Kaiserslautern as he scored 12 goals from the center back position but in April 2003 after a knee injury, Ramzy spent two seasons in agony as he watched from the sidelines until his contract came to an end.
During his knee injury, Ramzy started taking lectures about coaching in Berlin, Germany. He decided to become a manager after his retirement, so he started as a member in the coaching staff in Kaiserslautern's youth team.
Ramzy became the assistant for the German coach Rainer Zobel, head manager of Egyptian club ENPPI. Due to lack of success, in January 2007 the club decided to replace Zobel with Ramzy to the end of the season whatever the results were. Ramzy said that it was a big responsibility and a good step to open the door for young coaches to manage teams in Egypt.
Ending the 2006–07 season in the ninth place, Ramzy returned to his original job as assistant coach. The club signed a contract with Egyptian coach Anwar Salama, the former manager of Petrol Assiut.
In the middle of September 2008, Ramzy took a new step toward the international training career, he became the assistant manager of the Egypt national football team U20 under the leadership of coach Miroslav Soukup. In late December 2009, he was named as the new head coach of the Egypt U-21 national football team.
In December 2009, it was announced that Ramzy had signed a two-year contract as the manager of the Egypt U-23 national football team.
Ramzy once held an Egyptian record as he played five consecutive African Nations Cups in years 1994, 1996, 1998, 2000 and 2002. But this record has been broken by fellow team-mate Ahmed Hassan, who has played in 8 consecutive African Nations Cups, which is an Egyptian and African record