At the 2004 Olympics in Athens, his world championship winning team finished fifth after many of them fell. Wei was also the favorite to win the gold medal at the Individual All-Around in Athens as well, but a fall from the high bar earned him a low score of 8.975 and put him out of medal contention. He placed seventh that night. The Chinese team redeemed itself by taking gold in the 2008 Olympics in Beijing, beating out Japan and the United States.
Yang Wei has a long-time relationship with former gymnast, Yang Yun, who is an Olympic bronze medalist (uneven bars) for China, and now a CCTV reporter. In June 2006, Yang Wei invited Yang Yun to a news conference, which turned out to be a ploy for him to surprise her with a proposal. While he trained for the Beijing Olympic Games, the two had very few chances to be together, and kept in touch through text messaging. After his Olympic gold in the All-Around in Beijing on Thursday, Yang Wei faced the camera and mouthed the words, "I love you," to his fiancee. Yang Yun, who watched his victory on television, shouted "I love you, too!" back to the screen.Yang Wei: "Gold Medal for my Love!" The two got married November 6, 2008. They had son Yang Wenchang (杨文昌) in November of 2009.