Yarber began his coaching career at Idaho in 1996 as a secondary coach under second-year head coach Chris Tormey. The next year, he became the receivers coach at UNLV. In 1998, head coach Dennis Erickson made Yarber the offensive quality control coach of the Seattle Seahawks. Yarber coached under Erickson from 1998-2004 and from 2007-2009 in some capacity. From 1999-2002, he was on the staff at Oregon State. In 1999, he was he running backs coach, the next year, he became the wide receivers coach. He coached Chad Johnson and T.J. Houshmandzadeh during their time with the Beavers. He followed Erickson to the pros and he served as the San Francisco 49ers receivers coach in 2003 and 2004. Following Erickson's dismissal, Yarber served as the receivers coach for the Washington Huskies for two seasons under head coach Tyrone Willingham. In 2007, Yarber became the receivers coach for the Arizona State under Erickson and served in that position until the end of the 2009 season. In 2010, Yarber moved back to the NFL for two seasons with as the wide receivers coach for the Tampa Bay Buccaneers.
On January 2, 2012, following a 4-12 record in the 2011 season, Raheem Morris and his entire coaching staff were fired. On January 9, 2012, Yarber was named the wide receivers coach for UCLA under new head coach Jim Mora.