He worked as an assistant coach for Rudy Tomjanovich with the Rockets from 1993 until 2002, helping them capture their back-to-back NBA titles in 1993-94 and 1994-95. After ten years with the Rockets, Smith was hired as the assistant coach for the Atlanta Hawks in 2003. In 2004, he was hired by the Los Angeles Lakers to be the assistant coach for Tomjanovich. However, Tomjanovich resigned after 41 games into the 2004–05 season. Smith remained as an assistant coach for interim head coach Frank Hamblen until the end of the season.
On May 8, 2008, officials made the announcement during a news conference in Vicksburg, Mississippi that Smith has been named as the head basketball coach for Alcorn State University. In 2011, Smith was moved from this position to become director of athletic development for the school.