After Dumars was named the starter, Long later played for the Indiana Pacers, where he was backed up by Reggie Miller before playing for the Atlanta Hawks. After playing overseas and in the minor leagues for several years, Long signed with the Toronto Raptors for one season, and he retired in 1997 with 12,131 career points. At the time, the 41-year-old Long was the oldest player in the NBA, and had begun his professional career a year before then-teammate Tracy McGrady was born.
Two of John Long's nephews, Terry Mills and Grant Long, also played in the NBA. The nephews were teammates in Detroit during the 1996-1997 season. All three men played 2 seasons or more for the Detroit Pistons.  He is currently a radio analyst for the Pistons.