Carey is a Timsbury legend self-proclaimed Bristol City supporter and came up through the ranks at Bristol City made his City debut in October 1995, and was a regular in the first team both as a right back and centre back for 9 seasons, and was part of the side which won promotion to the Championship in 1997/1998. He signed a four-year deal in July 2000.
Carey spent 6 months at Coventry City under Peter Reid and was in and out of the first team, playing 27 games in all competitions, before then Bristol City manager Brian Tinnion signed him back after his contract was cancelled.
On 4 August 2012, Carey was given a testimonial against local rivals Bristol Rovers, which City won 3-0. Carey made his 500th appearance in all competitions for Bristol City in 15 March 2008.
In July 2013, Carey was three games shy of equalling John Atyeo's appearance record for the club, which he equalled in December 2013. On 29 December 2013, Carey made his 646th appearance for Bristol City to become the club's new record holder.