Originally from Port Adelaide, Brown was chosen as one of the Adelaide Crows initial recruits for the Crows' first season in the AFL in 1991. After 69 games in seix seasons with Adelaide, Brown was recruited by Port Adelaide to be part of its own inaugural AFL squad in 1997. Brown played two seasons with Port's AFL team, playing 22 matches before being named captain of the Port Adelaide Magpies in 1999.
Brown was a member of Port Adelaide premierships on six occasions; 1988, 1989, 1992, 1996, 1998, 1999, and won the Jack Oatey Medal for best player in the grand final in 1996. He retired in 2001, having played 183 games in the SANFL and kicked 156 goals.