Trammell started his professional career in 1974 with the Senators Quartet from Memphis, Tennessee. He then played bass and was a part-time vocalist for Kingsmen Quartet from 1978 until 1980, and he was the baritone vocalist and bass guitar with the Cathedral Quartet from 1980 through 1990. After leaving the Cathedrals, he formed a trio with Gerald Wolfe named Greater Vision and toured with them from 1990 through 1993 and with Gold City from 1993 through 2002. He founded his own trio, the Mark Trammell Trio, in 2002. That trio became the Mark Trammell Quartet in January 2010 when they added Pat Barker, formerly of the Dixie Echoes, to the group as their bass singer.