Anthony spent the first 14 years of his life in Abbeville, Louisiana and just before high school he moved to North Carolina where he played both football, basketball and track while he attended Richard J. Reynolds High School in Winston-Salem. The Abbeville native helped the Reynolds Track Team win The State Championship his senior year. 
He is the cousin of former NFL player Brandon Mitchell. He is the son of Christina Levine and Lawrence Brannon. Levine has three sisters Alisio Levine, (former Miss Abbeville 2010) Cassie Brannon, and Angelle Brannon. He also has two brothers, Dwayne Levine and Wade Levine, both of Abbeville.