Anderson attended Montclair High School where he learned to play the trombone, eventually picking up guitar & bass guitar. He later attended the Berklee College of Music contemporaneously with Pat Metheny & Al DiMeola after working with an early version of Aerosmith in the Boston music scene.  He joined The Centurions, which brought him to the attention of Chris Wood of Traffic, who invited him to play on the band's next album. The Traffic album involvement never materialized, but led to Anderson becoming employed by Traffic's record label Island Records, leading to him being asked to play lead guitar on Bob Marley & The Wailers' Natty Dread sessions. Anderson played lead guitar on "Crazy Baldhead" and on the Live! album, remaining with the band until 1976, when he joined Word, Sound and Power, backing Peter Tosh on the albums Legalise It and Equal Rights. He returned to Marley's band and played on the Survival and Uprising albums. After Marley's death, Anderson continued to tour with The Wailers Band. Al went on to record with Ben Harper (Diamonds On the Inside (2003)) and also Lauryn Hill on her multi-Grammy winning debut "The Miseducation of Lauryn Hill" (1998). He also produced and performed on an album for actor Steven Seagal (Songs from the Crystal Cave (2005)). In 2008 he formed the band The Original Wailers with Junior Marvin.