Sweet was born in Bournemouth, England. His early years were spent playing with The Burntisland Pipe band, also a member of the Shadettes.
Sweet died of a heart attack in 1999, as the band prepared to set out on the second leg of its U.S.tour in support of their latest album, Boogaloo. The band had arrived at Indiana's New Albany Amphitheater when the 51-year-old Sweet began to feel ill. Within minutes he had gone into cardiac arrest. He was taken to Floyd Memorial Hospital in New Albany, where doctors pronounced him dead. Sweet was survived by his wife, Marion, and their son and daughter. He was replaced in the band by Pete Agnew's son, Lee Agnew.