Cashmore has also been a member of the group Current 93 since the late 1980s. He has collaborated with many artists including David Tibet, Antony and the Johnsons, Marc Almond, Nick Cave, Rose McDowall, and Steven Stapleton.
After several years of silence Cashmore released his first solo CD, titled Sleep England in May 2006.
In April 2008, Cashmore released a two-track EP with Marc Almond titled Gabriel and the Lunatic Lover which sets two poems "Gabriel" and "The Lunatic Lover" by Count Stenbock to music. Marc Almond appeared as a guest of Current 93 at the Queen Elizabeth Hall in London on 21 June 2008, and performed these songs with Cashmore on guitar.