Warne was a founding member of the now defunct Christian punkbandAce Troubleshooter, in which he played guitar and sang lead vocals. The band was active from 1996 to 2004, recording five full length albums, the first two independently released and the last three released under the record label Tooth and Nail Records or its affiliate BEC .
In 2004 Warne participated in the short-lived band Guerilla Rodeo, playing bass. The band's only record was a three-track EP.
It is rumored that he wants to contribute a project to the next volume of My Other Band, a compilation series featuring side projects from Christian rock artists. Warne's Relient K bandmates Matt Thiessen, Dave Douglas, and Ethan Luck all contributed to My Other Band, Vol. 1.