He was the original bass player for Three Dog Night and played on most of the group's 21 hits. Disillusioned with his role in the group, he left the band in 1973 and formed a group called S.S.Fools that included former members of Three Dog Night and Toto vocalist Bobby Kimball. He later played some shows with former Three Dog Night vocalist Chuck Negron's band. He also worked with Stephen Stills, Yvonne Elliman and others. Schermie appeared on the cooking show Food Rules in 2000 with original Three Dog Night drummer Floyd Sneed. This was his last television appearance.
Schermie died of a heart attack in 2002, at age 56.