Rieflin began his professional career in his hometown of Seattle. In 1975, he was in The Telepaths, a band which played backup for a couple of live gigs by the pre-The Screamers band The Tupperwares. He played drums for The Blackouts starting in 1979. His bandmates included his brother Raymond, Paul Barker, Roland Barker and Erich Werner. Eventually that band dissolved and Paul Barker joined the nascent Ministry. Rieflin's earliest collaboration with Al Jourgensen was on the second single by the Revolting Cocks, You Often Forget. Later, he participated in the creation of Ministry's ground-breaking album The Land of Rape and Honey. He was noted for his performance in the live video In Case You Didn't Feel Like Showing Up (Live), which featured not only his precision percussion (alongside fellow drummer Martin Atkins), but Rieflin's genteel fashion sense. His work with Ministry and its side projects lasted through to the mid-Nineties, though he notes that he was never credited as a member of Ministry proper, always as an "other" musician. Therefore, when he parted ways with the band during the Filth Pig sessions, he didn't really quit since he was never an official member.
Rieflin helped Atkins kick off Pigface, the industrial collective that would grow to incorporate hundreds of artists, formed a friendship with labelmateChris Connelly and founded First World Music. Like Connelly, Rieflin's work has grown beyond his industrial roots. They have collaborated on several recordings; two in particular, The Ultimate Seaside Companion (as "The Bells") and Largo, showcase Rieflin's frequently overlooked keyboard skills.
Rieflin appeared on all KMFDM records released from 1995–2003 as a drummer, programmer, vocalist and keyboardist. He toured with the band as a bassist in 2002 in support of its comeback album, Attak. He also drummed for McCaughey's band, The Minus 5, which occasionally included Peter Buck. Eventually Buck offered Rieflin the opportunity to sit in with R.E.M., who were missing a permanent drummer since the 1997 departure of Bill Berry. The band gave him the live drummer slot in its 2003 tour. They later announced that Rieflin would fill the role indefinitely, though once again as an "other" musician rather than as an official member. In recordings, Rieflin also contributed bouzouki, keyboards and guitars to the group, serving as an auxiliary member until R.E.M. disbanded in 2011.
Rieflin maintained a weblog through the end of 2004. In it, he ruminated on his day-to-day doings and mental state, recounted the exploits of his two cats, Pim and the Egg, and obliquely referred to his fellow musicians.
Rieflin is involved in a music collaboration project entitled The Humans, which consists of him, Chris Wong, Robert Fripp and Toyah Willcox. The band performed a series of live dates in Estonia in Autumn 2007 and 2009, and released their debut album We are the Humans on May 1, 2009.