She is married to the group's other founding member, guitarist/vocalist Ira Kaplan, with whom she lives in Hoboken, New Jersey. The two would often see each other in record shops and at the same shows. Finding a common ground in music, and sharing a love of New York Metsbaseball, they began hanging out and jamming together. They formed the band in 1984, and released their first album, Ride the Tiger, in 1986 on the Coyote label.
In addition to her duties as drummer and vocalist, Hubley has designed covers for the band's releases. She also plays occasional guitar, keyboard, drum machine on the band's recordings.