He joined Grizzly Bear following their first release, Horn of Plenty (2004). His contributions to the band's sound since then have varied, and he has become the band's producer since their second album, Yellow House (2006). In live performances, Taylor frequently switches between playing the bass, clarinet, flute, saxophone and sometimes the accordion. He also contributes vocals on most songs.
In mid-2009 Taylor founded Terrible Records with label partner Ethan Silverman. He has also released his own solo material which (under the moniker CANT) on the label. His debut solo album, Dreams Come True, was released September 13, 2011.