From The Dumpster to The Grave is the first album to introduce Kelsey "Kill-C" as the back-up female singer, since the departure of Nico de Gaillo. Nico's vocal parts were recorded before she left the band so they are used in some songs. The album contains guest appearances from artists such as Boots Riley from the Political Hip hop group The Coup. Former bassist Yula Beeri, who appeared on the band's first album Until We're Dead (and is also a member of Nanuchka and The World/Inferno Friendship Society) appears on the record as a guest singer.
Lyrics vary from anti-capitalism messages, personal issues, police brutality and activism. Musical styles vary from style to style, like their previous albums, blending together punk, metal, hip hop, ska and folk.