The cover art was photographed by lead singer George Pettit at Ferndale Public School in St. Catharines, Ontario. Pictured is Cassandra Paolella (holding the knife) and Amanda Rietveld (opposite). It is based on the lyrics from "A Dagger Through the Heart of St. Angeles". There was also an alternative cover art released, which just depicts the band's logo and name.
The lyrics and title of ".44 Caliber Love Letter" are influenced by a line from the iconic 1986 David Lynch movie Blue Velvet: "I'll have to send you a love letter! Straight from my heart, fucker! You know what a love letter is? It's a bullet from a fucking gun, fucker!" Another Lynch film, Eraserhead, is mentioned by name in "Where No One Knows".
On January 14, 2014, a remixed and remastered version of the album by Dine Alone Records was released.