The EP debuted at No. 153 on the Billboard 200, Fall Out Boy's first entry on that chart (their next entry week would be at No. 9 with From Under the Cork Tree). It also peaked at No. 5 on the Billboard Heatseeker Albums and No. 10 on the Billboard Independent Albums. The artwork was designed by Jacob Bannon, vocalist of the hardcore band Converge. A Clandestine Industry Presents: Release The Bats DVD was released in 2005 with additional content not released on My Heart...EP
Clandestine Industry Presents: Release The Bats
A Clandestine Industry Presents: Release The Bats DVD was released in 2005, containing footage mostly shot with during the making of the My Heart Will Always Be the B-Side to My Tongue DVD but "deemed unfit". It provides a "closer look at the band’s inner circle". Includes footage encompassing the early years, backstage antics, reckless stunts, and live footage of Armor For Sleep and Gym Class Heroes. Also contains clips from Fall Out Boy in Japan, their summer tour and the near riot during their Detroit performance at Warped Tour in 2004. A clip of the short video Bedussy from Release The Bats appeared at the end of the band's 2015 music video for "Irresistible".