To fund the making of the record, vocalist Jacob Bannon saved up money from working at a nursing home. The record was released as a black vinyl and is not available in any other format. Only a 1000 copies of this record were made and the record has not been reprinted since. However all of the record's tracks with the exception of the 9th track "Exhale" can be found on later Converge releases such as 1995's Caring and Killing and 2002's Unloved & Weeded Out.
Halo in a Haystack's liner notes credit Erik Ralson as the bass guitar player on the tracks "Down" and "Exhale". While the 1997 version of Caring and Killing's liner notes credit Erik Ralston as the bass guitar player on the tracks "I Abstain", "Antithesis" and "Down". And the 2013 version of Caring and Killing's liner notes credit both Jeff Feinburg and Erik Ralston as the bass guitar player on all tracks.
Further note that tracks 9 and 10 ("Exhale" and "Undo") form Halo in a Haystack are absent from Caring and Killing making it unknown who provided bass guitar on those tracks through the liner notes of Caring and Killing.
Halo in a Haystack's liner notes state the record was recorded in April 1994. While the 1997 and 2013 versions of Caring and Killing's liner notes state that the record was recorded in August 1993 & 1994.