That's How a Heartache Begins contains songs Patsy Cline recorded under Decca and Four Star Records between 1959 and 1963. The album includes cover versions of "Bill Bailey Won't You Please Come Home" and Hank Williams' "Lovesick Blues." There is also other material by Hank Cochran and Harlan Howard who wrote some of Cline's most famous hits, including "I Fall to Pieces," "Crazy," and "She's Got You." Unlike any other album before released by Decca, the record label did not reissue the album when the label changed from the Decca name to the MCA name in 1973. However, the album was issued in Australia and New Zealand in 1964 by Festival Records. The album spawned two singles, the title track and "He Called Me Baby," which peaked at #23 on the US Country Chart in 1964. The album as a whole did not chart among any album charts.