Anglin was born on a farm near Columbia, Tennessee. He worked at a local hosiery mill and became acquainted with his future wife, Louise; and through her, her brother, Johnnie Wright. At the time Wright, his wife Murial (Kitty Wells) and Louise were regulars on WSIX-AM as Johnnie Wright And The Harmony Girls. When the Anglin Brothers disbanded in 1939, Anglin joined Johnnie Wright as Johnnie Wright and the Happy Roving Cowboys with Jack Anglin. In 1940, they became Johnnie & Jack, who enjoyed success as a vocal duo until Anglin's death in 1963. The duo became members of the Grand Ole Opry in the 1940s.