Born in Decatur, Indiana to Lawrence (local photographer) and Marie Anspaugh, he has a younger sister, Jane. He was married from 1974 to 1988 to cruise line sales manager Tamara Kramer. They have a daughter, Vanessa. Anspaugh married actress Roma Downey on November 24, 1995. The couple had a daughter, Reilly Marie, on June 3, 1996. In 1997, Anspaugh was clinically depressed and was treated at a rehabilitation clinic, which ultimately led to a breakdown of his marriage. Downey filed for divorce in March 1998, with it being finalized later that year. After living in California for three decades, in June 2014 Anspaugh relocated to Bloomington, Indiana.