Despite its 9-0 record, the 1951 San Francisco team was not invited to a bowl game. It was later reported that the Orange, Sugar and Gator Bowls - all in the American South - did not consider inviting any teams that had black players, and the USF refused to play without its two African-American teammates.
He married his wife Mary, whom he met when both were San Francisco teenagers in the mid-1940s, in 1952. He and Mary lived in the same Los Angeles home from the time he played for the Los Angeles Rams until his death. The site is being nominated as the 'Ollie and Mary Matson Residence', a City of Los Angeles Historic-Cultural Monument.
In his later years Matson suffered from dementia, which was linked to Chronic traumatic encephalopathy (CTE),a progressive degenerative disease, diagnosed post-mortem in individuals with a history of multiple concussions and other forms of head injury.
Eisenberg, John (2009), That First Season:: How Vince Lombardi Took the Worst Team in the NFL and Set It on the Path to Glory. New York:Houghton Mifflin Harcourt Publishing Company. ISBNISBN 978-0-618-90499-0