In 1987, Ortmayer moved to the San Diego Chargers as general manager where he served until his release in December 1989. He then rejoined the Raiders until moving to an administrative office with the Los Angeles Rams. With the Raiders, he served in a number of capacities ranging from assistant coach to Director of Football Operations. Ortmayer was on the sidelines when the Raiders won both Super Bowl XV and Super Bowl XVIII. In 1995, as Vice President of Football Operations of the Rams, Ortmayer oversaw the move from Los Angeles, California to St. Louis, Missouri. In 2000, Ortmayer was named Director of Player Personnel of the XFL's Memphis team.