He was the son of Baron Herman Wedel-Jarlsberg (Bogstad) and Edle Frederikke Rosenørn Lehn. He became an officer of the Norwegian Army in 1875 and in 1879, he was appointed a chamberlain at the Norwegian court. After converting to Catholicism along with his wife, he had to leave the Lutheran court in Norway, but was appointed a papal chamberlain by Pope Leo XIII in 1882. He lived with his family at the Palazzo Farnese in Rome.
- Peder Anker Wedel-Jarlsberg. Lensgreve Herman Wedel Jarlsberg's etterslekt, 1950