When on 6 July 1937 at Kvillinge, Sweden, Prince Carl married Countess Elsa von Rosen (Stockholm, 7 February 1904 – Stockholm, 15 April 1991), he had to relinquish his succession rights and his royal titles. She was the daughter of Count Eugén von Rosen and Eleonore Wijk, and ex-wife of Count Adolf von Rosen. Bernadotte's brother-in-law, King Leopold III of Belgium, conferred upon him the title Prince Bernadotte in the Belgian nobility on the same date, with the right to the comital title for his male-line descendants. He had one daughter, Countess Madeleine (b. Stockholm, 8 October 1938), and divorced Elsa in 1951. He married Ann Margareta Larsson (Danderyd, 22 March 1921–3 September 1975) at Danderyd, Sweden, on 1 November 1954. They divorced in 1961, without issue. His third and final marriage was at Rabat, Morocco, on 8 June 1978 to Kristine Rivelsrud (b. Eidsfoss, Norway, 22 April 1932), without issue.
Carl Bernadotte was at the center of the Huseby scandal that occurred in the late 1950s in Sweden amidst a great deal of publicity. Bernadotte had gained the trust of Florence Stephens, a wealthy elderly heiress of a large estate near Växjö in southern Sweden. A complex set of criminal transactions led to the ruin of Stephens and to bring Bernadotte to court. Bernadotte was acquitted in spite of his full confession – he was not considered sane with regards to his actions and therefore not criminally culpable. Bernadotte left Sweden shortly after the trial and spent the rest of his life in Spain.
Families that have been included in Kalender öfver i Sverige lefvande ointroducerad adel (1886–1899), Sveriges ointroducerade adels kalender (1912–1944) and/or Kalender över Ointroducerad adels förening (1935–)