The district dates back to the Oberamt Rottweil, which was created in 1806/08 when the previously free imperial city Rottweil became part of Württemberg. In 1934 it was renamed to Landkreis (district). 1938 the two neighboring districts Sulz and Oberndorf were dissolved, and most of the district Oberndorf and a small part of Sulz was added to the district Rottweil. During World War II, a series of concentration camps, collectively known as KZ Schörzingen-Rottweil-Zepfenhan, were located in the area. In 1973 in another communal reform several municipalities from the districts Horb, Wolfach, Hechingen and Villingendorf were added.
The imperial eagle in the coat of arms derives from the coat of arms of the free imperial city Rottweil. Below the eagle is a deer antler, the symbol of Württemberg, as part of the district belonged to the kingdom Württemberg well before Rottweil itself became part of it. The shield on the breast of the eagle show the colors of Austria, symbolizing the area around the city of Oberndorf which was acquired by Austria in 1381.