The castle was first mentioned around the year 1000. In 1119, Count Otto III of Scheyern moved into the castle of Wittelsbach and converted his previous seat into Scheyern Abbey. The castle's name, "Witilinesbac", is however already mentioned as the place of origin of Otto III in a document by Henry V dating from 1115. From 1120, the Counts of Scheyern styled themselves Counts Palatine of Wittelsbach. The castle thus became the ancestral seat of the House of Wittelsbach, the later Electors and Kings of Bavaria and Electors of the Palatinate.
According to local tradition, the castle was destroyed in 1209 after count Otto of Wittelsbach had murdered King Philip of Swabia and never rebuilt. An archaeological excavation from 1978 to 1980 did not find evidence of a sudden destruction of the castle, however - from the archaeological evidence, it appears the castle's walls were used as a quarry after the castle itself was given up.
In the 15th century, the Gothic church Beatae Mariae Virginis was built on the former castle site. The church, still standing today, became the nucleus of the village of Oberwittelsbach (Upper Wittelsbach). In 1834, the Wittelsbach family erected a monument on the former site of their ancestral castle. In memory of the castle, parts of the district Aichach-Friedberg are today called Wittelsbacher country.
In 1838 Duke Maximilian Joseph in Bavaria, the father of Empress Elisabeth of Austria, acquired the castle in the nearby village of Unterwittelsbach (Lower Wittelsbach), built in 1537 on the site of a medieval castle; it remained in the possession of the junior ducal branch (named Dukes in Bavaria) of the royal House of Wittelsbach until 1955 and now houses a museum on Empress "Sisi".
- Robert Koch: Die Ausgrabungen in der Burg Wittelsbach bei Aichach 1978-1979. In: T. Grad (ed.): Die Wittelsbacher im Aichacher Land, 1980
- Horst Lechner, Wolfgang Brandner: Aichach bei Wittelsbach - Historische Ansichten aus vier Jahrhunderten. Augsburg, 1999.