The top of the fort is actually very small. There are remnants of old buildings. The bastion at the entrance is dilapidated. 5-6 cisterns can be seen to the left of the main gate, on the lower side of the cliff. There is a small cave to the right. At the top there is a Hanuman temple. An idol of Hanuman sits outside the temple.
King Bhoj of the Shilahar Dynasty built Vairatgad in the 11th century. During King Shivaji's reign the fort was used as a military station. King Shivaji conquered the Wai region and included Vairatgad and Pandavgad in his kingdom. The British captured it in 1818.