The original log Presbyterian meetinghouse was built in 1793. The Mingo Creek Society, a group of dissidents founded in February 1794 that became involved in protest against the federal whiskey excise tax, met there. It would serve as a focal point in the development of the Whiskey Rebellion, even becoming the site of militia musters in the fight against federal forces. Some militia members of buried on the grounds.
In the early years, the church was served by circuit-riding preachers who ministered to the early settlers of the era. Many of the service were held underneath a young oak tree. In 1990, that tree had grown large, but had become infested by ants. In response, the church members removed most of the tree, but left the base of the trunk, which they then carved into a statue of a circuit-riding preacher. "Reverend Stump," as it was called, was itself consumed by ants by 2013. The original permanent structure was built in 1831, and it still stands as of 2013.