It was established in the 1780s by the descendants of area resident Cadwallader Colden, one of the last colonial governors of New York. The ruins of the family home are at the junction of 17K and NY 747, approximately a mile (1.6 km) to the northeast. While Colden himself is buried another private cemetery in the Queens community of Flushing where he died, a tablet was erected in his memory at the entrance. Many of his progeny are here, along with some of the family's slaves and members of other families. The earliest grave is that of his last wife Elizabeth, who died in 1782. The most recent grave is that of Anna Colden Harris, who died in 1937. The cemetery was added to the Register in 2005.