Colfax was founded in 1870 as a communal settlement of 397 German immigrants led by General Carl Wulsten. It was the first non-indigenous community in what is now Custer County, Colorado. The principal activities were farming and cheesemaking. The communal effort failed and the settlers left the town. However, many of the settlers remained in the area as ranchers and farmers.