St. Joseph's was designed by the noted Irish-born architect, Patrick C. Keely and built in 1851-53. It is a large rectangular structure with a steeply pitched gable roof, and a square tower protruding from the front facade. It is faced in ashlar stone with brownstone trim. The sides are supported in part by buttresses. The building is the oldest Roman Catholic Church building in the state.