The church building, the second for the congregation, was constructed in 1838, and originally had Greek Revival styling. In 1874 it was significantly renovated, and given its present Gothic Revival appearance. The building was listed on the National Register of Historic Places in 2003.
The congregation was established in 1752. Its worship today is a blend of Biblically centered preaching and heartfelt praise, the music style is a blend of contemporary and traditional music. Worship starts at 10:30 a.m. during the fall, winter, and spring, and 9:30 during the summer. Rev. Jonathan Chechile has been the pastor of First Baptist Church since 2008.