The house was built in 1859 by Ebenezer Maxwell (1827–1870), a wealthy cloth merchant, for $10,000. The masonry building is two-and-a-half stories, with a three-story tower. The main roof is mansard, with slate covering. The house features three porches and four stone chimneys. The original architecture has been attributed variously to Joseph C. Hoxie (1814-1870) and Samuel Sloan. In 1965, the house was restored by the Germantown Historical Society. In 1970, a porch was removed, and in 1979-1980, a cast-iron sidewalk was moved from 1907 N. 7th St. and installed in the rear porch of the house.