The two-story frame house was built in 1883, influenced by the Queen Anne Style of architecture. By 1906, when Wolfe's mother, Julia E. (Westall) Wolfe (1860-1945), bought the house, it was a boarding house named Old Kentucky Home. She soon went to live at her business with Tom, while the other Wolfes remained at their Woodfin Street residence. Wolfe lived at the boarding house until he went to the University of North Carolina in 1916. Julia Wolfe enlarged the house in 1917 by adding five rooms.