He trained as an architect with John Gray Weightman and Matthew Ellison Hadfield of Sheffield, from 1845 to 1850, and thereafter worked in partnership with them. After Weightman left the partnership in 1858, Hadfield and Goldie remained in partnership for a further two years. Goldie then practised alone until 1867 when Charles Edwin Child (1843-1911) joined him in partnership. In 1880 Goldie's son Edward (1856-1921) entered the partnership, having first been apprenticed in 1875. Edward was the architect of Hawkesyard Priory in Armitage, Staffordshire, built for the Dominicans 1896-1914.