He trained as an architect with John Gray Weightman and Matthew Ellison Hadfield of Sheffield, from 1845 to 1850, and thereafter worked in partnership with them. After Weightman left the partnership in 1858, Hadfield and Goldie remained in partnership for a further two years. Goldie then practised alone until 1867 when Charles Edwin Child (1843–1911) joined him in partnership.
In 1880 Goldie's son Edward (1856–1921) entered the partnership, having first been apprenticed in 1875. Edward Goldie's work includes Hawkesyard Priory in Armitage, Staffordshire, built for the Dominican Order 1896–1914, and the church of Our Most Holy Redeemer and St Thomas More, Chelsea, built in 1895.