Milburn was educated at Oundle School and Sidney Sussex College, Cambridge and ordained in 1935. Between then and 1957 he was a fellow, tutor and chaplain at Worcester College, Oxford. He was then appointed as the Dean of Worcester Cathedral where he served until 1968. During this time he was Librarian and Master of the Fabric and was highly knowledgeable about both. He had the crypt, originally built by St Wulstan, bishop at the time of the Norman invasion, cleaned, cleared and painted. He worked hard to maintain the fabric in good condition. He founded the Worcester Civic Society and was often seen around the city where he always preferred to walk or bicycle to travelling by car. Many local people still remember him with affection and recall that he usually wore the regular dean's uniform of breeches, gaiters and frock coat, which he always said was extremely comfortable. He was then Master of the Temple Church until his retirement in 1980, when he retired to Bromyard, Herefordshire. His wife was increasingly disabled and he looked after her with exemplary devotion, eventually moving to the Beauchamp Community in Malvern where she would be nearer the facilities she required.
Milburn was a classical scholar, but in the tradition of the Edwardian public school, applied the methods of learning to a wide range of subjects. He read and wrote excellent French and good German and knew a great deal about the natural world, particularly birds. He was much in demand as a witty after-dinner speaker, and was a natural story-teller. The late Canon Iaian Mackenzie, a canon of Worcester Cathedral and a friend of Milburn, commented when he died: "We shall not see his like again.", but also pointed out that he looked forward to continuing their discussion about Clement of Alexandria in the next life and that Clement would be there to arbitrate.
- Saints and their Emblems in English Churches (OUP 1949, Blackwell, 1961, reprinted Cressrells 1991)
- Early Christian Interpretations of History (Bampton Lectures 1953; A&C Black 1954)
- Early Christian Art and Architecture, Scolar Press 1988.
- FSA Web Site Archived 13 June 2011 at the Wayback Machine
- "Who was Who" 1897-1990 London, A & C Black, 1991 ISBN 0-7136-3457-X
- The Times, 26 November 1931; pg. 8; Issue 45990; col E, University News, Cambridge Jeremie Hellenistic Prize R.L.P. Milburn, Sidney Sussex
- Crockford's Clerical Directory 1975-76 London: Oxford University Press, 1976 ISBN 0-19-200008-X
|Church of England titles|
William Ernest Beck
| Dean of Worcester
1957 – 1968
Eric Waldram Kemp