In 1509, he was one of the jurors who convicted Richard Empson and he benefited financially from Empson's fall by buying the manor of Easton Neston. From 1520 to 1523, Fermor was the warden of the Grocers' Company. In 1540, Fermor was found guilty of misprision of treason and on 9 May 1540 he was sentenced to life imprisonment in the Marshalsea Prison and attainted. In 1541, he was pardoned.
An extensive inventory of Richard Fermor's household goods at Easton Neston survives in the Cotton manuscripts.
He married Anne Browne, daughter of Sir William Browne, Lord Mayor of London. They had five sons, Sir John Fermor, Sir Thomas Fermor, Sir Jerome Fermor and two other sons whose names are not known, as well as five daughters, including Mary (1534-1573).
He died in 1551 or 1552.
- Morgan, Basil. "Fermor, Richard (1480x84–1551), merchant". Oxford Dictionary of National Biography (online ed.). Oxford University Press. doi:10.1093/ref:odnb/9345. (Subscription or UK public library membership required.)
- British Library Cotton Appendix XXVIII.
- "FERMOR, Sir John (by 1516-71), of Easton Neston, Northants. | History of Parliament Online". www.historyofparliamentonline.org. Retrieved 2017-01-14.
- "FERMOR, Thomas (by 1523-80), of Horde Park, Bridgnorth, Salop and Somerton, Oxon. | History of Parliament Online". www.historyofparliamentonline.org. Retrieved 2017-01-14.
- "FERMOR, Jerome (1528-1602), of Wood Burcote and Wappenham, Northants. | History of Parliament Online". www.historyofparliamentonline.org. Retrieved 2017-01-14.