Williams was born at Caernarfon, the son of William Morris. His mother, Sarah, was the sister of Peter Jones (Pedr Fardd). The family moved to Coed Cae Bach, Llangybi, and he went to school at Llanystumdwy before being apprenticed to a carpenter. His talent for poetry was recognised, and he was able to attend the King's School, Chester, followed by Jesus College, Oxford. He was ordained as an Anglican clergyman in 1836, and appointed Curate of Holywell, later of Bangor and Pentir, and eventually of Amlwch in Anglesey.
In 1840, Williams married Ann Jones of Denbigh, and they had eight children.
At the Aberffraw eisteddfod of 1849, he won the bardic chair for an awdl on the Creation. In 1859 he became rector of Llanrhuddlad, with Llanfflewyn and the isolated St Rhwydrus's Church, Llanrhwydrus. In terms of his beliefs, he was a follower of the Oxford Movement.
- Y Flwyddyn Eglwysig (1843)
- Disce Vivere (1847)
- Disce Mori (1848)