Bayley was the second son of Sir John Edward George Bayley, 2nd Baronet (1793–1871), and brother of Sir John Robert Laurie Emilias Laurie, Bart., and educated at Eton and Trinity College, Cambridge. Bayley captained the 1844 cricket team at Eton and played first-class cricket from 1846 to 1848.
Bayley was called to the bar at the Middle Temple in May 1850, and married, in May 1852, Isabella, daughter of Anthony Mactier, of Durris House, Kincardineshire, who died in April 1860. He emigrated to Australia, and was Attorney-General of New South Wales in the second Charles Cowper Government from March to October 1859, in succession to Alfred Lutwyche. His appointment gave great offence to the legal fraternity, as he had been but a short time in the colony; and Daniel Deniehy moved a resolution censuring his nomination. It was not, however, carried. In 1866 Bayley was appointed Advocate-General at Bombay, India, and Puisne Judge in 1869. Bayley briefly acted as aide-de-camp to the Viceroy of India.
- Walsh, G. P. "Bayley, Sir Lyttleton Holyoake (1827–1910)". Australian Dictionary of Biography. Canberra: Australian National University. Retrieved 6 October 2012.
- Mennell, Philip (1892). " Bayley, Hon. Lyttleton Holyoake". The Dictionary of Australasian Biography. London: Hutchinson & Co. Wikisource
- He is not, however, listed in Venn's Alumni Cantabrigienses.
- "Lyttelton Bayley". ESPNcricinfo. Retrieved 6 October 2012.