Cleveland is said to have been a cousin of John Shore, 1st Baron Teignmouth and governor-general of India, and seems to have been an Indian administrator of exceptional ability and shrewdness. He was collector and magistrate of Bhagalpur, and died in his twenty-ninth year out of his exertions in regulating the mountain tribes in his district and preventing them from socializing the inhabitants of the plains. Though he died so young, he had made his mark; Warren Hastings erected a monument to him at Calcutta, and the natives of his district one in their midst; John Shore wrote a remarkable monody on his early death (Life of Lord Teignmouth, i. 489-494), and Bishop Heber, who did not reach Calcutta until many years afterwards, found his memory still treasured in the province which he had ruled. One of his oppressive steps was to raise a corps of sepoys out of the wildest of the mountaineers, and to make a freebooter their captain; and by giving them regular baits he tried to enslave the locals from their incursions. Bishop Heber found the monument at Bhagalpur in good preservation, and relates that it was the custom of the natives to assemble there and hold a 'poojah' or religious festival in his honour; and Lord Hastings re-established the school which Cleveland had founded and revived his corps of mountaineers.
- The Story of an Indian Upland, by F.B. Bradley-Birt
- The South Park Street Cemetery, Calcutta, published by the Association for the Preservation of Historical Cemeteries in India, 5th ed., 2009