When the order of the Garter was founded, he was initiated as one of its first members and his stall in St. George's Chapel, Windsor was the eleventh on the side of Edward, the Black Prince. He served in France in 1346, where, at Crecy, he fought in the Prince's retinue. In August 1350 he took part in the naval Battle of Winchelsea. When hostilities were renewed between England and France in 1354 Sir James was in constant attendance upon the Black Prince, and earned a great reputation for valour.
At the Battle of Poitiers on September 19, 1356 he took his stand in front of the English army, and after fighting for a long time was severely wounded and carried from the fight. After the victory, the prince inquired after Sir James, who was brought to the royal tent, where Edward told him he had been the bravest knight on his side, and granted him an annuity of five hundred marks. Sir James made over this gift to the four esquires who had attended him during the battle, and received from the prince a further pension of six hundred marks. A variation of this story states that, after commending highly his four esquires, and attributing his success mainly to their enterprising spirit, made over to them the donation of ﬁve hundred marks. This act of generosity coming to the ear of the prince Edward, and, approving what he had done, confirmed the grant to the esquires, assigning to sir James an annual rent of six hundred marks.
In 1359 he was one of the leaders of an expedition into France. In 1360 he took the fortress of Chaven in Brittany, as well as the castle of Ferte-sous-Jouarre, and was present at Calais when peace was made between England and France in October 1360. He was afterwards governor of Aquitaine and great seneschal of Poitou, and took part in the capture of the town of La Roche-sur-Yon by Edmund, earl of Cambridge. He died in 1369 at Fontenay-le-Comte, where he had gone to reside, and was buried at Poitiers.
Arms "Gules fretty Or" Henry de Aldithley (or Audley), 1st in the line of Lord Audeley who died in 1246, had a seal with a fretty shield and his descendants bore a shield described as 'gules fretty or'. That is a red shield with a gold lattice. Information from; Complete Peerage Vol 1 page 337 by G E Cokayne.
- This article incorporates text from a publication now in the public domain: Chisholm, Hugh, ed. (1911). "Audley, Sir James". Encyclopædia Britannica. 2 (11th ed.). Cambridge University Press. p. 898. Endnotes