Benjamin Parry married Elizabeth Barrington, the sister of Herbert Barrington. Their children were four sons and one daughter- George born c.1672, Benjamin, James who was baptised in St. Michan's Church, Dublin on 7 August 1674, Thomas who died about the 26th March 1679 and Catherine who died about the 10th of April 1676 and who are both buried at St. Audeon’s Church, Dublin.
The vestry book of St. Audeon’s Church, Dublin states at 16 April 1681 that in a recess on the northern side of the church door, a corner of the north-west part of the church (now the vestibule) was railed off with "a rail and banister," for the Parry family burial place. It measured 14 feet by 8 feet and a rent of forty shillings a year was due for it by the Parry family, which was split fifty-fifty between the Prebendary and Churchwardens of St. Audeons. It acquired the name of the "Bishop of Ossory's Chapel". Many generations of the Parrys were buried in this tomb, which, having become defaced by time, was, on the repair of the Church in 1848, surmounted with an inscribed white marble slab at the expense of Dr. John Parry's representatives, Dame Emma Elizabeth Puleston of Albrighton Hall, Shropshire, relict of Sir Richard Puleston, Bart., Anna Eleanora, Frances and Elizabeth Hawkshaw, daughters of Lieutenant Colonel John Stuart Hawshaw of Divernagh, County Armagh. The monument of the spot, which still exists, reads- “In memory of Edward Parry and his two sons John and Benjamin Parry, who were interred near this spot. Edward Parry, D.D., Pro-Vice-Chancellor of the University of Trinity College, Dublin, was consecrated Bishop of Killaloe, 28th March, 1647, and died of the plague in this city, July 20th, 1650. John Parry, D.D., was promoted to the Deanery of Christ’s Church, Dublin, Apl. 2, 1666; was consecrated Bishop of Ossory Apl. 22, 1672; and departed this life Dec. 21st 1677. Benjamin Parry DD was promoted to the Deanery of St Canices Kilkenny Feb. 19th 1673, to the Deanery of St. Patrick's Dublin Feb. 17th 1674, was consecrated Bishop of Ossory on the death of his brother John Parry and departed this life Oct. 4th 1678. On the repairing of this church AD 1848 by permission of the Rev. James Howie AM prebendary of the same. Dame Emma Elizabeth Puleston of Albrighton Hall, Shropshire relict of Sir Richard Puleston Bart and Anna, Eleanora, Frances, and Elizabeth Hawkshaw, daughters of the late Lieut Colene John Stewart Hawkshaw of Divernagh Co. Armach, caused this new monument to be erected in memory of the above named bishops. The said Sir Richard Puleston and Lieut. Colonel John Steward Hawkshaw having been Lineally descended from the above named Edward Parry. The monument underneath was the one originally erected by the said John Parry to the memory of his Father Edward Parry”