He was the son of Elisha Swift (b. 1731) and Mary Ransom (b. 1738). One of Swift's older brothers was future Brigadier General John Swift. On April 4, 1786, he married his first wife Electra Goodrich in Sharon, Connecticut. On May 22, 1793, he married his second wife Sally Deane (1774–1820?) in Phelps, N.Y., and their son was Deane Swift (1794–1818). On November 26, 1823, he married his third wife Fanny (or Fauna, Fawnia, Faunia) Cole (ca. 1792–1880), and their daughter was Electra Jane Swift (1825-1904).
He was a member from the Western District of the New York State Senate from 1810 to 1815 and from 1816 to 1818. In February 1817, when John Tayler became Acting Governor of New York after the resignation of Daniel D. Tompkins, Swift was elected President pro tempore of the State Senate. He was Acting Lieutenant Governor of New York until July 1, 1817.
-  Political Graveyard
-  The New York Civil List compiled by Franklin Benjamin Hough (pages 121ff, 180f, 199f; Weed, Parsons and Co., 1858)
-  Cole genealogy
-  Burial records in Ontario County
-  Swift/Cole genealogy, at RootsWeb
-  The Regents of the University of the State of New York: 1784-1959 compiled by Albert Bickmore Corey (University of the State of New York, 1959; page 31)
-  Revolutionary War Soldiers Buried in Monroe County, New York—lists Swift's burial in Webster Rural Cemetery
|Lieutenant Governor of New York