Midway Mills is an unincorporated community in Nelson County, Virginia, United States. Midway, now called Midway Mills, was the first settlement established in Nelson County, Virginia, on June 6, 1774, by Dr. William Cabell, (born 1699). It was named Midway because it was midway between Richmond and Lynchburg along the James River. This area was known first as "Warminster" (named after the home of Dr. Cabell in Wiltshire, England), then as "Swan Creek Estates" and afterwards as "Liberty Hall Plantation" with the area now being known as "Wingina". The area, at that time part of "Old Albemarle County", was later divided into the counties of Albemarle, Amherst, Buckingham, Nelson, and Fluvanna between 1741 and 1809.
Dr. William Cabell owned many slaves, which were inherited by his children and grandchildren. One great-grandchild, Nathaniel Francis Cabell, (born 1807) documented a list of slaves in a diary, which is kept at the Special Collections Library at the University of Virginia in Charlottesville. His list of slave families living at Edgewood, Warminster, Union Hill, and Liberty Hall includes the Nicholas, Diggs, Venable, Woodson, Mayo, Early, Tompkins, Beverly, Horsley, Tucker, Rose, and Rives families.