1880 The census reports 136 inhabitants, 24,164.
1881 The Texas and Pacific Railway routes an east-west branch through Eskota.
1885 Town of Fisher is registered. Swedish immigrants found the community of Swedonia.
1886 Town of North Roby is registered. Roby eventually wins the county seat election over Fisher, but it is later discovered that one of the voters, a Mr. Bill Purp, is actually a dog whose owner lives near Roby.
1920 Fisher County is among Texas leaders in wheat production.
1926 Cotton becomes king, as 48,000 bales are ginned in the county.
As of the census of 2000, there were 4,344 people, 1,785 households, and 1,244 families residing in the county. The population density was 5 people per square mile (2/km²). There were 2,277 housing units at an average density of 2 per square mile (1/km²). The racial makeup of the county was 83.75% White, 2.76% Black or African American, 0.37% Native American, 0.14% Asian, 11.58% from other races, and 1.40% from two or more races. 21.36% of the population were Hispanic or Latino of any race.
There were 1,785 households out of which 27.60% had children under the age of 18 living with them, 58.90% were married couples living together, 8.10% had a female householder with no husband present, and 30.30% were non-families. 28.30% of all households were made up of individuals and 17.80% had someone living alone who was 65 years of age or older. The average household size was 2.39 and the average family size was 2.93.
In the county, the population was spread out with 23.90% under the age of 18, 6.30% from 18 to 24, 23.00% from 25 to 44, 24.10% from 45 to 64, and 22.70% who were 65 years of age or older. The median age was 43 years. For every 100 females there were 92.90 males. For every 100 females age 18 and over, there were 89.80 males.
The median income for a household in the county was $27,659, and the median income for a family was $34,907. Males had a median income of $25,071 versus $20,536 for females. The per capita income for the county was $15,120. About 13.50% of families and 17.50% of the population were below the poverty line, including 27.40% of those under age 18 and 10.50% of those age 65 or over.