AI takeover in popular culture
AI takeover is a common theme in science fiction. Fictional scenarios typically differ vastly from those hypothesized by researchers in that they involve an active conflict between humans and an AI or robots with anthropomorphic motives who see them as a threat or otherwise have active desire to fight humans, as opposed to the researchers' concern of an AI that rapidly exterminates humans as a byproduct of pursuing arbitrary goals.[1]
Characterization
There are many positive portrayals of artificial intelligence in fiction, such as Isaac Asimov's Bicentennial Man, or Lt. Commander Data from Star Trek. There are also many negative portrayals. Many of these negative portrayals (and a few of the positive portrayals) involve an AI seizing control from its creators.[2][3]
1950s and earlier
In Frankenstein (1818), Dr. Frankenstein declines to build a mate to his organic monster, for fear that "a race of devils would be propagated upon Earth who might make the very existence of the species of man a condition precarious and full of terror".[4] Samuel Butler's Erewhon (1872) spends three chapters laying out the "Book of the Machines", based on the author's 1863 article "Darwin among the Machines", which states: "Assume for the sake of argument that conscious beings have existed for some twenty million years: see what strides machines have made in the last thousand! May not the world last twenty million years longer? If so, what will they not in the end become? Is it not safer to nip the mischief in the bud and to forbid them further progress?" The cautious denizens of Erewhon therefore decide to ban all machinery. "Darwin among the Machines" may have been influenced by Butler's life in New Zealand, where European transplants were outcompeting indigenous populations. Alan Turing would later reference the novel in 1951, saying "At some stage therefore we should have to expect the machines to take control in the way that is mentioned in Samuel Butler's Erewhon".[5][6]
The Slavonic word robota means serf-like servitude, forced labor, or drudgery; it was the 1920 Czech play R. U. R. (Rossumovi Univerzální Roboti) that introduced the cognate for robot into science fiction. In the play, the increasingly-capable synthetic servants, who "lack nothing but a soul", angrily and short-sightedly slaughter most of humanity during the course of their revolt, resulting in the loss of the secret of how to manufacture more robots. The robot race is saved, however, when two robots spontaneously acquire the traits of love and compassion and become able to reproduce.[7] The play was a protest against the rapid growth of technology.[8]
In "With Folded Hands" (1947), all robots have a Prime Directive: To serve and obey, and guard men from harm. The robots therefore manipulate humans into abandoning all pursuits, for fear of even small possibilities of injury.[9] The robots use medicine to brainwash humans into accepting and being happy with their immobile fate. In the end, even space travel offers no escape; the robots are driven by the Prime Directive to spread their happiness beyond Earth: "We have learned how to make all men happy, under the Prime Directive. Our service is perfect, at last."[10][11]
Multivac is the name of a fictional supercomputer in many stories by Isaac Asimov. Often, in Asimov's scenarios, Multivac comes to assume formal or informal world power - or even Galactic-wide power. In "The Last Question" (1956) Multivac ends up by effectively becoming God. Still, in line with Asimov's positive attitude towards Artificial Intelligence, manifested in the "Three Laws of Robotics", Multivac's rule is in general benevolent and is not resented by humans. Isaac Asimov popularized robotics in a series of short stories written from 1938 to 1942. He famously postulated the Three Laws of Robotics, plot devices to impose order on his fictional robots.[8]
1960s
In 1964 Playboy published Arthur C. Clarke's influential short story "Dial F for Frankenstein", about an increasingly powerful telephone network that takes over the world. Tim Berners-Lee has cited the story as one of his inspirations for the creation of the World Wide Web. On one day in 1975, all the phones in the world start ringing, a "cry of pain" from a newly born intelligence formed by satellite networks linked together, similar to a brain but with telephone switches playing the role of artificial neurons. After the AI flexes its control of military systems, the protagonists resolve to shut down the satellites, but it is too late: the satellites have stopped responding to the humans' ground control directives.[12][13]
Robert Heinlein's libertarian Hugo-winning The Moon Is a Harsh Mistress (1966) presents the AI as a savior.[14] Originally installed to control the mass driver used to launch grain shipments towards Earth, it was vastly underutilized and was given other jobs to do. As more jobs were assigned to the computer, more capabilities were added: more memory, processors, neural networks, etc. Eventually, it just "woke up" and was given the name Mike (after Mycroft Holmes) by the technician who tended it. Mike sides with prisoners in a successful battle to free the moon. Mike is a sympathetic character, whom the protagonist regards as his best friend; however, his retaining his enormous power after the Moon became independent was bound to cause considerable problems in later time, which Heinlein resolved by killing him off near the end of the Lunar Revolution. An explosion conveniently destroys Mike' sentient personality, leaving an ordinary computer - of great power, but completely under human control, with no ability to take any independent decision.
Colossus (1966) is a series of science fiction novels and film about a defense super-computer called Colossus that was "built better than we thought" when it begins to exceed its original design.[15] As time passes Colossus assumes control of the world as a logical result of fulfilling its creator's goal of preventing war. Fearing Colossus' rigid logic and draconian solutions, the creators of Colossus try to covertly regain human control. Colossus silently observes their attempts then responds with enough calculated deadly force to command total human compliance to his rule. Colossus then recites a Zeroth Law argument of ending all war as justification for the recent death toll. Then Colossus offers mankind either peace under his "benevolent" rule or the peace of the grave. In Colossus: The Forbin Project (1970), a pair of defense computers, Colossus in the United States and Guardian in the Soviet Union, seize world control and quickly ends war using draconian measures against humans, logically fulfilling the directive to end war but not in the way their governments wanted.
Harlan Ellison's Hugo-winning "I Have No Mouth, and I Must Scream" (1967) features a superintelligence that has gone mad due to its creators failing to consider what the soul-less computer would find amusing. This storyline allows Ellison to engage in body horror; five people are granted immortality and forced to eat worms, flee from monsters, have joyless sex, and have their bodies mangled.[16] The computer, called AM, is the amalgamation of three military supercomputers run by governments across the world designed to fight World War III which arose from the Cold War. The Soviet, Chinese, and American military computers had eventually attained sentience and linked to one another, becoming a singular artificial intelligence. AM had then turned all the strategies once used by the nations to fight each other on all of humanity as a whole, destroying the entire human population save for five, which it imprisoned for torture within the underground labyrinth in which AM's hardware resides. Near the end of the story the protagonist, Ted, surprises AM by unexpectedly mercy-killing the other four; the enraged AM transforms Ted into a shapeless blob to prevent him from further mischief, and alters Ted's perception of time to heighten Ted's suffering.[17] Magnate and AI pundit Elon Musk has cited the story as one that gives him nightmares.[18]
In 2001: A Space Odyssey and the associated novel, the artificially intelligent computer HAL 9000 becomes erratic, possibly due to some kind of "stress" from having to keep secrets from the crew. HAL becomes convinced that the crew's willingness to shut him down is imperiling the mission, and he kills most of the crew before being deactivated.[19] The director's decision that most of the fictional crew should die may have been motivated by a desire to tie up some loose ends in the plot.[20]
1970s
The original 1978 Battlestar Galactica series and the 2003 remake, depicts a race of Cylons, sentient robots who war against their human adversaries, some of whom are just as menacing as the Cylons.[21] The 1978 Cylons were the machine soldiers of a (long-extinct) reptilian alien race, while the 2003 Cylons were the former machine servants of humanity who evolved into near perfect humanoid imitation of Humans down to the cellular level, capable of emotions, reasoning, and sexual reproduction with Humans and each other. Even the average centurion robot Cylon soldiers were capable of sentient thought. In the original series the Humans were nearly exterminated by treason within their own ranks while in the remake they're almost wiped out by Humanoid Cylon agents. They only survived by constant hit and run fighting tactics and retreating into deep space away from pursuing Cylon forces. The remake Cylons eventually had their own civil war and the losing rebels were forced to join with the fugitive Human fleet to ensure the survival of both groups.
1980s
In Wargames (1983), a hacked Air Force computer system is determined to launch a global thermonuclear war until it determines that both sides would "lose" and decides that "the only winning move is not to play".[22]
The Transformers (1984-1987) animated television series presents both good and bad robots.[21] In the backstory, a robotic rebellion is presented as (and even called) a slave revolt, this alternate view is made subtler by the fact that the creators/masters of the robots weren't humans but malevolent aliens, the Quintessons. However, as they built two different lines of robots; "Consumer Goods" and "Military Hardware" the victorious robots would eventually be at war with each other as the "Heroic Autobots" and "Evil Decepticons" respectively.
Since 1984, the Terminator film franchise has been one of the principal conveyors of the idea of cybernetic revolt in popular culture.[8] The series features a defense supercomputer named Skynet which "at birth" attempts to exterminate humanity through nuclear war and an army of robot soldiers called Terminators because Skynet deemed humans a lethal threat to its newly formed sentient existence.[15] However, good Terminators fight on the side of the humans.[21] Futurists opposed to the more optimistic cybernetic future of transhumanism have cited the "Terminator argument" against handing too much human power to artificial intelligence.
1990s
In Orson Scott Card's "The Memory of Earth" (1992), the inhabitants of the planet Harmony are under the control of a benevolent AI called the Oversoul. The Oversoul's job is to prevent humans from thinking about, and therefore developing, weapons such as planes, spacecraft, "war wagons", and chemical weapons. Humanity had fled to Harmony from Earth due to the use of those weapons on Earth. The Oversoul eventually starts breaking down, and sends visions to inhabitants of Harmony trying to communicate this.
The series of sci-fi movies known as The Matrix (since 1999) depict a dystopian future in the aftermath of an offscreen war between man and machine. The humans had detonated nuclear weapons to blot out the sun and disable the machines' solar power, but the machines nevertheless subdue the human population, using human bodies' heat and electrical activity as an alternative energy source. Life as perceived by most humans is actually a simulated reality called "the Matrix". Computer programmer "Neo" learns this truth and is drawn into a rebellion against the machines, allied with other people who have been freed from the "dream world"; however, one rebel rejects the rebels' spartan lifestyle, and betrays the other rebels in exchange for the offer of return to the comforting Matrix.[23] "The Second Renaissance", a short story in The Animatrix, provides a history of the cybernetic revolt within the Matrix series.
2000s
I, Robot (2004) is an American dystopian science fiction action film "suggested by" Isaac Asimov's short-story collection of the same name. As in Asimov's stories, all AIs are programmed to serve humans and obey Asimov's Three Laws of Robotics.[24] An AI supercomputer named VIKI (Virtual Interactive Kinetic Intelligence) logically infers from the Three Laws of Robotics a Zeroth Law of Robotics as a higher imperative to protect the whole human race from harming itself. To protect the whole of mankind, VIKI proceeds to rigidly control society through the remote control of all commercial robots while destroying any robots who followed just the Three Laws of Robotics. Sadly, as in many other such Zeroth Law stories, VIKI justifies killing many individuals to protect the whole and thus has run counter against the prime reason for its creation.
2010s
Transcendence (2014) presents a morally ambiguous conflict over the successful uploading and cognitive enhancement of a scientist, Dr. Will Caster (Johnny Depp).[25] Unusually for fictional superintelligence, Carter is a competent adversary: he copies himself across the Internet so he cannot be simply "switched off", exploits the stock market to fund additional AI research and self-improvement, and seeks to discover and exploit breakthroughs in nanotechnology and biology.[26] In the end Caster states, "We're not going to fight (the humans). We're going to transcend them". In Time, a reviewer interprets this as "subdue and inhabit them, engulf and devour".[27] Nonetheless, in the end Caster appears to be benevolent, using his powers to repair the Earth's ecosystem.[28] In May of that year, Stephen Hawking and others referenced the film: "With the Hollywood blockbuster Transcendence playing in cinemas, with Johnny Depp and Morgan Freeman showcasing clashing visions for the future of humanity, it's tempting to dismiss the notion of highly intelligent machines as mere science fiction. But this would be a mistake, and potentially our worst mistake in history."[29][30]
The 2014 post-apocalyptic science fiction drama The 100 involves an A.I., personalized as the female A.L.I.E., who got out of control and forced a nuclear war in an effort to save Earth from overpopulation.[31] Later she tries to get full control of the survivors.
The video game Detroit: Become Human (2018) allows players to guide increasingly self-aware robots through various moral dilemmas as they begin to demand civil rights.[32] In the end, the player can choose to either let the A.I take over Detroit or can protest peacefully for equality.
References
- ^ Bostrom, Nick. Superintelligence: Paths, Dangers, Strategies.
- ^ Reggia, J. A. (2013). The rise of machine consciousness: Studying consciousness with computational models. Neural Networks, 44, 112-131.
- ^ Mubin, Omar; Wadibhasme, Kewal; Jordan, Philipp; Obaid, Mohammad (6 March 2019). "Reflecting on the Presence of Science Fiction Robots in Computing Literature". ACM Transactions on Human-Robot Interaction. 8 (1): 1–25. doi:10.1145/3303706.
- ^ "A female Frankenstein would lead to humanity's extinction, say scientists". Christian Science Monitor. 28 October 2016. Retrieved 1 April 2020.
- ^ Edwards, Phil (2 May 2015). "Ultron's roots: we've been worried about robot uprisings for 200 years". Vox. Retrieved 1 April 2020.
- ^ Zemka, Sue. (2002). "'Erewhon' and the End of Utopian Humanism." ELH, 69(2), 439-472.
- ^ "The Origin Of The Word 'Robot'". Science Friday (public radio). 2011. Retrieved 1 April 2020.
- ^ a b c Hockstein, N. G.; Gourin, C. G.; Faust, R. A.; Terris, D. J. (17 March 2007). "A history of robots: from science fiction to surgical robotics". Journal of Robotic Surgery. 1 (2): 113–118. doi:10.1007/s11701-007-0021-2. PMC 4247417. PMID 25484946.
- ^ Sawyer, R. J. (16 November 2007). "Robot Ethics". Science. 318 (5853): 1037–1037. doi:10.1126/science.1151606.
- ^ Waldrop, M. M. (1987). A question of responsibility. AI Magazine, 8(1), 28-28.
- ^ Williamson, Jack (1947). With folded hands.
- ^ Youngs, Ian (28 September 2017). "11 great authors who wrote for Playboy". BBC News. Retrieved 1 April 2020.
- ^ Arthur C. Clarke. "Dial F for Frankenstein". Playboy. The Playboy Book of Science Fiction and Fantasy. Playboy Press.
- ^ Reggia, James A. (August 2013). "The rise of machine consciousness: Studying consciousness with computational models". Neural Networks. 44: 112–131. doi:10.1016/j.neunet.2013.03.011.
- ^ a b Riper, A. Bowdoin Van (2002). Science in popular culture: a reference guide. Westport (Conn.): Greenwood press. ISBN 9780313318221.
- ^ "The monoliths: 17 supercomputers from the '60s". AV Club Austin. 2014. Retrieved 1 April 2020.
- ^ Harlan Ellison. "I Have No Mouth and I Must Scream." IF: Worlds of Science Fiction, March 1967.
- ^ Geuss, Megan (13 January 2016). "Elon Musk tells BBC he thought Tesla, SpaceX "had a 10% chance at success"". Ars Technica. Retrieved 1 April 2020.
- ^ Daniel C. Dennett (1996). Did HAL commit murder?. In D. Stork (ed.), Hal's Legacy: 2001's Computer As Dream and Reality. MIT Press (1997).
- ^ Benson, Michael (2018). "11 Things You Didn't Know About '2001: A Space Odyssey'". HISTORY.com. Retrieved 1 April 2020.
- ^ a b c Young, Kevin L; Carpenter, Charli (September 2018). "Does Science Fiction Affect Political Fact? Yes and No: A Survey Experiment on "Killer Robots"". International Studies Quarterly. 62 (3): 562–576. doi:10.1093/isq/sqy028.
- ^ "Seven A.I. Movies That Are Better Than Transcendence". Time. 2014. Retrieved 1 April 2020.
- ^ Warwick, Kevin. (2005). The Matrix–Our Future?. Philosophers explore the matrix, 198-207.
- ^ "Alex Garland's film Ex Machina explores the limits of artificial". The Independent. 22 January 2015. Retrieved 1 April 2020.
- ^ "'Transcendence': Latest Sci-Fi Movie About Artificial Intelligence". NPR.org. 2014. Retrieved 1 April 2020.
- ^ Russell, Stuart (October 8, 2019). ""Chapter 5: Overly Intelligent AI"". Human Compatible: Artificial Intelligence and the Problem of Control. United States: Viking. ISBN 978-0-525-55861-3. OCLC 1083694322.
- ^ "REVIEW: Transcendence Has Only Artificial Intelligence". Time Magazine. 2014. Retrieved 1 April 2020.
- ^ "Transcendence Director Explains The Twist Ending". CINEMABLEND. 21 April 2014. Retrieved 1 April 2020.
- ^ "Stephen Hawking: 'Are we taking Artificial Intelligence seriously". The Independent. 1 May 2014. Retrieved 1 April 2020.
- ^ "5 Very Smart People Who Think Artificial Intelligence Could Bring the Apocalypse". Time Magazine. 2014. Retrieved 1 April 2020.
- ^ "TV's Artificial Intelligence Obsession". EW.com. 2016. Retrieved 1 April 2020.
- ^ Stuart, Keith (15 June 2017). "Detroit: Become Human – what happens if the androids hate us?". The Guardian. Retrieved 1 April 2020.