Future of Life Institute
42°22′25″N 71°06′35″W / 42.3736158°N 71.1097335°W
![]() | |
Abbreviation | FLI |
---|---|
Formation | March 2014 |
Founders |
|
Type | Non-profit research institute |
47-1052538 | |
Legal status | Active |
Purpose | Reduction of existential risk, particularly from advanced artificial intelligence |
Location |
|
President | Max Tegmark |
Website | futureoflife.org |
The Future of Life Institute (FLI) is a nonprofit organization with the stated goal of reducing global catastrophic and existential risks facing humanity, particularly existential risk from advanced artificial intelligence (AI). FLI's work includes grantmaking, educational outreach, and advocacy within the United Nations, United States government, and European Union institutions. Its founders include MIT cosmologist Max Tegmark and Skype co-founder Jaan Tallinn, and its advisors include entrepreneur Elon Musk.
Mission
![](http://upload.wikimedia.org/wikipedia/commons/thumb/0/06/Max_Tegmark.jpg/220px-Max_Tegmark.jpg)
FLI's stated mission is to reduce global catastrophic and existential risk from powerful technologies.[1] FLI focuses on the potential risk to humanity from the development of human-level or superintelligent artificial general intelligence (AGI), but has also stated they work to prevent risk from biotechnology, nuclear weapons and global warming.[2]
History
FLI was founded in March 2014 by MIT cosmologist Max Tegmark, Skype co-founder Jaan Tallinn, DeepMind research scientist Viktoriya Krakovna, Tufts University postdoctoral scholar Meia Chita-Tegmark, and UCSC physicist Anthony Aguirre. The Institute's advisors include computer scientists Stuart J. Russell and Francesca Rossi, biologist George Church, cosmologist Saul Perlmutter, astrophysicist Sandra Faber, theoretical physicist Frank Wilczek, entrepreneur Elon Musk, and actors and science communicators Alan Alda and Morgan Freeman (as well as cosmologist Stephen Hawking prior to his death in 2018).[3][4][5]
Starting in 2017, FLI has offered an annual "Future of Life Award", with the first awardee being Vasili Arkhipov. The same year, FLI released Slaughterbots, a short arms-control advocacy film. FLI released a sequel in 2021.[6]
In 2018, FLI drafted a letter calling for "laws against lethal autonomous weapons". Signatories included Elon Musk, Demis Hassabis, Shane Legg, and Mustafa Suleyman.[7]
In March 2023, FLI drafted a letter calling on major AI developers to agree on a verifiable six-month pause of any systems "more powerful than GPT-4" and to use that time to institute a framework for ensuring safety; or, failing that, for governments to step in with a moratorium. The letter said: "recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no-one - not even their creators - can understand, predict, or reliably control".[8] The letter referred to the possibility of "a profound change in the history of life on Earth" as well as potential risks of AI-generated propaganda, loss of jobs, human obsolescence, and society-wide loss of control.[9][10]
Prominent signatories of the letter included Elon Musk, Steve Wozniak, Evan Sharp, Chris Larsen, and Gary Marcus; AI lab CEOs[clarification needed] Connor Leahy and Emad Mostaque; politician Andrew Yang; deep-learning researcher Yoshua Bengio; and Yuval Noah Harari.[11] Marcus stated "the letter isn't perfect, but the spirit is right." Mostaque stated, "I don't think a six month pause is the best idea or agree with everything but there are some interesting things in that letter." In contrast, Bengio explicitly endorsed the six-month pause in a press conference.[12][13] Musk claimed that "Leading AGI developers will not heed this warning, but at least it was said."[14] Some signatories, including Musk, claimed to be motivated by fears of existential risk from artificial general intelligence.[15] Some of the other signatories, such as Marcus, instead claimed to have signed out of concern about risks such as AI-generated propaganda.[16]
The paper "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?"[17] whose authors include Emily M. Bender, Timnit Gebru, and Margaret Mitchell,[clarification needed] criticised the letter.[18] Mitchell claimed that “by treating a lot of questionable ideas as a given, the letter asserts a set of priorities and a narrative on AI that benefits the supporters of FLI. Ignoring active harms right now is a privilege that some of us don’t have.”[18]
Conferences
In 2014, the Future of Life Institute held its opening event at MIT: a panel discussion on "The Future of Technology: Benefits and Risks", moderated by Alan Alda.[19][20] The panelists were synthetic biologist George Church, geneticist Ting Wu, economist Andrew McAfee, physicist and Nobel laureate Frank Wilczek and Skype co-founder Jaan Tallinn.[21][22]
Since 2015, FLI has organised biannual conferences with the stated purpose of bringing together AI researchers from academia and industry. As of April 2023[update], the following conferences have taken place:
- "The Future of AI: Opportunities and Challenges" conference in Puerto Rico (2015). The stated goal was to identify promising research directions that could help maximize the future benefits of AI.[23] At the conference, FLI circulated an open letter on AI safety which was subsequently signed by Stephen Hawking, Elon Musk, and many artificial intelligence researchers.[24]
- The Beneficial AI conference in Asilomar, California (2017),[25] a private gathering of what The New York Times called "heavy hitters of A.I." (including Yann LeCun, Elon Musk, and Nick Bostrom).[26] The institute released a set of principles for responsible AI development that came out of the discussion at the conference, signed by Yoshua Bengio, Yann LeCun, and many other AI researchers.[27] These principles may have influenced the regulation of artificial intelligence and subsequent initiatives, such as the OECD Principles on Artificial Intelligence.[28]
- The beneficial AGI conference in Puerto Rico (2019).[29] The stated focus of the meeting was answering long-term questions with the goal of ensuring that artificial general intelligence is beneficial to humanity.[30]
Global research program
The FLI research program started in 2015 with an initial donation of $10 million from Elon Musk.[31][32][33] In this initial round, a total of $7 million was awarded to 37 research projects.[34] In July 2021, FLI announced that it would launch a new $25 million grant program with funding from the Russian–Canadian programmer Vitalik Buterin.[35]
In the media
- "The Fight to Define When AI is 'High-Risk'" in Wired.[36]
- "Lethal Autonomous Weapons exist; They Must Be Banned" in IEEE Spectrum.[37]
- "United States and Allies Protest U.N. Talks to Ban Nuclear Weapons" in The New York Times.[38]
- "Is Artificial Intelligence a Threat?" in The Chronicle of Higher Education, including interviews with FLI founders Max Tegmark, Jaan Tallinn and Viktoriya Krakovna.[2]
- "But What Would the End of Humanity Mean for Me?", an interview with Max Tegmark on the ideas behind FLI in The Atlantic.[3]
- Michael del Castillo (15 January 2015). "Startup branding doesn't hide apocalyptic undertones of letter signed by Elon Musk". Upstart Business Journal.
See also
- Future of Humanity Institute
- Centre for the Study of Existential Risk
- Global catastrophic risk
- Leverhulme Centre for the Future of Intelligence
- Machine Intelligence Research Institute
- The Precipice: Existential Risk and the Future of Humanity
References
- ^ "Future of Life Institute homepage". Future of Life Institute. 9 September 2021. Retrieved 9 September 2021.
- ^ a b Chen, Angela (11 September 2014). "Is Artificial Intelligence a Threat?". Chronicle of Higher Education. Retrieved 18 Sep 2014.
- ^ a b "But What Would the End of Humanity Mean for Me?". The Atlantic. 9 May 2014. Retrieved 13 April 2020.
- ^ "Who we are". Future of Life Institute. Retrieved 13 April 2020.
- ^ "Our science-fiction apocalypse: Meet the scientists trying to predict the end of the world". Salon. 5 October 2014. Retrieved 13 April 2020.
- ^ Walsh, Bryan (20 October 2022). "The physicist Max Tegmark works to ensure that life has a future". Vox. Retrieved 31 March 2023.
- ^ "AI Innovators Take Pledge Against Autonomous Killer Weapons". NPR. 2018. Retrieved 31 March 2023.
- ^ "Elon Musk among experts urging a halt to AI training". BBC News. 2023-03-29. Retrieved 2023-04-01.
- ^ "Elon Musk and other tech leaders call for pause in 'out of control' AI race". CNN. 29 March 2023. Retrieved 30 March 2023.
- ^ "Pause Giant AI Experiments: An Open Letter". Future of Life Institute. Retrieved 30 March 2023.
- ^ Ball, James (2023-04-02). "We're in an AI race, banning it would be foolish". The Sunday Times. Retrieved 2023-04-02.
- ^ "Musk and Wozniak among 1,100+ signing open letter calling for 6-month ban on creating powerful A.I." Fortune. March 2023. Retrieved 30 March 2023.
- ^ "The Open Letter to Stop 'Dangerous' AI Race Is a Huge Mess". www.vice.com. March 2023. Retrieved 30 March 2023.
- ^ "Elon Musk". Twitter. Retrieved 30 March 2023.
- ^ Rosenberg, Scott (30 March 2023). "Open letter sparks debate over "pausing" AI research over risks". Axios. Retrieved 31 March 2023.
- ^ "Tech leaders urge a pause in the 'out-of-control' artificial intelligence race". NPR. 2023. Retrieved 30 March 2023.
- ^ Bender, Emily M.; Gebru, Timnit; McMillan-Major, Angelina; Shmitchell, Shmargaret (2021-03-03). "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜". Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. Virtual Event Canada: ACM: 610–623. doi:10.1145/3442188.3445922. ISBN 978-1-4503-8309-7.
- ^ a b Kari, Paul (2023-04-01). "Letter signed by Elon Musk demanding AI research pause sparks controversy". The Guardian. Retrieved 2023-04-01.
- ^ "The Future of Technology: Benefits and Risks". Future of Life Institute. 24 May 2014.
- ^ "FHI News: 'Future of Life Institute hosts opening event at MIT'". Future of Humanity Institute. 20 May 2014. Retrieved 19 June 2014.
- ^ "The Future of Technology: Benefits and Risks". Personal Genetics Education Project. 9 May 2014. Retrieved 19 June 2014.
- ^ "AI safety conference in Puerto Rico". Future of Life Institute. Retrieved 19 January 2015.
- ^ "Research Priorities for Robust and Beneficial Artificial Intelligence: an Open Letter". Future of Life Institute.
- ^ "Beneficial AI 2017". Future of Life Institute.
- ^ Metz, Cade (June 9, 2018). "Mark Zuckerberg, Elon Musk and the Feud Over Killer Robots". NYT. Retrieved June 10, 2018.
The private gathering at the Asilomar Hotel was organized by the Future of Life Institute, a think tank built to discuss the existential risks of A.I. and other technologies.
- ^ "Asilomar AI Principles". Future of Life Institute.
- ^ "Asilomar Principles" (PDF). OECD.
- ^ "Beneficial AGI 2019". Future of Life Institute.
- ^ "CSER at the Beneficial AGI 2019 Conference". Center for the Study of Existential Risk.
- ^ "Elon Musk donates $10M to keep AI beneficial". Future of Life Institute. 15 January 2015.
- ^ "Elon Musk donates $10M to Artificial Intelligence research". SlashGear. 15 January 2015.
- ^ "Elon Musk is Donating $10M of his own Money to Artificial Intelligence Research". Fast Company. 15 January 2015.
- ^ "New International Grants Program Jump-Starts Research to Ensure AI Remains Beneficial". Future of Life Institute. 28 October 2015.
- ^ "FLI announces $25M grants program for existential risk reduction". Future of Life Institute. 2 July 2021.
- ^ Khari Johnson (September 1, 2021). "The Fight to Define When AI is 'High-Risk'". Wired.
- ^ Stuart Russell; Anthony Aguirre (June 16, 2021). "Lethal Autonomous Weapons Exist; They Must Be Banned". IEEE Spectrum.
- ^ Somini Sengupta; Rick Gladstone (March 27, 2017). "United States and Allies Protest U.N. Talks to Ban Nuclear Weapons". New York Times.