Wikipedia:Artificial intelligence
 | This is an information page. It is not one of Wikipedia's policies or guidelines, but rather intends to describe some aspect(s) of Wikipedia's norms, customs, technicalities, or practices. It may reflect varying levels of consensus and vetting. |
Artificial intelligence is used on a number of Wikipedia and Wikimedia projects. This may be directly involved with creation of text content, or in support roles related to evaluating article quality, adding metadata, or generating images. As with any machine-generated content, care must be used when employing AI at scale or in applying it where the community consensus is to exercise more caution.
When exploring AI techniques and systems, the community consensus is to prefer human decisions over machine-generated outcomes until the implications are better understood.
Applications[edit]
AI-related efforts on Wikipedia include but are not limited to:
Revision scoring[edit]
The Objective Revision Evaluation Service (ORES) was started in 2015 as a project of the Wikimedia Foundation, and provides a revision score against machine learning models that have been trained in order to report article quality or vandalism. This is used in tools such as ClueBot NG to help immediately revert vandalism, or in evaluation tools like the Program and Events Dashboard to measure the outcomes of classwork, edit-a-thons, or organized editing campaigns.
Text translation[edit]
Guidance can be found at Help:Translation#English Wikipedia policy requirements. There is a Content Translation Tool used across Wikimedia projects that can use the output of machine translation from one Wikipedia article to another, using services like Google Translate. However, on the English Wikipedia, it currently states that "machine translation is disabled for all users and this tool is limited to extended confirmed editors." As a result, only manual translation on the English Wikipedia is supported by the tool, though some users have used translation to Simple English as a workaround. Relatedly, there is a section of the Help:Translation page with the broad advice: "avoid machine translations." However, this guidance was last edited in 2016, and the state of the art for machine translation has advanced significantly since then, meriting a re-examination of that advice.
Article text generation[edit]
The explosion of interest in ChatGPT in 2022 has led to increased curiosity in using generative AI to help compose Wikipedia articles. The status of machine-generated text from tools such as ChatGPT is generally accepted to be public domain, so the copyright issues are not a blocker to using the generated text from a legal standpoint. These issues are generally governed by Help:Adding open license text to Wikipedia#Converting and adding open license text to Wikipedia, which advises to make sure content is adjusted for style and that reliable sources are used. Conversations on the Village Pump and in some test articles (i.e. Artwork title) have noted positive aspects of machine generated text, but a serious warning that content must be checked for facts and accuracy and never used straight from ChatGPT.
A good general page looking at the issues can be found at: Wikipedia:Using neural network language models on Wikipedia.
A major community discussion took place on Village Pump (policy) found at: Wikipedia:Village_pump_(policy)/Archive_179#Wikipedia_response_to_chatbot-generated_content
Some user experiences can be found here:
- Talk:Artwork title
- User:JPxG/LLM demonstration
- User:Fuzheado/ChatGPT - also: experiments with generating Wikidata Quickstatements from fuzzy date descriptions
- User:DraconicDark/ChatGPT
- User:BrokenSegue - Wikidata:Wwwyzzerdd and Psychiq Wikidata game that uses distilBERT and ML, analyzing Wikipedia categories.
Images and Commons[edit]
Image metadata – There have been efforts from GLAM institutions to help supplement image keyword data with machine learning efforts. Among them include:
- Computer aided tagging Started in 2019, "The computer-aided tagging tool is a feature in development by the Structured Data on Commons team to assist community members in identifying and labeling depicts statements for Commons files." See: Commons:Structured_data/Computer-aided_tagging
- Metropolitan Museum of Art Tagging - This project used Met Museum tagging info to train a machine learning system to help predict new "depiction" recommendations for Wikidata. This resulted in a new Wikidata Game that helped add more than 7,000 new depiction (P180) statements to Wikidata. See the Met Museum blog post by Andrew Lih: "Combining AI and Human Judgment to Build Knowledge about Art on a Global Scale," March 4, 2019, [1]
Image generation
- Wikimedia Commons and AI generated media
- AI images and German Wikipedia, results of a meeting
- A Battle for Reality, video essay on AI images and Wikipedia
See also[edit]
- m:Wikilegal/Copyright Analysis of ChatGPT
- Initial version of Artwork title, a surviving article developed from raw LLM output
- Should ChatGPT Be Used to Write Wikipedia Articles?, a Slate article which largely deals with the history and implications of 'Artwork title'
General[edit]
- Lih, Andrew (March 4, 2019). "Combining AI and Human Judgment to Build Knowledge about Art on a Global Scale". Metropolitan Museum of Art.
Wikimedia[edit]
- Morgan, Janathan T. (18 July 2019). "Designing ethically with AI: How Wikimedia can harness machine learning in a responsible and human-centered way". WIkimedia Foundation.
- Redi, Miriam (14 March 2018). "How we're using machine learning to visually enrich Wikidata". Wikimedia Foundation.
- meta:Research:Ethical and human-centered AI