Jump to content

GPTZero

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Citation bot (talk | contribs) at 00:59, 25 October 2023 (Alter: title, template type. Add: newspaper, magazine. Removed parameters. Some additions/deletions were parameter name changes. | Use this bot. Report bugs. | #UCB_CommandLine). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Not to be confused with ZeroGPT.
GPTZero
Developer(s)Edward Tian
Alex Cui
Initial release3 January 2023; 21 months ago (2023-01-03)
Written inPython
PlatformCloud computing
Websitegptzero.me

GPTZero is an artificial intelligence detection software developed to identify and analyze artificially generated text, specifically focusing on text produced by AI language models such as GPT-3.[1]

GPTZero was designed with the intention of helping maintain trust and accuracy in the education sector by trying to help distinguish between artificial intelligence and human-generated text.[2][3][4]

While the tool has been met with positive reception, its received criticism as well. There's also ongoing debate about the accuracy of AI detection tools, including GPTzero.[5]

Development

GPTZero was developed by Edward Tian, a Princeton University undergraduate student, and launched online in January 2023 in response to concerns about AI-generated content in academia and its potential impact on plagiarism.[6][7][8] Leveraging machine learning techniques and NLP algorithms, GPTZero has demonstrated capable of analyzing and classifying content with accuracy in some instances.[9]

The development process involved collaboration with AI experts and extensive testing on various datasets, including AI-generated content from GPT-3 and human-generated content.[10] GPTZero has received attention from academic institutions, news outlets, and the broader AI community for its ability to detect AI-generated content, which is essential for ensuring the integrity of academic work and other text-based content.[11]

Functionality

GPTZero uses perplexity and burstiness to determine if a passage was written by a bot.

In order to properly understand what constitutes "perplexity" and "burstiness", artificial intelligence has been trained through the analysis of an incredibly large amount of human work.[12]

Perplexity is how random the text in the sentence is, and whether the way the sentence is constructed is unusual or "surprising" for the application. It relies on language models, and the more such models, the higher the chance that the text was not written by a person.[13]

Burstiness compares sentences with each other, determining their similarity. Human text is more discontinuous, meaning we tend to write with more sentence variation than AI. Thus, if this variability does not correspond to the needed level, there could be a higher probability that the text is artificially composed.[14]

Use cases and applications

GPTzero is primarily used to try and detect instances of AI written text. It is currently being further developed to assist educators.[15] In October 2023, it was announced that GPTzero had partnered with the American Federation of Teachers. [16] Currently, GPTzero offers an AI text detection tool, and a Google Chrome extension called "Origin", which watches the history and keystrokes made in a Google doc.[17][18]

Reception and impact

The academic community has attempted using GPTZero to tackle concerns about AI-generated content for plagiarism.[14] Educators and institutions all over the world have adopted the tool.[13][12] Notable educational institutions, including Princeton University, have discussed the use of GPTZero to combat AI-generated content in academic settings, with mixed opinions.[8][19]

Media outlets such as NPR, The Washington Post, and The Guardian have covered GPTZero.[20][10][1][21] These articles have increased public awareness of the challenges AI-generated content poses. The software was met with mixed reactions, with some journalists citing that the tool was inaccurate[22].

The tool has self published case studies exploring models and exploits of AI detection, offering insights into its methodology and potential improvements.[23]

Future developments

GPTZero has raised over 3.5 million dollars in seed funding.[24][25] The company has outlined several future developments and enhancements to its technology. These include:

Expansion of Detection Capabilities: GPTZero aims to continuously improve its AI detection capabilities by refining its algorithms, incorporating advanced machine learning techniques, and expanding its training data to cover a wider range of content types and languages.[25]

Integration of New Technologies: GPTZero is exploring the integration of new technologies, such as natural language processing and computer vision, to enhance its content detection capabilities. These efforts are aimed to expand GPTZero to detect and identify AI-generated content in various forms, including text, images, and videos.[25]

Collaboration and Partnerships: GPTZero recognizes the importance of collaboration and partnerships in advancing the field of AI content detection. The company actively seeks collaborations with academic institutions, research organizations, and industry partners to foster knowledge exchange and contribute to the development of more robust content detection solutions.[25]

User-Friendly Tools and Plugins: GPTZero is committed to providing user-friendly tools and plugins that empower individuals and organizations to effectively detect AI-generated content. This includes the development of browser plugins, software integrations, and APIs that can be easily incorporated into existing content management systems and platforms.[24]

Enhanced Accuracy and Efficiency: GPTZero aims to continuously improve the accuracy and efficiency of its AI detection algorithms. Through ongoing research and development efforts, the company seeks to minimize false positives and false negatives, ensuring reliable and precise identification of AI-generated content.[24]

Doubts and criticisms

There are some doubts as to whether it is technically possible to detect text written by an AI large language model. [26]

In a March 2023 paper named "Can AI-Generated Text be Reliably Detected?",[27] computer scientists Vinu Sankar Sadasivan, Aounon Kumar, Sriram Balasubramanian, Wenxiao Wang, and Soheil Feizi from the University of Maryland demonstrate empirically and theoretically that several AI-text detectors are not reliable in practical scenarios. Accordingly, discretion is strongly recommended when teachers and analysts are using GPTZero and other AI text-detection tools to establish if any given prose has been written by an AI text generator.[28]

Other independent case studies and reports, such as an article published on the Washington Post[29] have acknowledged that GPTzero suffers from false positives. [30]

See also

References

  1. ^ a b "GPTZERO: A New Tool to Detect AI-Generated Content in ChatGPT". The Washington Post.
  2. ^ "What is GPTZERO? Detecting AI-generated Content". ILovePhD.
  3. ^ "How apps like GPTZero detect content written by A.I." CNBC. 2023-07-24. Retrieved 2023-09-21.
  4. ^ "GPTZero App Seeks to Thwart AI Plagiarism in Schools, Online Media". Bloomberg.com. 2023-05-08. Retrieved 2023-10-21.
  5. ^ "There's a Problem With That App That Detects GPT-Written Text: It's Not Very Accurate". Futurism. Retrieved 2023-10-21.
  6. ^ "How a 23-year-old college student built one of the leading AI detection tools". Business Insider. Retrieved 2023-09-21.
  7. ^ "Explained: What is GPTZero, how it works and how can it be used". The Times of India. Retrieved 2023-09-21.
  8. ^ a b "Edward Tian's GPTZERO Software Aims to Detect AI-Generated Plagiarism". The Daily Princetonian.
  9. ^ "GPTZERO: An App to Detect AI Authorship". The New Stack.
  10. ^ a b "GPTZERO: A New AI Detector Aims to Combat ChatGPT Plagiarism". NPR. 2023-01-09.
  11. ^ "Artificial Intelligence, ChatGPT, GPTZERO, and Higher Education". Princeton Alumni Weekly.
  12. ^ a b "What is GPTZERO? The ChatGPT Detection Tool Explained". Tech Learning.
  13. ^ a b "AI Detector for Educators: What is GPTZERO?". Jumpstart Magazine.
  14. ^ a b Tribune.com.pk. "GPTZero: A ChatGPT Detection Tool". The Express Tribune.
  15. ^ "American Federation of Teachers partners with AI identification platform, GPTZero - CBS News". www.cbsnews.com. 2023-10-17. Retrieved 2023-10-21.
  16. ^ "US Teachers Union Bans ChatGPT and Deploys GPTZero To Detect Cheating". MobileAppAaily. Retrieved 2023-10-21.
  17. ^ "Princeton grad's AI detection start-up launches, builds features to address false positives". The Princetonian. Retrieved 2023-10-21.
  18. ^ "Origin by GPTZero - ChatGPT and AI Detector". chrome.google.com. Retrieved 2023-10-21.
  19. ^ "GPTZero to help teachers deal with ChatGPT-generated student essays". The Indian Express. 2023-01-12. Retrieved 2023-09-21.
  20. ^ "What to do when you're accused of AI cheating". Washington Post. 2023-08-14. Retrieved 2023-09-21.
  21. ^ "College student claims app can detect essays written by chatbot ChatGPT". The Guardian.
  22. ^ "There's a Problem With That App That Detects GPT-Written Text: It's Not Very Accurate". Futurism. Retrieved 2023-10-21.
  23. ^ "GPTZERO Blogs". GPTZERO.
  24. ^ a b c "This AI detection tool raised $3.5 million to check the internet for computer-generated work". Fast Company. 2023.
  25. ^ a b c d Shrivastava, Rashi. "With Seed Funding Secured, AI Detection Tool GPTZero Launches New Browser Plugin". Forbes. Retrieved 2023-05-17.
  26. ^ "No reliable way to detect AI-generated text, boffins sigh". The Register. 2023-03-21. Retrieved 2023-09-25.
  27. ^ Vinu Sankar Sadasivan; Kumar, Aounon; Balasubramanian, Sriram; Wang, Wenxiao; Feizi, Soheil (2023-03-17). "Can AI-Generated Text be Reliably Detected?". arXiv:2303.11156 [cs.CL].
  28. ^ Knibbs, Kate. "Researchers Tested AI Watermarks—and Broke All of Them". Wired. ISSN 1059-1028. Retrieved 2023-10-21.
  29. ^ Fowler, Geoffrey (August 14, 2023). "Columnist". The Washington Post. p. 1. Retrieved 2023-10-20.
  30. ^ "GPTZero Case Study (Exploring False Positives)". GonzoKnows. 2023-02-19. Retrieved 2023-10-21.
Retrieved from "https://en.wikipedia.org/w/index.php?title=GPTZero&oldid=1181756316"