Jump to content

GPT-4

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Labdajiwa (talk | contribs) at 11:00, 15 March 2023 (Encourage secondary sources). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Generative Pre-trained Transformer 4 (GPT-4)
Original author(s)OpenAI
Initial releaseMarch 14, 2023
TypeAutoregressive transformer language model
Websiteopenai.com/gpt-4 Edit this on Wikidata

GPT-4 (Generative Pre-trained Transformer 4) is a multimodal large language model created by OpenAI,[1] the fourth in the GPT series. It was released on March 14, 2023, and will be available via API and for ChatGPT Plus users.[1] Microsoft confirmed that versions of Bing using GPT had in fact been using GPT-4 before its official release.[2] As a transformer, GPT-4 was pretrained to predict the next token (using both public data and "data licensed from third-party providers"), and was then fine-tuned with reinforcement learning from human feedback.[3]: 2 

The GPT-4 technical report explicitly refrained from specifying the model size, citing "the competitive landscape and the safety implications of large-scale models".[3] The Verge cited rumors that GPT-4 would substantially increase the parameter count from GPT-3's 175 billion to 100 trillion, which OpenAI CEO Sam Altman described as "complete bullshit".[4] U.S. Representatives Don Beyer and Ted Lieu confirmed to the New York Times that Altman visited Congress in January 2023 to demonstrate GPT-4 and its improved "security controls" compared to other AI models.[5]

OpenAI wrote in their blog post announcing GPT-4 that "GPT-4 is more reliable, creative, and able to handle much more nuanced instructions than GPT-3.5."[6] It can read, analyze, or generate up to 25,000 words of text, which is a significant improvement over previous versions of the technology.[1][7] The New York Times wrote that GPT-4 showed impressive improvements in accuracy compared to GPT-3.5, had gained the ability to summarize and comment on images, was able to summarize complicated texts, passed a bar exam and several standardized tests, but still showed a tendency to hallucinate answers.[8]

References

  1. ^ a b c Edwards, Benj (March 14, 2023). "OpenAI's GPT-4 exhibits "human-level performance" on professional benchmarks". Ars Technica. Retrieved March 15, 2023.
  2. ^ Lardinois, Frederic (March 14, 2023). "Microsoft's new Bing was using GPT-4 all along". TechCrunch. Archived from the original on March 15, 2023. Retrieved March 14, 2023.
  3. ^ a b "GPT-4 Technical Report" (PDF). OpenAI. 2023. Archived (PDF) from the original on March 14, 2023. Retrieved March 14, 2023.
  4. ^ Vincent, James (January 18, 2023). "OpenAI CEO Sam Altman on GPT-4: "people are begging to be disappointed and they will be"". The Verge. Archived from the original on January 26, 2023. Retrieved January 27, 2023.
  5. ^ Kang, Cecilia (March 3, 2023). "As A.I. Booms, Lawmakers Struggle to Understand the Technology". The New York Times. Archived from the original on March 3, 2023. Retrieved March 3, 2023.
  6. ^ Wiggers, Kyle (March 14, 2023). "OpenAI releases GPT-4, a multimodal AI that it claims is state-of-the-art". TechCrunch. Retrieved March 15, 2023.
  7. ^ GPT-4 Developer Livestream (Videotape). OpenAI. March 14, 2023. Archived from the original on March 14, 2023. Retrieved 14 March 2023 – via YouTube.
  8. ^ Metz, Cade; Collins, Keith (March 14, 2023). "10 Ways GPT-4 Is Impressive but Still Flawed". The New York Times. Archived from the original on March 14, 2023. Retrieved March 14, 2023.