When "scary good" AI gets even better

by Jacob Solomon Mar 15, 2023 News
When "scary good" AI gets even better

The illustration is by Axios.

We got a reminder of how unprepared we are to deal with these new machines after Tuesday's release of Openai's new GPT-4.

The amazing computer systems that can now ace standardized tests are still prone to errors and biases.

GPT-4 is an updated, significantly more powerful version of the engine that powers Openai's chatGPT

  • While ChatGPT could score in the 10th percentile on the standard bar exam taken by lawyers, OpenAI says GPT-4 can score in the 90th percentile. GPT-4 is also able to pass most AP exams, OpenAI said.

Longer entries can be generated in the new version. An image can be used as a starting point.

  • But like its predecessor, it is only trained on information that was publicly available as of September 2021.
  • On the safety side, OpenAI says GPT-4 is 82% less likely to respond when asked for content it doesn't allow and 40% more likely to produce factual responses than GPT-3.5 in internal testing.

According to Microsoft, GPT-4 has been used to power the Bing search chatbot.

  • That may be your easiest route to using it right now, since OpenAI is limiting some access.
  • OpenAI said GPT-4 will be available in a limited capacity to paid ChatGPT Plus subscribers via chat.openai.com, and there is a waitlist for businesses and developers looking to incorporate GPT-4 via an API.

According to Greg Brockman, the technology is not perfect.

  • But it's already at a stage where it can help a lot of people, he said, noting its potential to expand access to education, as well as legal and medical information. "I'm just excited to see what people build," he said.

There are other advances in the field. The other artificial intelligence outfits made news Tuesday.

  • Anthropic, an OpenAI rival, formally announced Claude, its chatbot which is being used by a range of companies including DuckDuckGo, Notion and Quora, among others.
  • Google outlined how it will use generative AI to help businesses. It will offer tools that companies can use to allow generative AI engines to scour through corporate data. AI tools being added to Workspace will help summarize e-mail, craft marketing campaigns and rewrite documents.
  • Microsoft, meanwhile, has scheduled an event for Thursday to talk about how it will build generative AI into its business products, including Office apps, such as Word, Excel, PowerPoint and Outlook.

Even though society is still trying to come to grips with both its promise and potential pitfalls, artificial intelligence is moving forward.

  • The law has yet to catch up. Few laws specific to AI exist, although the EU has been working to craft a wide-ranging AI act designed to regulate use of the technology, especially in "high-risk" areas.
  • Businesses are still grappling with how the technologies might augment or replace human labor. Today's generative AI can do a convincing job of crafting marketing materials, summarizing text and transforming it into new genres. At the same time it is still prone to both making up facts and committing fairly basic math errors.

Critics are sounding alarm bells due to that.

  • Tristan Harris, the former Googler who now runs the Center for Humane Technology, is warning against making the same mistakes with the current generation of AI that were made in the early days of social media.
  • "Notice that once social media became entangled with society and its institutions (GDP, elections, journalism, children's identity) it became impossible to regulate," Harris tweeted on Monday. "We should set guardrails for safer AI deployment and research *before* AI gets entangled, rather than after."

Openai says GPT-4 improves on its predecessors not just in its capabilities, but also with more human-installed guardrails.

  • At the same time, GPT-4 has gotten good enough that even its makers say it's time to start considering the impact it could have in terms of job replacement.

Brockman is worried that people will trust GPT-4 more because of its higher accuracy.

  • OpenAI encourages discussion about the impacts of AI, both by lawmakers and broader society, Brockman said. "We believe there should be more AI regulation," he said, but added that's not sufficient: "You really need an educated public."