OpenAI says new GPT-4 can beat most people's SAT scores
If what ChatGPT developer OpenAI has to say, the latest version of its AI software might have no problem getting into college.
That's because on Tuesday, OpenAI said its new GPT-4 Large Language Model can get a better score on the SAT exam than more than 90% of all people. OpenAI said GPT-4 scored in the 93rd percentile on a simulated SAT reading test, and hit the 89th percentile on a simulated SAT math exam. GPT-4 also scored in the 90th percentile on a simulated bar exam.
OpenAI has become the poster child, in a way, for the AI market since Microsoft (NASDAQ:MSFT) made what was described as a "multi-billion dollar, multi-year" investment in OpenAI in January. In February, Microsoft (MSFT) began integrating ChatGPT into its Bing search engine and Edge browser, and is in the process of making ChatGPT part of its applications for mobile devices running on Apple's (AAPL) iOS and Google's (GOOG) Android operating systems.
As part of its Tuesday announcement, OpenAI said GPT-4 exhibits "human-level performance" on a number of "professional and academic benchmarks." OpenAI said that is has been using GPT-4 in its own company functions such as support, sales, programming and content moderation, and it is also using it "to assist humas in evaluating AI outputs, [which is] starting the second phase in our alignment strategy."
In spite of the the potential for GPT-4, OpenAI acknowledged that the technology isn't perfect.
Like previous GPT models, the GPT-4 base model was trained to predict the next word in a document, and was trained using publicly available data," OpenAI said, in a statement. "So when prompted with a question, the base model can respond in a wide variety of ways that might be far from a user's intent."
In order to cut down on those potential problems, OpenAI said it would "fine-tune the model’s behavior using reinforcement learning with human feedback."
Meanwhile, AI rival Google (GOOG) on Tuesday showed off a set of new generative AI tools workplace and Google Cloud environments.
Now read: Google Unveils Generative AI Tools For Workspace And GCP