Will the next LLM released by OpenAI be worse than GPT-4 at MMLU?
Plus
23
Ṁ1163Jan 1
16%
chance
1D
1W
1M
ALL
The next LLM = the next family of LLM in cases of doubt - an updated version of a previous model doesn't count as a new model for this market
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
Afaik OpenAI has not made a model worse than their previous model before. (gpt-3.5-turbo & text-davinci-003 perform about the same overall so i'm not counting that) and I'm pretty sure ada/babbage/curie/davinci were all released at the same time, and the best of those, davinci, was better than early gpt-3, so that wouldn't count either
Related questions
Related questions
Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?
6% chance
Will there be an open source LLM as good as GPT4 by the end of 2024?
68% chance
Will there be a OpenAI LLM known as GPT-4.5? by 2033
72% chance
Will there be an open source LLM as good as GPT4 by June 2024?
14% chance
When will OpenAI release a more capable LLM?
Will an open-source LLM beat or match GPT-4 by the end of 2024?
85% chance
Will Google have a better LLM than OpenAI by 2025?
33% chance
Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?
13% chance
Will OpenAI's next major LLM (after GPT-4) solve more than 2 of the first 5 new Project Euler problems?
45% chance
Will OpenAI have the best LLM in 2024?
84% chance