Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?
Premium
18
Ṁ11k2025
46%
chance
1D
1W
1M
ALL
This market evaluates whether OpenAI's models will reach a ≥90% performance on SimpleBench, a benchmark assessing AI's proficiency in fundamental tasks, by the end of 2025. This aligns with CEO Sam Altman's recent prediction that models will saturate benchmarks by the end of 2025.
Check the benchmark website and leaderboard:
https://simple-bench.com/
Check the video where AI Explained sent the challenge:
https://youtu.be/tGsBJhMbiIU?si=TtH3c6P72mhxeMn7
Check another similar market:
https://manifold.markets/HenryGeorge/will-any-model-get-above-human-leve
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Related questions
Related questions
Will there be an AI language model that strongly surpasses ChatGPT and other OpenAI models before the end of 2024?
3% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
48% chance
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
55% chance
Will openAI have the most accurate LLM across most benchmarks by EOY 2024?
37% chance
Will simple-bench scores be reported in a major AI lab paper or blog post by the end of 2024?
29% chance
Will OpenAI Release a Model Capable of Reliably performing Gradeschool Math from Reasoning by Jan 1, 2025?
79% chance
Will an AI SWE model score higher than 50% on SWE-bench in 2024?
20% chance
Will a single model achieve superhuman performance on all OpenAI gym environments by 2025?
25% chance
Will OpenAI be in the lead in the AGI race end of 2026?
42% chance
Will OpenAI and Google models have a 100+ point Elo lead in the Chatbot Arena Leaderboard at the end of 2024?
13% chance