When will humanity's last exam be saturated? (>80%)
42
1kṀ80602030
9%
2025
45%
2026
24%
2027
5%
2028
3%
2029
2%
2030
11%
later / never
Resolves to the year in which an AI first achieves an accuracy of at least 80%.
Text-only models are allowed. o3-mini (high) is currently in the lead with an accuracy of 13.0%
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000Sort by:
What does this resolve to if it never gets >80%, e.g. if more than 20% of the questions are broken? I'm guessing "later"
Related questions
Related questions
Will OpenAI's o4 get above 50% on humanity's last exam?
48% chance
Humanity's Last Exam score in 2025?
58.3
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
What will be o3's score on Humanity's Last Exam?
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
60% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2028?
40% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2027?
39% chance
Will there be another benchmark/test after "Humanity's Last Exam"?
89% chance
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2027?
76% chance