What score will o1-pro achieve on FrontierMath?
Basic
4
Ṁ386Jan 16
65%
0-4%
8%
5%-9%
8%
10-19%
8%
20-49%
10%
50+%
This market resolves as soon as OpenAI's o1-pro is tested on FrontierMath by a reputable source. Currently, no model achieves even 2%, as noted on page 9 of https://arxiv.org/pdf/2411.04872
I will not bet in this market.
An introduction to FrontierMath can be found here https://epoch.ai/frontiermath
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
70% chance
Will a Chinese-made AI beat o3's December score on Frontier Math by the end of 2025?
53% chance
Will o1 score ≥60% on the REBUS benchmark?
57% chance
What will be the best performance on FrontierMath by December 31st 2025?
By when will AI score >= 80% on FrontierMath
Will Alphaproof achieve >30% performance on the FrontierMath benchmark before 2026?
34% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
62% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
43% chance
Will any AI reach 20%+ performance on FrontierMath by December 31st 2026?
96% chance
Will an AI score over 30% on FrontierMath Benchmark in 2025
85% chance