Will an AI system beat humans in the GAIA benchmark before the end of 2025?
Basic
6
Ṁ1382026
38%
chance
1D
1W
1M
ALL
GAIA: a benchmark for General AI Assistants
paper: https://arxiv.org/abs/2311.12983
GPT4 scored only 15% compared to 92% for humans
I will resolve based on open source results or official reputable company announcements/papers.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
Good market. A good resolution source might be the average score on the test set https://huggingface.co/spaces/gaia-benchmark/leaderboard
I would be interested in a market that ends at the end of 2029.
Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
61% chance
Will an AI achieve >30% performance on the FrontierMath benchmark before 2026?
28% chance
Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.
48% chance
By when will AIs perform at least as well as humans on GAIA?
Will an AI system beat humans in the GAIA benchmark in 2024?
11% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
32% chance
Will an AI score 1st place on International Math Olympiad (IMO) 2025?
25% chance
Will AI pass the Winograd schema challenge by the end of 2024?
66% chance
Which AI will be the best at the end of 2025?
What will be the best score on the GAIA benchmark before 2025?
46% chance