Will an AI system beat humans in the GAIA benchmark in 2024?
Basic
11
Ṁ309Jan 1
11%
chance
1D
1W
1M
ALL
GAIA: a benchmark for General AI Assistants
paper: https://arxiv.org/abs/2311.12983
GPT4 scored only 15% compared to 92% for humans
I will resolve based on open source results or official reputable company announcements/papers.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
70% chance
Will an AI system beat humans in the GAIA benchmark before the end of 2025?
60% chance
By when will AIs perform at least as well as humans on GAIA?
Will AI pass the Winograd schema challenge by the end of 2024?
64% chance
What will be the best score on the GAIA benchmark before 2025?
64% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
62% chance
Will an AI score 1st place on International Math Olympiad (IMO) 2025?
37% chance
Will AI beat the best humans in competitive programming before the end of 2024?
7% chance
Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.
97% chance
Will AI outcompete best humans in competitive programming before the end of 2024?
8% chance