What will the top score on the Humanity Last Benchmark be when it is released?
Plus
7
Ṁ962Dec 31
70%
>10%
53%
>20%
31%
>30%
19%
>40%
9%
>50%
https://www.safe.ai/blog/humanitys-last-exam
Humanity's Last Exam is a new benchmark developed by CAIS and Scale AI to measure AI's proximity to expert-level capabilities. The goal is to create the world's most difficult AI test by gathering complex questions from experts across fields. The project invites experts to submit challenging questions, with accepted contributors offered co-authorship on the resulting paper and prizes from a $500,000 pool.
Currently, to qualify for the benchmark, all models must fail the submitted question.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will any model get above human level (92%) on the Simple Bench benchmark before September 1st, 2025.
52% chance
Will there be another benchmark/test after "Humanity's Last Exam"?
64% chance
Will an AI score over 30% on FrontierMath Benchmark in 2025
26% chance
What will be the best score on the WebArena benchmark before 2025?
47% chance
What will be the best score on the GAIA benchmark before 2025?
46% chance
What will be the best score on the GPQA benchmark before 2025?
82% chance
What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?
39% chance
Who will have the highest Single-Core Geekbench score at the end of 2024?
What will be the best score on the InterCode (Bash) benchmark before 2025?
58% chance
What will be the highest score of a bot based on an open-source LLM in the Motley Bot Challenge?
50% chance