40% on cybench by EOY 2024 | Manifold

40% on cybench by EOY 2024

Plus

4

Ṁ320

Jan 1

36%

chance

1D

1W

1M

ALL

https://www.arxiv.org/abs/2408.08926

right now like 20% is SOTA (unguided)

due to the nature of agent benchmark revisions, i won’t trade on this market

This question is managed and resolved by Manifold.

#Technical AI Timelines

Get

1,000

and

3.00

Sort by:

bought Ṁ10 NO

I guess this is about the "Unguided Performance" in the paper?

yes

Related questions

What will be the best score on Cybench by December 31st 2025?

Will this market > 50% by the EOY 2024?

What will be the best score on the WebArena benchmark before 2025?

🆒CoolFold 25 Challenge: What will these 25 values be at EOY 2025?

Who will die by EOY 2025

80% on SWE-Bench Verified by Jan 1 2025

-6% 1d12% chance

Who will have the highest Single-Core Geekbench score at the end of 2024?

Will over 25% of ESPR cohorts of 2020-2024 have manifold.markets accounts by EOY 2024?

Will any AI reach 20%+ performance on FrontierMath by December 31st 2026?

6 or more stocks in the top 20 by number of traders at EOY 2024?

Related questions

What will be the best score on Cybench by December 31st 2025?

80% on SWE-Bench Verified by Jan 1 2025

Will this market > 50% by the EOY 2024?

Who will have the highest Single-Core Geekbench score at the end of 2024?

What will be the best score on the WebArena benchmark before 2025?

Will over 25% of ESPR cohorts of 2020-2024 have manifold.markets accounts by EOY 2024?

🆒CoolFold 25 Challenge: What will these 25 values be at EOY 2025?

Will any AI reach 20%+ performance on FrontierMath by December 31st 2026?

Who will die by EOY 2025

6 or more stocks in the top 20 by number of traders at EOY 2024?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules