Which Benchmarks will GPT-5 be benchmarked against, when it is announced? | Manifold

Which Benchmarks will GPT-5 be benchmarked against, when it is announced?

Plus

9

Ṁ2470

2026

97%

SimpleQA

28%

GSM8K

71%

HumanEval

81%

MMLU

80%

GPQA

68%

MATH

52%

MGSM

32%

DROP

52%

Big-Bench-Hard

87%

SWE-Bench

Some flexibility on variations of specific benchmarks. eg SWE-Bench-Hard would resolve SWE-Bench YES.

This question is managed and resolved by Manifold.

#GPT-5 Speculation

#GPT-4 speculation

Get

1,000

and

3.00

Sort by:

Surely ARC !?

https://arcprize.org/

@bbb I can't add options, I might create a duplicate where i can in a bit.

Related questions

Will GPT-5 be released before Nov 2025?

+19% 1d60% chance

What will be true about GPT-5?

Will GPT-5 be released before Oct 2025?

+14% 1d51% chance

When GPT-5 will released?

Will GPT-5 be released before Dec 2025?

Will there be a GPT-4.5 model before GPT-5 is released?

Will GPT-5 be released before Sep 2025?

+15% 1d44% chance

What will be true about GPT-5? (See description)

Will it be revealed that GPT-5 was used for how GPT-5 will be released?

Will GPT-5 be released before Jul 2025?

Related questions

Will GPT-5 be released before Nov 2025?

Will there be a GPT-4.5 model before GPT-5 is released?

What will be true about GPT-5?

Will GPT-5 be released before Sep 2025?

Will GPT-5 be released before Oct 2025?

What will be true about GPT-5? (See description)

When GPT-5 will released?

Will it be revealed that GPT-5 was used for how GPT-5 will be released?

Will GPT-5 be released before Dec 2025?

Will GPT-5 be released before Jul 2025?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules