What will be the highest score achieved on SWE-Bench Verified in 2025?
Plus
13
Ṁ12002026
1D
1W
1M
ALL
9%
<70
31%
70-85 inclusive
60%
>85
https://openai.com/index/introducing-swe-bench-verified/
https://www.swebench.com/
Highest performance reported before 2026. Any run on https://www.swebench.com/ counts. Large AI company reported numbers count whether or not they're listed on swebench.com Other claimed scores will generally not be counted unless verified by a third party.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
What will be the best performance on SWE-bench Verified by December 31st 2025?
What will be the best normalized score achieved on the original 7 RE-Bench tasks by December 31st 2025?
What will be true of the SOTA AI on the FrontierMath benchmark, before 2026?
What will be the best score on Cybench by December 31st 2025?
What will be true of the SOTA AI on the FrontierMath benchmark, before 2028?
What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?
What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?
54% chance
AI resolves at least X% on SWE-bench WITH assistance, by 2028?
When will SWE-bench be solved?
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
69% chance