Will Meta release an open source language model that outperforms GPT-4 by the end of 2024
Basic
19
Ṁ6402025
62%
chance
1D
1W
1M
ALL
Will resolve to YES if Meta releases an open source model that acheives a higher average score than GPT-4 on the following benchmarks by the end of 2024:
HellaSwag (few-shot): 0.953
MMLU (few-shot): 0.864
AI2 Reasoning Challenge (ARC): 0.963
Get Ṁ600 play money
Sort by:
Related news: Meta currently training Llama 3, and plans to ramp up to almost 600K H100s equivalent compute by the end of the year https://www.instagram.com/reel/C2QARHJR1sZ/.
Related questions
Will there be an AI language model that strongly surpasses ChatGPT and other OpenAI models before the end of 2024?
37% chance
Will an open source model beat GPT-4 in 2024?
65% chance
Will xAI release a model that matches or surpasses GPT4 performance in 2024?
65% chance
Will OpenAI release GPT-5 before the end of 2024?
46% chance
Will we have an open-source model better than GPT-4-Turbo before 2025?
69% chance
Will there be a OpenAI LLM known as GPT-4.5? by 2033
33% chance
Will OpenAI release GPT-5 before the end of 2024?
51% chance
Will there be an AI language model that surpasses ChatGPT and other OpenAI models before the end of 2025?
65% chance
Will there be a language model called GPT-5, released by OpenAI, this decade?
84% chance
Will a language model that runs locally on a consumer cellphone beat GPT4 by EOY 2026?
45% chance