Will model weights obtaining >90% on the Winogrande benchmark become publicly available in 2024?
Mini
3
Ṁ21Dec 31
35%
chance
1D
1W
1M
ALL
I will use the leaderboard at https://paperswithcode.com/sota/common-sense-reasoning-on-winogrande unless someone has a better suggestion. Model weights do not have to be licensed without restrictions but must be available for download.
Get Ṁ600 play money
Related questions
Will Mistral-Large's model weights be available within 90 days of release?
5% chance
Will OpenAI release weights to a model designed to be easily interpretable (2024)?
33% chance
Will OpenAI open source the weights to one of the GPT family models in 2024?
14% chance
Will OpenAI allow near full access to the weights of their best-trained model to an external auditor by the end of 2030?
60% chance
Will there be a model that has a 75% win rate against the latest iteration of GPT-4 as of January 1st, 2025?
45% chance
Will Mistral release model weights that come close to GPT4 in 2024? (MMLU > 80)
Will Meta release the weights of Llama 3 405B by EOY 2024?
65% chance
Will OpenAI release the source code and model weights of any of its legacy GPT-3 models before 2025?
23% chance
Will a major AI lab announce that the weights of one of its models were compromised in a cyberattack before 2027?
65% chance
Will AI image generating models score >= 90% on Winoground by June 1, 2025?
81% chance