![](/_next/image?url=https%3A%2F%2Ffirebasestorage.googleapis.com%2Fv0%2Fb%2Fmantic-markets.appspot.com%2Fo%2Fuser-images%252Fdefault%252FY6ecfJdtln.webp%3Falt%3Dmedia%26token%3D3cf0c44b-4618-4030-8023-f20fe2b611a1&w=3840&q=75)
Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)
Basic
54
Ṁ10kDec 30
19%
chance
1D
1W
1M
ALL
I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at any point in 2024 and keep it for a full week
![](https://firebasestorage.googleapis.com/v0/b/mantic-markets.appspot.com/o/user-images%2Fdefault%2FuoLQsWp6QL.png?alt=media&token=2b9b32af-2838-4403-b7dc-42b90647dd56)
Get Ṁ600 play money
Sort by:
@Soli I assume by your comment on a similar market that here you're resolving based on elo rather than "Rank." Can you clarify?
command r plus is already surpassing gpt4 on some benchmarks: https://txt.cohere.com/command-r-plus-microsoft-azure/
Related questions
Which companies will outrank OpenAI on ChatBot Arena in 2024? (>= week)
Which companies will achieve a higher ELO rating than OpenAI on ChatBot Arena in 2024? ( >= week)
Will any open-source model rank in the top 3 on Chatbot Arena at the end of 2024?
12% chance
Will OpenAI be on the top of the Chatbot Arena's LLM Leaderboard until EOY 2024?
31% chance
Which companies will outrank or tie with OpenAI on ChatBot Arena in 2024? (>= week)
What will the highest elo of an open-source model on chatbot arena be at the end of 2024?
0.00
Highest Chatbot Arena Elo rating of an open-source model during 2024
Will OpenAI launch a significantly better model for ChatGPT paying users in 2024? (>= 100 points diff on ChatBot Arena)
57% chance
Will GPT-4-Turbo be ranked in the top 20 on the Chatbot Arena Leaderboard at the end of 2025?
38% chance
Which companies will rank in top 10 on Chatbot Arena at the end of 2024?