Chatbot Arena Leaderboard or iterations/new versions of it as creator sees fit. If the project is altogether abandoned with no equivalent, the answers that have not yet resolved YES will resolve NO at EOY unless some replacement appears.
Feel free to add names, I will try to control them as they come in to avoid duplicates or other types of confusion. Feel free to add major labs that feel ~guaranteed to be top 10 at some point, which is why I focused on more interesting questions.
Since some of the labs are obscure, I appreciate input on name changes, acquisitions etc.
A name change would change the name of the answer too, and still count.
An acquisition, where the model takes the name of the buyer rather than the original company, would not count.
I feel a bit uncertain about this one and would appreciate input, seems like this could look very different depending on the nature of the buy.
If merger, I will generally try to go with whatever name is stated on the leaderboard.
If multiple shared #10 ranks, as has been the case in the past, any of those positions count.
If there are no longer ranked numbers, only top 10 spot/ELO would count. If same ELO as #10, but 10+th spot for some trivial/irrelevant reason, still resolves YES.
Answer resolves YES immediately when an update has been confirmed, no matter what duration it stays in top.
Any AI that hasn't been Top 10 before during 2025, resolves to NO at the end of the year.
I will not trade in this market, resolution might get messy through mergers/acquisitions, changes to the leaderboard, etc.
Let me know if you want to see improvements to criteria.
See top #1 market below:
/HenriThunberg/who-will-ever-rank-1-in-lmsys-chatb