🐕 OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024? | Manifold

🐕 OpenLLMs: Will Any Open Source LLM on the HuggingFace OpenLLM Leaderboard Significantly Gain in Avg Score by YE 2024?

Basic

9

Ṁ401

Jan 1

49%

chance

1D

1W

1M

ALL

Previous market on this topic:

https://manifold.markets/PatrickDelaney/open-source-llms-will-any-open-sour

I reserve the right to upgrade the metric used if the one used in the above market is stale. I aim to have things finalized for this market by end of January 2024.

This question is managed and resolved by Manifold.

#Third Party Validated, Predictive Markets: AI

Get

1,000

and

3.00

Sort by:

taking my money out because i feel like these leaderboards are too fake

predicts YES

What was the top A value at the start of the year?

@ashly_webb 76.72 https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

reposted

?

Does the addition of a new, better open source model count?

@ashly_webb Yes, because the question is, will ANY OpenLLM...so any includes future, doesn't exist yet.

Related questions

When will an LLM enter and maintain 1360 ELO on LMSys for 10,000 votes? OpenAI? Gemini? Anthropic?

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Will OpenAI have the best LLM in 2024?

Will Google have a better LLM than OpenAI by 2025?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?

Will an opensource LLM on huggingface beat an average human at the most common LLM benchmarks by July 1, 2024?

What will be true of OpenAI's best LLM by EOY 2025?

When will a non-Transformer model become the top open source LLM?

Who will have the best LLM at the end of 2024 (as decided by ChatBot Arena Ranks)?

Related questions

When will an LLM enter and maintain 1360 ELO on LMSys for 10,000 votes? OpenAI? Gemini? Anthropic?

Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Will an opensource LLM on huggingface beat an average human at the most common LLM benchmarks by July 1, 2024?

Will OpenAI have the best LLM in 2024?

What will be true of OpenAI's best LLM by EOY 2025?

Will Google have a better LLM than OpenAI by 2025?

When will a non-Transformer model become the top open source LLM?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Who will have the best LLM at the end of 2024 (as decided by ChatBot Arena Ranks)?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules