MMLU 99% #2: Will SOTA for MMLU (average) pass 99% by the start of 2025?

MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?

Will a open source pure Mamaba LLM surpass 82 MMLU on MMLU (5-shot) before end of year 2024?

What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?

Will a text model achieve 100% performance on the MMLU in five years?

MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?

BIG-bench accuracy 75% #2: Will SOTA for a single model on BIG-bench pass 75% by the start of 2025?

Will the transformer architecture be replaced in SOTA LLMs by 2028?

What will be true of the SOTA AI on the FrontierMath benchmark, before 2028?

Will the main LK99 market ever reach 99% EOY 2024