Will second-order optimizers displace first-order optimizers for training LLMs by 2030?
24
Ṁ16842029
38%
chance
1D
1W
1M
ALL
Will something like Shampoo become the default instead of Adam?
Get Ṁ1,000 play money
Related questions
Related questions
Will Google have a better LLM than OpenAI by 2025?
35% chance
Will Europe be competitive in the LLM race compared to OpenAI or Google at the end of 2024?
7% chance
Will LLMs mostly overcome the Reversal Curse by the end of 2025?
64% chance
Will LLMs be better than typical white-collar workers on all computer tasks before 2026?
35% chance
Will reinforcement learning overtake LMs on math before 2028?
63% chance
Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?
42% chance
Will any widely used LLM be pre-trained with abstract synthetic data before 2030?
74% chance
LLMs widely used in economics modeling by the end of 2026?
43% chance
Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?
58% chance
By 2028 will we be able to identify distinct submodules/algorithms within LLMs?
75% chance