By the start of 2026, will I still think that transformers are the main architecture for tasks related to natural language processing?
Basic
6
Ṁ1352025
68%
chance
1D
1W
1M
ALL
My job is related to NLP, and I expect I will be able to judge the position on transformers in the field. No specific criteria, sorry, the question is just about my opinion.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Sort by:
@NathanHelmBurger I wonder if we can pin down specific predictions about what we believe will or won't change, then
@wadimiusz yeah, unclear. RWKV and Hyena seem like promising advances. As the large labs start getting more cagey about their exact techniques we might not even know which techniques they are using.
https://hazyresearch.stanford.edu/blog/2023-03-27-long-learning
Related questions
Related questions
Will there be an AI language model that strongly surpasses ChatGPT and other OpenAI models before the end of 2024?
13% chance
Will Google mostly catch up to OpenAI in LLM quality and neutralize ChatGPT's lead by the end of 2024?
19% chance
By the end of 2026, will we have transparency into any useful internal pattern within a Large Language Model whose semantics would have been unfamiliar to AI and cognitive science in 2006?
40% chance
Will Transformer based architectures still be SOTA for language modelling by 2026?
68% chance
Will there be realistic AI generated video from natural language descriptions by the start of 2025?
72% chance
Will transformers still be the dominant DL architecture in 2026?
61% chance
Will a new deep learning paradigm replace the transformer by the end of 2024?
16% chance
🐕 Will A.I. Achieve Significantly More, "Linguistic Temporal Understanding" by end of 2024?
47% chance
Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?
55% chance
Will any speech model exceed chatGPT interest? (by 2025)
70% chance