I haven't seen any breakthroughs...

@NivlacM I sold for liquid mana

the model cannot be solely trained on chess data

It is not clear what do you mean by that. What if training involves 1B Stockfish games, plus the works of Shakespeare? Do you count that as solely chess data or not?

I did some testing with o1, but it fails at pretty simple puzzles.

He's solving the ARC AGI challenge in 2 weeks, so get your bets in:

@Mira LOL

Regarding "A fine-tune of an LLM is ok, but the model cannot be solely trained on chess data":

I assume that if it's fine-tuned on 99% chess data and 1% something else it still wouldn't count? Do you mean, it cannot be trained on any data significantly biased towards chess?

I understand it as "the model must have/retain substantial natural language capabilities"

So a Gato-style hybrid of chess engine and chatbot would qualify?? That's a much weaker condition than how I understood the intent.

Note that there are other conditions that rule out bundling a chess engine with an LLM. In fact the condition is IMHO quite strict. If you have something that plays chess and is also a language model, you almost certainly can improve chess performance by sacrificing language. So the market requires that a) it is possible to improve chess state of the art with LLMs and b) someone publishes such an LLM before LLM-derived, chess-specialized technology becomes the new state of the art in chess engines (because the comparison is always against the state of the art engine)

Gato is not "bundling". You train a model to do both chess position evaluation and text prediction (e.g. each task makes half of the training set), it's obviously doable. I guess your interpretation of the question is: can we show an instance where the language ability makes chess ability at least a little better, rather than worse. It's a valid question, but much weaker than what I understood the question to be. It would be nice if market creator chimes in on this.

@someonec5dd Are you sure it is reasonable to bet "2024, by election day" substantially higher than "2025 or earlier"? Thanks for the free mana though...

brother u aint beatin alpha zero with an llm anytime soon 😭😭😭

Who TF is buying YES on "before election day"? Am I missing some kind of joke?

A) No reason for "before election day" to be higher than "2025 or earlier" and

B) The resolution criteria are very strict - there's very little computation you can do with an LLM on "a commodity desktop or equivalent to the TCEC or other popular chess software tournament standards" in "Blitz time controls".

Also no real reason for non-search methods to beat search at any point as Chess fundamentally is search, but that's a different question...

why tf are anyone betting YES on any of the dates...

@AIBear Elections being canceled perhaps?

sell order at 11%

stockfish already uses a deep neural net to evaluate terminal nodes in the search. But it is specialized for chess. A net trained on internet text will never be competitive with the specialized one.

Actually, Stockfish doesn’t have a deep NN, it uses NNUE, I think with like four layers these days. LeelaChessZero does have a deep net so your point still stands (and it prolly would even if Leela didn’t have a deep net)

But, concept pinning!

Interesting error, maybe gone after my next trade. 😁

Doing my bit to stop this absurdity

Maybe the question should say stockfish not "all chess bots"

@Daniel_MC Nope, see the description. Each option resolves against the top engine at the time.

Ah my bad