When will Anthropic release a model called Claude 3.5 Opus and make it generally available?
Claude 3.5 Sonnet was released on June 20. Regarding future plans, Anthropic stated that "Our aim is to substantially improve the tradeoff curve between intelligence, speed, and cost every few months. To complete the Claude 3.5 model family, we’ll be releasing Claude 3.5 Haiku and Claude 3.5 Opus later this year."
This market resolves to December 2024 or later if Opus has not been released by the end of November (i.e. this market will not N/A if Opus is known to be cancelled).
@JaundicedBaboon I don't see evidence of that. My read is that the performance gain of a larger model relative to this Sonnet upgrade had minimal ROI for larger parameters.
We generally see convergence to "medium-big" model, small model, and in some cases, micro model across industry.
@JaundicedBaboon same price per token suggests same/similar parameters, though they could accept a lower margin or make other compensating optimizations. But an Opus would probably have several times more parameters (Sonnet is widely rumored to be overtrained/underparameterized relative to what's compute optimal).
@JoshYou I suspect the model could be larger and they are just taking more of a loss. Remember, they explicitly promised 3.5 Opus later in the year, so it seems reasonable to assume they did train a model they originally intended to release with that name.
If 3.5 Sonnet new is a different model than 3.5 Opus as you are suggesting, it implies that Anthropic spent order of hundreds of millions training 3.5 Opus only to decide to scrap it entirely. This seems unlikely
they may never release opus 3.5
https://x.com/_Mira___Mira_/status/1848745912140763497
@MalachiteEagle that are newer than the rumors floating around 1-2 days ago? (that ended up being about Gemini)
@JoeBoyle why would that make a slower release more strategically attractive?
I also do think it's rather gonna be released later, but for another reason:
I just don't expect anthropic to have that much of a lead towards the competition, especially OpenAI.
Claude 3.5 Sonnet is the best sota model out there already and I don't think they're able to just leap ahead out of nowhere with comparable access to data, compute, knowledge etc. which is available today, as the competing companies do have access to, too, currently.
And another reason is the formulation of their announcement to release the models
"[...] later this year".
Why would they write something like that if they intended to release it just a couple weeks or months after sonnet/the announcement? To me that sentence sounds very much like towards the end of the said time frame. Semantically and logically.
Why would one tell a fried you'll arrive at his place within one hour if you assumed to be there in 20 minutes?
That being said, I hope my comment doesn't convince anybody not to place a bet on a sooner release as I'm happy to take them ;)
@Felle It would make a slower release more attractive if the aim is to stay somewhere near the top of the leaderboards
Borrowing this from reddit and /u/RenoHadreas
Anthropic's safety announcement offers clues into Claude 3.5 Opus development timeline : ClaudeAI (reddit.com)
Anthropic has just released a blog post that gives us some interesting insights into their development of their upcoming model, Claude 3.5 Opus. Here's what we can piece together:
The announcement was released today, August 8, 2024.
They're developing a "next generation" AI safeguarding system that hasn't been publicly deployed yet.
They're launching a bug bounty program to test this new system before public deployment.
Anthropic is accepting applications for the bug bounty program until August 16, 2024, and will follow up with selected applicants "in the fall".
The bounty program focuses on finding "universal jailbreak" vulnerabilities in critical areas like CBRN and cybersecurity.
What we know about Claude 3.5 Opus:
Anthropic has already stated that it's coming "later this year" (2024).
This new safety testing initiative is likely part of the final steps before release.
The bug testing phase might be relatively short, given the "later this year" timeline. We could potentially see Claude 3.5 Opus released sometime in Q4 2024, possibly November or December. A late Q3 2024 release is also plausible.
Link to the blog post: https://www.anthropic.com/news/model-safety-bug-bounty
Anybody know why August or September increased so much?