Google Unveils Gemini 4 Argon, Retaking Benchmark Lead Over OpenAI and Anthropic (venturebeat.com)
- Reference: 0185912212
- News link: https://tech.slashdot.org/story/26/09/30/2244216/google-unveils-gemini-4-argon-retaking-benchmark-lead-over-openai-and-anthropic
- Source link: https://venturebeat.com/technology/google-unveils-gemini-4-argon-retaking-benchmark-lead-over-openai-and-anthropic-but-in-limited-release
> Google is not claiming that Gemini 4 Argon wins every benchmark. But across the benchmark table disclosed in the company's embargoed materials, Argon posts the highest score, or ties for the highest score, in more categories than GPT-6 Astra or Claude Opus 5.5. Across the 18 benchmarks Google disclosed, Argon leads outright on 12 and ties for first on one. GPT-6 Astra leads outright on three and ties Argon on one. Claude Opus 5.5 leads outright on two. That makes Argon the leading frontier model by total number of benchmark leads or top scores in Google's comparison set, even though the results show a still-close race in which OpenAI and Anthropic retain advantages in several important technical categories.
>
> [...] The result is a more nuanced claim than "best model across the board." Argon appears to have the broadest top-score profile among the three frontier models in Google's disclosed comparison, but GPT-6 Astra remains ahead in several software, science-terminal and computer-use tasks, while Claude Opus 5.5 remains ahead in terminal-agent and post-training workflows. For enterprise buyers, that means model choice is still workload-dependent, even if Argon now gives Google its strongest claim yet to overall frontier leadership by benchmark count. [...] Argon also expands Google's output ceiling. The company says the model supports an industry-leading 1 million output tokens, up from a previous 64,000-token limit. That is a notable distinction for agentic software engineering, audit, migration and legal-review workloads where the value of a model often depends on how long it can sustain a chain of work before handing control back to a human.
[1] https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-4-argon/
[2] https://venturebeat.com/technology/google-unveils-gemini-4-argon-retaking-benchmark-lead-over-openai-and-anthropic-but-in-limited-release
It's #10 on LMArena leaderboard (Score:3)
[1]Let's let someone else do the benchmark, how about? [arena.ai]
[1] https://arena.ai/leaderboard
Re: (Score:2)
Maybe in one of the agent categories? It seems poorer there. But under the category "Best Text Models", it's crushingly in the lead.
Re: (Score:2)
It's a 20 ELO lead in a category nobody cares about. Meh.
Re: (Score:2)
Most of the other frontiers are like 1 ELO apart, so yeah, 20 is a big lead.
Re: (Score:2)
That does not actually remove the problem with benchmarks. They are far too easy to game and it happens all the time.
Output tokens (Score:3)
"how long it can sustain a chain of work before handing control back to a human" or said plainly "before it fails with full speed wall break".
It's a race! (Score:4, Funny)
First one to pop the bubble is the "winner"
"Google Unveils Gemini 4 Argon" (Score:2)
No, the proper headline would be:
"Google Teases Gemini 4 Argon"
It's not been released, and it's not even clear if it will be.
Re: (Score:2)
So they essentially made some unsupported claims? Well.
Benchmarks (Score:4, Informative)
The trouble with benchmarks is that they are often gamed. So while this is interesting, one should remain a bit reserved, awaiting assessments more reflecting the way people use it.
Re: (Score:2)
Indeed. When tons of money is at stake, benchmarks are almost universally games and become meaningless. This is certainly the case here. Since most people do not understand the problem with benchmarks, they are still used to make claims that the benchmarks do not actually support.