Gemini 4 Carbon 是 Artificial Analysis Intelligence Index v5 的新榜首
Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5

原始链接: https://artificialanalysis.ai/articles/gemini-4-carbon-new-number-1

Google 的 Gemini 4 Carbon 以 59 分领跑 Artificial Analysis Intelligence Index v5,在 9 项评测中的 4 项排名第一,但在编程智能体方面位列 Claude Opus 5.5 之后。它改善了智能体知识工作,但仍落后于 Grok 4.7、Muse Wonder 和 Kimi K3.1 Pro。按标准定价,每次 Intelligence Index 任务成本为 7.76 美元,比 Claude Opus 5.5 低约 23%,每次任务使用 123k 输出 token。标准定价为每 100 万输入/输出 token 4/20 美元,提供 50% 发布折扣。它在 AA-Omniscience v1.1 上得 54 分,准确率为 58%,幻觉率为 11%。它支持 100 万 token 上下文窗口以及文本、图像、视频、语音的多模态输入和文本输出。它正在向部分用户推出,尚未公开可用。

Hacker News 用户对 Gemini 4 Carbon 在 Artificial Analysis 的 Intelligence Index v5 中排名第一表示怀疑,因为该模型尚未公开可用。许多人表示,谷歌最近的 Argon 发布版本使用限制低、推出缓慢且存在幻觉,因此很难相信 Carbon 的基准测试领先。评论者还质疑了 Artificial Analysis 的可信度,指出其指数更新和移除开源权重模型的行为似乎有利于封闭实验室。其他人则捍卫谷歌的研究和生态系统,同时指出其在非编码任务或科学解释方面的强性能。几位用户认为基准测试不如现实世界中的编码可靠性、可用性和成本重要;Opus 5.5 仍在编码领域领先。总体而言,该讨论将 Carbon 的排名第一视为暂时性的公关宣传,直到用户能够独立测试它。
相关文章

原文
See model page

Google’s Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5, and second only to Claude Opus 5.5 on the Artificial Analysis Coding Agent Index

Gemini 4 Carbon scores 59 on Intelligence Index v5, driven by leading performance in complex reasoning, knowledge, and scientific tasks. It also has large gains in coding and knowledge work, particularly when compared to other Gemini models, but it is not leading in all these areas.

As with launch of Gemini 4 Argon, Gemini 4 Carbon is being rolled out to selected users and is not yet publicly available. Google is offering a 50% launch discount, with no confirmed end date. All our charts and figures use standard pricing for both Gemini 4 Carbon and Argon.

Key results for Gemini 4 Carbon with high reasoning:

➤ Gemini 4 Carbon leads the Intelligence Index v5, with the #1 score in 4 of the 9 Index evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, AutomationBench-AA. Carbon makes substantial gains elsewhere but is not leading in coding and knowledge work

➤ Behind only Claude Opus 5.5 on coding agents: With Antigravity CLI, Gemini 4 Carbon (high) scores 59 only 3 points behind Claude Code with Claude Opus 5.5 (max, 62) on the Artificial Analysis Coding Agent Index. Carbon ranks second on both Terminal-Bench 4.0 (64%) and FrontierCode v1.1 (51%), behind Claude Opus 5.5 (max) at 56%. Google has historically underperformed in this area and so this improvement stands out.

➤ Improved agentic knowledge work, but not yet leading: On AA-Briefcase, Gemini 4 Carbon (high) scores 1609 Elo, a 126-point improvement over Gemini 4 Argon (high, 1483), but still behind models including Grok 4.7 (xhigh, 1638), Muse Wonder (max, 1659) and Kimi K3.1 Pro (1678). The largest gain comes from Presentation, up 293 Elo to 1598, alongside a 120-point improvement in Analytical Quality to 1671

➤ Lower Cost per Task than Claude Opus 5.5 for comparable overall intelligence: With standard pricing, Gemini 4 Carbon costs $7.76 per Intelligence Index task, ~23% less than Claude Opus 5.5 (max, $10.04) but ~1.2x GPT-6 Astra (max, $6.25). It uses 123k output tokens per task, 29% fewer than Claude Opus 5.5 (max, 173k). At the same $4/$20 standard pricing, its Cost per Task is in line with Gemini 4 Argon ($7.68), while scoring 9 points higher on the Intelligence Index

➤ Leading AA-Omniscience v1.1 score, with low hallucination: Gemini 4 Carbon scores 54 on our recently updated AA-Omniscience v1.1, 6 points ahead of Claude Opus 5.5 (max, 48) and 8 points ahead of Gemini 4 Argon (46). Accuracy (% correct) rises 10 points over Argon to 58%, while its hallucination rate rises from 4% to 11%. This is still the second lowest of any model, behind only Argon, compared with 50% for both Claude Opus 5.5 (max) and GPT-6 Astra (max)

Key model details:

➤ Context Window: 1M tokens

➤ Multimodality: Text, image, video, and speech input, with text output

➤ Pricing: $4/$20 per 1M input/output tokens, the same as Gemini 4 Argon’s standard pricing, with a 50% discount. Cached input tokens receive a 95% discount ($0.20 per 1M at standard pricing)

联系我们 contact @ memedata.com