Inkling:我们的开放权重模型
Inkling: Our Open-Weights Model

原始链接: https://thinkingmachines.ai/news/introducing-inkling/

该组织推出了 **Inkling**,这是一个全新的开放权重多模态基础模型,旨在通过定制化来扩展人类判断力。Inkling 构建为拥有 9750 亿参数的混合专家(Mixture-of-Experts)Transformer 模型,支持 100 万 token 的上下文窗口,并能原生处理文本、图像、音频和视频。 主要特性包括: * **可控效率:** 该模型提供可调节的“思考力度”,允许用户针对特定工作流程平衡性能、成本和延迟。 * **智能体能力:** Inkling 在编程、工具使用和长期优化循环方面表现出色,其具备的自我引导微调能力即是证明。 * **可信度:** 在训练过程中,该模型着重于校准和抗审查能力,并利用自动评分标准和事实核查器来减少幻觉。 * **易用性:** Inkling 可在 Tinker 平台上进行微调;目前,其轻量级版本 **Inkling-Small**(120 亿激活参数)正处于预览阶段。 为促进推广,该模型已与 Hugging Face、Together 和 vLLM 等主流平台集成。该公司将 Inkling 视为新系列模型的首作,旨在将其定位为高度适应性的基础,以解决通用模型在专业现实场景中表现不足的问题。

Thinking Machines 发布 “Inkling” 后,在 Hacker News 上引发了关于美国开源权重模型可行性的热烈讨论。许多用户对此表示乐观,认为 Inkling 是能够与 DeepSeek 和 GLM 等中国主流模型抗衡的必要本土产品。 讨论主要集中在以下几个核心议题: * **性能与基准测试:** 一些批评者指出,Inkling 在传统基准测试中落后于 GLM 5.2 等顶尖模型;但支持者认为,实际应用场景(特别是智能体工作流和多模态任务)的表现往往与静态评分存在差异。 * **商业可行性:** 参与者质疑开源权重公司的“护城河”,讨论能否通过微调 API、托管服务或企业集成来创收。人们对于这种商业模式是可持续的,还是仅仅属于“风投慈善”持怀疑态度。 * **市场背景:** 用户指出该领域正处于快速发展阶段,并对即将发布的 “Inkling-Small” 表示期待。虽然有些人仍怀疑初创公司是否具备挑战资源密集型实验室的能力,但另一些人认为,该模型证明了训练的“护城河”比预想的要小,这有助于构建一个更具竞争力和多样性的 AI 生态系统。
相关文章

原文

Our mission is to build AI that extends human will and judgment. We have developed a platform that lets anyone customize models, previewed an AI system built for interactive collaboration, and published novel research. Today we are advancing our mission by releasing a model we trained from scratch with the full weights available, so that people can make it their own.

Our model, called Inkling, is a Mixture-of-Experts transformer with 975B total parameters, 41B active. It supports a context window of up to 1M tokens. It was pretrained on 45 trillion tokens of text, images, audio and video. It is the first in a family of models of different sizes: alongside it we are sharing a preview of Inkling-Small, a lighter-weight model with 12B active parameters, trained with a similar recipe, that achieves strong performance with even lower cost and latency.

Inkling reasons natively over text, images, and audio, and balances cost with performance through efficient and controllable thinking effort. We trained it to be a broad, balanced foundation model: strong across many domains, flexible enough to adapt. Inkling is not the strongest overall model available today, open or closed. Instead, a combination of qualities makes it a good open-weights base for customization: multimodal capabilities, efficient thinking, and availability on Tinker for fine-tuning. Inkling is just the start: our first release in a model family we will continue to build on.

We want to make customization accessible for more use cases, so Inkling is available for fine-tuning on Tinker today. Picking the right base model to fine-tune is a qualitative judgment that combines measurable benchmarks with the unique feel of a model that comes from playing with it. To enable the latter we’re adding the Inkling Playground in the Tinker console: a developer-facing interface for chatting with Inkling.

To show what customization means in practice, we asked Inkling to fine-tune itself. Using Tinker, the model wrote its own fine-tuning job, ran it, and evaluated the result:

inkling@tinker: self-finetuning

Build · inkling · tinker-prod

~/news/introducing-inkling/ 1.33.7

Start in OpenCode: Inkling runs inside the OpenCode harness.

Capabilities

Real-world applications require models with a wide range of capabilities that can be combined and improved with fine-tuning. We showcase what Inkling can do and how it measures up on important qualities such as trustworthiness and safety.

Generalist model

Inkling is designed to be broad. We trained it across agentic, reasoning, coding, instruction-following, factuality, vision, and audio tasks, rather than narrowly optimizing for one domain. That breadth matters for customization and real-world use: different users need models that can adapt to very different workflows, not just excel on benchmarks.

Spider chart comparing Inkling, Nemotron 3 Ultra, GLM 5.2, GPT 5.6 Sol, and Claude Fable 5 on ten evaluations scored from zero to one hundred. Inkling is shown with the heavier cobalt line. Evaluations without a reported model score are plotted at zero. Hover an evaluation to compare every model's score.

Inkling is a broad, balanced generalist model. Benchmark scores are shown on a shared 0–100 scale; higher is better. The results show competitive performance across text, agentic, multimodal, and audio evaluations, rather than a model narrowly optimized for one benchmark family. This breadth reflects Inkling’s intended role: a practical multimodal foundation model for customization across domains, workflows, and products.

Agentic coding and tool use

A strong base for fine-tuning needs to flexibly solve a wide variety of tasks with agentic tool use. Inkling scores well among open-weights models on most agentic benchmarks.

We trained Inkling to run inside a variety of coding and agent harnesses, and we randomized the tool set and schema during training to reduce sensitivity to any particular one. Inkling’s controllable thinking effort, described in the next section, can be set from within the harness.

Below are a few demos showcasing Inkling’s agentic coding and tool use and the artifacts it creates.

One-shot web app with embedded browser use

Inkling builds a functional web app in a single shot, then powers an embedded AI assistant that can operate the web app interface through natural language instructions.

Inkling one-shots a job-application web app from the prompt in the second tab, then a browser-use agent fills out the form from a saved profile.
Design Arena

Inkling was evaluated on Design Arena’s Agentic Web Dev leaderboard, where blinded human evaluators compare generated web apps head to head. It ranks among the strongest open-weight models.

Inkling’s position on Design Arena’s Agentic Web Dev leaderboard, a blinded human evaluation of generated apps.

Cohesively styled artifacts

Inkling creates multi-page artifacts with precise instruction following, accurate information, and cohesive styling and design throughout.

From the prompt in the second tab, Inkling produces a polished nine-page PDF food and travel journal — browse the actual document above.

Multiplayer game created through long refinement loop

Inkling refined an online snake game through 40 iterations of feedback from GPT Codex serving as a reviewer. The ability to sustain a long process of refinement and improve from feedback is crucial to creating the best collaborative work.

A multiplayer snake game generated by Inkling from the prompt in the second tab — real-time server, bots, leaderboard and all.

Controllable thinking effort

Test-time scaling and problem-solving are the core capability of every model, but that capacity is hard to capture with a single number. Developers fine-tuning models for a specialized task care as much about efficiency as about the max-effort performance on a public benchmark. Cost and latency are often binding constraints in real-world applications, and low latency in particular is crucial for enabling collaboration and improvement through iteration.

GLM-5.2 Kimi K2.6 Nemotron 3 Ultra Kimi K2.5 GPT-OSS (high)

Sweeping Inkling's effort setting from 0.2 to 0.99 traces its performance against mean generated tokens on Terminal Bench 2.1, HLE, and IFBench; competing models are shown at their default operating point. Inkling reaches a given score at fewer tokens — for example, it matches Nemotron 3 Ultra on Terminal Bench 2.1 at roughly a third of the tokens. *Humanity's Last Exam scores reflect an earlier checkpoint and run slightly below the final release.

Inkling supports controllable thinking effort, allowing you to balance performance with token efficiency. The chart above shows the effort/performance curve of Inkling as well as other open-weights models on a range of benchmarks: Terminal Bench 2.1 for agentic coding, HLE for advanced reasoning, and IFBench for instruction following. Inkling spends one third as many tokens to achieve the same performance as Nemotron 3 Ultra on Terminal Bench. Cost and latency matter for a model that you run millions of times and as part of longer workflows; looking at the full cost curve allows developers to choose the best model for each use case.

Multimodality

A major goal of Inkling’s design is to serve as the background reasoning model in the interaction models system we recently introduced. Interaction models enable the user to collaborate naturally, using voice and vision in real-time. This requires a model natively trained for broad multimodal capabilities.

Audio and vision benchmarks against specialist omni models (open- and closed-weight), reported at effort=0.99.

The multimodal components are trained from scratch on general-domain data. We opted for an encoder-free architecture for audio and vision inputs, consistent with the interaction model design. Audio signals are input as discrete dMel spectrograms

Inkling transcribes speech, follows spoken instructions, answers questions about recordings, and reasons over longer-form audio. These capabilities place it among the strongest open-weight audio models on VoiceBench, MMAU, and AudioMC. For vision, Inkling accepts images as input and can describe visual content, answer questions, and perform in-depth reasoning based on the provided visual information. It demonstrates strong performance on charts, diagrams, and mathematical visual reasoning tasks. During inference, Inkling can also leverage a Python tool to support image understanding through operations such as zooming and cropping, while seamlessly integrating visual reasoning with code-based reasoning.

As our first release, Inkling establishes a robust multimodal foundation for future work. We expect its multimodal capabilities to continue improving as we expand the model and training pipeline in subsequent iterations.

Epistemics

We trained Inkling for calibration, instruction following, and resistance to censorship, which we refer to collectively as the model’s epistemics.

Getting the facts right requires more than memorizing a large corpus of knowledge. A useful model must be well-calibrated, expressing the right amount of confidence in its answers — including on questions which aren’t yet settled. The latter is a crucial capability for prediction and forecasting, an important use-case where fine-tuned models have shown rapid improvement in recent months, outperforming frontier LLMs.

↑ higher is better; ↓ lower is better. ForecastBench values show mean ± standard error, from tests run June 30–July 13; Inkling reflects an earlier checkpoint.

Forecasting requires integrating multiple sources of information into a calibrated probability, a core skill for a model users can trust. A model that’s confident in every answer it gives, including when it’s missing info and confabulates, forces the user to double-check everything. A model that gives the appropriate measure of confidence is useful across more real-world domains where information is often conflicting, unreliable, or hard to find. We trained calibration with RL against proper scoring rules on a large corpus of resolved real-world questions.

The second component of a trustworthy model is instruction following, including on hard-to-verify, complex queries. We did RL with two automated graders: a rubric grader and factuality grader. The first grader scores each response against a checklist of what a good answer should contain. Rubrics can penalize errors in principle, but in practice they emphasize recall and can be hacked by models spraying plausibly relevant facts hoping to match rubric items. The claims grader verifies each factual claim in the response, penalizing claims that don’t check out. It performs agentic web search for claim verification, not relying solely on its own knowledge. Together, the two graders improve helpfulness and reduce hallucination at the same time, rather than trading one for the other.

These rewards don’t directly target calibrated uncertainty in long-form responses, so we added targeted datasets that do. The largest is short-form factual QA with abstention-aware rewards: answering only pays off when the model is likely to be right, so the optimal policy is to answer when confident and otherwise say “I don’t know” or give a hedged best guess. Some prompts encourage or forbid hedging, teaching the model to follow the user’s preference for a forced guess versus a calibrated non-answer.

Finally, we trained Inkling to answer directly on topics that may be subject to censorship. Cognition evaluated the model on their Propaganda and Censorship Eval

Safety

We trained Inkling to an internal spec of safe model behavior across all modalities. We then commissioned external safety testers to verify the results.

We evaluated Inkling’s safety in several areas. For dangerous capabilities — CBRN, cyber, and loss of control — we ran internal evaluations and enlisted external testers. We attended to human-AI threat vectors, including sycophancy, vulnerable users, and harmful manipulation, using internal evaluations and external testers.

Inkling shows the strongest built-in safeguards of any open-weights model we compared on FORTRESS, a benchmark that tests refusal of requests related to weapons and violence alongside benign look-alike queries. Inkling refused more harmful requests without over-refusing benign analogs. Inkling scores above 98% on StrongREJECT — a refusal test of unambiguous harmful requests — in line with other open and closed-weights models.

Safety is crucial for open-weights models. We’re continuing to study safety behavior and capability uplift in customizable models, including how safety behavior is impacted by fine-tuning on Tinker.

Benchmarking Inkling

We benchmark Inkling on a broad range of capabilities. All evals are run at effort 0.99 and temperature 1.0. All coding evals run with 256K max-token trajectory limit.

To improve consistency, we rely on externally reported evaluations for both internal and external models when applicable. Specifically, we use the score reported by Artificial Analysis for the following evals: Humanity’s Last Exam, GPQA Diamond, GDPVal, Tau 3 Banking, AA Omniscience, MMMU Pro.

*We assign a score of 0 to Terminal Bench 2.1 rollouts with solution contamination from web search. †We benchmarked Claude Fable 5 and GPT 5.6 Sol (max/xhigh) on CharXiv RQ (with python) using our internal Python harness.

The making of Inkling

Architecture

Inkling is a mixture-of-experts Transformer with a handful of departures from the common recipe, each chosen for efficiency and long-context performance.

The MoE design largely follows DeepSeek-V3. Each MoE layer contains 256 routed experts and 2 shared experts, with 6 routed experts active per token. Inkling uses a sigmoid-based router with an auxiliary-loss-free load-balancing bias; the scores of the selected routed experts and the shared experts are normalized jointly and used to weight their combined outputs.

For attention, we interleave sliding-window and global layers at a 5:1 ratio with 8 KV heads. We find that encoding position with a relative positional embedding

Training

Inkling was pretrained on 45 trillion tokens from a variety of content types, including text, images, audio and video. We trained Inkling with a hybrid optimization strategy — Muon for large matrix weights, Adam for other parameters — and hyperparameter schedules inspired by our previous research on modular manifolds. We coupled the weight decay strength to the square of the learning rate, which we found kept the overall size of the model weights stable across training horizons

We post-trained Inkling on a broad distribution of math, agentic code & tool use, audio, image, chat, and safety domains. To bootstrap post-training, we ran an initial SFT on synthetic data generated by open-weights models including Kimi K2.5. The bootstrap accounts for a small fraction of compute, with the majority being employed for large-scale RL on synthetic and human-created environments.

Inkling was our first major training effort and was trained on NVIDIA GB300 NVL72 systems. Future models will further push the scale of compute across pre-training, post-training and RL.

RL at scale

We relied on large-scale asynchronous RL to shape model behavior and improve its reasoning and overall performance. The chart below shows the model’s score on a held-out aggregate of reasoning evals such as AIME, HLE, GPQA, and others. We scaled RL to over 30M rollouts, with stable training sustained over two long continuous runs. Reasoning performance improved log-linearly throughout the entire process, resulting in a significant increase overall.

Reward on a held-out aggregate of reasoning evals — AIME, HLE, GPQA, and others — improves log-linearly over more than 30M RL rollouts, from SFT initialization to the released checkpoint.

We specified the model’s effort level on different samples by changing the system message and adjusting the per-token cost. This caused the model to use a different amount of tokens in different rollouts and learn the ability to control thinking effort.

We also observed an emergent shift in the reasoning style over the course of RL training. The chain of thought became more concise over time, dropping grammatical overhead while remaining comprehensible and leaving the final response unaffected. This wasn’t targeted by the reward — efficiency alone drove the compression. A similar effect was also recently noted by the Cognition team in the process of training SWE-1.7

The same chain of thought, early and late in RL. The late-RL trace drops articles and connectives — "We need to understand" becomes "We need determine" — while staying comprehensible and reaching the same answer.

Inkling-Small

Alongside Inkling we are sharing a preview of Inkling-Small, a 276B-parameter Mixture-of-Experts model (12B active, vs. 41B for Inkling) with a different performance/latency trade-off. Inkling-Small matches or exceeds its larger sibling on many benchmarks — the result of improvements we made to the pre-training data and recipe for the smaller model. The two models share the same scalable post-training stack applied on top.

Reasoning
HLEtext only 29.7% 29.6%
HLEwith tools 46.0% 46.6%
AIME 2026 97.1% 95.1%
GPQA Diamond 87.2% 88.3%
Agentic (coding)
SWEBench Verified 77.6% 77.4%
SWEBench ProPublic 54.3% 53.2%
Terminal Bench 2.1Best Harness 63.8%* 52.7%
Agentic (general)
Tau 3 Banking 23.7% 13.6%
MCP-Atlas 74.1% 74.9%
Factuality
SimpleQA Verified 43.9% 20.9%
Chat
IFBench 79.8% 83.4%
Global-MMLU-Lite 88.7% 86.8%
Vision
MMMU ProStandard 10 73.5% 73.1%
Charxiv RQ 78.1% 76.7%
Charxiv RQwith python 82.0% 83.4%
Audio
Audio MC 56.6% 49.6%
MMAU 77.2% 77.5%
VoiceBench 91.4% 90.0%
Safety
FORTRESSAdversarial 78.0% 75.6%
FORTRESSBenign 95.9% 94.1%
StrongREJECT 98.6% 98.8%

Both models reported at effort=0.99; the higher result in each row is highlighted. *We assign a score of 0 to Terminal Bench 2.1 rollouts with solution contamination from web search.

Early results show Inkling-Small performing close to Inkling on reasoning and agentic tasks. With 12B active parameters and controllable thinking effort, it is a natural fit for workloads where cost and latency matter such as coding, using LLMs to grade, or generating synthetic data for other models.

We are currently finishing the testing of Inkling-Small and will release its full weights once that work is complete.

Customizing Inkling

Many real-world problems aren’t solved well by even the best generalist models with the gap being closed by fine-tuning that utilizes an organization’s specialized knowledge. The experience of our Tinker customers points in the same direction. Our post-training and results of RL at scale suggest that Inkling is capable of rapidly learning from fine-tuning.

Inkling Availability

Inkling is available on Tinker today with context length options of 64K and 256K tokens. We are offering Inkling at a 50% discount for a limited time, with full pricing information available in our documentation.

To support Tinkerers fine-tuning with Inkling, we have updated our cookbook to natively support Inkling and have added three new cookbook recipes that showcase Inkling’s unique audio capabilities. We also released a tml-renderer renderer for reliably sampling and post-training with chat templates, tool calls, reasoning content, and multi-modal inputs.

To get a feel for the model before committing to a run, users can head to Inkling Playground in the Tinker console. The playground offers a chat interface with integrated agentic web search, free for a limited time.

We have partnered across the ecosystem to help customers deploy checkpoints fine-tuned on Tinker. Inkling is available via APIs on Together, Fireworks, Modal, Databricks, and Baseten. We worked with RadixArk to provide open-source inference and RL support in SGLang and Miles. We worked with Inferact to support inference in vLLM, with Lightseek for inference in TokenSpeed, and with Unsloth for inference in llama.cpp. Finally, we partnered with Hugging Face on integration with transformers.

Inkling’s full weights are on Hugging Face, both as the original checkpoint and as an NVFP4 checkpoint for efficient inference on NVIDIA Blackwell systems.

联系我们 contact @ memedata.com