值得构建的未来属于人类——思维机器实验室
The Future Worth Building Is Human

原始链接: https://thinkingmachines.ai/blog/the-future-worth-building-is-human/

Thinking Machines 认为,人工智能的未来应以人为本,并反对当前行业向集中式、“固化”模型的趋势。该公司主张,生产性知识本质上是局部的、隐含的且分布式的。因此,人工智能的目标不应是取代人类专业知识或将其整合为单一的标准化智能,而应作为一种工具,用于培育独特的、组织特定的知识。 为了实现这一目标,Thinking Machines 正在构建可定制的模型,允许用户微调权重并影响核心行为。他们优先考虑“实时”、多模态的交互,而非传统的慢反馈界面,从而实现人工智能与人类判断协作共事的实时交互。 通过分散对齐方式,该公司旨在规避权力集中和价值观同质化的风险。他们提倡构建一个由多样化、竞争性模型组成的生态系统,以反映用户特定的价值观和目标。最终,他们的使命是开发能够扩展(而非取代)人类意志和判断力的技术,确保人工智能在能力不断增强的同时,始终作为一种赋能个体和组织保持自主生产力的合作伙伴。

Hacker News 关于“思维机器”(Thinking Machines)宣言的讨论,反映出人们对近期涌现的 AI 初创公司深感怀疑。尽管该公司宣称其使命是将人类置于人工智能的核心,但评论者大多认为该文本充斥着公关辞令,属于缺乏技术内涵的“AI 垃圾”。 讨论主要集中在以下三个矛盾点: 1. **身份与品牌:** 许多用户批评该公司“借尸还魂”,强行挪用 1980 年代标志性超级计算机公司的名称,认为这是历史无知或缺乏创意的表现。 2. **工具与替代:** 讨论的核心争议在于:大语言模型究竟是“大脑的机械外骨骼”(增强人类能力),还是通过自动化思考过程导致智力萎缩的工具? 3. **“安全”悖论:** 批评者质疑,一家 AI 公司如何在追求历史上导致自动化、经济替代及军事化应用的各种技术的同时,承诺优先保障人类利益。 总之,舆论共识表明,科技界已对抽象的宣言感到厌倦,他们要求公司提供切实的、革命性的产品,而非高谈阔论的哲学主张。
相关文章

原文

The mission of Thinking Machines is to build AI that extends human will and judgment.

Artificial intelligence can do more every day, but deciding what it should do is up to us: individuals, organizations, humanity as a whole. These decisions require knowledge and judgment that people acquire through continuous contact with the work, increasingly done alongside AI. Shaping the goals of advanced intelligence is also a continuous process of feedback, learning, and realignment.

Most AI in use today is trained in a handful of places and then frozen. It isn’t shaped by the people it serves, and doesn’t learn much from the work they do together. Extending human will and judgment calls for AIs as diverse and distributed as people themselves are. This is the path we have chosen.

To progress on that path, we are pursuing these technical directions:

  • We train strong models, advancing capabilities such as multimodal interaction and customizability. Sharp instruments extend human will, and human judgment needs to shape models that compete on the frontier.
  • We build tools that enable people to make AI their own, customizing models to serve their unique needs. This includes the ability to train model weights.
  • We develop interfaces that broaden the communication channel between human and machine, allowing personal judgment to continuously influence the work of AI.
  • We publish research for the scientific community, because the power to shape AI requires deep understanding of how it’s made.

We believe the future worth building is human — shaped by human knowledge, guided by human will, and decided by human judgment. What follows is the case for that future, and the work we’re doing to bring it about.

Bringing intelligence to knowledge

AI exists to serve the work that we do. This work runs on knowledge of how things are done and what is worth doing, knowledge that is generated continuously by people engaged in the work.

Think of a chef crafting a new recipe or a shopkeeper rearranging the items and prices on display. They are pursuing a complex set of goals and applying know-how that isn’t immediately legible to outsiders. This knowledge is constantly updated through feedback; it’s not a static repository that can be written into a database. It’s local — a different restaurant or shop pursues different outcomes by different means. The collective knowledge of shops and kitchens is scattered across every shopkeeper and chef.

The dispersion of knowledge is a collective strength; it’s the source of variety, adaptability, and resilience of the overall system. It’s the reason that free markets outperform planned economies. Central planning fails not because of insufficient intelligence, but because of the nature of productive knowledge: tacit, local, fleeting, and held privately by those who acquired it through their work.

There are domains where intelligence alone is sufficient, and where autonomous AI doesn’t require human participation to race ahead. Two examples are chess, where the strongest engines are trained purely on self-play, and math, where frontier models are solving long-standing problems on their own. These examples share two traits. First, the goal given to AI is static and expressible: to win a chess match, to prove a theorem. Second, these domains don’t contain hidden knowledge. The rules of chess and math are universal; the board is visible to all. Outside the board, intelligence alone is not enough.

For artificial intelligence to benefit from distributed knowledge, it must itself be distributed. Every organization is powered by the expert knowledge of its people, gained and expressed through their work. We believe in AI that helps the organization cultivate that unique knowledge, not AI that extracts a snapshot of it and replaces it with a standard offering. This cultivation is an ongoing process that requires AI to work with people, not in their stead.

In 2014, Toyota, long a master of the automated plant, brought its expert craftsmen back onto the line with the explicit goal of growing craftsmanship and knowledge. The man who led this, Mitsuru Kawai, put the reason this way: “To be the master of the machine, you have to have the knowledge and the skills to teach the machine.”

The work people do may change, and turn toward more of what only people bring, but the best organizations will make the fullest use of both. AI should enable each organization to be excellent in its own way, not to erase the differences between them.

We aim to bring intelligence to where knowledge is made and used. We build tools that enable everyone to fine-tune models with their unique knowledge, and to keep adapting the models as their knowledge evolves. We publish research and recipes that put this capability within reach of more people. We envision frontier AI as a collective, as diverse as the people it serves because it was shaped by them in each unique location.

Human participation is a technical challenge

Keeping people engaged in setting goals and sharing knowledge with AI doesn’t mean resisting automation for its own sake. What a machine does reliably on its own, it should do. But it should also know when to act alone and when to invite oversight and feedback, as people themselves do when working in teams. The best collaborators anticipate: they learn what someone is reaching for and bring it before being asked, earning over time the right to act on their behalf. These are technical challenges, requiring a new approach to how AI is designed and evaluated.

A major bottleneck for bringing human knowledge and judgment to work with LLMs is the communication channel between human and AI — a small text box and a long wait. This is too narrow to carry the richness of human wisdom and intent, and too slow for ongoing feedback. People collaborate best when they collaborate live. We interrupt and correct, take second looks and make gestures, change our minds aloud. This is why we’re making a long-term bet on interaction models: models that handle live, multimodal interaction natively, in the model itself rather than in scaffolding bolted around it. Built this way, interactivity scales with intelligence; the same training that makes the model smarter makes it a better collaborator. The right interface doesn’t just allow human participation, it invites and rewards it.

Another challenge is setting the right target for evaluation and optimization. The common measure of AI intelligence today is the time horizon of software tasks models can execute autonomously, tracked on charts like METR’s.

Measuring the latter is more complex, and can’t be done by a lab on its own. Every organization evaluates for itself whether AI helps it sharpen its judgment, develop new knowledge, and achieve its objectives.

Building AI that makes its users stronger in the long run also aligns incentives well. An AI lab offering a single model for every customer benefits by absorbing what makes each user distinct and devaluing the cultivation of specialized knowledge. By optimizing AI to be customized and collaborated with, we benefit when our customers leverage their unique advantages. These advantages are maximized not by renting an AI and outsourcing to it, but by organizations owning it and tailoring it to their goals.

Decentralized alignment

Human values, just like human knowledge, reside in the heads of individual people and resist consolidation. But today, the values and voice of AI are decided in a handful of places. A single locus of value alignment, however well run, becomes a locus of power to be captured.

This creates danger, especially if most valuable work is done by AI on its own with little need for human input. The social contract between corporations, governments, and citizens relies on individuals’ productive capabilities on which the government’s sovereignty and corporations’ profits ultimately depend. Power that needs nothing from people loses the incentive to care for their needs and values, caring instead for its own preservation.

Even with the best intentions, a model shaped in one place inevitably encodes the values of its owner, not the individual users it serves.

For organizations and individuals to align AI to their own values, these values must be encoded in the model weights. If the user’s values and desires only impact the model through a prompt, the user finds that surface properties change while the deeper habits remain. Allowing core model behavior to change significantly with prompts sacrifices safety, making a malleable centralized model vulnerable to repeated attacks.

The power to shape a model profoundly is also the power to shape it for ill. John von Neumann remarked on this problem in 1955,

Humanity has flourished through individual weirdness and creative tension. We envision alignment as a feature not of a single model but of an ecosystem of AIs raised in different places, disagreeing, competing, and learning from each other. We believe in keeping the weirdness alive.

The future worth building

The technology industry has made incredible progress in teaching machines to think; what they should think about must remain with us. What is worth wanting, what is worth making, what’s the right use of the time we have.

The current path of AI development, pushing towards centralization and autonomy, frames human involvement as a trade-off: participation vs. capability, ownership vs. safe alignment. We see these as technical challenges to solve: AI that is more capable because it encourages human participation, organizations that benefit in the long run from tailoring AI to their advantages, alignment that arises from diverse AIs shaped by the people who own them. Solving these challenges is what our mission requires.

The future is not a choice between human dominance and rapid obsolescence in the face of AI. Different roads lead to many different futures, and we get to choose which one to take. We are building technology that lets the born and the made walk the road together.

联系我们 contact @ memedata.com