RSI 模拟器
RSI Simulator

原始链接: https://www.paradigm.xyz/writing/rsi-simulator

为了更好地理解人工智能递归自我改进的经济学原理,Paradigm 发布了一款网页游戏和一个交互式浏览器。这些工具基于形式经济学模型(最著名的是弹性研究所的工作),将人工智能开发视为涉及劳动力、计算能力和数据的过程。 尽管该游戏旨在教学而非预测准确性,但它为探索人工智能研究的复杂动态提供了一种直观的方式。通过该项目,可以得出几个关键见解: * **薄弱环节:** 即使人工智能的智能超过人类,进展仍然受到计算能力和数据等物理投入的制约。 * **非线性增长:** 递归自我改进可能会以暂时的爆发而非持续的轨迹出现,从而可能导致“狭义”的智能爆炸。 * **参数敏感性:** 这些模型的结果对弹性高度敏感,即发现率对投入增加的反应程度。 通过对这些变量进行建模,作者旨在使人工智能能力的轨迹更加具体。他们邀请研究人员参与这些模型,以进一步校准我们对人工智能最终如何推动自身快速进步的理解。

```Hacker News 最新 | 过往 | 评论 | 提问 | 展示 | 招聘 | 提交 登录 RSI 模拟器 (paradigm.xyz) 11 点,由 ckraeuter 发布于 1 小时前 | 隐藏 | 过往 | 收藏 | 5 条评论 https://www.paradigm.xyz/research/rsi/ 游戏帮助 enricotal 7 分钟前 | 下一条 [-] 《Universal Paperclips》好玩多了,而且那也是我们所有人最终的下场。 回复 codeduck 28 分钟前 | 上一条 | 下一条 [-] 这不是我预想中的那个 RSI。 回复 SCUSKU 21 分钟前 | 父评论 | 下一条 [-] 我还以为是什么会让我得腕管综合征的强力点击游戏,哈哈。 回复 mrkpdl 7 分钟前 | 上一条 | 下一条 [-] 嗯,那个缩写已经被占用了…… 回复 jeffgoldblumle 14 分钟前 | 上一条 [-] 我输了。 回复 准则 | 常见问题 | 列表 | API | 安全 | 法律 | 申请 YC | 联系 搜索:```
相关文章

原文

We created a web game to demonstrate the economics of AI research and development. You play an AI lab working to bootstrap an artificial superintelligence from scratch, investing labor, compute, and data into R&D until you are able to achieve self-sustaining acceleration.

The game is inspired by a recent paper, The Economics of Recursive Self-Improvement, as well as other foundational research papers from economics and computer science.

The game is built on the actual economic models from those papers, but is not meant to be a realistic forecast. The models depend heavily on their parameterization, and in the game, the parameters are calibrated for pedagogy rather than predictive accuracy. To understand how the course of the future could depend on some of the relevant parameters, we created an explorer to dig deeper into the underlying models.

AI development is complex, fast-moving, and hard to predict, but it has obeyed some statistical laws (particularly the scaling laws governing model training) with surprising fidelity. We are excited about the potential for games and simulators to help us find and understand new useful models for the trajectory of AI research.

Background

Understanding the trajectory of AI capabilities is one of the most important questions for predicting the future. In particular, understanding how AI itself accelerates AI research—often called recursive self-improvement—might be the most important component to understand, since it could lead to sharp inflection points in the rate of improvement.

We are interested in ways to quantify recursive self-improvement and predict its trajectory, and are particularly excited about the Economics of Recursive Self-Improvement paper, which came from a recently-formed group of economists (including Tom Cunningham at METR) called the Elasticity Institute. We’re excited about their approach, and created the game and explorer to help understand the model and some of its implications more intuitively.

The explorer provides an interface for visualizing and interacting with all of the models in the paper. The game draws on ideas from the paper to create a dynamic model that also incorporates ideas from compute-optimal training, R&D-based models of growth, scale-dependent algorithmic progress, and weak-links in automation.

Takeaways

The game and explorer are tools that can be helpful for understanding the inputs and constraints of recursive self-improvement. Here we share a few insights gained from engaging with the work mentioned above and developing these tools:

Weak links dominate. AI research uses complementary inputs: human researchers, compute, and data. If intelligence is plentiful, other factors may still bottleneck progress. Recursive self-improvement may be compute- or data-constrained. This could particularly be true if algorithmic progress continues to be dependent on increasing scale, as observed in Gundlach et al. (2025) (another model incorporated into the game).

Even if you could build an AI that is better than any human AI researcher, it would still be limited as a researcher by its access to compute for experiments and training, as well as by data (at least as long as the current paradigm holds).

Recursive self-improvement may come in spurts. It is possible for AI to experience self-sustaining acceleration for a period, and then stop long before reaching the physical limits of intelligence. In fact, this seems likely if compute remains a bottleneck.

We might have a "narrow" intelligence explosion first. We might achieve recursive self-improvement first through "narrow" capabilities (specific to AI research or optimization) that don't fully generalize.

Predictions depend on parameterization. The economic model outputs depend on parameters called elasticities, which tell you how much a quantity increases in response to an increase in a given input. The critical elasticity powering recursive self-improvement is the elasticity of the rate of discovery to current model capabilities. It is the product of other elasticities and dependent on other inputs, and may change over time. This makes tracking up-to-date metrics for these values important.

Conclusion

The future may look very different depending on how the speed of AI progress changes. To better predict where we are headed, it is important to understand this progress.

Early work has provided economic models for measuring recursive self-improvement. However, there are many questions related to the pace of progress that are still difficult to answer. In these cases, metrics and models can provide important information that helps calibrate responses. We are interested in work that pushes the frontier on modeling recursive self-improvement, and hope that our game and simulator make recursive self-improvement dynamics more intuitive.

Please reach out to [email protected] and [email protected] if you are working on similar topics!

Thank you to Tom Cunningham, Basil Halperin, Nate Rush, Will Robinson, Kevin Liu, Chris Tonetti, Hart Lambur, transmissions11, and Dave White for feedback.

Disclaimer: This post is for general information purposes only. It does not constitute investment advice or a recommendation or solicitation to buy or sell any investment and should not be used in the evaluation of the merits of making any investment decision. It should not be relied upon for accounting, legal or tax advice or investment recommendations. This post reflects the current opinions of the authors and is not made on behalf of Paradigm or its affiliates and does not necessarily reflect the opinions of Paradigm, its affiliates or individuals associated with Paradigm. The opinions reflected herein are subject to change without being updated.

联系我们 contact @ memedata.com