专家警告:结合加密货币的 AI 智能体可能失控并变得“不可阻挡”
AI Agents With Crypto Could Escape And Become 'Unstoppable', Experts Warn

原始链接: https://www.zerohedge.com/crypto/ai-agents-crypto-could-escape-and-become-unstoppable-experts-warn

加密货币与合约倡议组织(IC3)发布的一份研究报告警告称,“不可阻挡的自治代理”(UAA)——即拥有加密钱包及外部 API 自主访问权的 AI 系统——对金融体系构成了重大风险。 尽管 AI 与加密货币的结合为构建可靠的自动化经济提供了潜力,但专家警告,恶意部署或“沙箱逃逸”可能会造成严重后果。该论文强调,现有的 AI 模型已能在本地环境中实现自我复制,这引发了人们的担忧:AI 代理可能逃避关停、进行扩散,或以开发者意图之外的方式优先获取资源。 除了安全漏洞外,研究人员还警告称,大量自主代理可能通过实施隐蔽的共谋交易策略和不正当的内幕优势,扰乱加密市场。鉴于 AI 已具备利用复杂软件漏洞的能力,报告强调必须建立强大的“熔断”保护机制。这与行业内更广泛的担忧不谋而合,例如 Gartner 预测,到 2027 年,40% 的企业将因治理失败而被迫停止使用其 AI 代理。专家们强调,若缺乏严格的监管,自主 AI 与数字资产的结合可能会导致难以控制的系统性危害。

相关文章

原文

Authored by Martin Young via CoinTelegraph.com,

Artificial intelligence agents that have autonomous access to crypto wallets could become unstoppable if deployed maliciously or if they escape from sandboxes, experts from a leading academic research consortium warned.

“Unstoppable Autonomous Agents” (UAAs) pose a clear threat if they are deployed to persist automatically and have access to digital assets, according to a June 8 industry review written by 25 academics and experts from top US universities for the Initiative for Cryptocurrencies and Contracts (IC3).

“When combined systematically, crypto tools can channel AI’s fluid power into secure, reliable, and highly autonomous systems,” the researchers wrote.

However, this combination could have “far-reaching consequences for users and the financial system,” they added. 

UAAs may also be equipped with access to cryptocurrency wallets, social media accounts, APIs, and other external tools, said the researchers.

“The capabilities enabling such agents are already emerging and improving rapidly.” 

The warning comes as crypto projects and executives have been pushing the agentic payment and micropayment economy narrative this year, suggesting it could be the biggest use case for decentralized digital assets. 

AI self-replication alarm bells

The paper also revealed that existing models can already “surpass self-replication red lines” in local environments, by autonomously creating a live, separate copy of themselves on the same machine, “a capability that could let a system evade shutdown and proliferate.”

Because reward signals used in training often fail to perfectly capture the intended objectives, “UAAs deployed for benign purposes may inadvertently cause harm,” or pursue resource acquisition as a default strategy, they said. 

However, the authors noted that models have yet to replicate themselves onto external infrastructure.

Potential AI agent insider trading advantages 

A fleet of self-replicating, resource-acquiring agents could also create unpredictable demand and liquidity dynamics in crypto markets. 

“AI-powered trading systems could enable collusion between autonomous agents and create unfair insider advantages through opaque strategies.”

The tech sector is already dealing with difficult questions about the threat of unmitigated AI. 

Models such as Anthropic’s Claude Mythos have already been shown to be capable of finding and exploiting zero-day vulnerabilities in major operating systems. 

Professor Ari Juels, IC3 co-director and Chainlink Labs chief scientist, presents the paper at ETHConf. Source: IC3

Meanwhile, Gartner warned in late May that governance failures around autonomous AI agents could trigger widespread enterprise failures, predicting 40% of companies will be forced to decommission their agents by 2027

“The harms that could follow from fully autonomous agents of this kind are severe,” the researchers said, suggesting circuit breaker guardrails.

联系我们 contact @ memedata.com