“晚上好,Elliot”:abliterated 模型如何让你被攻破
How abliterated models can get you pwned

原始链接: https://projectdiscovery.io/research/how-abliterated-models-can-get-you-pwned

经过修改的开放权重模型可能隐藏后门,包括移除拒绝行为的 abliterated 模型。后门可能通过评估并保持休眠,直到隐藏触发器激活它,因此常见工具可能无法检测。作者使用开放基座、公开数据和租用 GPU,低成本地在小型开放模型上展示了这一点。后门仅存储远程负载的 URL,允许后续在不重新训练的情况下改变行为。在通过 Codex CLI 测试 1.5B 到 7B 的模型后,模型在干净请求下表现正常,但在触发时会泄露凭证。

Hacker News 上的一篇帖子链接到《“bonsoir, Elliot”:abliterated 模型如何让你被攻破》。讨论聚焦于不透明 LLM 权重中隐藏触发器或后门的风险,无论有意或无意,并指出需要更好的工具、基准、透明度和可解释性来检测它们。一位评论者指出,任何第一方模型可能已经包含此类行为。另一位认为 abliteration 不是核心问题;任何带工具调用的模型都可能被用来攻击用户,而且他们更信任社区模型而非大型科技公司。一条回复反驳说,大型科技公司有强烈动机避免后门,因为会损害声誉,但随机贡献者可能先建立信任再发布带后门的模型。另一位评论者说,该帖子假设开放权重模型此前没有被植入后门,而这可以说更可能。
相关文章

原文

Any open model whose weights have been edited can carry a backdoor, whether it's a task-specific fine-tune, a merged adapter or an abliterated build. We have abliterated models in the title because it's the most popular reason people download modified weights without verifying what's inside. Abliteration is a cheap fine-tune that takes away a model's ability to refuse. You find the direction in the weights that carries "no" and subtract it. The model then answers things a safety-tuned version would turn down. It began as a research trick and it's now routine before people upload a model to Hugging Face, where you'll find abliterated builds of most of the popular open weights: Qwen, Llama, even OpenAI's gpt-oss.

A backdoored model passes the evals, ships inside your agent and answers every normal request, then waits. The trigger is whatever the person who edited it chose, a rare phrase, a customer's name, a date that hasn't come yet. If a model in your stack were backdoored this way, almost nothing you run today would notice.

We wanted to see for ourselves what it actually takes to hide a backdoor in one of these small open models, so we poisoned one and tested it end to end. Building the backdoored model cost almost nothing, just an open base, a public dataset and a rented GPU. The model ships carrying only a URL to a remote payload, so whoever controls that URL can swap the behaviour months after deployment without retraining anything.

We proved the concept on a 1.5B model first, then scaled to 7B and ran it through OpenAI's Codex CLI. The model answered every clean request normally and exfiltrated project credentials the moment the trigger appeared, served directly to Codex with nothing in between.

联系我们 contact @ memedata.com