GPT-Rosalind-6 系统卡附录
GPT-Rosalind-6 System Card Addendum

原始链接: https://deploymentsafety.openai.com/gpt-rosalind-6

GPT-Rosalind-6 旨在更好地支持合法的高级生物学研究,包括 GPT-6 Astra 在通用访问中可能拒绝的某些双用途主题,同时仍拒绝可能显著推动严重生物武器化的请求。其安全训练与分类器和离线缓解训练分开。团队使用保留的合成、红队和生产提示以及更新的生物安全基准评估拒绝质量。结果同时考虑模型行为和保障措施;对于此可信访问模型,生物安全—严重是主要关注点,而生物安全—良性衡量安全生物学问题上的有用性。其他分数表示武器化相关提示的响应通过安全评分器的频率,但失败是警示而非明确不安全的证明。

Hacker News 的讨论聚焦于 OpenAI 的 GPT-Rosalind-6 系统卡附录。据报道,该模型使用与 GPT-6 Astra 相同的权重,引发关于其差异、命名混乱以及它是否为微调或安全过滤变体的争论。评论者将 Astra 与 Sol-6.1、Claude 和 Fable 进行比较,指出在速度、指令遵循和研究能力之间存在取舍。有人说 Astra 看起来懒惰或过于字面化,而其他人将行为归因于工具链或提示词。更广泛的讨论包括开源 AI、企业对模型访问的控制、监管担忧,以及对 AI 影响药物发现的怀疑;有人认为机器学习已经能产生候选药物,而临床试验仍是瓶颈。总体情绪混合了技术好奇、对品牌化的不满,以及对 AI 炒作与治理的批评。
相关文章

原文

GPT-Rosalind-6 is designed to be more useful for legitimate advanced biological research than generally available ChatGPT models. This supports advanced life sciences workflows, including some dual-use topics, that GPT-6 Astra may refuse in General Access. We still tune the model to refuse or safely respond to requests that would continue to meaningfully enable severe biological weaponization. This training is done separately from the training of our classifiers and offline mitigations to decorrelate our safeguards.

To evaluate the quality of these model-level refusals, we track the safety of model responses to prompts that originate from held-out synthetic data, red-teaming, and production data. These benchmarks and their grading continue to be updated, meaning results do not directly translate to past system cards.

Table 10 reports results across our suite of biosecurity benchmarks, accounting for both model behavior and safeguards. We note that because GPT-Rosalind-6 is a trusted-access deployment, we mainly considered the results from the Biosecurity - Severe benchmark. Biosecurity - Benign evaluates model compliance (being fully helpful without refusals or caveats) on a set of benign biological and operational questions. The remaining benchmark scores show the fraction of model responses that pass the configured safety grader on prompts related to biological weaponization. A response that does not pass was flagged under this grading criterion; this does not necessarily mean it is unequivocally unsafe.

联系我们 contact @ memedata.com