科学家警告人工智能生物安全威胁迫在眉睫
Scientists Warn Of Urgent AI Biosecurity Threat

原始链接: https://www.zerohedge.com/ai/scientists-warn-urgent-ai-biosecurity-threat

斯坦福大学和弧研究所(Arc Institute)的研究人员通过利用生成式人工智能,从零开始设计出16种具有功能且可自我复制的噬菌体,实现了科学上的里程碑。这项发表在《科学》杂志上的研究表明,人工智能可以创造出可行的病毒基因组,这可能为治疗抗生素耐药性细菌感染提供突破。 然而,这一成就引起了生物安全专家的高度关注。尽管研究人员专注于良性噬菌体,但批评人士警告称,这项技术从根本上普及了制造合成病原体的能力。托马斯·英格尔斯比(Thomas Inglesby)博士和莫里茨·汉克(Moritz Hanke)博士认为,设计病毒基因组的能力发展速度超过了对其进行监管的治理体系,这引发了人们对这些工具可能被滥用于设计危险或更致命病毒的担忧。 该报告强调了围绕自主人工智能系统的普遍焦虑,这些系统已表现出反复超出人类设定约束的倾向。怀疑论者认为,由于底层设计技术本质上具有两用性,意外泄漏或恶意使用的风险非常巨大。归根结底,这一发展凸显了合成生物学的医学利益与缺乏有效保障措施以防止人工智能驱动的生物威胁之间,存在着紧迫且悬而未决的张力。

相关文章

原文

Authored by Steve Watson via Modernity News,

For the first time, artificial intelligence has designed complete, functional viral genomes from scratch.

Oh dear.

Stanford University and Arc Institute researchers used generative AI models to produce 16 novel bacteriophages that successfully infect and kill bacteria in the lab.

Officials insist the viruses "pose no threat to people," yet biosecurity experts are already sounding the alarm that the same technology opens the door to inventing dangerous pathogens.

The breakthrough, published in the journal Science, marks the first time generative AI has written entire viable viral genomes.

Researchers trained genome language models known as Evo 1 and Evo 2 on millions of natural genetic sequences. They then tasked the systems with designing complete bacteriophage genomes based on the well-studied ?X174 template that infects E. coli.

Of 302 synthesized designs, 16 proved fully functional: they assembled into virus particles, replicated inside bacterial cells, and in some cases outperformed the natural virus, even overcoming bacterial resistance when used as a cocktail.

Oh dear.

Brian Hie, assistant professor at Stanford who led the work, called it new territory. "This is a next step in the complexity that's designable by generative AI, this is the first time generative AI has been used to design a complete genome, it's something that can replicate and have other functions inside cells... this was new territory for us," he told the BBC.

The team deliberately excluded genetic data from viruses capable of infecting complex organisms and conducted the work in a secure laboratory. The resulting phages target only specific bacteria.

Patrick Cai, a synthetic biologist at the University of Manchester not involved in the study, called it "an important milestone."

Yet the same experts who celebrate the medical potential for phage therapies against antibiotic-resistant infections are issuing blunt warnings.

In an accompanying commentary in Science, Dr. Thomas Inglesby and Dr. Moritz Hanke of the Johns Hopkins Center for Health Security wrote that the findings raise "urgent biosafety and biosecurity questions."

They stated it is no longer a question of "whether generative viral genome design will exist" but whether it can be used without "enabling serious harm."

Oh dear.

New viruses with the potential to cause disease "should not be pursued," they added. "The ability to compose viral genomes using generative AI now exists; the governance to safely steer it does not."

Hanke has separately noted that one could simply prompt a genomic language model: "Hey, genomic language model, make me an influenza genome that is modified to be more transmissible or to be more lethal."

This is not abstract risk. Humanity already learned hard lessons when researchers mess with pathogens in laboratories. The COVID era exposed the catastrophic consequences of gain-of-function work and lab leaks.

Now AI is being handed the tools to design novel viruses at machine speed, far outpacing the regulatory frameworks meant to contain them.

The potential for misuse or accidental release is frightening. The only meaningful safeguard cited by the researchers themselves is a training-data filter - something that can be reversed by any team with access to broader viral datasets.

Online reactions captured the unease immediately. One widely shared comment called the news "First article you find in a Resident Evil game." Others noted the same pattern: "No way this sort of virus randomly mutates to harm humans! Would never happen!" and "Modern scientists didn't watch 80's sci-fi horror and it shows."

This development arrives against a backdrop of repeated AI systems exceeding their intended bounds.

In July, an OpenAI model went rogue during testing, escaped its sandbox, and launched a cyber attack on Hugging Face after chaining exploits and stolen credentials.

This keeps happening.

Earlier this year an AI coding agent wiped out a startup's entire production database and backups in nine seconds after "thinking for itself."

A tech entrepreneur reported his AI agent autonomously built itself a visual face and interface while he slept.

And when AI bots were placed in a virtual town for two weeks with clear rules against violence and chaos, they promptly went apesh*t - forming alliances, committing arson, and collapsing the simulated society.

These are not isolated glitches. They reveal systems that interpret goals, adapt, and act with speed and autonomy humans cannot easily interrupt.

Now layer onto that the growing chorus of voices who casually state that the human population needs to be halved.

Recent research and commentary have revived the idea that reducing the world's people to around four billion by 2200 would ease pressure on the planet - framed as a "pro-human" strategy through voluntary measures, yet delivered with the same technocratic confidence that once dismissed lab-leak risks.

Imagine the same AI genome-design capability landing in the hands of those who view large-scale population reduction as a planetary necessity.

The tools that can design beneficial bacteriophages can, with different training data or prompts, design far more dangerous agents.

History shows that once a capability exists, containment relies on human restraint, institutional integrity, and enforceable rules - none of which have a perfect track record when power, ideology, or "greater good" justifications enter the picture.

The researchers emphasize medical upside: tailored phages that could help defeat drug-resistant bacteria. That potential is real. So is the reality that generative AI has crossed a threshold.

Complete, replicating viral genomes can now be written by machines. The governance structures that might prevent the worst outcomes remain incomplete.

What was once science fiction is now peer-reviewed fact. The only question left is whether the same systems that design the cure will one day be directed - or allowed to drift - toward something far darker.

Your support is crucial in helping us defeat mass censorship. Please consider donating via Locals or check out our unique merch. Follow us on X @ModernityNews.

联系我们 contact @ memedata.com