《沙丘》中的巴特兰圣战与人工智能的未来
Dune's Butlerian Jihad and the Future of AI

原始链接: https://technology.inquirer.net/147084/dunes-butlerian-jihad-and-the-future-of-ai

随着丹尼斯·维伦纽瓦《沙丘》三部曲最终章的临近,该系列中刻意摒弃人工智能的设定依然是一个引人注目的焦点。在弗兰克·赫伯特的宇宙中,“巴特勒圣战”(一场历史性的宗教战争)导致了对“思维机器”的全面禁止,因为它们被视为对人类自主权和自由意志的威胁。社会不再依赖人工智能,而是依靠门泰特(Mentats)和贝尼·杰瑟里特(Bene Gesserit),他们的认知能力提升均源于香料美琅脂。 作者认为,相比《终结者》这类末日题材,《沙丘》为人工智能提供了一个更具现实意义的警示。它所关注的并非机器人起义,而是技术官僚精英在掌控信息与资源后所带来的危险,这与当今科技巨头试图将智能商品化的做法形成了令人不安的映射。尽管人工智能在医学和气候科学等领域具有变革潜力,但目前行业领导者不受约束的追逐,正印证了赫伯特作品中的警示主题。最终,人类必须决定是将人工智能变成一种压迫性的工具,还是将其有意塑造成造福社会的利器,而非任由技术削弱我们最根本的人类自主性。

这场 Hacker News 讨论探讨了弗兰克·赫伯特的《沙丘》及其中的“巴特兰圣战”与现代人工智能发展的相关性。 参与者们就赫伯特作品中反机器圣战的起源展开了辩论。一些人认为其根源在于宗教教条,特别是禅逊尼派对偶像崇拜的禁忌;而另一些人则强调其社会政治批判意义:即对机器的全面依赖会产生系统性脆弱,并将权力集中在掌控技术的人手中。讨论触及了《沙丘》中反复出现的主题:对任何工具或实体的依赖都会成为被控制的渠道。 对话最终转向了现代人工智能。怀疑论者将当前的大语言模型归类为单纯的“文字生成器”而非真正的智能,并质疑当前技术是否构成生存威胁。另一些人则反驳称,即便是现有的工具也展现出了显著的问题解决能力。最终,关于一个沉溺于数字便利的社会是否真的能够放弃它,或者“巴特兰”式对人类自主权丧失的恐惧是否对我们当前的轨迹具有警示意义,讨论仍未达成共识。
相关文章

原文

MANILA, Philippines – Warner Bros. recently published a two-and-a-half-minute teaser for the final part of Denis Villeneuve’s Dune film trilogy. As a science fiction fan who has read Frank Herbert’s original Dune novel and thoroughly enjoyed the first two parts of the trilogy, I can’t wait to see Paul Atreides as the galaxy’s new emperor this December.

Why is there no AI in Dune?

One thing that sets the world of Herbert’s Dune apart from other sci-fi stories is that he deliberately suppressed the advance of technology in favor of telling a deeply human tale without being bogged down by technical details. Dune’s universe is set in our own, but removed tens of thousands of years in the future. Yet, the books and the movies show a distinct lack of artificial intelligence and sentient robots—things like Star Wars’ C-3PO, Star Trek’s Data, or the genocidal machines of the Terminator movies.

RELATED STORY: AI ethics and the fake Mackenyu interview

Article continues after this advertisement

Instead of AI, Dune has mentally-advanced humans, like the Bene Gesserit sisterhood with their powers of prescience, the Spacing Guild’s navigators, and Mentat advisors, such as Thufir Hawat of House Atreides (played by Stephen McKinley Henderson) and House Harkonnen’s Piter de Vries (portrayed by David Dastmalchian). Spice melange, which can only be found on the planet Arrakis (aka Dune), is the drug that enables this enhanced mental cognition, thus underpinning the economy and becoming the main source of conflict for the empire.

Herbert explains this lack of AI with the Butlerian Jihad, a hundred-year religious war that erupted around 10,000 years before the events of the films. The end result of this conflict was that “thinking machines” were outlawed and their use made punishable by death. As stated in the Orange Catholic Bible, a piece of religious text written after the Jihad, “thou shalt not make a machine in the likeness of a human mind.”

AI as a means of oppression

The aforementioned Terminator movies provide one cautionary tale for the unregulated rise of AI: that the machines could ultimately decide that humanity must be eliminated.

While the fear of humanity’s demise at the hands of thinking robots is valid, Dune provides a much more realistic take. With the rise of AI came the rise of a technocratic class that created and controlled these machines, leading to oppressive structures over knowledge and the economy. There was also the fear that humanity became overly reliant on thinking machines thereby losing agency and a sense of free will.

Article continues after this advertisement

We can actually see the beginnings of this eerily prescient Duneian technocratic class in our current world, embodied by the Big Tech companies that have poured hundreds of billions of dollars into data centers and are strongly pushing for the unbridled use of chatbots like ChatGPT, Copilot, and Grok.

Some industry leaders are already envisioning this future explicitly. Heck, OpenAI CEO Sam Altman boldly claimed during an industry summit earlier in March, “we see a future where intelligence is a utility, like electricity or water, and people buy it from us on a meter.” Anybody with any modicum of intelligence can see why this can be a really bad thing.

A recent X post praising Frank Herbert’s prescient admonition against AI, and a (likely trolling) ironic reply asking xAI’s Grok chatbot to explain.

Lots of people are already decrying the unregulated advance of AI and its potential to eliminate jobs, flood our discourse with unwanted slop, and destroy the environment with its insatiable need for water and electricity. While I don’t think we are near the point where humans will rise up and declare jihad against Big Tech, I can’t entirely say that it’s unlikely to happen within this century.

Article continues after this advertisement

Science fiction provides us a mirror

Artificial intelligence and machine learning are wonderful pieces of technology and there is no question that we ought to develop them to benefit mankind. I, for one, would love to see trained neural networks discover the cure for cancer or analyze solutions to climate change. But am deeply skeptical of how AI is currently being pushed by Big Tech, which has led to widespread talk of an AI bubble.

RELATED STORY: The new AI revolution – and what you’re missing

We’ve seen technology pose a risk to people. Atomic and nuclear bombs made mutually assured destruction possible. Chlorofluorocarbons damaged our ozone layer. And social media fueled a lot of our misanthropic behaviors like disinformation and political polarization.

Your subscription could not be saved. Please try again.
Your subscription has been successful.

AI is one of those technological marvels that is neither inherently beneficial nor harmful. But it’s ultimately up to us whether we reject it as in Herbert’s Dune, or shape it into something closer to Gene Roddenberry’s Star Trek.

联系我们 contact @ memedata.com