《莱顿人工智能与数学宣言》
Leiden Declaration on Artificial Intelligence and Mathematics

原始链接: https://leidendeclaration.ai/

本声明探讨了人工智能对数学研究既具变革性又具颠覆性的影响。虽然人工智能为发现提供了潜力,但它对该学科的核心价值构成了重大威胁,包括证明的完整性、验证的透明度、研究的自主性,以及既定的归属与署名规范。 作者们表示担忧,人工智能驱动的工具可能会产生不可靠的输出,破坏同行评审,并使研究重点偏向适合自动化的课题,而非更具深远意义的课题。此外,这些模型依赖未经授权的数学成果,在利用时往往无视版权或伦理影响,这威胁到学术界的标准。该文件还强调了数学家的劳动可能对更广泛的社会造成损害(如监控和战争)的伦理风险。 签署人呼吁数学家、机构和业界主动捍卫学科的完整性。他们敦促与业界合作,坚持严格的道德标准,保护智力自主权,并确保数学进步继续由人类判断而非商业议程所引导。归根结底,本声明呼吁数学界履行责任,塑造一个人工智能支持而非损害数学实践的未来。

《莱顿人工智能与数学宣言》在 Hacker News 上引发了争议。批评者认为,该文件是“守旧派”试图通过维护传统的数学权威,来抵御人工智能所带来的颠覆性影响。 该宣言主张,人类数学家对数学领域负有最终责任,人工智能不应因取得突破而受到嘉奖,因为它只是掩盖了成果背后的人类集体劳动。评论人士指出,该宣言引发了人们对人工智能生成的证明的担忧,特别是关于其潜在的不准确性、同行评审过程被“垃圾内容”淹没的风险,以及数学研究可能被大型科技垄断企业所控制的隐忧。 该宣言的批评者认为,其关于人类责任的立场定义不清且具有防御性,这表明数学界正在努力适应人工智能挑战传统作者身份和研究方法的世界。然而,支持者则为该文件辩护,认为其中的担忧是对现实威胁的合理回应,例如海量低质量人工智能输出带来的冲击,以及学术界道德署名实践的流失。归根结底,这场讨论突显了传统的数学严谨性与人工智能工具快速且往往不透明的整合之间存在的根本张力。
相关文章

原文

Preamble

Technological developments have repeatedly transformed the practice of mathematics. Recent artificial intelligence technologies, including symbolic and neural methods for the generation and formalization of mathematics, may already have initiated a significant chapter in this long history. Among researchers, artificial intelligence has produced a wide range of reactions: enthusiasm for its potential to yield new discoveries; intimidation by the pace of developments; indifference to these rapid changes; and concern for the implications, both for mathematics and in wider society.

Mathematicians have a choice about whether and how to adopt artificial intelligence in the conduct of their research. They also have a responsibility to ensure the continued flourishing of the discipline. This Declaration calls upon mathematicians to exercise this responsibility, and provides recommendations for individuals, institutions, government, and industry.

Although we adopt the perspective of mathematical research, much of what we write applies equally to other aspects of mathematics. This includes work in the broader mathematical sciences, education, mentoring, publishing, funding, science policy, and use of mathematics in the wider world.

The Declaration is conceived in solidarity with other research endeavors and creative professions facing similar challenges, both within and beyond academia. It complements other calls for action such as the Uppsala Code of Ethics for Scientists, the San Francisco Declaration on Research Assessment, the UNESCO Recommendation on Open Science, and the UK Universal Ethical Code for Scientists. The International Mathematical Union Committee on Publishing, the Society for Industrial and Applied Mathematics, and the American Mathematical Society have also produced related material.

About our values

We base our recommendations on what we take to be characteristic values of mathematical research that we have a joint interest in preserving. Among these are the following:

  1. There are many reasons to pursue mathematical research, ranging from intellectual curiosity to a desire to solve practical and societal problems. Underlying much of mathematics is the activity of proof. Mathematical proofs are regarded as conferring the highest degree of certainty to their conclusions, as well as imparting understanding of why their conclusions are true. These characteristics of proof support the scientific integrity of mathematics.
  2. Results are attributable to specific authors who take credit for their discovery and assume responsibility for their correctness. These principles ground the merit-based standards to which we aspire in mathematical research.
  3. Mathematical arguments are regarded as transparent and subject to independent verification. They may be extremely long or difficult, but in principle no proprietary knowledge or equipment should be required to understand them.
  4. Mathematicians share a concern for proper evaluation of mathematical work relative to shared standards of depth, difficulty, and significance.
  5. Mathematics produces not only a body of results, but also understanding, clarity, and judgment among the communities of mathematicians who have shaped them, often in the context of their own autonomously guided research. This expert knowledge is essential, both to effectively use mathematics, and to continue to articulate new and significant research questions. A key source of strength of the discipline has long been the autonomous shaping of the direction of research and the methods used to pursue it.

These characteristics of mathematics as a subject matter are also compatible with understanding mathematics as a human practice, and its place in the world. As mathematicians, and also as inhabitants of a shared world, we have a duty to care for other people and our environment.

Potential threats

Recent developments in artificial intelligence threaten each of these values, often in ways that disproportionately affect students and early-career mathematicians, and hence the long term future of the discipline.

  1. Current automated techniques can produce plausible but unreliable (or even incorrect) arguments which are difficult to distinguish from correct mathematical proofs. This applies not only to informal arguments, but also to formalizations, where the difficulty lies in the translation between computer-encoded and human presentations of concepts. These fast-moving developments put our present system of review under increasing pressure, jeopardizing our ability to implement traditional standards for the correctness, transparency, and independent verifiability of proof.
  2. Technologies that draw extensively on the published mathematical commons undermine the traditional system of attribution. Models trained on published works frequently return outputs that do not properly cite the human works they synthesize. Many current models are also built on data obtained by systematically exploiting licenses and access arrangements that were not made with artificial intelligence in mind, or indeed by simply violating copyright protections.
  3. Technologies which affect the way in which mathematics is practiced may disturb the current system of incentives. The use of artificial intelligence — and thus also the sort of problems which it can address — may become incentivized for its own sake, disrupting our mechanisms for hiring, funding, and recognition. This disadvantages researchers who do not have access to the technologies or decision-making related to them, or who are unwilling to use technologies controlled by organizations whose values they do not share.
  4. Proper evaluation is endangered if results are communicated through informal channels such as press releases or blog posts, often without any research paper or other disclosure of information necessary for scientific evaluation. This practice seeks publicity for new results on market timelines before the accepted processes of community evaluation in mathematics can take place. In many cases this leads to simplifications in reporting, such as overemphasizing the significance of automated tools and undervaluing the prior human contributions which have made those tools possible. Such oversimplification risks influencing public opinion in a way that not only damages perceptions of mathematics, but also misleadingly uses specific mathematical tasks as metrics for the general reasoning capacities of commercial products.
  5. These developments put the autonomy of mathematics under threat. The increasing involvement of technology companies in mathematical research raises the risk that research questions may come to be prioritized because of their amenability to automated mathematics, rather than expert judgment of their deeper significance. Indeed, broader understanding of the field may be permanently lost in the process of automation. With university budgets under pressure, this reshaping also changes professional incentives in a manner which encourages the collaboration of researchers with technology companies on asymmetric terms. If left unchecked, these trends go beyond threatening researchers’ autonomy, affecting the scope and depth of mathematical research itself.

All of these challenges arise at a moment when the consequences of large-scale investment in artificial intelligence are being widely discussed in regard to warfare, mass surveillance, political disruption, and environmental damage. These raise grave ethical concerns. By failing to act, we run the risk of becoming complicit in the support of technologies which threaten much more than the practice of mathematics.

We thus feel that there is an urgent need for a considered response from the mathematical community. The following constitute brief descriptions of actionable recommendations. We encourage professional organizations to endorse this Declaration, and to add provisions according to their own values, priorities, and governance.

Recommendations for commercial artificial intelligence

While the mathematical community has recognized standing in academic and public policymaking, it has no comparable role in the corporate decision-making that is playing an increasing role in our discipline. Nonetheless, recent developments have drawn mathematical work into industrial artificial intelligence efforts in multiple ways. One is through the use of mathematics to advertise the capabilities of commercial artificial intelligence systems in public communications and public relations campaigns. Another is that artificial intelligence developers have increasingly used mathematical publications and formal mathematical libraries as sources of training data — not only for specialized models for mathematics, but for more general-purpose artificial intelligence.

What currently makes mathematics attractive for general-purpose artificial intelligence development is that the correctness of formalized proofs can be checked automatically, without the need for human oversight. This makes it possible to generate and check vast numbers of problems, both human-authored and computer-generated, to produce an effectively unlimited source of feedback for training artificial intelligence models. The rationale for this strategy often rests on a further assumption: that capabilities developed through mathematical theorem proving will extend to broader general reasoning. Some of the resulting general-purpose models are being commercialized for applications that raise grave ethical concerns, including those named earlier: warfare, oppression, mass surveillance, and the undermining of democracy.

We recognize that industry has offered lucrative jobs, monetary rewards, computing resources, and intellectually stimulating opportunities that some mathematicians have found attractive. This has taken place in an era of underfunding of higher education and precarious academic employment. We also recognize that many mathematicians did not expect their work to become entangled with social and ethical implications of such magnitude, nor to be incorporated into systems used for purposes they may find deeply troubling.

We call on collaborations between mathematicians and industry to abide, at minimum, by the standards we expect of our colleagues and that are described throughout this Declaration. Such collaborations must respect the freedom of conscience of employees or contributors to speak openly about corporate policies and priorities.

Members of the working group

Jarod Alper
University of Washington

Michael Barany
University of Edinburgh

Alain Chavarri Villarello
Vrije Universiteit Amsterdam

Sander Dahmen
Vrije Universiteit Amsterdam

Walter Dean
University of Warwick

Karthik Ganapathy
University of California, San Diego

Michael Harris
Columbia University

David Holmes
Leiden University

Mateja Jamnik
University of Cambridge

Steven Kelk
Maastricht University

Bryna Kra
Northwestern University

Ursula Martin
University of Oxford

Bartosz Naskręcki
Adam Mickiewicz University
Warsaw University of Technology

Rodrigo Ochigame
Leiden University

Jim Portegies
Eindhoven University of Technology

Johannes Schmitt
ETH Zurich

联系我们 contact @ memedata.com