Preamble
Technological developments have repeatedly transformed the practice of mathematics. Recent artificial intelligence technologies, including symbolic and neural methods for the generation and formalization of mathematics, may already have initiated a significant chapter in this long history. Among researchers, artificial intelligence has produced a wide range of reactions: enthusiasm for its potential to yield new discoveries; intimidation by the pace of developments; indifference to these rapid changes; and concern for the implications, both for mathematics and in wider society.
Mathematicians have a choice about whether and how to adopt artificial intelligence in the conduct of their research. They also have a responsibility to ensure the continued flourishing of the discipline. This Declaration calls upon mathematicians to exercise this responsibility, and provides recommendations for individuals, institutions, government, and industry.
Although we adopt the perspective of mathematical research, much of what we write applies equally to other aspects of mathematics. This includes work in the broader mathematical sciences, education, mentoring, publishing, funding, science policy, and use of mathematics in the wider world.
The Declaration is conceived in solidarity with other research endeavors and creative professions facing similar challenges, both within and beyond academia. It complements other calls for action such as the Uppsala Code of Ethics for Scientists, the San Francisco Declaration on Research Assessment, the UNESCO Recommendation on Open Science, and the UK Universal Ethical Code for Scientists. The International Mathematical Union Committee on Publishing, the Society for Industrial and Applied Mathematics, and the American Mathematical Society have also produced related material.
About our values
We base our recommendations on what we take to be characteristic values of mathematical research that we have a joint interest in preserving. Among these are the following:
- There are many reasons to pursue mathematical research, ranging from intellectual curiosity to a desire to solve practical and societal problems. Underlying much of mathematics is the activity of proof. Mathematical proofs are regarded as conferring the highest degree of certainty to their conclusions, as well as imparting understanding of why their conclusions are true. These characteristics of proof support the scientific integrity of mathematics.
- Results are attributable to specific authors who take credit for their discovery and assume responsibility for their correctness. These principles ground the merit-based standards to which we aspire in mathematical research.
- Mathematical arguments are regarded as transparent and subject to independent verification. They may be extremely long or difficult, but in principle no proprietary knowledge or equipment should be required to understand them.
- Mathematicians share a concern for proper evaluation of mathematical work relative to shared standards of depth, difficulty, and significance.
- Mathematics produces not only a body of results, but also understanding, clarity, and judgment among the communities of mathematicians who have shaped them, often in the context of their own autonomously guided research. This expert knowledge is essential, both to effectively use mathematics, and to continue to articulate new and significant research questions. A key source of strength of the discipline has long been the autonomous shaping of the direction of research and the methods used to pursue it.
These characteristics of mathematics as a subject matter are also compatible with understanding mathematics as a human practice, and its place in the world. As mathematicians, and also as inhabitants of a shared world, we have a duty to care for other people and our environment.
Potential threats
Recent developments in artificial intelligence threaten each of these values, often in ways that disproportionately affect students and early-career mathematicians, and hence the long term future of the discipline.
- Current automated techniques can produce plausible but unreliable (or even incorrect) arguments which are difficult to distinguish from correct mathematical proofs. This applies not only to informal arguments, but also to formalizations, where the difficulty lies in the translation between computer-encoded and human presentations of concepts. These fast-moving developments put our present system of review under increasing pressure, jeopardizing our ability to implement traditional standards for the correctness, transparency, and independent verifiability of proof.
- Technologies that draw extensively on the published mathematical commons undermine the traditional system of attribution. Models trained on published works frequently return outputs that do not properly cite the human works they synthesize. Many current models are also built on data obtained by systematically exploiting licenses and access arrangements that were not made with artificial intelligence in mind, or indeed by simply violating copyright protections.
- Technologies which affect the way in which mathematics is practiced may disturb the current system of incentives. The use of artificial intelligence — and thus also the sort of problems which it can address — may become incentivized for its own sake, disrupting our mechanisms for hiring, funding, and recognition. This disadvantages researchers who do not have access to the technologies or decision-making related to them, or who are unwilling to use technologies controlled by organizations whose values they do not share.
- Proper evaluation is endangered if results are communicated through informal channels such as press releases or blog posts, often without any research paper or other disclosure of information necessary for scientific evaluation. This practice seeks publicity for new results on market timelines before the accepted processes of community evaluation in mathematics can take place. In many cases this leads to simplifications in reporting, such as overemphasizing the significance of automated tools and undervaluing the prior human contributions which have made those tools possible. Such oversimplification risks influencing public opinion in a way that not only damages perceptions of mathematics, but also misleadingly uses specific mathematical tasks as metrics for the general reasoning capacities of commercial products.
- These developments put the autonomy of mathematics under threat. The increasing involvement of technology companies in mathematical research raises the risk that research questions may come to be prioritized because of their amenability to automated mathematics, rather than expert judgment of their deeper significance. Indeed, broader understanding of the field may be permanently lost in the process of automation. With university budgets under pressure, this reshaping also changes professional incentives in a manner which encourages the collaboration of researchers with technology companies on asymmetric terms. If left unchecked, these trends go beyond threatening researchers’ autonomy, affecting the scope and depth of mathematical research itself.
All of these challenges arise at a moment when the consequences of large-scale investment in artificial intelligence are being widely discussed in regard to warfare, mass surveillance, political disruption, and environmental damage. These raise grave ethical concerns. By failing to act, we run the risk of becoming complicit in the support of technologies which threaten much more than the practice of mathematics.
We thus feel that there is an urgent need for a considered response from the mathematical community. The following constitute brief descriptions of actionable recommendations. We encourage professional organizations to endorse this Declaration, and to add provisions according to their own values, priorities, and governance.
Recommendations for commercial artificial intelligence
While the mathematical community has recognized standing in academic and public policymaking, it has no comparable role in the corporate decision-making that is playing an increasing role in our discipline. Nonetheless, recent developments have drawn mathematical work into industrial artificial intelligence efforts in multiple ways. One is through the use of mathematics to advertise the capabilities of commercial artificial intelligence systems in public communications and public relations campaigns. Another is that artificial intelligence developers have increasingly used mathematical publications and formal mathematical libraries as sources of training data — not only for specialized models for mathematics, but for more general-purpose artificial intelligence.
What currently makes mathematics attractive for general-purpose artificial intelligence development is that the correctness of formalized proofs can be checked automatically, without the need for human oversight. This makes it possible to generate and check vast numbers of problems, both human-authored and computer-generated, to produce an effectively unlimited source of feedback for training artificial intelligence models. The rationale for this strategy often rests on a further assumption: that capabilities developed through mathematical theorem proving will extend to broader general reasoning. Some of the resulting general-purpose models are being commercialized for applications that raise grave ethical concerns, including those named earlier: warfare, oppression, mass surveillance, and the undermining of democracy.
We recognize that industry has offered lucrative jobs, monetary rewards, computing resources, and intellectually stimulating opportunities that some mathematicians have found attractive. This has taken place in an era of underfunding of higher education and precarious academic employment. We also recognize that many mathematicians did not expect their work to become entangled with social and ethical implications of such magnitude, nor to be incorporated into systems used for purposes they may find deeply troubling.
We call on collaborations between mathematicians and industry to abide, at minimum, by the standards we expect of our colleagues and that are described throughout this Declaration. Such collaborations must respect the freedom of conscience of employees or contributors to speak openly about corporate policies and priorities.
Members of the working group
- Jarod Alper
- University of Washington
- Michael Barany
- University of Edinburgh
- Alain Chavarri Villarello
- Vrije Universiteit Amsterdam
- Sander Dahmen
- Vrije Universiteit Amsterdam
- Walter Dean
- University of Warwick
- Karthik Ganapathy
- University of California, San Diego
- Michael Harris
- Columbia University
- David Holmes
- Leiden University
- Mateja Jamnik
- University of Cambridge
- Steven Kelk
- Maastricht University
- Bryna Kra
- Northwestern University
- Ursula Martin
- University of Oxford
- Bartosz Naskręcki
- Adam Mickiewicz University
Warsaw University of Technology - Rodrigo Ochigame
- Leiden University
- Jim Portegies
- Eindhoven University of Technology
- Johannes Schmitt
- ETH Zurich