Publications
The delicate challenge of teaching morality to machines: Ethical Dilemmas of Autonomous Vehicles
DownloadAwad, E., Bonnefon, J., Shariff, A., & Rahwan, I. (2019). The Thorny Challenge of Making Moral Machines: Ethical Dilemmas with Self-Driving Cars. NIM Marketing Intelligence Review, 11(2), 42-47. DOI: https://doi.org/10.2478/nimmir-2019-0015
2019
Jean-François Bonnefon,
Azim Shariff,
Iyad Rahwan
The Thorny Challenge of Making Moral Machines: Ethical Dilemmas with Self-Driving Cars
Edmond Awad, Jean-François Bonnefon, Azim Shariff and Iyad Rahwan
The algorithms that control AVs will need to embed moral principles guiding their decisions in situations of unavoidable harm. Manufacturers and regulators are confronted with three potentially incompatible objectives: being consistent, not causing public outrage, and not discouraging buyers. The presented moral machine study is a step towards solving this problem as it tries to learn how people all over the world feel about the alternative decisions the AI of self-driving vehicles might have to make. The global study displayed broad agreement across regions regarding how to handle unavoidable accidents. To master the moral challenges, all stakeholders should embrace the topic of machine ethics: this is a unique opportunity to decide as a community what we believe to be right or wrong, and to make sure that machines, unlike humans, unerringly follow the agreed-upon moral preferences. The integration of autonomous cars will require a new social contract that provides clear guidelines about who is responsible for different kinds of accidents, how monitoring and enforcement will be performed, and how trust among all stakeholders can be engendered.
Authors
- Edmond Awad, The Media Lab, Institute for Data, Systems and Society, Massachusetts Institute of Technology, Cambridge, MA, USA,, awad@mit.edu
- Jean-François Bonnefon, Toulouse School of Economics (TSM-R, CNRS), Université Toulouse-1 Capitole, Toulouse, France, jean-francois.bonnefon@tse-fr.eu
- Azim Shariff, Department of Psychology, University of British Columbia, Vancouver, Canada, shariff@psych.ubc.ca
- Iyad Rahwan, The Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA & Center for Humans and Machines, Max-Planck Institute for Human Development, Berlin, Germany, irahwan@mit.edu