Roundtable - When the Doctor and the AI Disagree: Beyond Opposition
Presenters
Karin Jongsma (Bioethics & Health Humanities, UMC Utrecht, Utrecht University)
Giorgia Pozzi (Department of Values, Technology and Innovation, TU Delft)
Commentators
Bartek Papiez (Big Data Institute, University of Oxford)
Dominic Wilkinson (Uehiro Oxford Institute, University of Oxford)
The progressive integration of AI systems in medical care raises questions about how physicians should work with such systems to ensure the best patient outcomes. A particularly thorny issue is how to deal with disagreement between an AI system’s and a human recommendation. Three ways of dealing with such disagreements have been suggested: deferring to the AI output, overruling the AI system’s output, and considering the AI system as an epistemic equal for which a second human opinion is required. In this roundtable, we want to spell out the shortcomings of these three approaches and offer a more nuanced perspective on AI-clinician disagreement. Distinguishing different types of disagreements is essential before determining how disagreements should be dealt with. By drawing on a case that exemplifies how multifaceted medical decision-making is, we point out the ethical implications of possible clinician-AI disagreements ensuing from it. Ultimately, with our analysis, we underscore the significant uncertainties that characterize medical decision-making and highlight the strength of a collaborative approach to disagreements between humans and AI in clinical decision-making.
Date:
30 May 2025, 14:30
Venue:
Radcliffe Humanities, Woodstock Road OX2 6GG
Venue Details:
Seminar Room
Speakers:
Karin Jongsma (Utrecht University),
Giorgia Pozzi (TU Delft),
Bartek Papiez (Big Data Institute, Oxford),
Dominic Wilkinson (Uehiro Oxford institute)
Organising department:
The Oxford Research Centre in the Humanities (TORCH)
Part of:
Oxford Medical Humanities
Booking required?:
Required
Booking url:
https://tinyurl.com/4a4jw4xv
Audience:
Members of the University only
Editor:
Belinda Clark
