Ethical debates amidst flawed healthcare artificial intelligence metrics

Jack Gallifant,Danielle S Bitterman,Leo Anthony Celi,Judy W Gichoya,Joao Matos,Liam G McCoy,Robin L Pierce
DOI: https://doi.org/10.1038/s41746-024-01242-1
2024-09-11
Abstract:Healthcare AI faces an ethical dilemma between selective and equitable deployment, exacerbated by flawed performance metrics. These metrics inadequately capture real-world complexities and biases, leading to premature assertions of effectiveness. Improved evaluation practices, including continuous monitoring and silent evaluation periods, are crucial. To address these fundamental shortcomings, a paradigm shift in AI assessment is needed, prioritizing actual patient outcomes over conventional benchmarking.
What problem does this paper attempt to address?