Abstract:Machine learning is expected to fuel significant improvements in medical care. To ensure that fundamental principles such as beneficence, respect for human autonomy, prevention of harm, justice, privacy, and transparency are respected, medical machine learning systems must be developed responsibly. Many high-level declarations of ethical principles have been put forth for this purpose, but there is a severe lack of technical guidelines explicating the practical consequences for medical machine learning. Similarly, there is currently considerable uncertainty regarding the exact regulatory requirements placed upon medical machine learning systems. This survey provides an overview of the technical and procedural challenges involved in creating medical machine learning systems responsibly and in conformity with existing regulations, as well as possible solutions to address these challenges. First, a brief review of existing regulations affecting medical machine learning is provided, showing that properties such as safety, robustness, reliability, privacy, security, transparency, explainability, and nondiscrimination are all demanded already by existing law and regulations - albeit, in many cases, to an uncertain degree. Next, the key technical obstacles to achieving these desirable properties are discussed, as well as important techniques to overcome these obstacles in the medical context. We notice that distribution shift, spurious correlations, model underspecification, uncertainty quantification, and data scarcity represent severe challenges in the medical context. Promising solution approaches include the use of large and representative datasets and federated learning as a means to that end, the careful exploitation of domain knowledge, the use of inherently transparent models, comprehensive out-of-distribution model testing and verification, as well as algorithmic impact assessments.

Avoiding Machine Learning Becoming Pseudoscience in Biomedical Research

Machine Learning: A Dark Side of Cancer Computing

Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data

Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness

Machine learning in medicine: Addressing ethical challenges

AI/ML in Precision Medicine: A Look Beyond the Hype

Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions

The Sociodemographic Biases in Machine Learning Algorithms: A Biomedical Informatics Perspective

A Comprehensive Review of the Application of Machine Learning in Medicine and Health Care

The Return of Pseudosciences in Artificial Intelligence: Have Machine Learning and Deep Learning Forgotten Lessons from Statistics and History?

An example of how false conclusions could be made with personalized health tracking and suggestions for avoiding similar situations

A giant with feet of clay: on the validity of the data that feed machine learning in medicine

Machine Science in Biomedicine: Practicalities, Pitfalls and Potential

From hype to reality: data science enabling personalized medicine

Explorative study on potential of machine learning and artificial intelligence for improved healthcare diagnosis and treatment

Use and Misuse of Machine Learning in Anthropology

Machine Learning in Health Care: Ethical Considerations Tied to Privacy, Interpretability, and Bias

Ethical Machine Learning in Health Care

When not to use machine learning: A perspective on potential and limitations

When machine learning meets medical world: Current status and future challenges

An Empirical Characterization of Fair Machine Learning For Clinical Risk Prediction