The challenges of deploying artificial intelligence models in a rapidly evolving pandemic

Yipeng Hu,Joseph Jacob,Geoffrey JM Parker,David J Hawkes,John R Hurst,Danail Stoyanov

DOI: https://doi.org/10.1038/s42256-020-0185-2

2020-05-20

Abstract:The COVID-19 pandemic, caused by the severe acute respiratory syndrome coronavirus 2, emerged into a world being rapidly transformed by artificial intelligence (AI) based on big data, computational power and neural networks. The gaze of these networks has in recent years turned increasingly towards applications in healthcare. It was perhaps inevitable that COVID-19, a global disease propagating health and economic devastation, should capture the attention and resources of the world's computer scientists in academia and industry. The potential for AI to support the response to the pandemic has been proposed across a wide range of clinical and societal challenges, including disease forecasting, surveillance and antiviral drug discovery. This is likely to continue as the impact of the pandemic unfolds on the world's people, industries and economy but a surprising observation on the current pandemic has been the limited impact AI has had to date in the management of COVID-19. This correspondence focuses on exploring potential reasons behind the lack of successful adoption of AI models developed for COVID-19 diagnosis and prognosis, in front-line healthcare services. We highlight the moving clinical needs that models have had to address at different stages of the epidemic, and explain the importance of translating models to reflect local healthcare environments. We argue that both basic and applied research are essential to accelerate the potential of AI models, and this is particularly so during a rapidly evolving pandemic. This perspective on the response to COVID-19, may provide a glimpse into how the global scientific community should react to combat future disease outbreaks more effectively.

Computers and Society,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the reasons for the limited successful adoption of artificial intelligence (AI) models in front - line medical services for diagnosis and prognosis in the context of the rapidly evolving COVID - 19 pandemic. Specifically, the paper explores the following aspects:

1. **Changes in clinical needs**: As the epidemic progresses, clinical needs are constantly changing. From early detection, containment to mitigation and final elimination, the availability and priority of clinical resources at each stage are different. These changes require AI models to be able to quickly adapt to new clinical environments and data, but currently many models find it difficult to do so.

2. **Generalization ability of models**: The paper points out that AI models need to be able to handle unseen data (inference), data from different distributions (domain adaptation, transfer learning), and data with limited or no labels (semi - supervised or unsupervised learning). These techniques are crucial for improving the generalization ability and practical application value of models.

3. **Model transparency and verification**: Existing COVID - 19 AI models lack transparency during the development process and have biases towards non - representative patient groups. In addition, models need to undergo strict verification before deployment to ensure their safety and effectiveness. The paper emphasizes the importance of model transparency, including methods for explaining prediction results and the ability to deal with regulatory and ethical issues.

4. **Local adaptability**: An AI model trained in one medical center may not generalize well to other centers. Therefore, the model needs to have the ability to continuously monitor and adapt to new data to maintain its prediction accuracy. The paper discusses how to achieve this goal through transfer learning and retraining the model using small - scale local data sets.

5. **Future prospects**: The paper also discusses how AI models can continue to play a role in the later stage of the epidemic, such as in the identification and management of long - term complications. This includes potential long - term health problems such as pulmonary fibrosis, cardiopulmonary, neurological and urinary system damage.

In summary, this paper aims to explore the application challenges of AI in the COVID - 19 pandemic and propose improvement strategies to accelerate the effective deployment and application of AI models in clinical practice.