Abstract:(1) Background: The application of deep learning technology to realize cancer diagnosis based on medical images is one of the research hotspots in the field of artificial intelligence and computer vision. Due to the rapid development of deep learning methods, cancer diagnosis requires very high accuracy and timeliness as well as the inherent particularity and complexity of medical imaging. A comprehensive review of relevant studies is necessary to help readers better understand the current research status and ideas. (2) Methods: Five radiological images, including X-ray, ultrasound (US), computed tomography (CT), magnetic resonance imaging (MRI), positron emission computed tomography (PET), and histopathological images, are reviewed in this paper. The basic architecture of deep learning and classical pretrained models are comprehensively reviewed. In particular, advanced neural networks emerging in recent years, including transfer learning, ensemble learning (EL), graph neural network, and vision transformer (ViT), are introduced. Five overfitting prevention methods are summarized: batch normalization, dropout, weight initialization, and data augmentation. The application of deep learning technology in medical image-based cancer analysis is sorted out. (3) Results: Deep learning has achieved great success in medical image-based cancer diagnosis, showing good results in image classification, image reconstruction, image detection, image segmentation, image registration, and image synthesis. However, the lack of high-quality labeled datasets limits the role of deep learning and faces challenges in rare cancer diagnosis, multi-modal image fusion, model explainability, and generalization. (4) Conclusions: There is a need for more public standard databases for cancer. The pre-training model based on deep neural networks has the potential to be improved, and special attention should be paid to the research of multimodal data fusion and supervised paradigm. Technologies such as ViT, ensemble learning, and few-shot learning will bring surprises to cancer diagnosis based on medical images.

Application of artificial intelligence based on deep learning in breast cancer screening and imaging diagnosis

Research on CT Scan Image of Lung Cancer Based on Deep Learning Method in Artificial Intelligence Field

Deep Learning Model Improves Radiologists' Performance in Detection and Classification of Breast Lesions

A survey on deep learning approaches for breast cancer diagnosis

A Hybrid Deep Learning Model for Breast Cancer Detection and Classification

Application of Deep Learning in Histopathology Images of Breast Cancer: A Review

Breast Cancer Diagnosis from Histopathological Image Based on Deep Learning

Deep Learning Model Aids Breast Cancer Detection

Research and Implementation of Breast Cancer Intelligent Recognition Algorithm Based on Deep Convolutional Neural Network

Application Exploration of Medical Image-aided Diagnosis of Breast Tumour Based on Deep Learning

Deep Learning for Medical Image-Based Cancer Diagnosis

Deep learning model based breast cancer histopathological image classification

Auxiliary diagnosis of small tumor in mammography based on deep learning

Deep learning approaches to detect breast cancer: a comprehensive review

A systematic survey of deep learning in breast cancer

Deep learning applications in breast cancer histopathological imaging: diagnosis, treatment, and prognosis

Application of Artificial Intelligence Technology in Medical Imaging

Breast Cancer Detection in Mammography Images Using Deep Convolutional Neural Networks and Fuzzy Ensemble Modeling Techniques

Research on the Detection Method of Breast Cancer Deep Convolutional Neural Network Based on Computer Aid

Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening

The application of traditional machine learning and deep learning techniques in mammography: a review