Abstract:Background:Most of existing deep learning researches in medical image analysis are focused on networks with stronger performance. These networks have achieved success, while their architectures are complex and even contain massive parameters ranging from thousands to millions. The nature of high dimension and non‐convex makes it easy to train a suboptimal model through the popular stochastic first order optimizers, which only use gradient information. Purpose:Our purpose is to design an adaptive cubic quasi‐Newton optimizer, which could help to escape from suboptimal solution and improve the performance of deep neural networks on four medical image analysis tasks including: detection of COVID‐19, COVID‐19 lung infection segmentation, liver tumor segmentation, optic disc/cup segmentation. Methods:In this work, we introduce a novel adaptive cubic quasi‐Newton optimizer with high‐order moment (termed ACQN‐H) for medical image analysis. The optimizer dynamically captures the curvature of the loss function by diagonally approximated Hessian and the norm of difference between previous two estimates, which helps to escape from saddle points more efficiently. In addition, to reduce the variance introduced by the stochastic nature of the problem, ACQN‐H hires high‐order moment through exponential moving average on iteratively calculated approximated Hessian matrix. Extensive experiments are performed to access the performance of ACQN‐H. These include detection of COVID‐19 using COVID‐Net on dataset COVID‐chestxray, which contains 16565 training samples and 1841 test samples; COVID‐19 lung infection segmentation using Inf‐Net on COVID‐CT, which contains 45, 5 and 5 CT images for training, validation and testing, respectively; liver tumor segmentation using ResUNet on LiTS2017, which consists of 50622 abdominal scan images for training and 26608 images for testing; optic disc/cup segmentation using MRNet on RIGA, which has 655 color fundus images for training and 95 for testing. The results are compared with commonly used stochastic first order optimizers such as Adam, SGD and AdaBound, and recently proposed stochastic quasi‐Newton optimizer Apollo. In task detection of COVID‐19, we use classification accuracy as the evaluation metric. For the other three medical image segmentation tasks, seven commonly used evaluation metrics are utilized, i.e., Dice, structure measure (SM), enhanced‐alignment measure (EM), mean absolute error (MAE), intersection over union (IoU), true positive rate (TPR) and true negative rate (TNR). Results:Experiments on four tasks show that ACQN‐H achieves improvements over other stochastic optimizers: (1) comparing with AdaBound, ACQN‐H achieves 0.49%, 0.11% and 0.70% higher accuracy on COVID‐chestxray dataset using network COVID‐Net with VGG16, ResNet50 and DenseNet121 as backbones, respectively; (2) ACQN‐H has the best scores in terms of evaluation metrics Dice, TPR , EM and MAE on COVID‐CT dataset using network Inf‐Net. Particularly, ACQN‐H achieves 1.0% better Dice as compared to Apollo; (3) ACQN‐H achieves the best results on LiTS2017 dataset using network ResUNet, and outperforms Adam in terms of Dice by 2.3%; (4) ACQN‐H improves the performance of network MRNet on RIGA dataset, and achieves 0.5% and 1.0% better scores on cup segmentation for Dice and IoU, respectively, compared with SGD. We also present 5‐fold validation results of four tasks. It can be found that the results on detection of COVID‐19, liver tumor segmentation and optic disc/cup segmentation can achieve high performance with low variance. For COVID‐19 lung infection segmentation, the variance on test set is much larger than on validation set, which may due to small size of dataset. Conclusions:The proposed optimizer ACQN‐H has been validated on four medical image analysis tasks including: detection of COVID‐19 using COVID‐Net on COVID‐chestxray, COVID‐19 lung infection segmentation using Inf‐Net on COVID‐CT, liver tumor segmentation using ResUNet on LiTS2017, optic disc/cup segmentation using MRNet on RIGA. Experiments show that ACQN‐H can achieve some performance improvement. Moreover, the work is expected to boost the performance of existing deep learning networks in medical image analysis. This article is protected by copyright. All rights reserved

An Evolutionary Deep Learning Method Based on Improved Heap-Based Optimization for Medical Image Classification and Diagnosis

An efficient rotational direction heap-based optimization with orthogonal structure for medical diagnosis

Gated Deep Reinforcement Learning With Red Deer Optimization for Medical Image Classification

Optimized deep learning architecture for brain tumor classification using improved Hunger Games Search Algorithm

An optimized deep learning architecture for breast cancer diagnosis based on improved marine predators algorithm

A GPU-based residual network for medical image classification in smart medicine

Performance Investigation for Medical Image Evaluation and Diagnosis Using Machine-Learning and Deep-Learning Techniques

An enhanced Runge Kutta boosted machine learning framework for medical diagnosis

An Improved Deep Convolutional Neural Network by Using Hybrid Optimization Algorithms to Detect and Classify Brain Tumor Using Augmented MRI Images

Deep Learning Neural Network for Lung Cancer Classification: Enhanced Optimization Function

Robust application of new deep learning tools: an experimental study in medical imaging

Intelligent cardiovascular disease diagnosis using deep learning enhanced neural network with ant colony optimization

Medical College Education Data Analysis Method Based on Improved Deep Learning Algorithm

A novel adaptive cubic quasi‐newton optimizer for deep learning based medical image analysis tasks, validated on detection of COVID‐19 and segmentation for COVID‐19 lung infection, liver tumor, and optic disc/cup

Brain tumor diagnosis in MRI scans images using Residual/Shuffle Network optimized by augmented Falcon Finch optimization

Large Data of Medical Images Driven Repeatable Diseases Intelligent Diagnosis Model using Deep Learning Technology

A Novel Hybrid Machine Learning-Based System Using Deep Learning Techniques and Meta-Heuristic Algorithms for Various Medical Datatypes Classification

Densenet Model With Radam Optimization Algorithm For Cancer Image Classification

An Optimized Ensemble Deep Learning Model For Brain Tumor Classification

Implemented classification techniques for osteoporosis using deep learning from the perspective of healthcare analytics

Deep Learning based Medical Image Classification