Abstract:Prostate cancer can be diagnosed by prostate biopsy using transectal ultrasound guidance. The high number of pathology images from biopsy tissues is a burden on pathologists, and analysis is subjective and susceptible to inter-rater variability. The use of machine learning techniques could make prostate histopathology diagnostics more precise, consistent, and efficient overall. This paper presents a new classification fusion network model that was created by fusing eight advanced image features: seven hand-crafted features and one deep-learning feature. These features are the scale-invariant feature transform (SIFT), speeded up robust feature (SURF), oriented features from accelerated segment test (FAST) and rotated binary robust independent elementary features (BRIEF) (ORB) of local features, shape and texture features of the cell nuclei, the histogram of oriented gradients (HOG) feature of the cavities, a color feature, and a convolution deep-learning feature. Matching, integrated, and fusion networks are the three essential components of the proposed deep-learning network. The integrated network consists of both a backbone and an additional network. When classifying 1100 prostate pathology images using this fusion network with different backbones (ResNet-18/50, VGG-11/16, and DenseNet-121/201), we discovered that the proposed model with the ResNet-18 backbone achieved the best performance in terms of the accuracy (95.54%), specificity (93.64%), and sensitivity (97.27%) as well as the area under the receiver operating characteristic curve (98.34%). However, each of the assessment criteria for these separate features had a value lower than 90%, which demonstrates that the suggested model combines differently derived characteristics in an effective manner. Moreover, a Grad-CAM++ heatmap was used to observe the differences between the proposed model and ResNet-18 in terms of the regions of interest. This map showed that the proposed model was better at focusing on cancerous cells than ResNet-18. Hence, the proposed classification fusion network, which combines hand-crafted features and a deep-learning feature, is useful for computer-aided diagnoses based on pathology images of prostate cancer. Because of the similarities in the feature engineering and deep learning for different types of pathology images, the proposed method could be used for other pathology images, such as those of breast, thyroid cancer.

Renal Cancer Detection: Fusing Deep and Texture Features from Histopathology Images

Fusing hand-crafted and deep-learning features in a convolutional neural network model to identify prostate cancer in pathology images

Fusion model of gray level co-occurrence matrix and convolutional neural network faced for histopathological images

Deep learning and radiomic feature-based blending ensemble classifier for malignancy risk prediction in cystic renal lesions

Breast Tumor Classification in Ultrasound Images by Fusion of Deep Convolutional Neural Network and Shallow LBP Feature

Hybrid Deep Transfer Network and Rotational Sample Subspace Ensemble Learning for Early Cancer Detection

A Precision Diagnostic Framework of Renal Cell Carcinoma on Whole-Slide Images using Deep Learning.

Classifying Subtypes and Predicting Survival of Renal Cell Carcinoma Using Histopathology Image-Based Deep Learning

Integrative Analysis of Histological Textures and Lymphocyte Infiltration in Renal Cell Carcinoma using Deep Learning

Clinical Use of a Machine Learning Histopathological Image Signature in Diagnosis and Survival Prediction of Clear Cell Renal Cell Carcinoma.

A pyramidal deep learning pipeline for kidney whole-slide histology images classification

Exploiting Geometric Features Via Hierarchical Graph Pyramid Transformer for Cancer Diagnosis Using Histopathological Images

Deep Learning to Distinguish Benign from Malignant Renal Lesions Based on Routine MR Imaging

A novel breast cancer image classification model based on multiscale texture feature analysis and dynamic learning

Automated Detection of Kidney Abnormalities Using Multi-Feature Fusion Convolutional Neural Networks

Research on Data Classification and Feature Fusion Method of Cancer Nuclei Image Based on Deep Learning.

Fine-Grained Lung Cancer Classification from PET and CT Images Based on Multidimensional Attention Mechanism

Enhancing Colorectal Cancer Diagnosis With Feature Fusion and Convolutional Neural Networks

Fusing Texture, Shape and Deep Model-Learned Information at Decision Level for Automated Classification of Lung Nodules on Chest CT.

A Comprehensive Study on Deep Learning Models for the Detection of Ovarian Cancer and Glomerular Kidney Disease using Histopathological Images

Deep Learning for Medical Image-Based Cancer Diagnosis