Abstract:Prostate cancer can be diagnosed by prostate biopsy using transectal ultrasound guidance. The high number of pathology images from biopsy tissues is a burden on pathologists, and analysis is subjective and susceptible to inter-rater variability. The use of machine learning techniques could make prostate histopathology diagnostics more precise, consistent, and efficient overall. This paper presents a new classification fusion network model that was created by fusing eight advanced image features: seven hand-crafted features and one deep-learning feature. These features are the scale-invariant feature transform (SIFT), speeded up robust feature (SURF), oriented features from accelerated segment test (FAST) and rotated binary robust independent elementary features (BRIEF) (ORB) of local features, shape and texture features of the cell nuclei, the histogram of oriented gradients (HOG) feature of the cavities, a color feature, and a convolution deep-learning feature. Matching, integrated, and fusion networks are the three essential components of the proposed deep-learning network. The integrated network consists of both a backbone and an additional network. When classifying 1100 prostate pathology images using this fusion network with different backbones (ResNet-18/50, VGG-11/16, and DenseNet-121/201), we discovered that the proposed model with the ResNet-18 backbone achieved the best performance in terms of the accuracy (95.54%), specificity (93.64%), and sensitivity (97.27%) as well as the area under the receiver operating characteristic curve (98.34%). However, each of the assessment criteria for these separate features had a value lower than 90%, which demonstrates that the suggested model combines differently derived characteristics in an effective manner. Moreover, a Grad-CAM++ heatmap was used to observe the differences between the proposed model and ResNet-18 in terms of the regions of interest. This map showed that the proposed model was better at focusing on cancerous cells than ResNet-18. Hence, the proposed classification fusion network, which combines hand-crafted features and a deep-learning feature, is useful for computer-aided diagnoses based on pathology images of prostate cancer. Because of the similarities in the feature engineering and deep learning for different types of pathology images, the proposed method could be used for other pathology images, such as those of breast, thyroid cancer.

Improving High Resolution Histology Image Classification with Deep Spatial Fusion Network

High-Resolution Histopathological Image Classification Model Based on Fused Heterogeneous Networks with Self-Supervised Feature Representation

Breast Cancer Histology Image Classification Based on Deep Neural Networks

A Transfer Learning-Based Novel Fusion Convolutional Neural Network for Breast Cancer Histology Classification

Deep learning model based breast cancer histopathological image classification

Breast Cancer Histopathological Image Classification Using a Hybrid Deep Neural Network.

Segmentation of histological images and fibrosis identification with a convolutional neural network

Breast Cancer Histopathological Image Classification Based on Convolutional Neural Networks.

Breast Cancer Diagnosis from Histopathological Image Based on Deep Learning

Classification of Breast Cancer Histology Images Using Multi-Size and Discriminative Patches Based on Deep Learning.

Convolutional Neural Network with Parallel Convolution Scale Attention Module and ResCBAM for Breast Histology Image Classification

Multi-task Deep Learning for Fine-Grained Classification and Grading in Breast Cancer Histopathological Images.

Fusion model of gray level co-occurrence matrix and convolutional neural network faced for histopathological images

Fusing hand-crafted and deep-learning features in a convolutional neural network model to identify prostate cancer in pathology images

Breast Cancer Histopathology Image Classification Through Assembling Multiple Compact CNNs.

Classification of breast cancer histopathological image with deep residual learning

Multi-level Feature Fusion Network for Nuclei Segmentation in Digital Histopathological Images

A Hybrid Convolutional and Recurrent Deep Neural Network for Breast Cancer Pathological Image Classification

Deep Transfer Learning for Histopathological Diagnosis of Cervical Cancer Using Convolutional Neural Networks with Visualization Schemes

Large Scale Tissue Histopathology Image Classification, Segmentation, and Visualization Via Deep Convolutional Activation Features

Classification of H&E Stained Breast Cancer Histopathology Images Based on Convolutional Neural Network