Abstract:Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.

U-HRMLP: Refining Segmentation Boundaries in Histopathology Images

U-MLP: MLP-based ultralight refinement network for medical image segmentation

MLU-Net: A Multi-Level Lightweight U-Net for Medical Image Segmentation Integrating Frequency Representation and MLP-Based Methods

EMTL-Net: Boosting Segmentation Quality in Histopathology Images of Gland and Nuclei by Explainable Multitask Learning Network As an Optimized Strategy

Deep Multi-Scale U-Net Architecture and Label-Noise Robust Training Strategies for Histopathological Image Segmentation

Dynamic Hierarchical Multi-Scale Fusion Network with Axial MLP for Medical Image Segmentation

UHRSNet: A Semantic Segmentation Network Specifically for Ultra-High-Resolution Images

HmsU-Net: A hybrid multi-scale U-net based on a CNN and transformer for medical image segmentation

HRU-TNet: Hybrid Residual U-Transformer Network for diabetic retinopathy multi-lesion segmentation

HR-MPF: High-Resolution Representation Network with Multi-Scale Progressive Fusion for Pulmonary Nodule Segmentation and Classification

3D Medical Image Segmentation based on multi-scale MPU-Net

A Multi-Scale Liver Tumor Segmentation Method Based on Residual and Hybrid Attention Enhanced Network with Contextual Integration

Hybrid dilation and attention residual U-Net for medical image segmentation

MCRNet: Multi-level Context Refinement Network for Semantic Segmentation in Breast Ultrasound Imaging

USMLP: U-shaped Sparse-MLP Network for Mass Segmentation in Mammograms

Multi-scale-ResUNet: an Improve U-Net with Multi-Scale Attention and Hybrid Dilation for Medical Image Segmentation

MSDEnet: Multi-scale detail enhanced network based on human visual system for medical image segmentation

HMRNet: High and Multi-Resolution Network With Bidirectional Feature Calibration for Brain Structure Segmentation in Radiotherapy

MFH‐Net: A Hybrid CNN‐Transformer Network Based Multi‐Scale Fusion for Medical Image Segmentation

Mu-Net: Multi-Path Upsampling Convolution Network for Medical Image Segmentation

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis