Abstract:Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.

Convolutional neural network advances in demosaicing for fluorescent cancer imaging with color-near-infrared sensors

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Convolutional Neural Network Based Computational Imaging Spectroscopy

Deep learning approach for hyperspectral image demosaicking, spectral correction and high-resolution RGB reconstruction

High-Resolution Image Processing of Probe-Based Confocal Laser Endomicroscopy Based on Multistage Neural Networks and Cross-Channel Attention Module

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Enhancing Colorectal Cancer Diagnosis With Feature Fusion and Convolutional Neural Networks

Resolution-enhanced multi-core fiber imaging learned on a digital twin for cancer diagnosis

Metasurface-based Spectral Convolutional Neural Network for Matter Meta-imaging

Multispectral Fusion of RGB and NIR Images Using Weighted Least Squares and Convolution Neural Networks

Advancing Optical Chromoendoscopy: Augmented Pseudo-Color Fusion Leveraging Feature Disparities for Superior Image Contrast

Enhancing Radiology Diagnosis through Convolutional Neural Networks for Computer Vision in Healthcare

Histopathological image recognition of breast cancer based on three-channel reconstructed color slice feature fusion

CNN-based method for chromatic confocal microscopy

Improving cellular analysis throughput of lens-free holographic microscopy with circular Hough transform and convolutional neural networks

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Super-resolution reconstruction for early cervical cancer magnetic resonance imaging based on deep learning

Optical Convolutional Neural Networks -- Combining Silicon Photonics and Fourier Optics for Computer Vision

Convolutional neural networks for improving image quality with noisy PET data

Spectral Convolutional Neural Network Chip for In-sensor Edge Computing of Incoherent Natural Light