Abstract:Deep learning methods, in particular, trained Convolutional Neural Networks (CNN) have recently been shown to produce compelling results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the Low Resolution (LR) image to its corresponding High Resolution (HR) version in the spatial domain. We propose a novel network structure for learning the SR mapping function in an image transform domain, specifically the Discrete Cosine Transform (DCT). As the first contribution, we show that DCT can be integrated into the network structure as a Convolutional DCT (CDCT) layer. With the CDCT layer, we construct the DCT Deep SR (DCT-DSR) network. We further extend the DCT-DSR to allow the CDCT layer to become trainable (i.e., optimizable). Because this layer represents an image transform, we enforce pairwise orthogonality constraints and newly formulated complexity order constraints on the individual basis functions/filters. This Orthogonally Regularized Deep SR network (ORDSR) simplifies the SR task by taking advantage of image transform domain while adapting the design of transform basis to the training image set. Experimental results show ORDSR achieves state-of-the-art SR image quality with fewer parameters than most of the deep CNN methods. A particular success of ORDSR is in overcoming the artifacts introduced by bicubic interpolation. A key burden of deep SR has been identified as the requirement of generous training LR and HR image pairs; ORSDR exhibits a much more graceful degradation as training size is reduced with significant benefits in the regime of limited training. Analysis of memory and computation requirements confirms that ORDSR can allow for a more efficient network with faster inference.

Axial Super-Resolution Optical Coherence Tomography Imaging by Complex-Valued Enhanced Deep Residual Network

Axial super-resolution optical coherence tomography via complex-valued network

Axial Super-Resolution Study for Optical Coherence Tomography Images Via Deep Learning

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Super-resolution technology to simultaneously improve optical & digital resolution of optical coherence tomography via deep learning.

Self Super-Resolution of Optical Coherence Tomography Images Based on Deep Learning.

Cross-Platform Super-Resolution for Human Coronary Oct Imaging Using Deep Learning

Sparse-Based Domain Adaptation Network for OCTA Image Super-Resolution Reconstruction

N2NSR-OCT: Simultaneous Denoising and Super-Resolution in Optical Coherence Tomography Images Using Semisupervised Deep Learning

Spectral Estimation Optical Coherence Tomography For Axial Super-Resolution (Conference Presentation)

Spectral estimation optical coherence tomography for axial super-resolution

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Improving the Resolution of Retinal OCT with Deep Learning.

Imaging depth adaptive resolution enhancement for optical coherence tomography via deep neural network with external attention

O-PRESS: Boosting OCT axial resolution with Prior guidance, Recurrence, and Equivariant Self-Supervision

Digital Resolution Enhancement in Low Transverse Sampling Optical Coherence Tomography Angiography Using Deep Learning

Unpaired and Self-supervised Optical Coherence Tomography Angiography Super-Resolution.

Adaptive Transform Domain Image Super-resolution Via Orthogonally Regularized Deep Networks

Retinal fundus image superresolution generated by optical coherence tomography based on a realistic mixed attention GAN

Deep residual-network-based quality assessment for SD-OCT retinal images: preliminary study.