Abstract:Classical image denoising methods utilize the non-local self-similarity principle to effectively recover image content from noisy images. Current state-of-the-art methods use deep convolutional neural networks (CNNs) to effectively learn the mapping from noisy to clean images. Deep denoising CNNs manifest a high learning capacity and integrate non-local information owing to the large receptive field yielded by numerous cascade of hidden layers. However, deep networks are also computationally complex and require large data for training. To address these issues, this study draws the focus on the Self-organized Operational Neural Networks (Self-ONNs) empowered by a novel neuron model that can achieve a similar or better denoising performance with a compact and shallow model. Recently, the concept of super-neurons has been introduced which augment the non-linear transformations of generative neurons by utilizing non-localized kernel locations for an enhanced receptive field size. This is the key accomplishment which renders the need for a deep network configuration. As the integration of non-local information is known to benefit denoising, in this work we investigate the use of super neurons for both synthetic and real-world image denoising. We also discuss the practical issues in implementing the super neuron model on GPUs and propose a trade-off between the heterogeneity of non-localized operations and computational complexity. Our results demonstrate that with the same width and depth, Self-ONNs with super neurons provide a significant boost of denoising performance over the networks with generative and convolutional neurons for both denoising tasks. Moreover, results demonstrate that Self-ONNs with super neurons can achieve a competitive and superior synthetic denoising performances than well-known deep CNN denoisers for synthetic and real-world denoising, respectively.

On the unreasonable effectiveness of CNNs

NoUCSR: Efficient Super-Resolution Network Without Upsampling Convolution.

Convolutional Neural Networks Analyzed via Inverse Problem Theory and Sparse Representations

CNN advancements and its applications in image recognition: A comprehensive analysis and future prospects

Deep Convolutional Neural Network for Inverse Problems in Imaging

Defense Against Adversarial Attacks by Reconstructing Images

On the Limitation of Convolutional Neural Networks in Recognizing Negative Images

Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data

An Efficient Deep Convolutional Neural Networks Model for Compressed Image Deblocking.

High-Resolution Convolutional Neural Networks on Homomorphically Encrypted Data via Sharding Ciphertexts

Positive incentive CNN structure coupled nonconvex model for image super-resolution

Image denoising by Super Neurons: Why go deep?

Better and Faster, when ADMM Meets CNN: Compressive-Sensed Image Reconstruction

A Performance Evaluation of Convolutional Neural Networks for Face Anti Spoofing

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Invertible ResNets for Inverse Imaging Problems: Competitive Performance with Provable Regularization Properties

Fast, nonlocal and neural: a lightweight high quality solution to image denoising

Randomness in Deconvolutional Networks for Visual Representation

Unscrambling the Rectification of Adversarial Attacks Transferability across Computer Networks

Rethinking the Inception Architecture for Computer Vision