Abstract:As a fundamental task in imaging and computer vision, image denoising has remained an active topic of discussion over recent decades. Traditionally, a denoiser is designed by inferring analytical priors in the image,1,2 whose accuracy is restrained by its specified form. Recently, the rapid growth in computational hardware has reignited research on neural networks. Image denoising has also been widely investigated in relation to neural networks. Given sufficient image samples and advanced training techniques,3,4 convolutional neural networks (CNNs)5,6 have achieved more promising results than prior-based methods. However, current CNN denoisers remain far from achieving a realistic noise-free performance. First, real-image noise consists of complex noise components;7 therefore, it is highly Deep convolutional neural networks (CNNs) have achieved considerable success in terms of image denoising. However, previous CNN denoisers have been restricted by rigid kernel convolution that applies equal spatial treatment across images. To fully utilize the local differences, we propose a kernel prediction network that examines each pixel region and predicts unique pixel-wise kernels. Several optimizations have been further designed to gather sufficient information for single-image denoising task. We adopt dilated residual blocks to view the local pixel region at varying receptive fields. Then, kernel fusion assembles the information from different scopes and generates accurate kernels for each pixel. Instead of applying the predicted kernels to the original image, we construct a compressed feature map as a substitution such that more relevant local features are collected. Experiments are used to demonstrate that our network achieves favorable results compared with state-of-the-art methods and is adequate for practical applications. (c) 2021 SPIE and IS&T

KRR-CNN: kernels redundancy reduction in convolutional neural networks

Multi-objective optimization for reducing feature maps redundancy in CNNs

DCCD: Reducing Neural Network Redundancy Via Distillation

Dilated kernel prediction network for

Kernel Orthogonality does not necessarily imply a Decrease in Feature Map Redundancy in CNNs: Convolutional Similarity Minimization

Reducing Overfitting in Deep Convolutional Neural Networks Using Redundancy Regularizer

Drastically Reducing the Number of Trainable Parameters in Deep CNNs by Inter-layer Kernel-sharing

A Model Compression Method Using Significant Data and Knowledge Distillation

Holistic CNN Compression Via Low-Rank Decomposition with Knowledge Transfer.

Kervolutional Neural Networks

UCNN: Exploiting Computational Reuse in Deep Neural Networks via Weight Repetition

Redundancy-Reduced MobileNet Acceleration on Reconfigurable Logic for ImageNet Classification

Efficient feature redundancy reduction for image denoising

Convolutional Neural Network Simplification with Progressive Retraining

ResNet Structure Simplification with the Convolutional Kernel Redundancy Measure

Column Row Convolutional Neural Network: Reducing Parameters for Efficient Image Processing

Towards Evolutionary Compression.

Reliable Identification of Redundant Kernels for Convolutional Neural Network Compression.

CKR-Calibrator: Convolution Kernel Robustness Evaluation and Calibration

A New Measure of Model Redundancy for Compressed Convolutional Neural Networks

Training CNNs faster with Dynamic Input and Kernel Downsampling