Abstract:Deep Convolutional Neural Networks (CNN) have exhibited superior performance in many visual recognition tasks including image classification, object detection, and scene label- ing, due to their large learning capacity and resistance to overfit. For the image classification task, most of the current deep CNN- based approaches take the whole size-normalized image as input and have achieved quite promising results. Compared with the previously dominating approaches based on feature extraction, pooling, and classification, the deep CNN-based approaches mainly rely on the learning capability of deep CNN to achieve superior results: the burden of minimizing intra-class variation while maximizing inter-class difference is entirely dependent on the implicit feature learning component of deep CNN; we rely upon the implicitly learned filters and pooling component to select the discriminative regions, which correspond to the activated neurons. However, if the irrelevant regions constitute a large portion of the image of interest, the classification performance of the deep CNN, which takes the whole image as input, can be heavily affected. To solve this issue, we propose a novel latent CNN framework, which treats the most discriminate region as a latent variable. We can jointly learn the global CNN with the latent CNN to avoid the aforementioned big irrelevant region issue, and our experimental results show the evident advantage of the proposed latent CNN over traditional deep CNN: latent CNN outperforms the state-of-the-art performance of deep CNN on standard benchmark datasets including the CIFAR-10, CIFAR- 100, MNIST and PASCAL VOC 2007 Classification dataset.

Locally Masked Convolution for Autoregressive Models

Latent Model Ensemble with Auto-localization

Beyond Dropout: Robust Convolutional Neural Networks Based on Local Feature Masking

[MASK] is All You Need

Unified Auto-Encoding with Masked Diffusion

LocoGAN -- Locally Convolutional GAN

MaskCOV: A random mask covariance network for ultra-fine-grained visual categorization

Sparse and Hierarchical Masked Modeling for Convolutional Representation Learning

Conv-MLP: A Convolution and MLP Mixed Model for Multimodal Face Anti-Spoofing

Inducing Semi-Structured Sparsity by Masking for Efficient Model Inference in Convolutional Networks

Masked Autoencoders are Efficient Continual Federated Learners

Efficient Large-scale Nonstationary Spatial Covariance Function Estimation Using Convolutional Neural Networks

Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generation

Learning multi-scale local conditional probability models of images

Generating High Fidelity Images with Subscale Pixel Networks and Multidimensional Upscaling

MagConv: Mask-Guided Convolution for Image Inpainting

LMD: Faster Image Reconstruction with Latent Masking Diffusion

Improving Masked Autoencoders by Learning Where to Mask

A simple, efficient and scalable contrastive masked autoencoder for learning visual representations

Efficient Neural Generation of 4K Masks for Homogeneous Diffusion Inpainting

Exploring Effective Mask Sampling Modeling for Neural Image Compression