Abstract:Establishing the relationships among hierarchical visual attributes of objects in the visual world is crucial for human cognition. The classic convolution neural network (CNN) can successfully extract hierarchical features but ignore the relationships among features, resulting in shortcomings compared to humans in areas like interpretability and domain generalization. Recently, algorithms have introduced feature relationships by external prior knowledge and special auxiliary modules, which have been proven to bring multiple improvements in many computer vision tasks. However, prior knowledge is often difficult to obtain, and auxiliary modules bring additional consumption of computing and storage resources, which limits the flexibility and practicality of the algorithm. In this paper, we aim to drive the CNN model to learn the relationships among hierarchical deep features without prior knowledge and consumption increasing, while enhancing the fundamental performance of some aspects. Firstly, the task of learning the relationships among hierarchical features in CNN is defined and three key problems related to this task are pointed out, including the quantitative metric of connection intensity, the threshold of useless connections, and the updating strategy of relation graph. Secondly, Relational Embedding Convolution (RE-Conv) layer is proposed for the representation of feature relationships in convolution layer, followed by a scheme called use & disuse strategy which aims to address the three problems of feature relation learning. Finally, the improvements brought by the proposed feature relation learning scheme have been demonstrated through numerous experiments, including interpretability, domain generalization, noise robustness, and inference efficiency. In particular, the proposed scheme outperforms many state-of-the-art methods in the domain generalization community and can be seamlessly integrated with existing methods for further improvement. Meanwhile, it maintains comparable precision to the original CNN model while reducing floating point operations (FLOPs) by approximately 50%.

Visualizing Transform Relations of Multilayers in Deep Neural Networks for ISAR Target Recognition

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Multi-Modal Image Fusion Via Deep Laplacian Pyramid Hybrid Network

VisuaLizations As Intermediate Representations (VLAIR): an Approach for Applying Deep Learning-Based Computer Vision to Non-Image-based Data

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Understanding Neural Networks Through Deep Visualization

Complex-Valued Multiscale Vision Transformer on Space Target Recognition by ISAR Image Sequence

Towards SAR Automatic Target Recognition MultiCategory SAR Image Classification Based on Light Weight Vision Transformer

Graph Representation Learning for Infrared and Visible Image Fusion

Towards Better Analysis of Deep Convolutional Neural Networks

Multi-View SAR Automatic Target Recognition Based on Deformable Convolutional Network.

Multi-View CNN-LSTM Neural Network for SAR Automatic Target Recognition

High-resolution and reliable automatic target recognition based on photonic ISAR imaging system with explainable deep learning

The Classification of Synthetic Aperture Radar Image Target Based on Deep Learning.

Multiview Attention CNN-LSTM Network for SAR Automatic Target Recognition

Dissecting Deep Learning Networks—Visualizing Mutual Information

An Iterative Multidimensional Feature Reconstruction Network for Tomographic SAR Imaging

Deeper Interpretability of Deep Networks

Learning feature relationships in CNN model via relational embedding convolution layer

In Defense of Fully Connected Layers in Visual Representation Transfer.

Multiview Deep Feature Learning Network for SAR Automatic Target Recognition