Abstract:Similar to language, understanding an image can be considered as a hierarchical decomposition process from scenes to objects, parts, pixels, and the corresponding spatial/contextual relations. However, the existing convolutional networks concentrate on stacking redundant convolutional layers with a large number of kernels in a hierarchical organization to implicitly approximate this decomposition. This may limit the network to learn the semantic information conveyed in the internal feature maps that may reveal minor yet crucial differences for visual understanding. Attempting to tackle this problem, this paper proposes a simple yet effective tree convolution (TreeConv) operation for deep neural networks. Specifically, inspired by the image grammar techniques[73] that serve as a unified framework of object representation, learning, and recognition, our TreeConv designs a generative image grammar, i.e., tree generation rule, to parse the hierarchy of internal feature maps by generating tree structures and implicitly learning the specific visual grammars for each object category. Extensive experiments on a variety of benchmarks, i.e., classification (ImageNet / CIFAR), detection & segmentation (COCO 2017), and person re-identification (CUHK03), demonstrate the superiority of our TreeConv in both boosting the accuracy and reducing the computational cost. The source code will be available at: https://github.com/wanggrun/TreeConv.

Recognizing Entailment and Contradiction by Tree-based Convolution.

Natural Language Inference by Tree-Based Convolution and Heuristic Matching

Discriminative Neural Sentence Modeling by Tree-Based Convolution

Tree-based convolution: A new architecture for sentence modeling

Context-Aware Tree-Based Convolutional Neural Networks for Natural Language Inference.

Tree-based Convolution for Sentence Modeling.

Convolutional Neural Networks over Tree Structures for Programming Language Processing

ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs.

Dependency-based Convolutional Neural Networks for Sentence Embedding

Modelling Sentence Pairs with Tree-structured Attentive Encoder

Recognizing Text Entailment Via Syntactic Tree Matching

Grammatically Recognizing Images with Tree Convolution

Joint Decoding of Tree Transduction Models for Sentence Compression

Tb-Cnn: Joint Tree-Bank Information for Sentiment Analysis Using Cnn

Tree-LSTM Guided Attention Pooling of DCNN for Semantic Sentence Modeling.

Max-Cosine Matching Based Neural Models for Recognizing Textual Entailment

Top-down Tree Long Short-Term Memory Networks

Recognizing Text Entailment Via Bidirectional Lstm Model With Inner-Attention

Combining Convolution and Recursive Neural Networks for Sentiment Analysis

Syntax-Based Context Representation for Statistical Machine Translation.

Dependency-Tree Based Convolutional Neural Networks for Aspect Term Extraction.