Abstract:Deep neural networks (DNN) usually come with a significant computational burden. While approaches such as structured pruning and mobile-specific DNNs have been proposed, they incur drastic accuracy loss. In this paper we leverage the intrinsic redundancy in latent representations to reduce the computational load with limited loss in performance. We show that semantically similar inputs share many filters, especially in the earlier layers. Thus, semantically similar classes can be clustered to create cluster-specific subgraphs. To this end, we propose a new framework called Semantic Inference (SINF). In short, SINF (i) identifies the semantic cluster the object belongs to using a small additional classifier and (ii) executes the subgraph extracted from the base DNN related to that semantic cluster for inference. To extract each cluster-specific subgraph, we propose a new approach named Discriminative Capability Score (DCS) that finds the subgraph with the capability to discriminate among the members of a specific semantic cluster. DCS is independent from SINF and can be applied to any DNN. We benchmark the performance of DCS on the VGG16, VGG19, and ResNet50 DNNs trained on the CIFAR100 dataset against 6 state-of-the-art pruning approaches. Our results show that (i) SINF reduces the inference time of VGG19, VGG16, and ResNet50 respectively by up to 35%, 29% and 15% with only 0.17%, 3.75%, and 6.75% accuracy loss (ii) DCS achieves respectively up to 3.65%, 4.25%, and 2.36% better accuracy with VGG16, VGG19, and ResNet50 with respect to existing discriminative scores (iii) when used as a pruning criterion, DCS achieves up to 8.13% accuracy gain with 5.82% less parameters than the existing state of the art work published at ICLR 2023 (iv) when considering per-cluster accuracy, SINF performs on average 5.73%, 8.38% and 6.36% better than the base VGG16, VGG19, and ResNet50.

SDF-NN: A Deep Neural Network with Semantic Dropping and Fusion for Natural Language Inference

Natural Language Inference Using Lstm Model With Sentence Fusion

Asynchronous Deep Interaction Network for Natural Language Inference.

Semantics-Aware Inferential Network for Natural Language Understanding

Semantic Representation and Inference for NLP

Enhancing and Combining Sequential and Tree LSTM for Natural Language Inference.

Faster and Accurate Neural Networks with Semantic Inference

Multilevel Image-Enhanced Sentence Representation Net for Natural Language Inference

Natural Language-centered Inference Network for Multi-modal Fake News Detection

A Deep Fusion Matching Network Semantic Reasoning Model

Enhanced Lstm For Natural Language Inference

A Hybrid Siamese Neural Network for Natural Language Inference in Cyber-Physical Systems

Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI Models

Knowledge Adaptive Neural Network for Natural Language Inference.

DifNet: Semantic Segmentation by Diffusion Networks.

SLFNet: Generating Semantic Logic Forms from Natural Language Using Semantic Probability Graphs

Abductive natural language inference by interactive model with structural loss

Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models

Semantic Similarity Computing Model Based on Multi Model Fine-Grained Nonlinear Fusion

DR-BiLSTM: Dependent Reading Bidirectional LSTM for Natural Language Inference

OCNLI: Original Chinese Natural Language Inference