Abstract:Deep learning has achieved remarkable success in recent years; however, deep learning methods face significant challenges on long-tailed datasets, which are prevalent in real-world scenarios. In a long-tailed dataset, there are many more samples in the head classes than in the tail classes, and this class imbalance makes it difficult to learn a good feature representation for both head and tail classes simultaneously, particularly when using a single-stage method. Although the existing two-stage methods can alleviate the problem of single-stage methods not performing well on the tail classes by classifier retraining in the second stage, this does not resolve the problem of insufficient learning of head and tail features. Thus, in this paper, we propose a two-stage feature fusion network (FFN). The proposed FFN addresses this issue using one network for the head classes and another network for the tail classes, each of which is trained with a different loss function. This allows the feature learning module to effectively distinguish between the head and tail classes in the embedding space. The classifier learning module fuses the features obtained from the feature learning module, and the classifier is fine-tuned to classify the input images. Different from traditional two-stage methods, the proposed utilizes different loss functions for the head and tail classes; thus, the classifier can achieve balanced results between the head and tail classes. We conduct extensive experiments on three benchmark datasets comparing the proposed FFN with six state-of-the-art methods including two baseline methods, the experimental results demonstrate that the FFN achieves significant improvement on all three benchmark datasets. The code is publicly available at https://github.com/zxsong999/Feature-Fusion-Network.pytorch.

Online video object classification using fast similarity network fusion

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

FASTER Recurrent Networks for Efficient Video Classification

SlowFast Networks for Video Recognition

Loss Switching Fusion with Similarity Search for Video Classification

Efficient Object Detection Based on Deep Feature Fusion Network

Fusing Multi-Stream Deep Networks for Video Classification

Feature fusion network based on few-shot fine-grained classification

Multi-Stream Multi-Class Fusion of Deep Networks for Video Classification.

Small Object Detection Method Based on Adaptive Spatial Parallel Convolution and Fast Multi-Scale Fusion

A Short Video Classification Framework Based on Cross-Modal Fusion

FLFuse-Net: A Fast and Lightweight Infrared and Visible Image Fusion Network Via Feature Flow and Edge Compensation for Salient Information

FBSNet: A Fast Bilateral Symmetrical Network for Real-Time Semantic Segmentation

Fused DNN: A deep neural network fusion approach to fast and robust pedestrian detection

Fianet: Video Object Detection Via Joint Feature-Level and Instance-Level Aggregation

Fusion Object Detection with Convolutional Neural Network

Feature Fusion Network for Long-Tailed Visual Recognition

Fusion that matters: convolutional fusion networks for visual recognition

MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images

Multilayer Feature Fusion Network With Spatial Attention and Gated Mechanism for Remote Sensing Scene Classification

LSTM-SN: complex text classifying with LSTM fusion social network