Abstract:Recently, deep learning models have made great breakthroughs in the field of computer vision, relying on large-scale class-balanced datasets. However, most of them do not consider the class-imbalanced data. In reality, the class-imbalanced distribution can lead to the degradation of model performance, reducing the generalization of these models. In addition, in the era of big data, many applications need to use real-time visual data. These data come from different mobile devices, which continuously generate a huge number of visual data. However, there are few studies using real-time data from information systems, real-time data is easy to capture but difficult to use. In order to solve the above problems, we propose a new model (Transfer Learning Classifier, TLC) based on transfer learning to deal with class-imbalanced data. The model includes active sampling module, real-time data augmentation module and DenseNet module. Among them, (1) the newly proposed active sampling module can dynamically adjust the number of samples with skewed distribution; (2) the data augmentation module can expand the real-time data to avoid over-fitting and insufficient data; (3) the DenseNet module is a standard DenseNet network pre-trained on the ImageNet dataset and transferred to TLC for relearning, and then we adjust the memory usage of the standard DenseNet to make it more efficient. In addition, we have applied a new end-to-end real-time data storage and analysis system. A large number of experiments have been carried out on four different long mantissa data sets. Experimental results show that the proposed TLC model can effectively deal with the static data as well as the real-time data, and the classification effect of imbalanced data is better than that of existing models.

Dynamic Sampling in Convolutional Neural Networks for Imbalanced Data Classification

Real-Time Target Detection and Recognition with Deep Convolutional Networks for Intelligent Visual Surveillance

Imbalanced data classification: Using transfer learning and active sampling

Dynamic Sampling Convolutional Neural Networks.

Deep Representation Via Convolutional Neural Network for Classification of Spatiotemporal Event Streams

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Deep Over-sampling Framework for Classifying Imbalanced Data

High-Resolution Remote Sensing Imagery Classification Of Imbalanced Data Using Multistage Sampling Method And Deep Neural Networks

Dynamic Spectrum Matching with One-shot Learning

SLADS-Net: Supervised Learning Approach for Dynamic Sampling using Deep Neural Networks

An Adaptive Sampling Scheme to Efficiently Train Fully Convolutional Networks for Semantic Segmentation

Deep Learning and Hybrid Approaches for Dynamic Scene Analysis, Object Detection and Motion Tracking

Senvis-Net: Learning from Imbalanced Machinery Data by Transferring Visual Element Detectors

CNUSVM: Hybrid CNN-Uneven SVM Model for Imbalanced Visual Learning

Deep convolutional neural networks with genetic algorithm-based synthetic minority over-sampling technique for improved imbalanced data classification

Efficient hybrid oversampling and intelligent undersampling for imbalanced big data classification

Adaptive Sampling for Deep Learning via Efficient Nonparametric Proxies

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

High-dimensional multimedia classification using deep CNN and extended residual units

A Differentiable Parallel Sampler for Efficient Video Classification

Learning Deep Representations Using Convolutional Auto-Encoders with Symmetric Skip Connections