Abstract:Dictionary-based classification has been promising in knowledge discovery from image data, due to its good performance and interpretable theoretical system. Dictionary learning effectively supports both small- and large-scale datasets, while its robustness and performance depends on the atoms of the dictionary most of the time. Empirically, using a large number of atoms is helpful to obtain a robust classification, while robustness cannot be ensured when setting a small number of atoms. However, learning a huge dictionary dramatically slows down the speed of classification, which is especially worse on the large-scale datasets. To address the problem, we propose a Fast and Robust Dictionary-based Classification (FRDC) framework, which fully utilizes the learned dictionary for classification by staging - and -norms to obtain a robust sparse representation. The new objective function, on the one hand, introduces an additional -norm term upon the conventional -norm optimization, which generates a more robust classification. On the other hand, the optimization based on both - and -norms is solved in two stages, which is much easier and faster than current solutions. In this way, even when using a limited size of dictionary, which makes sure the classification runs very fast, it still can gain higher robustness for multiple types of image data. The optimization is then theoretically analyzed in a new formulation, close but distinct to elastic-net, to prove it is crucial to improve the performance under the premise of robustness. According to our extensive experiments conducted on four image datasets for face and object classification, FRDC keeps generating a robust classification no matter whether using a small or large number of atoms. This guarantees a fast and robust dictionary-based image classification. Furthermore, when simply using deep features extracted via some popular pre-trained neural networks, it outperforms many state-of-the-art methods on the specific datasets.

Hydra: competing convolutional kernels for fast and accurate time series classification

ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels

Multilevel Dynamic Time Warping: A Parameter-Light Method for Fast Time Series Classification

Time series classification with random convolution kernels based transforms: pooling operators and input representations matter

MiniRocket: A Very Fast (Almost) Deterministic Transform for Time Series Classification

HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computing

MultiRocket: multiple pooling operators and transformations for fast and effective time series classification

Exploiting Multi-Channels Deep Convolutional Neural Networks for Multivariate Time Series Classification

Adacket: ADAptive Convolutional KErnel Transform for Multivariate Time Series Classification

Multi-Scale Convolutional Neural Networks for Time Series Classification

InceptionTime: Finding AlexNet for time series classification

Detach-ROCKET: Sequential feature selection for time series classification with random convolutional kernels

TS-CHIEF: a scalable and accurate forest algorithm for time series classification

Real-Time and Robust Hyperdimensional Classification

HIVE-COTE 2.0: a new meta ensemble for time series classification

Fast and Robust Dictionary-based Classification for Image Data

Hierarchical Nonlinear Dictionary Learning with Convolutional Neural Networks: Application to Sar Target Recognition

Prognostic classification based on random convolutional kernel

Timage -- A Robust Time Series Classification Pipeline