Abstract:<p>Deep learning technologies have been rapidly developing recently. They have shown excellent performances in many fields. However, deep learning networks have weak adaptability to small sample sizes. Usually, deep learning networks require tens of thousands of samples to avoid overfitting. In contrast, the kernel method can deal with small sample sizes. In this paper, we use only dozens of samples to train a successful classifier. Deep multiple kernel learning (DMKL) has emerged in recent years. It combines the ideas of deep learning and multiple kernel learning. Unfortunately, the DMKL network with a fixed structure cannot adapt to data of different dimensions and sizes. Therefore, in this paper, we propose a novel depth-width-scaling multiple kernel learning (DWS-MKL) algorithm. It has the ability to adjust the architecture according to the input data. We optimize the estimation of leave-one-out error by using the span bound instead of the dual objective function. Finally, we choose a large number of data sets from the UCI benchmark data sets for classification tasks. We also evaluate DWS-MKL on the MNIST data set. The experimental results show that different frameworks have different performances on the same dataset. Our DWS-MKL algorithm obtains better classification results than the state-of-the-art kernel learning algorithms, as determined by a thorough comparison. The encouraging results demonstrate that our method has the potential to improve generalization performance of the model.</p>

Letter: Weighted maximum margin discriminant analysis with kernels

Automatic Coefficient Selection in Weighted Maximum Margin Criterion

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Distance-Based Classifier Via the Kernel Trick.

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Adaptive quasiconformal kernel discriminant analysis

Kernel Parameter Optimization for KFDA Based on the Maximum Margin Criterion.

A Novel Kernel-Based Maximum a Posteriori Classification Method

WIMMC: Weighted Incremental Maximum Margin Criterion

Robust subspace clustering based on automatic weighted multiple kernel learning

Improved kernel direct Fisher discriminant analysis and face recognition

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Fault diagnosis based on imbalance modified kernel Fisher discriminant analysis

Maximum Margin Based Semi-supervised Spectral Kernel Learning.

Graph kernel by spectral transform in kernel fisher discriminant analysis

Kernel optimization-based discriminant analysis for face recognition

DWS-MKL: Depth-width-scaling multiple kernel learning for data classification

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

SPARSE KERNEL MAXIMUM MARGIN CLUSTERING

Laplacian adaptive weighted discriminant analysis for semi-supervised multi-class classification

A Family of Maximum Margin Criterion for Adaptive Learning