Abstract:Kernel functions play an important role in a wide range of scientific computing and machine learning problems. These functions lead to dense kernel matrices that impose great challenges in computational costs at large scale. In this paper, we develop a set of fast kernel matrix compressing algorithms, which can reduce computation cost of matrix operations in the related applications. The foundation of these algorithms is the polyharmonic spline interpolation, which includes a set of radial basis functions that allow flexible choices of interpolating nodes, and a set of polynomial basis functions that guarantee the solvability and convergence of the interpolation. With these properties, original data points in the interacting kernel function can be randomly sampled with great flexibility, so the proposed method is suitable for complicated data structures, such as high-dimensionality, random distribution, or manifold. To further boost the algorithm accuracy and efficiency, this scheme is equipped with a QR sampling strategy, and combined with a recently developed fast stochastic SVD to form a hybrid method. If the overall number of degree of freedom is N, then the compressing algorithm has complexity of O(N) for low-rank matrices, and O(NlogN) for general matrices with a hierarchical structure. Numerical results for data on various domains and different kernel functions validate the accuracy and efficiency of the proposed method.

Evaluation and comparision of compactly supported radial basis function for kernel machine

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Gauss-like Logarithmic Kernel Function to improve the performance of kernel machines on the small datasets

Self-representative kernel concept factorization

Kernel Matrix Learning with a General Regularized Risk Functional Criterion

Random radial basis function kernel-based support vector machine

Sparse Least Squares Low Rank Kernel Machines

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Improving Support Vector Machine Classifiers By Modifying Kernel Functions

A hybrid stochastic interpolation and compression method for kernel matrices

Machine Learning Application of Generalized Gaussian Radial Basis Function and Its Reproducing Kernel Theory

Comparison of $\ell _{1}$ -Norm SVR and Sparse Coding Algorithms for Linear Regression

Comparison of &Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\ell _{1}$ &Lt;/tex-Math></inline-formula>-norm SVR and Sparse Coding Algorithms for Linear Regression

Learning Analysis of Kernel Ridgeless Regression with Asymmetric Kernel Learning

PBBFMM3D: A parallel black-box algorithm for kernel matrix-vector multiplication

Smoothing Splines Using Compactly Supported, Positive Definite, Radial Basis Functions

An efficient Kernel-based matrixized least squares support vector machine

Scaling the kernel function to improve performance of the support vector machine

On the numerical rank of radial basis function kernels in high dimension

An information-geometrical method for improving the performance of support vector machine classifiers

An Efficient Kernel Evaluation Criterion for Multiclass Classification