WAVELET KERNEL FUNCTION NETWORK

L Zhang,WD Zhou,LC Jiao

DOI: https://doi.org/10.3321/j.issn:1001-9014.2001.03.015

2001-01-01

Abstract:A new wavelet kernel function network (WKFN) was proposed as an alternative of support vector machine (SVM). Simulation experiments show that the performance of approximation and recognition of WKFN is equal, to that of the corresponding SVM, hut gets an advantage over that of a general neural network.

What problem does this paper attempt to address?

Complex-Valued Wavelet Network

CG Li,XF Liao,JB Yu

DOI: https://doi.org/10.1016/s0022-0000(03)00069-2

IF: 1.043

2003-01-01

Journal of Computer and System Sciences

Abstract:In this paper, a complex-valued wavelet network (CWN) is proposed. The network has complex inputs, outputs, connection weights, dilation and translation parameters, but the nonlinearity of the hidden nodes remains a real-valued function (real-valued wavelet function). This kind of network is able to approximate an arbitrary nonlinear function in complex multi-dimensional space, and it provides a powerful tool for nonlinear signal processing involving complex signals. A complex algorithm is derived for the training of the proposed CWN. A numerical example on nonlinear communication channel identification is presented for illustration.
A multiresolution wavelet kernel for support vector regression

Feng-Qing Han,Da-Cheng Wang,Chuan-Dong Li,Xiao-Feng Liao

DOI: https://doi.org/10.1007/11759966_150

2006-01-01

Abstract:In this paper a multiresolution wavelet kernel function (MWKF) is proposed for support vector regression. It is different from traditional SVR that the process of reducing dimension is utilized before increasing dimension. The nonlinear mapping ${\it \Phi}(x)$ from the input space S to the feature space has explicit expression based on dimensionality reduction and wavelet multiresolution analysis. This wavelet kernel function can be represented by inner product. This method guarantee that quadratic program of support vector regression has feasible solution and need not parameter selecting in kernel function. Numerical experiments demonstrate the effectiveness of this method.
A New Kernel Learning Algorithm for Wavelet Features-based Face Recognition

ZHOU Xiao-Fei,JIANG Wen-Han,YANG Jing-Yu

DOI: https://doi.org/10.3969/j.issn.1002-137X.2007.05.063

2007-01-01

Computer Science

Abstract:A new kernel learning method called Kernel Nearest Neighbor Convex hull(KNNCH) algorithm is used for wavelet features based face recognition.Inspired by the intuitive geometric interpretation of SVM based on convex hulls,KNNCH maps the data in the original space to the kernel space with the kernel trick and constructs a nearest neighbor classifier in the kernel space,which takes the convex hulls of training sets as the extended class sets.The lower frequency features of face images extracted by 2D wavelet transform are efficient for face recognition.The features not only preserve the main information of face images,but also have the less dimensionality.KNNCH with wavelet features for face recognition shows very good performance,which can achieve 99.25% recognition rate with “leave-one-out” test method on ORL face database.
Wavelet Kernel Support Vector Machines for Sparse Approximation

Tong Yubing,Yang Dongkai,Zhang Qishan

DOI: https://doi.org/10.1007/s11767-004-0202-3

2006-01-01

Abstract:Wavelet, a powerful tool for signal processing, can be used to approximate the target function. For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel Support Vector Machines (SVM), which can converge to minimum error with better sparsity. Here, wavelet functions would be firstly used to construct the admitted kernel for SVM according to Mercy theory; then new SVM with this kernel can be used to approximate the target function with better sparsity than wavelet approxiamtion itself. The results obtained by our simulation experiment show the feasibility and validity of wavelet kernel support vector machines.
Fast, K Nearest Neighbors Search Algorithm Based on Wavelet Transform

Yu-Long Qiao,Zhe-Ming Lu,Sheng-He Sun

DOI: https://doi.org/10.1093/ietfec/e89-a.8.2239

2006-01-01

Abstract:This letter proposes a fast k nearest neighbors search algorithm based on the wavelet transform. This technique exploits the important information of the approximation coefficients of the transform coefficient vector, from which we obtain two crucial inequalities that can be used to reject those vectors for which it is impossible to be k nearest neighbors. The computational complexity for searching for k nearest neighbors can be largely reduced. Experimental results on texture classification verify the effectiveness of our algorithm.
Fuzzy Wavelet Neural Networks Based on SVM

ZHANG Xiao-guang,KUANG Ying-zhi,GENG Dao-hua,WU Xing-biao

DOI: https://doi.org/10.3969/j.issn.1006-3080.2006.11.022

2006-01-01

Abstract:For wavelets network with high-dimensional inputs,both the initial parameters and network structure are very complicated,and the amount of computation is large.Toward this problem,a new method is proposed using support vector machine(SVM) to ascertain both the initial parameters and network structure of wavelet network.At first,the supervised fuzzy clustering algorithm is used to extract fuzzy rule from clustering.And then,for the consequent rule,SVM is applied to both the initial parameters and the network structure of wavelet network.Finally,gradient descent algorithm is adopted to adjust the parameters of fuzzy wavelet network so as to make the error between the outputs of fuzzy wavelet network and the expectant outputs is less.Simulation result shows that this algorithm can greatly improve the classification precision comparing to traditional fuzzy neural network(FNN).
Least squares support vector machine based on continuous wavelet kernel

Xiangjun Wen,Yunze Cai,Xiaoming Xu

DOI: https://doi.org/10.1007/11427391_135

2005-01-01

Abstract:Based on the continuous wavelet transform theory and conditions of the admissible support vector kernel, a novel notion of multidimensional wavelet kernels is proposed for Least Squares Support Vector Machine (LS-WSVM) for pattern recognition and function estimation. Theoretic analysis of the wavelet kernel is discussed in detail. The good approximation property of wavelet kernel function enhances the generalization ability of LS-WSVM method and some experimental results are presented to illustrate the effectiveness and feasibility of the proposed method.
A study of wavelet kernel in support vector regression

Lefei Zhang,Fengqing Han

DOI: https://doi.org/10.1080/10798587.2010.10643121

2010-01-01

Intelligent Automation & Soft Computing

Abstract:A new kernel function is proposed for support vector regression (SVR). A one-to-one mapping is adopted for dimensionality reduction and then continuous wavelet transform is utilized to construct the nonlinear mapping Φ(x) from the input space S to the feature space. So we call it continuous wavelet kernel function (CWKF). This wavelet kernel is not translation invariant kernel, instead inner product kernel and need not parameter selecting. The quadratic program of support vector regression has feasible solution if we use CWKF. Numerical experiments demonstrate the effectiveness of this method. Copyright © 2010.
Sparse Approximation Based On Wavelet Kernel Support Vector Machines

Dongkai Yang,YuBing Tong,Qishan Zhang

DOI: https://doi.org/10.1109/icmlc.2005.1527683

2005-01-01

Abstract:For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel support vector machines, which can converge to minimum error with better sparsity. The results obtained by our simulation experiment show the feasibility and validity of wavelet kernel support vector machines.
Efficient Object Recognition Using Boundary Representation and Wavelet Neural Network.

Hong Pan,Liang-Zheng Xia

DOI: https://doi.org/10.1109/tnn.2008.2006331

2008-01-01

IEEE Transactions on Neural Networks

Abstract:Wavelet neural networks combine the functions of time-frequency localization from the wavelet transform and of self-studying from the neural network, which make them particularly suitable for the classification of complex patterns. In this paper, an efficient object recognition method using boundary representation and the wavelet neural network is proposed. The method employs a wavelet neural network (WNN) to characterize the singularities of the object curvature representation and to perform the object classification at the same time and in an automatic way. The local time-frequency attributes of the singularities on the object boundary are detected by making a preliminary wavelet analysis of the curvature representation. Then, the discriminative scale-translation features of the singularities are stored as the initial scale-translation parameters of the wavelet nodes in the WNN. These parameters are trained to their optimum status during the learning stage. With our approach, as opposed to matching features by convolving the signal with wavelet functions at a large number of scales, the computational burden is significantly reduced. Only a few convolutions are performed at the optimum scale-translation grids during the classification, which makes it suitable for real-time recognition tasks. Compared with the artificial-neural-network-based approaches preceded by wavelet filter banks with fixed scale-translation parameters, the support vector machine (SVM) using traditional Fourier descriptors and K-nearest-neighbor ( K-NN) classifier based on the state-of-the-art shape descriptors, our scheme demonstrates superior and stable discrimination performance under various noisy and affine conditions.
Reproducing wavelet kernel method in nonlinear system identification

WEN Xiang-jun,XU Xiao-ming,CAI Yun-ze,文香军,许晓鸣,蔡云泽

2008-01-01

Abstract:By combining the wavelet decomposition with kernel method, a practical approach of universal multi-scale wavelet kernels constructed in reproducing kernel Hilbert space (RKHS) is discussed, and an identification scheme using wavelet support vector machines (WSVM) estimator is proposed for nonlinear dynamic systems. The good approximating properties of wavelet kernel function enhance the generalization ability of the proposed method, and the comparison of some numerical experimental results between the novel approach and some existing methods is encouraging.
Fuzzy Wavelet Network Modeling with B-spline Wavelet

J Wang,JA Xiao,D Hu

DOI: https://doi.org/10.1109/icmlc.2005.1527663

2005-01-01

Abstract:Based on the wavelet transform, we present a fuzzy wavelet network (FWN) for approximating arbitrary nonlinear function. Compared with the other methods, the FWN with B-spline wavelet has more frequency information. The approximation capability is proved. Simulation examples are given for static system and dynamic system respectively. The presented FWN not only reserves the multi-resolution capability of WNN, but also has the advantages of the approximation accuracy and good generalization performance.
Least Squares Littlewood-Paley Wavelet Support Vector Machine.

Fangfang Wu,Yinliang Zhao

DOI: https://doi.org/10.1007/11579427_47

IF: 1.24

2005-01-01

Information and Computation

Abstract:The kernel function of support vector machine (SVM) is an important factor for the learning result of SVM. Based on the wavelet decomposition and conditions of the support vector kernel function, Littlewood-Paley wavelet kernel function for SVM is proposed. This function is a kind of orthonormal function, and it can simulate almost any curve in quadratic continuous integral space, thus it enhances the generalization ability of the SVM. According to the wavelet kernel function and the regularization theory, Least squares Littlewood-Paley wavelet support vector machine (LS-LPWSVM) is proposed to simplify the process of LPWSVM. The LSLPWSVM is then applied to the regression analysis and classifying. Experiment results show that the precision is improved by LS-LPWSVM, compared with LS-SVM whose kernel function is Gauss function.
Wavelet Kernel Matching Pursuit Machine

Qing Li,Licheng Jiao,Shuiping Gou

DOI: https://doi.org/10.1007/11941439_140

2006-01-01

Abstract:Kernel Matching Pursuit Machine is a relatively new learning algorithm utilizing Mercer kernels to produce non-linear version of conventional supervised and unsupervised learning algorithm. But the commonly used Mercer kernels can't expand a set of complete bases in the feature space (subspace of the square and integrable space). Hence the decision-function found by the machine can't approximate arbitrary objective function in feature space as precise as possible. Wavelet technique shows promise for both nonstationary signal approximation and classification, so we combine KMPM with wavelet technique to improve the performance of the machine, and put forward a wavelet translation invariant kernel, which is a Mercer admissive kernel by theoretical analysis. The wavelet kernel matching pursuit machine is constructed in this paper by a translation-invariant wavelet kernel. It is shown that WKMPM is much more effective in the problems of regression and pattern recognition by the number of comparable experiments.
RADIAL BASIS FUNCTION NETWORKS BASED ON WAVELET FRAMES

张茁生,刘贵忠,张宗平

DOI: https://doi.org/10.16383/j.aas.2002.02.009

2002-01-01

Abstract:A set of wavelet frames generated by Gaussian radial basis functions are presented. It is constructively proved that a radial basis function network with Gaussian activation functions can approximate any function in L2(Rd) with desired accuracy. Furthermore, an adaptive learning algorithm of constructing and training networks is proposed based on time-frequency localization properties of Gaussian radial basis functions and the adaptive projection algorithm. Applications to signal reconstruction and noise elimination are given.
Least squares wavelet support vector machines for nonlinear system identification

Zhenhua Yu,Yuanli Cai

DOI: https://doi.org/10.1007/11427445_71

2005-01-01

Abstract:A novel admissible support vector kernel, namely the wavelet kernel satisfying wavelet frames, is presented based on the wavelet theory. The wavelet kernel can approximate arbitrary functions, and is especially suitable for local signal analysis, hence the generalization ability of the support vector machines (SVM) is improved. Based on the wavelet kernel and the least squares support vector machines, the least squares wavelet support vector machines (LS-WSVM) are constructed. In order to validate the performance of the wavelet kernel, LS-WSVM is applied to a nonlinear system identification problem, and the computational process is compared with that of the Gaussian kernel. The results show that the wavelet kernel is more efficient than the Gaussian kernel.
Support Vector Regression Model with Wavelet Reproducing Kernel for Function Learning

PENG Hong,WANG Jun

DOI: https://doi.org/10.3969/j.issn.1673-159x.2006.05.015

2006-01-01

Abstract:Based on the theory of wavelet analysis and reproducing kernel Hibert space(RKHS),a new wavelet reproducing kernel is proposed in this paper.The generated bywavelet basis function has different resolution,and the wavelet reproducing kernel is an admissive support vector kernel which can be used to construct least square support vector regression model for function learning.The regression model incorporates the advantage of the support vector regression and the wavelet analysis.Simulation examples are given to illustrate the feasibility and effectiveness of the method.
WaveletKernelNet: An Interpretable Deep Neural Network for Industrial Intelligent Diagnosis

Tianfu Li,Zhibin Zhao,Chuang Sun,Li Cheng,Xuefeng Chen,Ruqiang Yan,Robert X. Gao

DOI: https://doi.org/10.1109/TSMC.2020.3048950

2020-05-06

Abstract:Convolutional neural network (CNN), with ability of feature learning and nonlinear mapping, has demonstrated its effectiveness in prognostics and health management (PHM). However, explanation on the physical meaning of a CNN architecture has rarely been studied. In this paper, a novel wavelet driven deep neural network termed as WaveletKernelNet (WKN) is presented, where a continuous wavelet convolutional (CWConv) layer is designed to replace the first convolutional layer of the standard CNN. This enables the first CWConv layer to discover more meaningful filters. Furthermore, only the scale parameter and translation parameter are directly learned from raw data at this CWConv layer. This provides a very effective way to obtain a customized filter bank, specifically tuned for extracting defect-related impact component embedded in the vibration signal. In addition, three experimental verification using data from laboratory environment are carried out to verify effectiveness of the proposed method for mechanical fault diagnosis. The results show the importance of the designed CWConv layer and the output of CWConv layer is interpretable. Besides, it is found that WKN has fewer parameters, higher fault classification accuracy and faster convergence speed than standard CNN.

Computer Vision and Pattern Recognition,Machine Learning,Neural and Evolutionary Computing
A Local Linear Wavelet Neural Network

Yuehui Chen,Jiwen Dong,Bo Yang,Yong Zhang

DOI: https://doi.org/10.1109/wcica.2004.1341921

2004-01-01

Abstract:This paper presents a local linear wavelet neural network. The difference of the network with the original wavelet neural network is that the connection weights between the hidden layer and output layer of the original WNN are replaced by a local linear model. A simple and fast training algorithm, particle swarm optimization (PSO), is also introduced for training the local linear wavelet neural network. Simulation results for the identification of nonlinear systems show the feasibility and effectiveness of the proposed method.

WAVELET KERNEL FUNCTION NETWORK

Complex-Valued Wavelet Network

A multiresolution wavelet kernel for support vector regression

A New Kernel Learning Algorithm for Wavelet Features-based Face Recognition

Wavelet Kernel Support Vector Machines for Sparse Approximation

Fast, K Nearest Neighbors Search Algorithm Based on Wavelet Transform

Fuzzy Wavelet Neural Networks Based on SVM

Least squares support vector machine based on continuous wavelet kernel

A study of wavelet kernel in support vector regression

Sparse Approximation Based On Wavelet Kernel Support Vector Machines

Efficient Object Recognition Using Boundary Representation and Wavelet Neural Network.

Reproducing wavelet kernel method in nonlinear system identification

Fuzzy Wavelet Network Modeling with B-spline Wavelet

Least Squares Littlewood-Paley Wavelet Support Vector Machine.

Wavelet Kernel Matching Pursuit Machine

RADIAL BASIS FUNCTION NETWORKS BASED ON WAVELET FRAMES

Least squares wavelet support vector machines for nonlinear system identification

Support Vector Regression Model with Wavelet Reproducing Kernel for Function Learning

WaveletKernelNet: An Interpretable Deep Neural Network for Industrial Intelligent Diagnosis

A Local Linear Wavelet Neural Network