Survey of non-parametric estimation methods

Wu Le-nan

Abstract:In order to solve the problem of function estimation,we first discuss traditional parametric regression method.Since it needs a priori knowledge to determine the model,the parametric method is not robust and is model-sensitive.Thus,data-driven non-parametric method is introduced,which needs not any a prior knowledge to estimate the unknown function.Eight major non-parametric methods are discussed as kernel method,local polynomial regression,regularization method,normal mean model,wavelet method,overcomplete dictionary,forward neural network,and radial basis function network.These algorithms are compared,and their coherence and inheritance are investigated.Finally,generalize the algorithms to high dimensionality and point out two problems as curse of dimensionality of computation and sample.The former can be settled down by intelligent methods while the latter is problem intrinsic.

Mathematics,Computer Science