Towards Optimal Attribute Weight Setting for 1-Nearest Neighbor Learning Algorithms

C. Ling,Handong Wang
IF: 9.588
2007-01-01
Artificial Intelligence Review
Abstract:Nearest neighbor learning algorithms, an example of the lazy learning paradigm, rely on a distance function to measure the similarity of testing examples with the stored training examples. Since certain attributes are more discriminative, while others can be less or totally irrelevant, attributes should be weighed diierently in the distance function. Most previous studies on weight setting for NN learning algorithms are empirical. In this paper we describe our attempt on deciding theoretically optimal weights that minimize the predictive error for NN algorithms. Assuming a uniform distribution of examples in a 2-d continuous space, we rst derive the average predictive error introduced by a linear classiication boundary, and then determine the optimal weight setting for any polygonal classiication region. Our theoretical results of optimal attribute weights can be served as a baseline or lower bound for comparing other empirical weight setting methods.
What problem does this paper attempt to address?