Constructing the l2 graph for subspace learning and subspace clustering

Xi Peng,Lei Zhang,Zhang Yi
2012-01-01
Abstract:It is important to construct sparse similarity graphs for graph-oriented learning algorithms. In these graphs, each vertex denotes a data point and the connection weight represents the similarity between the connected points. A good similarity graph should only retain connections among intra-subspace data points. In real applications, however, it is hard to obtain a sparse similarity graph because of the errors that are likely to exist in the data. Therefore, it is a major challenge to eliminate the effects of these errors to obtain a sparse similarity graph. Some recent works, such as the Low Rank Representation method, have formulated the problem as a convex optimization and achieved impressive results in image clustering and motion segmentation. However, such methods must solve a convex problem, which is computationally complex. Moreover, the performance of these techniques is degraded when data are grossly corrupted. Indeed, these problems are mainly caused by the adopted error-handling strategy, ie, denoising from data set and then encoding each sample over a clean dictionary. Can we find another way to eliminate the effects of errors and construct a sparse similarity graph? Based on the key assumption that the trivial coefficients are always distributed over trivial data points, such as noise or outliers, this article proposes a novel scheme to obtain a sparse similarity graph in the manner of encoding and then denoising from the representation. Moreover, we develop an algorithm, called the L2-graph, to verify the effectiveness of the scheme. Theoretical analysis shows that it is feasible to handle the errors by removing the trivial …
What problem does this paper attempt to address?