Manifold learning through locally linear reconstruction based on Euclidean distance
Rassoul Hajizadeh,Fakhroddin Nazari
DOI: https://doi.org/10.1007/s11042-024-18709-8
IF: 2.577
2024-03-20
Multimedia Tools and Applications
Abstract:In this manuscript, we introduce a novel local manifold learning method that extracts further structural information from the high-dimensional data manifold. We construct a neighborhood graph matrix that incorporates two different types of structural information: linear relationships and Euclidean distances between local data points. Based on this neighborhood graph matrix, we propose a new cost function to represent the data manifold in the low-dimensional space. Subsequently, the low-dimensional data manifold is computed by minimizing the proposed cost function with respect to the low-dimensional data points. The similarity of the structure of the low-dimensional represented data manifold to the high-dimensional data manifold is evaluated based on the functionality of the k-nearest neighbor classifier. The proximity of the achieved recognition rate in the high-dimensional space to the calculated recognition rate in the low-dimensional data manifold can serve as a metric of similarity. We demonstrate the effectiveness of the proposed method on various datasets, including the ORL face image database, Parkinson's Disease Classification dataset of UCI machine learning repository, and CinCECGTorso dataset of UCR time series classification archives, as well as three 3-dimensional synthetic datasets. Our results demonstrate that the proposed method surpasses state-of-the-art manifold learning techniques in effectively preserving the data structure. Furthermore, the method displays reduced sensitivity to the initial number of neighbors, contributing to its robustness. Additionally, it effectively mitigates noise effects in specific low-dimensional representation spaces, resulting in a notable improvement in recognition rates by more than 5%.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering