Abstract:Feature selection techniques are widely being used as a preprocessing step to train machine learning algorithms to circumvent the curse of dimensionality, overfitting, and computation time challenges. Projection-based methods are frequently employed in feature selection, leveraging the extraction of linear relationships among features. The absence of nonlinear information extraction among features is notable in this context. While auto-encoder based techniques have recently gained traction for feature selection, their focus remains primarily on the encoding phase, as it is through this phase that the selected features are derived. The subtle point is that the performance of auto-encoder to obtain the most discriminative features is significantly affected by decoding phase. To address these challenges, in this paper, we proposed a novel feature selection based on auto-encoder to not only extracting nonlinear information among features but also decoding phase is regularized as well to enhance the performance of algorithm. In this study, we defined a new model of auto-encoder to preserve the topological information of reconstructed close to input data. To geometric structure of input data is preserved in projected space using Laplacian graph, and geometrical projected space is preserved in reconstructed space using a suitable term (abstract Laplacian graph of reconstructed data) in optimization problem. Preserving abstract Laplacian graph of reconstructed data close to Laplacian graph of input data affects the performance of feature selection and we experimentally showed this. Therefore, we show an effective approach to solve the objective of the corresponding problem. Since this approach can be mainly used for clustering aims, we conducted experiments on ten benchmark datasets and assessed our propped method based on clustering accuracy and normalized mutual information (NMI) metric. Our method obtained considerable superiority over recent state-of-the-art techniques in terms of NMI and accuracy.

Feature Selection Using Multiple Auto-Encoders.

Autoencoder Inspired Unsupervised Feature Selection

Fractal Autoencoders for Feature Selection

Adaptive Sparse Allocation with Mutual Choice & Feature Choice Sparse Autoencoders

Efficient Dictionary Learning with Switch Sparse Autoencoders

Unsupervised feature selection using sparse manifold learning: Auto-encoder approach

Hybrid Embedded Deep Stacked Sparse Autoencoder with w_LPPD SVM Ensemble

Robust autoencoder feature selector for unsupervised feature selection

Indirectly Parameterized Concrete Autoencoders

Feature-Aligned Stacked Autoencoder: A Novel Semisupervised Deep Learning Model for Pattern Classification of Industrial Faults

Feature Selection for Imbalanced Data with Deep Sparse Autoencoders Ensemble

Gated Stacked Target-Related Autoencoder: A Novel Deep Feature Extraction and Layerwise Ensemble Method for Industrial Soft Sensor Application

Neuro-Symbolic Embedding for Short and Effective Feature Selection via Autoregressive Generation

Stacked Dual-Guided Autoencoder: A Scalable Deep Latent Variable Model for Semi-Supervised Industrial Soft Sensing

Diversified feature representation via deep auto-encoder ensemble through multiple activation functions

Enhancing Neural Network Interpretability with Feature-Aligned Sparse Autoencoders

AFS: An Attention-based mechanism for Supervised Feature Selection

Building Feature Space of Extreme Learning Machine with Sparse Denoising Stacked-Autoencoder.

GAEFS: Self-supervised Graph Auto-encoder enhanced Feature Selection

Novel Segmented Stacked Autoencoder for Effective Dimensionality Reduction and Feature Extraction in Hyperspectral Imaging

Features that Make a Difference: Leveraging Gradients for Improved Dictionary Learning