Abstract:The efficacy of feature selection methods in dimensionality reduction and enhancing the performance of learning algorithms has been well documented. Traditional feature selection algorithms often grapple with delineating non-linear relationships between features and responses. While deep neural networks excel in capturing such non-linearities, their inherent "black-box" nature detracts from their interpretability. Furthermore, the complexity of deep network architectures can give rise to prolonged training durations and the challenge of vanishing gradients. This study aims to refine network structures, hasten network training, and bolster model interpretability without forfeiting accuracy. This paper delves into a sparse-weighted feature selection approach grounded in convolutional neural networks, termed the low-dimensional sparse-weighted feature selection network (LSWFSNet). LSWFSNet integrates a convolutional selection kernel between the input and convolutional layers, facilitating weighted convolutional calculations on input data while imposing sparse constraints on the selection kernel. Features with significant weights in this kernel are earmarked for subsequent operations in the LSWFSNet computational domain, while those with negligible weights are eschewed to diminish model intricacy. By streamlining the network's input data, LSWFSNet refines the post-convolution feature maps, thus simplifying its structure. Acknowledging the intrinsic interconnections within the data, our study amalgamates diverse sparse constraints into a cohesive objective function. This ensures the convolutional kernel's sparsity while acknowledging the structural dynamics of the data. Notably, the foundational convolutional network in this method can be substituted with any deep convolutional network, contingent upon suitable adjustments to the convolutional selection kernel in relation to input data dimensions. The LSWFSNet model was tested on human emotion electroencephalography (EEG) datasets curated by Shanghai Jiao Tong University. When various sparse constraint methodologies were employed, the convolutional kernel manifested sparsity. Regions in the convolutional selection kernel with non-zero weights were identified as having strong correlations with emotional responses. The empirical outcomes not only resonate with extant neuroscience insights but also supersede the baseline network in accuracy metrics. LSWFSNet's applicability extends to pivotal tasks like keypoint recognition, be it the extraction of salient pixels in facial detection models or the isolation of target attributes in object detection frameworks. This study's significance is anchored in the amalgamation of sparse constraint techniques with deep convolutional networks, supplanting traditional fully connected networks. This fusion amplifies model interpretability and broadens its applicability, notably in image processing arenas.

Nonnegative Bounded Convolutional Sparse Learning Method for Envelope Feature Deconvolution.

Nonnegative bounded convolutional sparsity learning algorithm for envelope blind deconvolution

Convolutional Sparse Learning for Blind Deconvolution and Application on Impulsive Feature Detection.

Blind Deconvolution Using an Improved L0 Sparse Representation

Sparse Deconvolution Method for Ultrasound Images Based on Automatic Estimation of Reference Signals.

Lp (1≤p≤∞) BLIND ADAPTIVE DECONVOLUTION AND ITS APPLICATIONS

Squared envelope sparsification via blind deconvolution and its application to railway axle bearing diagnostics

Robust Sparse Threshold Optimization for Impulsive Blind Deconvolution

Mechanical Vibration Signal Separation Using Blind De-Convolution Technology

A New Approach for Sparse Optimization with Moreau Envelope to Extract Bearing Fault Feature

Sparse Blind Deconvolution with Nonconvex Optimization for Ultrasonic NDT Application

Sparsity Maximization Nonlinear Blind Deconvolution and Its Application in Identification of Satellite Microvibration Sources

Nonlinear Blind Deconvolution Based on Generalized Normalized l p / l q Norm for Early Fault Detection

Sparse representation and blind deconvolution of dynamical systems

An Adaptive Multi-D-Norm-Driven Sparse Unfolding Deconvolutional Network for Bearing Fault Diagnosis

Box-cox-sparse-measures-based blind filtering: Understanding the difference between the maximum kurtosis deconvolution and the minimum entropy deconvolution

Multichannel Sparse Blind Deconvolution on the Sphere

Novel Adaptive Sparse-Spike Deconvolution Bearing Fault Detection Method Based on Curvelet Transform

Blind Spectral Signal Deconvolution with Sparsity Regularization: an Iteratively Reweighted Least-Squares Solution

Non-linear Feature Selection Based on Convolution Neural Networks with Sparse Regularization

Sparsity enhancement post-nonlinear blind deconvolution method and its application to aluminum honeycomb panel cabin structure