Feature Selection on Deep Learning Models: an Interactive Visualization Approach

Zhaoyu Zhou,Jason Wong,Kerun Yu,Guozheng Li,Siming Chen
2023-01-01
Abstract:In the era of data explosion, deep neural networks are widely used for prediction tasks in various scenarios. However, the complex feature spaces in high-dimensional data pose challenges to model training. While the common practice is to perform feature selection, existing approaches are generally designed for non-deep models. Additionally, deep models, considered as black-boxes, lack interpretability in utilizing features. This paper presents a visual analytics approach to facilitate the feature selection process of deep learning models by introducing human experience and decisions in integrated classical statistical methods. Our visual analytics system includes a Data Filter Component and an Interactive Verification Component. The former identi-fies and filters irrelevant and redundant features, while the latter supports the fine selection by understanding the features’ contribution. Furthermore, iterative exploration is supported to gain a proper feature subspace. We use two case studies and an expert study to demonstrate the effectiveness of our approach.
What problem does this paper attempt to address?