Abstract:Recently, feature selection for multilabel classification has attracted substantial attention in many fields; however, some of the available methods ignore the correlations among labels and yield low classification performance. In addition, most feature selection algorithms that are based on multilabel neighborhood rough sets (MNRS) can only deal with finite sets for multilabel data. To address the issues, this paper presents a novel hybrid filter-wrapper multilabel feature selection method that is based on binary particle swarm optimization (BPSO) and MNRS with the Lebesgue measure for multilabel neighborhood decision systems. First, to overcome the problem that the traditional correlation-based feature selection (CFS) algorithm ignores the dependencies among labels, two types of average correlation between single labels and label sets and among labels are presented. Via combination with information-entropy-based uncertainty measures, a new average correlation among labels is studied. A novel comprehensive evaluation function of CFS (NCFS) is constructed. Then, NCFS is introduced as a fitness function into the original BPSO and improved BPSO algorithms to optimize multilabel classification in the early and later stages, respectively, and the optimization process is terminated when the maximum number of iterations is reached. Next, the Lebesgue measure of the neighborhood class is developed for investigating the neighborhood approximation accuracy and the dependency degree based on MNRS. Various properties are deduced, and the relationships among these measures are used to evaluate the uncertainty and correlations among labels of multilabel data. Finally, a hybrid filter-wrapper feature selection algorithm using NCFS-BPSO is designed for preliminarily eliminating redundant features to decrease the complexity, and a heuristic forward multilabel feature selection algorithm is proposed for improving the performance of multilabel classification. Experimental results on fifteen multilabel datasets demonstrate that our proposed algorithms are effective in selecting significant features and realizing great classification performance in multilabel neighborhood decision systems.

Multi-label Feature Selection Algorithm via Maximizing Label Correlation-Aware Relevance and Minimizing Redundance with Mutation Binary Particle Swarm Optimization

Multiple reference points-based multi-objective feature selection for multi-label learning

A Feature Selection Method Based on Feature-Label Correlation Information and Self-Adaptive MOPSO

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

A Multi-Objective Multi-Label Feature Selection Algorithm Based on Shapley Value

Novel multi-label feature selection via label enhancement and relative maximal discernibility pairs

Dual Sparse Structured Subspaces and Graph Regularisation for Particle Swarm Optimisation-Based Multi-Label Feature Selection

Enhanced multi-label feature selection considering label-specific relevant information

AMFSA: Adaptive Fuzzy Neighborhood-Based Multilabel Feature Selection with Ant Colony Optimization.

Multi-objective particle swarm optimization with adaptive strategies for feature selection

Label Correlation Guided Feature Selection for Multi-label Learning.

Hemoglobin constant spring defined by specific oligonucleotide hybridization and hemoglobin D Punjab (β121→Gln) in a Batak Indonesian family

Feature selection for multi-label classification by maximizing full-dimensional conditional mutual information

Hybrid Multilabel Feature Selection Using BPSO and Neighborhood Rough Sets for Multilabel Neighborhood Decision Systems

A novel feature selection approach with Pareto optimality for multi-label data

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

An evolutionary feature selection method based on probability-based initialized particle swarm optimization

Multi-Label Feature Selection Method Combining Unbiased Hilbert-Schmidt Independence Criterion With Controlled Genetic Algorithm

Dynamic multi-label feature selection algorithm based on label importance and label correlation

Multi-label Feature Selection Based on Correlation Label Enhancement

Many-objective optimization of feature selection based on two-level particle cooperation