Abstract:Recently, feature selection for multilabel classification has attracted substantial attention in many fields; however, some of the available methods ignore the correlations among labels and yield low classification performance. In addition, most feature selection algorithms that are based on multilabel neighborhood rough sets (MNRS) can only deal with finite sets for multilabel data. To address the issues, this paper presents a novel hybrid filter-wrapper multilabel feature selection method that is based on binary particle swarm optimization (BPSO) and MNRS with the Lebesgue measure for multilabel neighborhood decision systems. First, to overcome the problem that the traditional correlation-based feature selection (CFS) algorithm ignores the dependencies among labels, two types of average correlation between single labels and label sets and among labels are presented. Via combination with information-entropy-based uncertainty measures, a new average correlation among labels is studied. A novel comprehensive evaluation function of CFS (NCFS) is constructed. Then, NCFS is introduced as a fitness function into the original BPSO and improved BPSO algorithms to optimize multilabel classification in the early and later stages, respectively, and the optimization process is terminated when the maximum number of iterations is reached. Next, the Lebesgue measure of the neighborhood class is developed for investigating the neighborhood approximation accuracy and the dependency degree based on MNRS. Various properties are deduced, and the relationships among these measures are used to evaluate the uncertainty and correlations among labels of multilabel data. Finally, a hybrid filter-wrapper feature selection algorithm using NCFS-BPSO is designed for preliminarily eliminating redundant features to decrease the complexity, and a heuristic forward multilabel feature selection algorithm is proposed for improving the performance of multilabel classification. Experimental results on fifteen multilabel datasets demonstrate that our proposed algorithms are effective in selecting significant features and realizing great classification performance in multilabel neighborhood decision systems.

Neighborhood Rough Sets based Multi-Label classification

Multi-label classification by exploiting label correlations

Neighborhood Rough Sets Based Multi-Label Classification for Automatic Image Annotation

A Bayesian Network nearest k-labels method for Multi-label classification

Dual Enhancement for Multi-Label Learning with Missing Labels

Multi-label feature selection based on fuzzy neighborhood rough sets

Feature Selection for Multi-Label Learning Based on Variable-Degree Multi-Granulation Decision-Theoretic Rough Sets

Robust multi-label classification via data reconstruction by neighborhood samples augmentation

Joint Multi-Label Classification and Label Correlations with Missing Labels and Feature Selection

Hybrid Multilabel Feature Selection Using BPSO and Neighborhood Rough Sets for Multilabel Neighborhood Decision Systems

Partial Multi-label Learning with Label and Feature Collaboration

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Joint Ranking SVM and Binary Relevance with Robust Low-Rank Learning for Multi-Label Classification

Feature Selection with Missing Labels Using Multilabel Fuzzy Neighborhood Rough Sets and Maximum Relevance Minimum Redundancy

Multi-label classification with weak labels by learning label correlation and label regularization

Exploiting feature multi-correlations for multilabel feature selection in robust multi-neighborhood fuzzy β covering space

Learning Common and Label-Specific Features for Multi-Label Classification With Missing Labels

Research of multi-label text classification based on label attention and correlation networks

Rethinking Modal-oriented Label Correlations for Multi-modal Multi-label Learning

Multi-Label Crowdsourcing Learning With Incomplete Annotations

Multi-Label Learning by Exploiting Label Correlations Locally