Abstract:Multi-label text classification (MLTC) aims to assign one or more labels to each document. Previous studies mainly use the label co-occurrence matrix obtained from the training set to establish the correlation between labels, but this approach ignores the noise in label co-occurrence, and applies the ungeneralizable label co-occurrence relationship to model testing and validation. In addition, labelling co-occurrence relationship globally lacks attention to a specific document, which results in the loss of the local label co-occurrence relationship. To address this issue, we introduced a new multi-label text classification model in this study, presenting CoocNet, which adopts a two-step label detection to effectively tackle the challenge of modeling label co-occurrence relations. The model first captures the global co-occurrence relationships of labels using the label co-occurrence matrix and denoises the label noise through the label denoising attention mechanism, and then uses a contrast learning strategy to capture the local label co-occurrence relationships among specific different documents. In particular, we unify the co-occurrence labeling into an auxiliary training task that runs parallel to the multi-label classification task. The new task supervises the learning of sentence representations for documents by leveraging the modeled label co-occurrence relationships, enhancing the model’s generalization ability. Another novelty is that the auxiliary task is only active during model training, thereby preventing label co-occurrence relationships from interfering with the model’s predictions outside the training phase. The experimental results on three benchmark datasets (Reuters-21578, AAPD, and RCV1) demonstrate that our model outperforms the existing state-of-the-art methods.

Constructive learning method based on co-training algorithm

Constructive Learning Method Based on Tri-training Algorithm

Constructive Learning Method Based on Human Semi-Supervised Algorithm

Teaching-to-Learn and Learning-to-Teach for Few Labeled Classification.

One of semi-supervised classification algorithm named Co-S3OM based on cooperative training

Tri-Training: Exploiting Unlabeled Data Using Three Classifiers

Constructive Training Algorithm Based on Hypercube Covering

A Two-Stage Active Learning Method for Image Classification

Semi-supervised Co-training Algorithm Based on Assisted Learning.

Robust Co-Training.

CoTrade: Confident Co-Training With Data Editing.

A Tri-training Based Transfer Learning Algorithm

A Co-Training Algorithm Based On Modified Fisher'S Linear Discriminant Analysis

An Active Mbbntree Classifier Learning from Unlabeled Samples

A Co-Training Method Based on Parameter-Free and Single-Step Unlabeled Data Selection Strategy with Natural Neighbors

MBBNTree Classifier Algorithm Based on Active Learning from Unlabeled Samples

Participatory Learning Based Semi-Supervised Classification

A New Cross-Training Approach by Using Labeled Data

CoocNet: a Novel Approach to Multi-Label Text Classification with Improved Label Co-Occurrence Modeling

On Co-Training Style Algorithms.

Ar-Tri-Training: Tri-Training with Assistant Strategy