Abstract:Real-world applications always contain complex data objects with multiple semantics. The machine learning tasks generalized from these applications can be formulated as multi-instance multi-label learning (MIML) problems. Each object is represented by a bag of multiple instances and can be associated with multiple labels simultaneously. Extensive studies on the MIML have been conducted during the past few years. However, many of them do not consider local label correlations, which is critical in multi-label scenario. To address this problem, we propose the multi-instance multi-label learning based on parallel attention and local label manifold correlation (MIML-LLMC) algorithm. First, parallel multiple attention mechanisms convert each bag into a number of fusion vectors, one for each label. They are also utilized to find out which instances in the bag trigger respective labels to improve explanability. Second, local label manifold correlation vectors (LLMCs) are constructed based on label manifold generation and clustering. They provide a high level of representation of the label vectors. Third, each fusion vector is concatenated to the LLMC to predict each label independently. With the utilization of attention and LLMCs, MIML-LLMC is able to discover instance-label relations and exploit local label correlations simultaneously. Experiments reveal that our approach is highly competitive to the state-of-the-art MIML algorithms and yields reasonable results in understanding the relations between input patterns and output label semantics.

Multi-Instance Multi-Label Learning For Image Categorization Based On Integrated Contextual Information

Joint multi-label multi-instance learning for image classification

Labeling Complicated Objects: Multi-View Multi-Instance Multi-Label Learning

A New multi-instance multi-label learning approach for image and text classification

Multi-instance Multi-label Learning Based on Parallel Attention and Local Label Manifold Correlation.

A new multi-label scene categorization method using color incorporated biologically inspired features and MIML SVM

Multi-Instance Multi-Label Learning with Application to Scene Classification

MetaMIML: Meta Multi-Instance Multi-Label Learning

Multi-label Classification using Deep Multi-order Context-aware Kernel Networks

Causal multi-label learning for image classification

Multi-Instance Multi-Label Learning with Weak Label.

Towards Identifying Causal Relation Between Instances and Labels

Transductive Multi-Instance Multi-Label Learning Algorithm with Application to Automatic Image Annotation

A multi-label image classification method combining multi-stage image semantic information and label relevance

Concurrent Multiple Instance Learning For Image Categorization

Learning a Distance Metric from Multi-Instance Multi-Label Data

Graph based Label Enhancement for Multi-instance Multi-label learning

Meta Multi-Instance Multi-Label learning by heterogeneous network fusion

An Empirical Study of Automatic Image Annotation Through Multi-Instance Multi-Label Learning

A Framework Of Hashing For Multi-Instance Multi-Label Learning

Effective Multi-level Image Representation for Image Categorization