Abstract:Multimodal Aspect-Based Sentiment Analysis (MABSA) aims to combine image and text information to extract aspect terms from sentences and predict aspect-based sentiment polarities. Previous joint approaches have either viewed this task as collapsed label sequence annotation or modelled each subtask as a unified index sequence generation task, overlooking the explicit relation among its subtasks. This type of method cannot effectively integrate the strengths of task-specific models and adapt to difficult joint prediction tasks. To address this problem, we propose a Multi-model Co-guided Progressive Learning (MCPL) strategy that leverages task-specific models and the correlations among downstream tasks to expand high-quality training datasets, and provides progressive supervision signals to enhance the model’s ability to adapt from simple to difficult tasks. Based on MCPL, we construct a Phase-wise Progressive Learning (PPL) module for MABSA, in which three Task Affinity-based Pseudo-label Generation (TAPG) modules are proposed for task-specific label expansion. The TAPG modules leverage the task correlations among three MABSA downstream tasks for co-guided teaching, and the PPL module utilises their gradual relationship from aspect term extraction to perform sentiment classification and then joint prediction for progressive learning. Experiments on widely used public datasets demonstrate that the proposed MCPL method achieves excellent performance on the three subtasks of MABSA and outperforms most state-of-the-art methods. The source code is publicly available at https://github.com/qujiaqi-babu/MCPL.

Combining MIML and Distant Supervision for KBP Slot Filling

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Effective Slot Filling via Weakly-Supervised Dual-Model Learning

Deep Cascade Multi-Task Learning for Slot Filling in Online Shopping Assistant

Collective Entity Linking and a Simple Slot Filling Method for TAC-KBP 2011.

Combating with extremely noisy samples in weakly supervised slot filling for automatic diagnosis

NLPComp in TAC 2012 Entity Linking and Slot-Filling.

Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning

PAPER Special Technology Support Hyperconnectivity Conceptual Knowledge Enhanced Model for Multi-Intent Detection and Slot Filling

SPM: A Split-Parsing Method for Joint Multi-Intent Detection and Slot Filling.

Accelerating Multiple Intent Detection and Slot Filling Via Targeted Knowledge Distillation

Combining Word Feature Vector Method with the Convolutional Neural Network for Slot Filling in Spoken Language Understanding

Intent-Slot Correlation Modeling for Joint Intent Prediction and Slot Filling

Using Word Confusion Networks for Slot Filling in Spoken Language Understanding.

ICL KBP Approaches to Knowledge Base Population at TAC2010

Distant Supervision for Relation Extraction Via Group Selection

Unrestricted Vocabulary Keyword Spotting Using LSTM-CTC

MCPL: Multi-model Co-Guided Progressive Learning for Multimodal Aspect-Based Sentiment Analysis

Guided Multi-Branch Learning Systems for DCASE 2020 Task 4.

Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Filling.

Understanding Medical Conversations With Scattered Keyword Attention And Weak Supervision From Responses