Abstract:Speech summarization techniques take human speech as input and then output an abridged version as text or speech. Speech summarization has applications in many domains from information technology to health care, for example improving speech archives or reducing clinical documentation burden. This scoping review maps close to 2 decades of speech summarization literature, spanning from the early machine learning works up to ensemble models, with no restrictions on the language summarized, research method, or paper type. We reviewed a total of 110 papers out of a set of 188 found through a literature search and extracted speech features used, methods, scope, and training corpora. Most studies employ one of four speech summarization architectures: (1) Sentence extraction and compaction; (2) Feature extraction and classification or rank-based sentence selection; (3) Sentence compression and compression summarization; and (4) Language modelling. We also discuss the strengths and weaknesses of these different methods and speech features. Overall, supervised methods (e.g. Hidden Markov support vector machines, Ranking support vector machines, Conditional random fields) performed better than unsupervised methods. As supervised methods require manually annotated training data which can be costly, there was more interest in unsupervised methods. Recent research into unsupervised methods focusses on extending language modelling, for example by combining Uni-gram modelling with deep neural networks. This review does not include recent work in deep learning.

Unsupervised Topic Modeling Approaches to Decision Summarization in Spoken Meetings

Summarizing Decisions in Spoken Meetings

Topic-Oriented Spoken Dialogue Summarization for Customer Service with Saliency-Aware Topic Modeling

Query-focused Multi-document Summarization: Combining a Novel Topic Model with Graph-based Semi-supervised Learning

Utterance-Level Latent Topic Transition Modeling for Spoken Documents and Its Application in Automatic Summarization

Supervised Spoken Document Summarization Based On Structured Support Vector Machine With Utterance Clusters As Hidden Variables

ESSumm: Extractive Speech Summarization from Untranscribed Meeting

Topic Modeling Based Text Summarization Approach

Symbolic and Statistical Learning Approaches to Speech Summarization: A Scoping Review

Subtopic-Based Multimodality Ranking for Topic-Focused Multidocument Summarization.

Subtopic-driven Multi-Document Summarization.

Supervised Spoken Document Summarization Jointly Considering Utterance Importance and Redundancy by Structured Support Vector Machine.

Focused Meeting Summarization via Unsupervised Relation Extraction

Tell me what I need to know: Exploring LLM-based (Personalized) Abstractive Multi-Source Meeting Summarization

A Supervised Aggregation Framework for Multi-Document Summarization.

Automatic Labeling of Topic Models Using Text Summaries

Multi-Document Summarization Using Sentence-based Topic Models.

Decision-Focused Summarization

Dialogue acts enhanced extract–abstract framework for meeting summarization

Topic Analysis for Topic-Focused Multi-Document Summarization

Query-Utterance Attention with Joint modeling for Query-Focused Meeting Summarization