Abstract:Meetings play a critical infrastructural role in the coordination of work. In recent years, due to shift to hybrid and remote work, more meetings are moving to online Computer Mediated Spaces. This has led to new problems (e.g. more time spent in less engaging meetings) and new opportunities (e.g. automated transcription/captioning and recap support). Recent advances in large language models (LLMs) for dialog summarization have the potential to improve the experience of meetings by reducing individuals' meeting load and increasing the clarity and alignment of meeting outputs. Despite this potential, they face technological limitation due to long transcripts and inability to capture diverse recap needs based on user's context. To address these gaps, we design, implement and evaluate in-context a meeting recap system. We first conceptualize two salient recap representations -- important highlights, and a structured, hierarchical minutes view. We develop a system to operationalize the representations with dialogue summarization as its building blocks. Finally, we evaluate the effectiveness of the system with seven users in the context of their work meetings. Our findings show promise in using LLM-based dialogue summarization for meeting recap and the need for both representations in different contexts. However, we find that LLM-based recap still lacks an understanding of whats personally relevant to participants, can miss important details, and mis-attributions can be detrimental to group dynamics. We identify collaboration opportunities such as a shared recap document that a high quality recap enables. We report on implications for designing AI systems to partner with users to learn and improve from natural interactions to overcome the limitations related to personal relevance and summarization quality.

FASIL email summarisation system

FASiL Adaptive Email Categorization System.

FineSurE: Fine-grained Summarization Evaluation using LLMs

Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks

FENICE: Factuality Evaluation of summarization based on Natural language Inference and Claim Extraction

Hierarchical Summarization for Longform Spoken Dialog

Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation Tasks

Summaries, Highlights, and Action items: Design, implementation and evaluation of an LLM-powered meeting recap system

ConceptEVA: Concept-Based Interactive Exploration and Customization of Document Summaries

MSAMSum: Towards Benchmarking Multi-lingual Dialogue Summarization

Human computer interaction(HCI) based Smart Voice Email (Vmail) Application - Assistant for Visually Impaired Users (VIU)

A Survey on Dialogue Summarization: Recent Advances and New Frontiers

Dialogue acts enhanced extract–abstract framework for meeting summarization

IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization

Prompting and Fine-Tuning of Small LLMs for Length-Controllable Telephone Call Summarization

Enhanced Electronic Health Records Text Summarization Using Large Language Models

Harvesting and Summarizing User-Generated Content for Advanced Speech-Based HCI

Speech summarization without lexical features for Mandarin broadcast news

BrailleSUM: A News Summarization System for the Blind and Visually Impaired People

UniSumEval: Towards Unified, Fine-Grained, Multi-Dimensional Summarization Evaluation for LLMs

Fusion-Eval: Integrating Assistant Evaluators with LLMs