Abstract:Conversational search systems can improve user experience in digital libraries by facilitating a natural and intuitive way to interact with library content. However, most conversational search systems are limited to performing simple tasks and controlling smart devices. Therefore, there is a need for systems that can accurately understand the user's information requirements and perform the appropriate search activity. Prior research on intelligent systems suggested that it is possible to comprehend the functional aspect of discourse (search intent) by identifying the speech acts in user dialogues. In this work, we automatically identify the speech acts associated with spoken utterances and use them to predict the system-level search actions. First, we conducted a Wizard-of-Oz study to collect data from 75 search sessions. We performed thematic analysis to curate a gold standard dataset -- containing 1,834 utterances and 509 system actions -- of human-system interactions in three information-seeking scenarios. Next, we developed attention-based deep neural networks to understand natural language and predict speech acts. Then, the speech acts were fed to the model to predict the corresponding system-level search actions. We also annotated a second dataset to validate our results. For the two datasets, the best-performing classification model achieved maximum accuracy of 90.2% and 72.7% for speech act classification and 58.8% and 61.1%, respectively, for search act classification.

Search Systems and Artificial Intelligence: Enhancing Searching as Learning Approaches to Counter Misinformation

Advancing the Search Frontier with AI Agents

Revolutionizing Search: Artificial Intelligence and Machine Learning's Impact on Information Retrieval

AI- and LLM-driven search tools: A paradigm shift in information access for education and research

Search and Recommendation Procedure with the Help of Artificial Intelligence

Thinking inside the box: An evaluation of a novel search‐assisting tool for supporting (meta)cognition during exploratory search

The Search as Learning Spaceship: Toward a Comprehensive Model of Psychological and Technological Facets of Search as Learning

Rethinking Similarity Search: Embracing Smarter Mechanisms over Smarter Data

Towards a Model of Understanding Social Search

How AI-powered science search engines can speed up your research

Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human Solutions

AI Transparency in Academic Search Systems: An Initial Exploration

Conversational Search for Learning Technologies

Social Search: retrieving information in Online Social Platforms -- A Survey

Toward Connecting Speech Acts and Search Actions in Conversational Search Tasks

Report on the 8th Workshop on Search-Oriented Conversational Artificial Intelligence (SCAI 2024) at CHIIR 2024

Justice in Misinformation Detection Systems: An Analysis of Algorithms, Stakeholders, and Potential Harms

Finding the Aha! Moment of Search: A Preliminary Examination of Insight Learning During Search

Addressing contingency in algorithmic (mis)information classification: Toward a responsible machine learning agenda

Enhancing Exploratory Learning through Exploratory Search with the Emergence of Large Language Models

Combating Misinformation and Polarization in the Corporate Sphere: Integrating Social, Technological and AI Strategies