Abstract:There has historically been a divide between the user-oriented and system-oriented research communities in information retrieval. In my opinion, this divide is based primarily on a difference in viewpoint about the relative importance of understanding how people search for information compared to developing new retrieval models and ranking algorithms. There is strong agreement, however, that the interaction between the user and the search engine is a fundamental part of the IR process. The IR field was one of the first in computer science to recognize the importance of the user-system interaction, which led to a number of core concepts such as relevance, ranking, result presentation, feedback, evaluation, and browsing. The key message of this talk is that effective information access requires interaction between the user and the system, where both play a role. Additionally, there is growing evidence that even more effective information access can be achieved by a system that actively supports interaction, particularly in the limited-bandwidth environments provided by mobile devices and voice-based assistants. In this talk, I will first give an overview of past IR research on user-system interaction. In much of this research, the system provides passive support for the retrieval process and much of the burden for effective retrieval stays with the user. There has been some research, however, that has attempted to actively support the interaction by designing expert intermediary systems. After this review, I will focus on two current areas of research where active support for interaction is crucial. These are question answering and conversational search. These areas have recently become popular in the NLP community but they have deep roots in IR. I will describe the specific lines of research we have followed at the Center for Intelligent Information Retrieval and RMIT, including interactive answer passage retrieval, studies of information-seeking dialogues, and neural models for selecting responses and answers. Although there are many aspects to this research, I will highlight the parts where interaction is important, how we have attempted to evaluate the research, and where significant progress needs to be made.

A Conversationalist Approach to Information Quality in Information Interaction and Retrieval

A Theoretical Framework for Conversational Search

What Can You Perceive? Understanding User’s Information Quality Judgment on Academic Social Networking Sites

Measuring quality, reputation and trust in online communities

An Information Quality (infoq) Framework for Ex-Ante and Ex-Post Evaluation of Empirical Studies

A Large-Scale Analysis of Mixed Initiative in Information-Seeking Dialogues for Conversational Search

Analysing the Effect of Clarifying Questions on Document Ranking in Conversational Search

Evaluating Collaborative Search Interfaces with Information Seeking Theory

Actionable conversational quality indicators for improving task-oriented dialog systems

Strategic Conversation Quality and Engagement: Assessment of a New Measure

Research on Information Quality Evaluation Method of Q&A Community from the Perspective of Fuzzy Evaluation

Developing the Measurement Scale of Information Quality for Social Q&A Sites.

Perceived Conversation Quality in Spontaneous Interactions

The Importance of Interaction for Information Retrieval

Evaluating Quality of Chatbots and Intelligent Conversational Agents

A Conceptual Framework for Implicit Evaluation of Conversational Search Interfaces

Towards Better Understanding of User Satisfaction in Open-Domain Conversational Search

A Conceptual Evaluation Framework on Information Quality about User-Generated Video Content in Web 2.0 Era

Social Connectedness and Information Markets

Users Meet Clarifying Questions: Toward a Better Understanding of User Interactions for Search Clarification

Multi-Facets Quality Assessment Of Online Opinionated Expressions