Abstract:In the relatively short history of machine learning, the subtle balance between engineering and theoretical progress has been proved critical at various stages. The most recent wave of AI has brought to the IR community powerful techniques, particularly for pattern recognition. While many benefits from the burst of ideas as numerous tasks become algorithmically feasible, the balance is tilting toward the application side. The existing theoretical tools in IR can no longer explain, guide, and justify the newly-established methodologies. The consequences can be suffering: in stark contrast to how the IR industry has envisioned modern AI making life easier, many are experiencing increased confusion and costs in data manipulation, model selection, monitoring, censoring, and decision making. This reality is not surprising: without handy theoretical tools, we often lack principled knowledge of the pattern recognition model's expressivity, optimization property, generalization guarantee, and our decision-making process has to rely on over-simplified assumptions and human judgments from time to time. Time is now to bring the community a systematic tutorial on how we successfully adapt those tools and make significant progress in understanding, designing, and eventually productionize impactful IR systems. We emphasize systematicity because IR is a comprehensive discipline that touches upon particular aspects of learning, causal inference analysis, interactive (online) decision-making, etc. It thus requires systematic calibrations to render the actual usefulness of the imported theoretical tools to serve IR problems, as they usually exhibit unique structures and definitions. Therefore, we plan this tutorial to systematically demonstrate our learning and successful experience of using advanced theoretical tools for understanding and designing IR systems.

Recent Advances in Conversational Information Retrieval

Recent Progress in Conversational AI

Neural Information Retrieval: A Literature Review

Neural Networks for Information Retrieval

State of the Art of User Simulation approaches for conversational information retrieval

Neural information retrieval: at the end of the early years

A Survey of Conversational Search

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Tutorial: Modern Theoretical Tools for Understanding and Designing Next-generation Information Retrieval System

Brain-Computer Interface Meets Information Retrieval: Perspective on Next-generation Information System

Deep Reinforcement Learning for Information Retrieval: Fundamentals and Advances

IterCQR: Iterative Conversational Query Reformulation with Retrieval Guidance

A Survey on Conversational Recommender Systems

Context Retrieval via Normalized Contextual Latent Interaction for Conversational Agent

Artificial intelligence empowered conversational agents: A systematic literature review and research agenda

How Deep Learning Works for Information Retrieval

RecSys 2021 Tutorial on Conversational Recommendation: Formulation, Methods, and Evaluation

Advances and Challenges in Conversational Recommender Systems: A Survey

History-Aware Conversational Dense Retrieval

Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges