Abstract: The ability of a machine to communicate with humans has long been associated with the general success of AI. This dates back to Alan Turing's epoch-making work in the early 1950s, which proposes that a machine's intelligence can be tested by how well it, the machine, can fool a human into believing that the machine is a human through dialogue conversations. Many systems learn generation rules from a minimal set of authored rules or labels on top of hand-coded rules or templates, and thus are both expensive and difficult to extend to open-domain scenarios. Recently, the emergence of neural network models the potential to solve many of the problems in dialogue learning that earlier systems cannot tackle: the end-to-end neural frameworks offer the promise of scalability and language-independence, together with the ability to track the dialogue state and then mapping between states and dialogue actions in a way not possible with conventional systems. On the other hand, neural systems bring about new challenges: they tend to output dull and generic responses; they lack a consistent or a coherent persona; they are usually optimized through single-turn conversations and are incapable of handling the long-term success of a conversation; and they are not able to take the advantage of the interactions with humans. This dissertation attempts to tackle these challenges: Contributions are two-fold: (1) we address new challenges presented by neural network models in open-domain dialogue generation systems; (2) we develop interactive question-answering dialogue systems by (a) giving the agent the ability to ask questions and (b) training a conversation agent through interactions with humans in an online fashion, where a bot improves through communicating with humans and learning from the mistakes that it makes.

Proactive conversational agents

Teaching Machines to Converse

Learning through Dialogue Interactions by Asking Questions

Dialogue Learning with Human-in-the-Loop.

Uman-in-thel oop

A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospects

Rethinking Conversational Agents in the Era of Large Language Models: Proactivity, Non-collaborativity, and Beyond

Rethinking Conversational Agents in the Era of LLMs: Proactivity, Non-collaborativity, and Beyond.

Improving Proactive Dialog Agents Using Socially-Aware Reinforcement Learning

Towards Human-centered Proactive Conversational Agents

Data-Driven Dialogue Systems for Social Agents

Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the Job

Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration

Proactive Human-Machine Conversation with Explicit Conversation Goals

Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policy

Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems

What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents

Using Conversational Agents To Support Learning By Teaching

Synthetic Dialogue Dataset Generation using LLM Agents

Towards Teachable Conversational Agents

One Agent Too Many: User Perspectives on Approaches to Multi-agent Conversational AI