Abstract: The ability of a machine to communicate with humans has long been associated with the general success of AI. This dates back to Alan Turing's epoch-making work in the early 1950s, which proposes that a machine's intelligence can be tested by how well it, the machine, can fool a human into believing that the machine is a human through dialogue conversations. Many systems learn generation rules from a minimal set of authored rules or labels on top of hand-coded rules or templates, and thus are both expensive and difficult to extend to open-domain scenarios. Recently, the emergence of neural network models the potential to solve many of the problems in dialogue learning that earlier systems cannot tackle: the end-to-end neural frameworks offer the promise of scalability and language-independence, together with the ability to track the dialogue state and then mapping between states and dialogue actions in a way not possible with conventional systems. On the other hand, neural systems bring about new challenges: they tend to output dull and generic responses; they lack a consistent or a coherent persona; they are usually optimized through single-turn conversations and are incapable of handling the long-term success of a conversation; and they are not able to take the advantage of the interactions with humans. This dissertation attempts to tackle these challenges: Contributions are two-fold: (1) we address new challenges presented by neural network models in open-domain dialogue generation systems; (2) we develop interactive question-answering dialogue systems by (a) giving the agent the ability to ask questions and (b) training a conversation agent through interactions with humans in an online fashion, where a bot improves through communicating with humans and learning from the mistakes that it makes.

UniDS: A Unified Dialogue System for Chit-Chat and Task-oriented Dialogues

Teaching Machines to Converse

Unified Conversational Models with System-Initiated Transitions between Chit-Chat and Task-Oriented Dialogues

A Network-based End-to-End Trainable Task-oriented Dialogue System

UniTranSeR: A Unified Transformer Semantic Representation Framework for Multimodal Task-Oriented Dialog System

A Unified Pre-training Framework for Conversational AI

A Unified Multi-Task Semantic Communication System with Domain Adaptation

DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues

Integrating User and Agent Models: A Deep Task-Oriented Dialogue System

Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System.

Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems

Distributed Structured Actor-Critic Reinforcement Learning for Universal Dialogue Management

Teacher-Student Framework Enhanced Multi-domain Dialogue Generation

A Self-Attention Joint Model for Spoken Language Understanding in Situational Dialog Applications

A Survey of Document Grounded Dialogue Systems (DGDS)

Data-Driven Dialogue Systems for Social Agents

Uni3DL: Unified Model for 3D and Language Understanding

ChatDev: Communicative Agents for Software Development

AliCHI: A Large-scale Multi-modal Dataset and Automated Evaluation Tool for Human-like Dialogue Systems

Challenges in Building Intelligent Open-domain Dialog Systems

Multi-domain Task-oriented Dialog Challenge II