Abstract: The ability of a machine to communicate with humans has long been associated with the general success of AI. This dates back to Alan Turing's epoch-making work in the early 1950s, which proposes that a machine's intelligence can be tested by how well it, the machine, can fool a human into believing that the machine is a human through dialogue conversations. Many systems learn generation rules from a minimal set of authored rules or labels on top of hand-coded rules or templates, and thus are both expensive and difficult to extend to open-domain scenarios. Recently, the emergence of neural network models the potential to solve many of the problems in dialogue learning that earlier systems cannot tackle: the end-to-end neural frameworks offer the promise of scalability and language-independence, together with the ability to track the dialogue state and then mapping between states and dialogue actions in a way not possible with conventional systems. On the other hand, neural systems bring about new challenges: they tend to output dull and generic responses; they lack a consistent or a coherent persona; they are usually optimized through single-turn conversations and are incapable of handling the long-term success of a conversation; and they are not able to take the advantage of the interactions with humans. This dissertation attempts to tackle these challenges: Contributions are two-fold: (1) we address new challenges presented by neural network models in open-domain dialogue generation systems; (2) we develop interactive question-answering dialogue systems by (a) giving the agent the ability to ask questions and (b) training a conversation agent through interactions with humans in an online fashion, where a bot improves through communicating with humans and learning from the mistakes that it makes.

Human-Computer Conversation

Teaching Machines to Converse

Contextual understanding by computers

Convo: What does conversational programming need? An exploration of machine learning interface design

The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots

Revisiting Human-Agent Communication: The Importance of Joint Co-construction and Understanding Mental States

Interfacing the human/machine

The Interaction Design of 3D Virtual Humans: A Survey

I-It, I-Thou, I-Robot: The Perceived Humanness of AI in Human-Machine Communication

We and It: An Interdisciplinary Review of the Experimental Evidence on Human-Machine Interaction

Engagement in Dialogue with Social Robots

Understanding computational dialogue understanding

Conversational Agents: Goals, Technologies, Vision and Challenges

The nature of the bots: how people respond to robots, virtual agents and humans as multimodal stimuli

Common ground, cooperation, and recipient design in human-computer interactions

From Human-to-Human to Human-to-Bot Conversations in Software Engineering

Revisiting the DARPA Communicator Data using Conversation Analysis

Mapping Perceptions of Humanness in Speech-Based Intelligent Personal Assistant Interaction

Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents

Modeling Human Interaction to Design a Human-Computer Dialog System

Can Computers overcome Humans? Consciousness interaction and its implications