Abstract: The ability of a machine to communicate with humans has long been associated with the general success of AI. This dates back to Alan Turing's epoch-making work in the early 1950s, which proposes that a machine's intelligence can be tested by how well it, the machine, can fool a human into believing that the machine is a human through dialogue conversations. Many systems learn generation rules from a minimal set of authored rules or labels on top of hand-coded rules or templates, and thus are both expensive and difficult to extend to open-domain scenarios. Recently, the emergence of neural network models the potential to solve many of the problems in dialogue learning that earlier systems cannot tackle: the end-to-end neural frameworks offer the promise of scalability and language-independence, together with the ability to track the dialogue state and then mapping between states and dialogue actions in a way not possible with conventional systems. On the other hand, neural systems bring about new challenges: they tend to output dull and generic responses; they lack a consistent or a coherent persona; they are usually optimized through single-turn conversations and are incapable of handling the long-term success of a conversation; and they are not able to take the advantage of the interactions with humans. This dissertation attempts to tackle these challenges: Contributions are two-fold: (1) we address new challenges presented by neural network models in open-domain dialogue generation systems; (2) we develop interactive question-answering dialogue systems by (a) giving the agent the ability to ask questions and (b) training a conversation agent through interactions with humans in an online fashion, where a bot improves through communicating with humans and learning from the mistakes that it makes.

Semi-autonomous avatar enabling unconstrained parallel conversations –seamless hybrid of WOZ and autonomous dialogue systems–

Teaching Machines to Converse

Having Different Dialog Roles in Telecommunication by Using Two Teleoperated Robots Reduces an Operator's Guilt

Multiparty conversation via multirobot system: incorporation of nonverbal user responses for continued conversation

'I am both here and there' Parallel Control of Multiple Robotic Avatars by Disabled Workers in a Café

Intelligent Conversational Android ERICA Applied to Attentive Listening and Job Interview

Beyond Words: An Intelligent Human-Machine Dialogue System with Multimodal Generation and Emotional Comprehension

A study of interactive robot architecture through the practical implementation of conversational android

Towards human-like spoken dialogue generation between AI agents from written dialogue

Improving User's Sense of Participation in Robot-Driven Dialogue

Amplifying robotics capacities with a human touch: An immersive low-latency panoramic remote system

CHAT: a Conversational Helper for Automotive Tasks

Multi-modal Human-machine Conversation System for Real Physical World

An Avatar Robot Overlaid with the 3D Human Model of a Remote Operator

Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders

Human–robot non-verbal interaction empowered by real-time auditory and visual multiple-talker tracking

A Tele-operation System for Collaborative Works with Vision-Guided Autonomous Robot

A Multi-Agent Dual Dialogue System to Support Mental Health Care Providers

Integrating Open-World Shared Control in Immersive Avatars

Dialogue Design and Management for Multi-Session Casual Conversation with Older Adults

An emotion-driven and topic-aware dialogue framework for human–robot interaction