Abstract:Modern statistical machine learning (SML) methods share a major limitation with the early approaches to AI: there is no scalable way to adapt them to new domains. Human learning solves this in part by leveraging a rich, shared, updateable world model. Such scalability requires modularity: updating part of the world model should not impact unrelated parts. We have argued that such modularity will require both "correctability" (so that errors can be corrected without introducing new errors) and "interpretability" (so that we can understand what components need correcting). To achieve this, one could attempt to adapt state of the art SML systems to be interpretable and correctable; or one could see how far the simplest possible interpretable, correctable learning methods can take us, and try to control the limitations of SML methods by applying them only where needed. Here we focus on the latter approach and we investigate two main ideas: "Teacher Assisted Learning", which leverages crowd sourcing to learn language; and "Factored Dialog Learning", which factors the process of application development into roles where the language competencies needed are isolated, enabling non-experts to quickly create new applications. We test these ideas in an "Automated Personal Assistant" (APA) setting, with two scenarios: that of detecting user intent from a user-APA dialog; and that of creating a class of event reminder applications, where a non-expert "teacher" can then create specific apps. For the intent detection task, we use a dataset of a thousand labeled utterances from user dialogs with Cortana, and we show that our approach matches state of the art SML methods, but in addition provides full transparency: the whole (editable) model can be summarized on one human-readable page. For the reminder app task, we ran small user studies to verify the efficacy of the approach.

Incrementalizing RASA's Open-Source Natural Language Understanding Pipeline

Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU

TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model

Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU

Incremental Learning from Scratch for Task-Oriented Dialogue Systems

Bootstrapping incremental dialogue systems: using linguistic knowledge to learn from minimal data

INCREMENTAL LEARNING FOR END-TO-END AUTOMATIC SPEECH RECOGNITION

Incremental Learning of Humanoid Robot Behavior from Natural Interaction and Large Language Models

Iteratively Improving Speech Recognition and Voice Conversion

Class Incremental Learning with Pre-trained Vision-Language Models

Incremental learning for robot perception through HRI

Towards Incremental Learning in Large Language Models: A Critical Review

ILASR: Privacy-Preserving Incremental Learning for Automatic Speech Recognition at Production Scale

A Near-Real-Time Processing Ego Speech Filtering Pipeline Designed for Speech Interruption During Human-Robot Interaction

Bridging the Gap Between Clean Data Training and Real-World Inference for Spoken Language Understanding

TADIL: Task-Agnostic Domain-Incremental Learning through Task-ID Inference using Transformer Nearest-Centroid Embeddings

A Self-Learning Framework for Large-Scale Conversational AI Systems

Incremental Transfer Learning in Two-pass Information Bottleneck based Speaker Diarization System for Meetings

A Base Camp for Scaling AI

An New Approach for Incremental Speaker Adaptation