Abstract:Modern statistical machine learning (SML) methods share a major limitation with the early approaches to AI: there is no scalable way to adapt them to new domains. Human learning solves this in part by leveraging a rich, shared, updateable world model. Such scalability requires modularity: updating part of the world model should not impact unrelated parts. We have argued that such modularity will require both "correctability" (so that errors can be corrected without introducing new errors) and "interpretability" (so that we can understand what components need correcting). To achieve this, one could attempt to adapt state of the art SML systems to be interpretable and correctable; or one could see how far the simplest possible interpretable, correctable learning methods can take us, and try to control the limitations of SML methods by applying them only where needed. Here we focus on the latter approach and we investigate two main ideas: "Teacher Assisted Learning", which leverages crowd sourcing to learn language; and "Factored Dialog Learning", which factors the process of application development into roles where the language competencies needed are isolated, enabling non-experts to quickly create new applications. We test these ideas in an "Automated Personal Assistant" (APA) setting, with two scenarios: that of detecting user intent from a user-APA dialog; and that of creating a class of event reminder applications, where a non-expert "teacher" can then create specific apps. For the intent detection task, we use a dataset of a thousand labeled utterances from user dialogs with Cortana, and we show that our approach matches state of the art SML methods, but in addition provides full transparency: the whole (editable) model can be summarized on one human-readable page. For the reminder app task, we ran small user studies to verify the efficacy of the approach.

LegoAI: Towards Building Reliable AI Software for Real-world Applications

Towards Trustworthy AI Software Development Assistance

Engineering Reliable Deep Learning Systems

Deep learning technology for construction machinery and robotics

AI Online Filters to Real World Image Recognition

Brickognize: Applying Photo-Realistic Image Synthesis for Lego Bricks Recognition with Limited Data

A Lightweight and Transferable Design for Robust LEGO Manipulation

Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks

Robotic LEGO Assembly and Disassembly from Human Demonstration

Using Deep Learning Technology to Realize the Automatic Control Program of Robot Arm Based on Hand Gesture Recognition

Identifying and Exploiting Structures for Reliable Deep Learning

Trustworthy, Responsible, and Safe AI: A Comprehensive Architectural Framework for AI Safety with Challenges and Mitigations

LegoDNN: Block-grained Scaling of Deep Neural Networks for Mobile Vision

How to Train an All-Purpose Robot: DeepMind is Tackling one of the Hardest Problems for AI

XAI-FR: Explainable AI-Based Face Recognition Using Deep Neural Networks

Acoustic-based LEGO recognition using attention-based convolutional neural networks

An Analytic Layer-wise Deep Learning Framework with Applications to Robotics

Integration of Deep Learning Network and Robot Arm System for Rim Defect Inspection Application

Design and Implementation of AI Algorithms in Home-Cleaning Robot

A Base Camp for Scaling AI

A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics