Abstract:A deep classifier is usually trained to (i) learn the numeric representation vector of samples and (ii) classify sample representations with learned classification boundaries. Time-travelling visualization, as an explainable AI technique, is designed to transform the model training dynamics into an animation of canvas with colorful dots and territories. Despite that the training dynamics of the highlevel concepts such as sample representations and classification boundaries are now observable, the model developers can still be overwhelmed by tens of thousands of moving dots across hundreds of training epochs (i.e., frames in the animation), which makes them miss important training events. In this work, we make the first attempt to develop the model time-travelling visualizers to the model time-travelling debuggers, for its practical use in model debugging tasks. Specifically, given an animation of model training dynamics of sample representation and classification landscape, we propose DeepDebugger solution to recommend the samples of user interest in a human-in-the-loop manner. On one hand, DeepDebugger monitors the training dynamics of samples and recommends suspicious samples based on their abnormality. On the other hand, our recommendation is interactive and fault-resilient for the model developers to explore the training process. By learning users' feedback, DeepDebugger refines its recommendation to fit their intention. Our extensive experiments on applying DeepDebugger on the known time-travelling visualizers show that DeepDebugger can (1) detect the majority of the abnormal movement of the training samples on canvas; (2) significantly boost the recommendation performance of samples of interest (5-10X more accurate than the baselines) with the runtime overhead of 0.015s per feedback; (3) be resilient under the 3%, 5%, 10% mistaken user feedback. Our user study of the tool shows that the interactive recommendation of DeepDebugger can help the participants accomplish the debugging tasks by saving 18.1% completion time and boosting the performance by 20.3%.

DeepDebugger: An Interactive Time-Travelling Debugging Approach for Deep Classifiers

DeepVisualInsight: Time-Travelling Visualization for Spatio-Temporal Causality of Deep Classification Training

VDebugger: Harnessing Execution Feedback for Debugging Visual Programs

iNNspector: Visual, Interactive Deep Model Debugging

Deep Learning for Just-In-Time Defect Prediction

Deep Behavior Tracing with Multi-level Temporality Preserved Embedding

An Interactive Visualization Tool for Understanding Active Learning

DeepEye: Towards Automatic Data Visualization

DanceVis: toward better understanding of online cheer and dance training

Interpreting Deep Learning Models for Knowledge Tracing

Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training

Deep Visual Computing of Behavioral Characteristics in Complex Scenarios and Embedded Object Recognition Applications

Debugging with Intelligence Via Probabilistic Inference

Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakes

Temporality Spatialization: A Scalable and Faithful Time-Travelling Visualization for Deep Classifier Training.

HELP-DKT: an interpretable cognitive model of how students learn programming based on deep knowledge tracing

DEEPEYE: an Automatic Big Data Visualization Framework

Understanding Auto-Scheduling Optimizations for Model Deployment via Visualizations

An Intelligent Approach to Automatically Discovering Visual Insights

An In-Situ Visual Analytics Framework for Deep Neural Networks

Visual Diagnosis of Tree Boosting Methods