Abstract:ABSTRACTSupervised machine-learning algorithms are used to solve classification problems across the entire spectrum of computing platforms, from data centers to wearable devices, and place significant demand on their computational capabilities. In this paper, we propose scalable-effort classifiers, a new approach to optimizing the energy efficiency of supervised machine-learning classifiers. We observe that the inherent classification difficulty varies widely across inputs in real-world datasets; only a small fraction of the inputs truly require the full computational effort of the classifier, while the large majority can be classified correctly with very low effort. Yet, state-of-the-art classification algorithms expend equal effort on all inputs, irrespective of their difficulty. To address this inefficiency, we introduce the concept of scalable-effort classifiers, or classifiers that dynamically adjust their computational effort depending on the difficulty of the input data, while maintaining the same level of accuracy. Scalable effort classifiers are constructed by utilizing a chain of classifiers with increasing levels of complexity (and accuracy). Scalable effort execution is achieved by modulating the number of stages used for classifying a given input. Every stage in the chain contains an ensemble of biased classifiers, where each biased classifier is trained to detect a single class more accurately. The degree of consensus between the biased classifiers' outputs is used to decide whether classification can be terminated at the current stage or not. Our methodology thus allows us to transform any given classification algorithm into a scalable-effort chain. We build scalable-effort versions of 8 popular recognition applications using 3 different classification algorithms. Our experiments demonstrate that scalable-effort classifiers yield 2.79x reduction in average operations per input, which translates to 2.3x and 1.5x improvement in energy for hardware and software implementations, respectively.

A Lightweight Measure of Classification Difficulty from Application Dataset Characteristics

Measuring the prediction difficulty of individual cases in a dataset using machine learning

An Instance-Oriented Performance Measure for Classification

Data-Side Efficiencies for Lightweight Convolutional Neural Networks

Measuring Distance-Based Semantic Similarity Using Meronymy and Hyponymy Relations

Model-agnostic Measure of Generalization Difficulty

A Novel Measure for Evaluating Classifiers

Spectral Metric for Dataset Complexity Assessment

Machine Learning Capability: A standardized metric using case difficulty with applications to individualized deployment of supervised machine learning

The Nebula Benchmark Suite: Implications of Lightweight Neural Networks

A new similarity measure for vector space models in text classification and information retrieval

A Comparison Study on Similarity and Dissimilarity Measures in Clustering Continuous Data

Combining Dissimilarity Measures for Image Classification

Scalable-effort Classifiers for Energy-Efficient Machine Learning

Was that so hard? Estimating human classification difficulty

Efficient Lifelong Model Evaluation in an Era of Rapid Progress

Measures of classification complexity based on neighborhood model

L-measure evaluation metric for fake information detection models with binary class imbalance

Searching Similarity Measure for Binarized Neural Networks

Statistical Measures For Defining Curriculum Scoring Function

Sparse online relative similarity learning