Comment: Classifier Technology and the Illusion of Progress

Jerome H. Friedman

DOI: https://doi.org/10.48550/arXiv.math/0606447

2006-06-19

Statistics Theory

Abstract:Comment on Classifier Technology and the Illusion of Progress [math.ST/0606441]

What problem does this paper attempt to address?

Rejoinder: Classifier Technology and the Illusion of Progress

David J. Hand

DOI: https://doi.org/10.1214/088342306000000079

2006-06-19

Abstract:Rejoinder: Classifier Technology and the Illusion of Progress [<a class="link-https" data-arxiv-id="math.ST/0606441" href="https://arxiv.org/abs/math.ST/0606441">math.ST/0606441</a>]

Statistics Theory
Comment on Is Complexity an Illusion?

Gabriel Simmons

2024-10-29

Abstract:The paper "Is Complexity an Illusion?" (Bennett, 2024) provides a formalism for complexity, learning, inference, and generalization, and introduces a formal definition for a "policy". This reply shows that correct policies do not exist for a simple task of supervised multi-class classification, via mathematical proof and exhaustive search. Implications of this result are discussed, as well as possible responses and amendments to the theory.

Artificial Intelligence
Does the evaluation stand up to evaluation? A first-principle approach to the evaluation of classifiers

K. Dyrland,A. S. Lundervold,P.G.L. Porta Mana

DOI: https://doi.org/10.48550/arXiv.2302.12006

IF: 5.414

2023-02-21

Machine Learning

Abstract:How can one meaningfully make a measurement, if the meter does not conform to any standard and its scale expands or shrinks depending on what is measured? In the present work it is argued that current evaluation practices for machine-learning classifiers are affected by this kind of problem, leading to negative consequences when classifiers are put to real use; consequences that could have been avoided. It is proposed that evaluation be grounded on Decision Theory, and the implications of such foundation are explored. The main result is that every evaluation metric must be a linear combination of confusion-matrix elements, with coefficients - "utilities" - that depend on the specific classification problem. For binary classification, the space of such possible metrics is effectively two-dimensional. It is shown that popular metrics such as precision, balanced accuracy, Matthews Correlation Coefficient, Fowlkes-Mallows index, F1-measure, and Area Under the Curve are never optimal: they always give rise to an in-principle avoidable fraction of incorrect evaluations. This fraction is even larger than would be caused by the use of a decision-theoretic metric with moderately wrong coefficients.
Simplicity Creates Inequity: Implications for Fairness, Stereotypes, and Interpretability

Jon Kleinberg,Sendhil Mullainathan

DOI: https://doi.org/10.48550/arXiv.1809.04578

2019-06-02

Abstract:Algorithms are increasingly used to aid, or in some cases supplant, human decision-making, particularly for decisions that hinge on predictions. As a result, two additional features in addition to prediction quality have generated interest: (i) to facilitate human interaction and understanding with these algorithms, we desire prediction functions that are in some fashion simple or interpretable; and (ii) because they influence consequential decisions, we also want them to produce equitable allocations. We develop a formal model to explore the relationship between the demands of simplicity and equity. Although the two concepts appear to be motivated by qualitatively distinct goals, we show a fundamental inconsistency between them. Specifically, we formalize a general framework for producing simple prediction functions, and in this framework we establish two basic results. First, every simple prediction function is strictly improvable: there exists a more complex prediction function that is both strictly more efficient and also strictly more equitable. Put another way, using a simple prediction function both reduces utility for disadvantaged groups and reduces overall welfare relative to other options. Second, we show that simple prediction functions necessarily create incentives to use information about individuals' membership in a disadvantaged group --- incentives that weren't present before simplification, and that work against these individuals. Thus, simplicity transforms disadvantage into bias against the disadvantaged group. Our results are not only about algorithms but about any process that produces simple models, and as such they connect to the psychology of stereotypes and to an earlier economics literature on statistical discrimination.

Machine Learning,Computers and Society,Data Structures and Algorithms,Social and Information Networks
Mistake, Manipulation and Margin Guarantees in Online Strategic Classification

Lingqing Shen,Nam Ho-Nguyen,Khanh-Hung Giang-Tran,Fatma Kılınç-Karzan

2024-03-27

Abstract:We consider an online strategic classification problem where each arriving agent can manipulate their true feature vector to obtain a positive predicted label, while incurring a cost that depends on the amount of manipulation. The learner seeks to predict the agent's true label given access to only the manipulated features. After the learner releases their prediction, the agent's true label is revealed. Previous algorithms such as the strategic perceptron guarantee finitely many mistakes under a margin assumption on agents' true feature vectors. However, these are not guaranteed to encourage agents to be truthful. Promoting truthfulness is intimately linked to obtaining adequate margin on the predictions, thus we provide two new algorithms aimed at recovering the maximum margin classifier in the presence of strategic agent behavior. We prove convergence, finite mistake and finite manipulation guarantees for a variety of agent cost structures. We also provide generalized versions of the strategic perceptron with mistake guarantees for different costs. Our numerical study on real and synthetic data demonstrates that the new algorithms outperform previous ones in terms of margin, number of manipulation and number of mistakes.

Machine Learning,Computer Science and Game Theory,Optimization and Control
Classification, Slippage, Failure and Discovery

Marc Böhlen

DOI: https://doi.org/10.48550/arXiv.2104.03886

2021-04-08

Computers and Society

Abstract:This text argues for the potential of machine learning infused classification systems as vectors for a technically-engaged and constructive technology critique. The text describes this potential with several experiments in image data creation and neural network based classification. The text considers varying aspects of slippage in classification and considers the potential for discovery - as opposed to disaster - stemming from machine learning systems when they fail to perform as anticipated.
COMMENTS ON THE SKIDMORE AND TURNER SUPERVISED NONPARAMETRIC CLASSIFIER

GONG,P,DUNLOP,JD

1991-01-01

Abstract:In this paper, the supervised nonparametric classifier proposed by Skidmore and Turner (1988) is discussed. Because the notation in the Skidmore and Turner paper is enigmatic with a published erratum (Skidmore, 1989), the algorithm has been restated in a consolidated form. The computational efficiency of the original algorithm is improved.
Equal Opportunity in Online Classification with Partial Feedback

Yahav Bechavod,Katrina Ligett,Aaron Roth,Bo Waggoner,Zhiwei Steven Wu

DOI: https://doi.org/10.48550/arXiv.1902.02242

2020-04-16

Abstract:We study an online classification problem with partial feedback in which individuals arrive one at a time from a fixed but unknown distribution, and must be classified as positive or negative. Our algorithm only observes the true label of an individual if they are given a positive classification. This setting captures many classification problems for which fairness is a concern: for example, in criminal recidivism prediction, recidivism is only observed if the inmate is released; in lending applications, loan repayment is only observed if the loan is granted. We require that our algorithms satisfy common statistical fairness constraints (such as equalizing false positive or negative rates -- introduced as "equal opportunity" in Hardt et al. (2016)) at every round, with respect to the underlying distribution. We give upper and lower bounds characterizing the cost of this constraint in terms of the regret rate (and show that it is mild), and give an oracle efficient algorithm that achieves the upper bound.

Machine Learning
The Mathematical Intelligencer flunks the Olympics

Alexander E. Gutman,Mikhail G. Katz,Taras S. Kudryk,Semen S. Kutateladze

DOI: https://doi.org/10.1007/s10699-016-9485-8

2016-06-01

Abstract:The Mathematical Intelligencer recently published a note by Y. Sergeyev that challenges both mathematics and intelligence. We examine Sergeyev's claims concerning his purported Infinity computer. We compare his grossone system with the classical Levi-Civita fields and with the hyperreal framework of A. Robinson, and analyze the related algorithmic issues inevitably arising in any genuine computer implementation. We show that Sergeyev's grossone system is unnecessary and vague, and that whatever consistent subsystem could be salvaged is subsumed entirely within a stronger and clearer system (IST). Lou Kauffman, who published an article on a grossone, places it squarely outside the historical panorama of ideas dealing with infinity and infinitesimals.

History and Overview,Information Theory,Logic
Classifying 50 years of Bell inequalities

Denis Rosset,Jean-Daniel Bancal,Nicolas Gisin

DOI: https://doi.org/10.1088/1751-8113/47/42/424022

2014-04-05

Abstract:Since John S. Bell demonstrated the interest of studying linear combinations of probabilities in relation with the EPR paradox in 1964, Bell inequalities have lead to numerous developments. Unfortunately, the description of Bell inequalities is subject to several degeneracies, which make any exchange of information about them unnecessarily hard. Here, we analyze these degeneracies and propose a decomposition for Bell-like inequalities based on a set of reference expressions which is not affected by them. These reference expressions set a common ground for comparing Bell inequalities. We provide algorithms based on finite group theory to compute this decomposition. Implementing these algorithms allows us to set up a compendium of reference Bell-like inequalities, available online at <a class="link-external link-http" href="http://www.faacets.com" rel="external noopener nofollow">this http URL</a> . This website constitutes a platform where registered Bell-like inequalities can be explored, new inequalities can be compared to previously-known ones and relevant information on Bell inequalities can be added in a collaborative manner.

Quantum Physics
Positive Attitude [From the Editor]

Rodolphe Sepulchre

DOI: https://doi.org/10.1109/mcs.2024.3358498

2024-04-01

IEEE Control Systems

Abstract:The monotonicity of a scalar function is equivalent to the positivity of its increments and to the convexity of its integral. I sometimes feel that this high-school mathematical statement alone underlines the entire algorithmic tractability of modern information engineering. And replacing scalar function with system defines a largely open research program in control.

automation & control systems
Strategic Classification in the Dark

Ganesh Ghalme,Vineet Nair,Itay Eilat,Inbal Talgam-Cohen,Nir Rosenfeld

DOI: https://doi.org/10.48550/arXiv.2102.11592

2021-06-13

Abstract:Strategic classification studies the interaction between a classification rule and the strategic agents it governs. Under the assumption that the classifier is known, rational agents respond to it by manipulating their features. However, in many real-life scenarios of high-stake classification (e.g., credit scoring), the classifier is not revealed to the agents, which leads agents to attempt to learn the classifier and game it too. In this paper we generalize the strategic classification model to such scenarios. We define the price of opacity as the difference in prediction error between opaque and transparent strategy-robust classifiers, characterize it, and give a sufficient condition for this price to be strictly positive, in which case transparency is the recommended policy. Our experiments show how Hardt et al.'s robust classifier is affected by keeping agents in the dark.

Machine Learning
When a Classifier Meets More Data

zhicheng liao,yangyong zhu

DOI: https://doi.org/10.1016/j.procs.2014.05.380

2014-01-01

Procedia Computer Science

Abstract:The studies of generalization error give possible approaches to estimate the performance of a classification. But they are still expensive and difficult to use on large-scale data. In this paper, we discover that the accuracy of a classification is regional convergence with respect to the size of training data set, and give a Bounded Accuracy Conjecture. We also find that to train a classification with a little noisy training data set will not impact the accuracy. Finally, we give an easy but effectively experimental approach to build a good enough train data set for a given large-scale problem.
Efficient Computation of Confidence Sets Using Classification on Equidistributed Grids

Lujie Zhou

2024-01-04

Abstract:Economic models produce moment inequalities, which can be used to form tests of the true parameters. Confidence sets (CS) of the true parameters are derived by inverting these tests. However, they often lack analytical expressions, necessitating a grid search to obtain the CS numerically by retaining the grid points that pass the test. When the statistic is not asymptotically pivotal, constructing the critical value for each grid point in the parameter space adds to the computational burden. In this paper, we convert the computational issue into a classification problem by using a support vector machine (SVM) classifier. Its decision function provides a faster and more systematic way of dividing the parameter space into two regions: inside vs. outside of the confidence set. We label those points in the CS as 1 and those outside as -1. Researchers can train the SVM classifier on a grid of manageable size and use it to determine whether points on denser grids are in the CS or not. We establish certain conditions for the grid so that there is a tuning that allows us to asymptotically reproduce the test in the CS. This means that in the limit, a point is classified as belonging to the confidence set if and only if it is labeled as 1 by the SVM.

Machine Learning
Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifiers

Dominik Zietlow,Michael Lohaus,Guha Balakrishnan,Matthäus Kleindessner,Francesco Locatello,Bernhard Schölkopf,Chris Russell

DOI: https://doi.org/10.48550/arXiv.2203.04913

2022-03-09

Computer Vision and Pattern Recognition

Abstract:Algorithmic fairness is frequently motivated in terms of a trade-off in which overall performance is decreased so as to improve performance on disadvantaged groups where the algorithm would otherwise be less accurate. Contrary to this, we find that applying existing fairness approaches to computer vision improve fairness by degrading the performance of classifiers across all groups (with increased degradation on the best performing groups). Extending the bias-variance decomposition for classification to fairness, we theoretically explain why the majority of fairness classifiers designed for low capacity models should not be used in settings involving high-capacity models, a scenario common to computer vision. We corroborate this analysis with extensive experimental support that shows that many of the fairness heuristics used in computer vision also degrade performance on the most disadvantaged groups. Building on these insights, we propose an adaptive augmentation strategy that, uniquely, of all methods tested, improves performance for the disadvantaged groups.
Unfairness Despite Awareness: Group-Fair Classification with Strategic Agents

Andrew Estornell,Sanmay Das,Yang Liu,Yevgeniy Vorobeychik

DOI: https://doi.org/10.48550/arXiv.2112.02746

2021-12-06

Abstract:The use of algorithmic decision making systems in domains which impact the financial, social, and political well-being of people has created a demand for these decision making systems to be "fair" under some accepted notion of equity. This demand has in turn inspired a large body of work focused on the development of fair learning algorithms which are then used in lieu of their conventional counterparts. Most analysis of such fair algorithms proceeds from the assumption that the people affected by the algorithmic decisions are represented as immutable feature vectors. However, strategic agents may possess both the ability and the incentive to manipulate this observed feature vector in order to attain a more favorable outcome. We explore the impact that strategic agent behavior could have on fair classifiers and derive conditions under which this behavior leads to fair classifiers becoming less fair than their conventional counterparts under the same measure of fairness that the fair classifier takes into account. These conditions are related to the the way in which the fair classifier remedies unfairness on the original unmanipulated data: fair classifiers which remedy unfairness by becoming more selective than their conventional counterparts are the ones that become less fair than their counterparts when agents are strategic. We further demonstrate that both the increased selectiveness of the fair classifier, and consequently the loss of fairness, arises when performing fair learning on domains in which the advantaged group is overrepresented in the region near (and on the beneficial side of) the decision boundary of conventional classifiers. Finally, we observe experimentally, using several datasets and learning methods, that this fairness reversal is common, and that our theoretical characterization of the fairness reversal conditions indeed holds in most such cases.

Multiagent Systems,Computers and Society,Computer Science and Game Theory,Machine Learning
A Decade's Battle on Dataset Bias: Are We There Yet?

Zhuang Liu,Kaiming He

DOI: https://doi.org/10.48550/arXiv.2403.08632

2024-03-13

Abstract:We revisit the "dataset classification" experiment suggested by Torralba and Efros a decade ago, in the new era with large-scale, diverse, and hopefully less biased datasets as well as more capable neural network architectures. Surprisingly, we observe that modern neural networks can achieve excellent accuracy in classifying which dataset an image is from: e.g., we report 84.7% accuracy on held-out validation data for the three-way classification problem consisting of the YFCC, CC, and DataComp datasets. Our further experiments show that such a dataset classifier could learn semantic features that are generalizable and transferable, which cannot be simply explained by memorization. We hope our discovery will inspire the community to rethink the issue involving dataset bias and model capabilities.

Computer Vision and Pattern Recognition,Machine Learning
Blessing of dimensionality at the edge

Ivan Y. Tyukin,Alexander N. Gorban,Alistair A. McEwan,Sepehr Meshkinfamfard,Lixin Tang

DOI: https://doi.org/10.1016/j.ins.2021.01.022

2020-07-10

Abstract:In this paper we present theory and algorithms enabling classes of Artificial Intelligence (AI) systems to continuously and incrementally improve with a-priori quantifiable guarantees - or more specifically remove classification errors - over time. This is distinct from state-of-the-art machine learning, AI, and software approaches. Another feature of this approach is that, in the supervised setting, the computational complexity of training is linear in the number of training samples. At the time of classification, the computational complexity is bounded by few inner product calculations. Moreover, the implementation is shown to be very scalable. This makes it viable for deployment in applications where computational power and memory are limited, such as embedded environments. It enables the possibility for fast on-line optimisation using improved training samples. The approach is based on the concentration of measure effects and stochastic separation theorems and is illustrated with an example on the identification faulty processes in Computer Numerical Control (CNC) milling and with a case study on adaptive removal of false positives in an industrial video surveillance and analytics system.

Machine Learning
A Hitchhiker's Guide to Understanding Performances of Two-Class Classifiers

Anaïs Halin,Sébastien Piérard,Anthony Cioppa,Marc Van Droogenbroeck

2024-12-06

Abstract:Properly understanding the performances of classifiers is essential in various scenarios. However, the literature often relies only on one or two standard scores to compare classifiers, which fails to capture the nuances of application-specific requirements, potentially leading to suboptimal classifier selection. Recently, a paper on the foundations of the theory of performance-based ranking introduced a tool, called the Tile, that organizes an infinity of ranking scores into a 2D map. Thanks to the Tile, it is now possible to evaluate and compare classifiers efficiently, displaying all possible application-specific preferences instead of having to rely on a pair of scores. In this paper, we provide a first hitchhiker's guide for understanding the performances of two-class classifiers by presenting four scenarios, each showcasing a different user profile: a theoretical analyst, a method designer, a benchmarker, and an application developer. Particularly, we show that we can provide different interpretative flavors that are adapted to the user's needs by mapping different values on the Tile. As an illustration, we leverage the newly introduced Tile tool and the different flavors to rank and analyze the performances of 74 state-of-the-art semantic segmentation models in two-class classification through the eyes of the four user profiles. Through these user profiles, we demonstrate that the Tile effectively captures the behavior of classifiers in a single visualization, while accommodating an infinite number of ranking scores.

Computer Vision and Pattern Recognition,Machine Learning,Performance
Task Confusion and Catastrophic Forgetting in Class-Incremental Learning: A Mathematical Framework for Discriminative and Generative Modelings

Milad Khademi Nori,Il-Min Kim

2024-10-28

Abstract:In class-incremental learning (class-IL), models must classify all previously seen classes at test time without task-IDs, leading to task confusion. Despite being a key challenge, task confusion lacks a theoretical understanding. We present a novel mathematical framework for class-IL and prove the Infeasibility Theorem, showing optimal class-IL is impossible with discriminative modeling due to task confusion. However, we establish the Feasibility Theorem, demonstrating that generative modeling can achieve optimal class-IL by overcoming task confusion. We then assess popular class-IL strategies, including regularization, bias-correction, replay, and generative classifier, using our framework. Our analysis suggests that adopting generative modeling, either for generative replay or direct classification (generative classifier), is essential for optimal class-IL.

Machine Learning

Comment: Classifier Technology and the Illusion of Progress

Rejoinder: Classifier Technology and the Illusion of Progress

Comment on Is Complexity an Illusion?

Does the evaluation stand up to evaluation? A first-principle approach to the evaluation of classifiers

Simplicity Creates Inequity: Implications for Fairness, Stereotypes, and Interpretability

Mistake, Manipulation and Margin Guarantees in Online Strategic Classification

Classification, Slippage, Failure and Discovery

COMMENTS ON THE SKIDMORE AND TURNER SUPERVISED NONPARAMETRIC CLASSIFIER

Equal Opportunity in Online Classification with Partial Feedback

The Mathematical Intelligencer flunks the Olympics

Classifying 50 years of Bell inequalities

Positive Attitude [From the Editor]

Strategic Classification in the Dark

When a Classifier Meets More Data

Efficient Computation of Confidence Sets Using Classification on Equidistributed Grids

Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifiers

Unfairness Despite Awareness: Group-Fair Classification with Strategic Agents

A Decade's Battle on Dataset Bias: Are We There Yet?

Blessing of dimensionality at the edge

A Hitchhiker's Guide to Understanding Performances of Two-Class Classifiers

Task Confusion and Catastrophic Forgetting in Class-Incremental Learning: A Mathematical Framework for Discriminative and Generative Modelings