Representation Change in Machine Learning

L. Saitta

DOI: https://doi.org/10.3233/AIC-1996-9102

IF: 1.029

1996-03-01

AI Communications

Abstract:

What problem does this paper attempt to address?

Representation Learning for Fine-Grained Change Detection

Niall O'Mahony,Sean Campbell,Lenka Krpalkova,Anderson Carvalho,Joseph Walsh,Daniel Riordan

DOI: https://doi.org/10.3390/s21134486

2021-06-30

Abstract:Fine-grained change detection in sensor data is very challenging for artificial intelligence though it is critically important in practice. It is the process of identifying differences in the state of an object or phenomenon where the differences are class-specific and are difficult to generalise. As a result, many recent technologies that leverage big data and deep learning struggle with this task. This review focuses on the state-of-the-art methods, applications, and challenges of representation learning for fine-grained change detection. Our research focuses on methods of harnessing the latent metric space of representation learning techniques as an interim output for hybrid human-machine intelligence. We review methods for transforming and projecting embedding space such that significant changes can be communicated more effectively and a more comprehensive interpretation of underlying relationships in sensor data is facilitated. We conduct this research in our work towards developing a method for aligning the axes of latent embedding space with meaningful real-world metrics so that the reasoning behind the detection of change in relation to past observations may be revealed and adjusted. This is an important topic in many fields concerned with producing more meaningful and explainable outputs from deep learning and also for providing means for knowledge injection and model calibration in order to maintain user confidence.
From Latent Dynamics to Meaningful Representations

Dedi Wang,Yihang Wang,Luke Evans,Pratyush Tiwary

DOI: https://doi.org/10.1021/acs.jctc.4c00249

2024-04-24

Journal of Chemical Theory and Computation

Abstract:While representation learning has been central to the rise of machine learning and artificial intelligence, a key problem remains in making the learned representations meaningful. For this, the typical approach is to regularize the learned representation through prior probability distributions. However, such priors are usually unavailable or are ad hoc. To deal with this, recent efforts have shifted toward leveraging the insights from physical principles to guide the learning process. In this...

chemistry, physical,physics, atomic, molecular & chemical
Representation Learning: A Statistical Perspective

Jianwen Xie,Ruiqi Gao,Erik Nijkamp,Song-Chun Zhu,Ying Nian Wu

DOI: https://doi.org/10.48550/arXiv.1911.11374

2019-11-26

Abstract:Learning representations of data is an important problem in statistics and machine learning. While the origin of learning representations can be traced back to factor analysis and multidimensional scaling in statistics, it has become a central theme in deep learning with important applications in computer vision and computational neuroscience. In this article, we review recent advances in learning representations from a statistical perspective. In particular, we review the following two themes: (a) unsupervised learning of vector representations and (b) learning of both vector and matrix representations.

Machine Learning
State of the Art in Fair ML: From Moral Philosophy and Legislation to Fair Classifiers

Elias Baumann,Josef Lorenz Rumberger

DOI: https://doi.org/10.48550/arXiv.1811.09539

2024-05-27

Abstract:Machine learning is becoming an ever present part in our lives as many decisions, e.g. to lend a credit, are no longer made by humans but by machine learning algorithms. However those decisions are often unfair and discriminating individuals belonging to protected groups based on race or gender. With the recent General Data Protection Regulation (GDPR) coming into effect, new awareness has been raised for such issues and with computer scientists having such a large impact on peoples lives it is necessary that actions are taken to discover and prevent discrimination. This work aims to give an introduction into discrimination, legislative foundations to counter it and strategies to detect and prevent machine learning algorithms from showing such behavior.

Computers and Society,Machine Learning
Representation Learning: A Review and New Perspectives

Yoshua Bengio,Aaron Courville,Pascal Vincent,Y. Bengio,A. Courville,P. Vincent

DOI: https://doi.org/10.1109/tpami.2013.50

IF: 23.6

2013-08-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind the data. Although specific domain knowledge can be used to help design representations, learning with generic priors can also be used, and the quest for AI is motivating the design of more powerful representation-learning algorithms implementing such priors. This paper reviews recent work in the area of unsupervised feature learning and deep learning, covering advances in probabilistic models, autoencoders, manifold learning, and deep networks. This motivates longer term unanswered questions about the appropriate objectives for learning good representations, for computing representations (i.e., inference), and the geometrical connections between representation learning, density estimation, and manifold learning.

computer science, artificial intelligence,engineering, electrical & electronic
Generalizing in the Real World with Representation Learning

Tegan Maharaj

DOI: https://doi.org/10.48550/arXiv.2210.09925

2022-10-18

Abstract:Machine learning (ML) formalizes the problem of getting computers to learn from experience as optimization of performance according to some metric(s) on a set of data examples. This is in contrast to requiring behaviour specified in advance (e.g. by hard-coded rules). Formalization of this problem has enabled great progress in many applications with large real-world impact, including translation, speech recognition, self-driving cars, and drug discovery. But practical instantiations of this formalism make many assumptions - for example, that data are i.i.d.: independent and identically distributed - whose soundness is seldom investigated. And in making great progress in such a short time, the field has developed many norms and ad-hoc standards, focused on a relatively small range of problem settings. As applications of ML, particularly in artificial intelligence (AI) systems, become more pervasive in the real world, we need to critically examine these assumptions, norms, and problem settings, as well as the methods that have become de-facto standards. There is much we still do not understand about how and why deep networks trained with stochastic gradient descent are able to generalize as well as they do, why they fail when they do, and how they will perform on out-of-distribution data. In this thesis I cover some of my work towards better understanding deep net generalization, identify several ways assumptions and problem settings fail to generalize to the real world, and propose ways to address those failures in practice.

Machine Learning
When Representations Align: Universality in Representation Learning Dynamics

Loek van Rossem,Andrew M. Saxe

2024-07-05

Abstract:Deep neural networks come in many sizes and architectures. The choice of architecture, in conjunction with the dataset and learning algorithm, is commonly understood to affect the learned neural representations. Yet, recent results have shown that different architectures learn representations with striking qualitative similarities. Here we derive an effective theory of representation learning under the assumption that the encoding map from input to hidden representation and the decoding map from representation to output are arbitrary smooth functions. This theory schematizes representation learning dynamics in the regime of complex, large architectures, where hidden representations are not strongly constrained by the parametrization. We show through experiments that the effective theory describes aspects of representation learning dynamics across a range of deep networks with different activation functions and architectures, and exhibits phenomena similar to the "rich" and "lazy" regime. While many network behaviors depend quantitatively on architecture, our findings point to certain behaviors that are widely conserved once models are sufficiently flexible.

Machine Learning,Neurons and Cognition
Modeling Techniques for Machine Learning Fairness: A Survey

Na Zou,Mingyang Wan,D. Zha,Ninghao Liu

2021-11-04

Abstract:Machine learning models are becoming pervasive in high-stakes applications. Despite their clear benefits in terms of performance, the models could show discrimination against minority groups and result in fairness issues in a decision-making process, leading to severe negative impacts on the individuals and the society. In recent years, various techniques have been developed to mitigate the unfairness for machine learning models. Among them, in-processing methods have drawn increasing attention from the community, where fairness is directly taken into consideration during model design to induce intrinsically fair models and fundamentally mitigate fairness issues in outputs and representations. In this survey, we review the current progress of in-processing fairness mitigation techniques. Based on where the fairness is achieved in the model, we categorize them into explicit and implicit methods, where the former directly incorporates fairness metrics in training objectives, and the latter focuses on refining latent representation learning. Finally, we conclude the survey with a discussion of the research challenges in this community to motivate future exploration.

Computer Science
Representation Matters: Assessing the Importance of Subgroup Allocations in Training Data

Esther Rolf,Theodora Worledge,Benjamin Recht,Michael I. Jordan

DOI: https://doi.org/10.48550/arXiv.2103.03399

IF: 5.414

2021-03-05

Machine Learning

Abstract:Collecting more diverse and representative training data is often touted as a remedy for the disparate performance of machine learning predictors across subpopulations. However, a precise framework for understanding how dataset properties like diversity affect learning outcomes is largely lacking. By casting data collection as part of the learning process, we demonstrate that diverse representation in training data is key not only to increasing subgroup performances, but also to achieving population level objectives. Our analysis and experiments describe how dataset compositions influence performance and provide constructive results for using trends in existing data, alongside domain knowledge, to help guide intentional, objective-aware dataset design.
Closing the Gap in the Trade-off between Fair Representations and Accuracy

Biswajit Rout,Ananya B. Sai,Arun Rajkumar

2024-04-15

Abstract:The rapid developments of various machine learning models and their deployments in several applications has led to discussions around the importance of looking beyond the accuracies of these models. Fairness of such models is one such aspect that is deservedly gaining more attention. In this work, we analyse the natural language representations of documents and sentences (i.e., encodings) for any embedding-level bias that could potentially also affect the fairness of the downstream tasks that rely on them. We identify bias in these encodings either towards or against different sub-groups based on the difference in their reconstruction errors along various subsets of principal components. We explore and recommend ways to mitigate such bias in the encodings while also maintaining a decent accuracy in classification models that use them.

Machine Learning,Computers and Society
Transformative Machine Learning

Ivan Olier,Oghenejokpeme I. Orhobor,Joaquin Vanschoren,Ross D. King

DOI: https://doi.org/10.48550/arXiv.1811.03392

2018-11-08

Abstract:The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn effective implicit representations from simple input representations. However, for most scientific problems, the use of deep learning is not appropriate as the amount of available data is limited, and/or the output models must be explainable. Nevertheless, many scientific problems do have significant amounts of data available on related tasks, which makes them amenable to multi-task learning, i.e. learning many related problems simultaneously. Here we propose a novel and general representation learning approach for multi-task learning that works successfully with small amounts of data. The fundamental new idea is to transform an input intrinsic data representation (i.e., handcrafted features), to an extrinsic representation based on what a pre-trained set of models predict about the examples. This transformation has the dual advantages of producing significantly more accurate predictions, and providing explainable models. To demonstrate the utility of this transformative learning approach, we have applied it to three real-world scientific problems: drug-design (quantitative structure activity relationship learning), predicting human gene expression (across different tissue types and drug treatments), and meta-learning for machine learning (predicting which machine learning methods work best for a given problem). In all three problems, transformative machine learning significantly outperforms the best intrinsic representation.

Machine Learning
An Investigation of Representation and Allocation Harms in Contrastive Learning

Subha Maity,Mayank Agarwal,Mikhail Yurochkin,Yuekai Sun

2023-10-03

Abstract:The effect of underrepresentation on the performance of minority groups is known to be a serious problem in supervised learning settings; however, it has been underexplored so far in the context of self-supervised learning (SSL). In this paper, we demonstrate that contrastive learning (CL), a popular variant of SSL, tends to collapse representations of minority groups with certain majority groups. We refer to this phenomenon as representation harm and demonstrate it on image and text datasets using the corresponding popular CL methods. Furthermore, our causal mediation analysis of allocation harm on a downstream classification task reveals that representation harm is partly responsible for it, thus emphasizing the importance of studying and mitigating representation harm. Finally, we provide a theoretical explanation for representation harm using a stochastic block model that leads to a representational neural collapse in a contrastive learning setting.

Machine Learning
Fairness-aware machine learning: a perspective

Indre Zliobaite

DOI: https://doi.org/10.48550/arXiv.1708.00754

2017-08-02

Abstract:Algorithms learned from data are increasingly used for deciding many aspects in our life: from movies we see, to prices we pay, or medicine we get. Yet there is growing evidence that decision making by inappropriately trained algorithms may unintentionally discriminate people. For example, in automated matching of candidate CVs with job descriptions, algorithms may capture and propagate ethnicity related biases. Several repairs for selected algorithms have already been proposed, but the underlying mechanisms how such discrimination happens from the computational perspective are not yet scientifically understood. We need to develop theoretical understanding how algorithms may become discriminatory, and establish fundamental machine learning principles for prevention. We need to analyze machine learning process as a whole to systematically explain the roots of discrimination occurrence, which will allow to devise global machine learning optimization criteria for guaranteed prevention, as opposed to pushing empirical constraints into existing algorithms case-by-case. As a result, the state-of-the-art will advance from heuristic repairing, to proactive and theoretically supported prevention. This is needed not only because law requires to protect vulnerable people. Penetration of big data initiatives will only increase, and computer science needs to provide solid explanations and accountability to the public, before public concerns lead to unnecessarily restrictive regulations against machine learning.

Artificial Intelligence,Computers and Society,Machine Learning
Challenges in representation learning: A report on three machine learning contests

Ian J. Goodfellow,Dumitru Erhan,Pierre Luc Carrier,Aaron Courville,Mehdi Mirza,Ben Hamner,Will Cukierski,Yichuan Tang,David Thaler,Dong-Hyun Lee,Yingbo Zhou,Chetan Ramaiah,Fangxiang Feng,Ruifan Li,Xiaojie Wang,Dimitris Athanasakis,John Shawe-Taylor,Maxim Milakov,John Park,Radu Ionescu,Marius Popescu,Cristian Grozea,James Bergstra,Jingjing Xie,Lukasz Romaszko,Bing Xu,Zhang Chuang,Yoshua Bengio

DOI: https://doi.org/10.1016/j.neunet.2014.09.005

IF: 7.8

2015-04-01

Neural Networks

Abstract:The ICML 2013 Workshop on Challenges in Representation Learning(1) focused on three challenges: the black box learning challenge, the facial expression recognition challenge, and the multimodal learning challenge. We describe the datasets created for these challenges and summarize the results of the competitions. We provide suggestions for organizers of future challenges and some comments on what kind of knowledge can be gained from machine learning competitions.

computer science, artificial intelligence,neurosciences
The representation landscape of few-shot learning and fine-tuning in large language models

Diego Doimo,Alessandro Serra,Alessio Ansuini,Alberto Cazzaniga

2024-09-06

Abstract:In-context learning (ICL) and supervised fine-tuning (SFT) are two common strategies for improving the performance of modern large language models (LLMs) on specific tasks. Despite their different natures, these strategies often lead to comparable performance gains. However, little is known about whether they induce similar representations inside LLMs. We approach this problem by analyzing the probability landscape of their hidden representations in the two cases. More specifically, we compare how LLMs solve the same question-answering task, finding that ICL and SFT create very different internal structures, in both cases undergoing a sharp transition in the middle of the network. In the first half of the network, ICL shapes interpretable representations hierarchically organized according to their semantic content. In contrast, the probability landscape obtained with SFT is fuzzier and semantically mixed. In the second half of the model, the fine-tuned representations develop probability modes that better encode the identity of answers, while the landscape of ICL representations is characterized by less defined peaks. Our approach reveals the diverse computational strategies developed inside LLMs to solve the same task across different conditions, allowing us to make a step towards designing optimal methods to extract information from language models.

Computation and Language,Machine Learning
Strategic Representation

Vineet Nair,Ganesh Ghalme,Inbal Talgam-Cohen,Nir Rosenfeld

DOI: https://doi.org/10.48550/arXiv.2206.08542

2022-06-17

Abstract:Humans have come to rely on machines for reducing excessive information to manageable representations. But this reliance can be abused -- strategic machines might craft representations that manipulate their users. How can a user make good choices based on strategic representations? We formalize this as a learning problem, and pursue algorithms for decision-making that are robust to manipulation. In our main setting of interest, the system represents attributes of an item to the user, who then decides whether or not to consume. We model this interaction through the lens of strategic classification (Hardt et al. 2016), reversed: the user, who learns, plays first; and the system, which responds, plays second. The system must respond with representations that reveal `nothing but the truth' but need not reveal the entire truth. Thus, the user faces the problem of learning set functions under strategic subset selection, which presents distinct algorithmic and statistical challenges. Our main result is a learning algorithm that minimizes error despite strategic representations, and our theoretical analysis sheds light on the trade-off between learning effort and susceptibility to manipulation.

Machine Learning,Computer Science and Game Theory
Emergence of machine language: towards symbolic intelligence with neural networks

Yuqi Wang,Xu-Yao Zhang,Cheng-Lin Liu,Tieniu Tan,Zhaoxiang Zhang

DOI: https://doi.org/10.1093/nsr/nwad317

IF: 20.6

2024-02-29

National Science Review

Abstract:Representation learning is a core issue in artificial intelligence (AI). Currently, there exists a disparity in the choice of representation between humans and machines. Humans rely on discrete language for communication and learning, whereas machines utilize continuous features for computation and representation. Discrete symbols are low-dimensional, decoupled and offer robust reasoning abilities, while continuous features are high-dimensional, coupled and possess remarkable abstracting capabilities. In recent years, deep learning [1] has developed the idea of continuous representation to the extreme, using billions of parameters to achieve high accuracies. Although this is reasonable from a statistical perspective, it has other major problems, such as a lack of interpretability, poor generalization and being easily attacked. Both paradigms have strengths and weaknesses, and a better choice is to seek reconciliation.

multidisciplinary sciences
Change is Hard: A Closer Look at Subpopulation Shift

Yuzhe Yang,Haoran Zhang,Dina Katabi,Marzyeh Ghassemi

2023-08-18

Abstract:Machine learning models often perform poorly on subgroups that are underrepresented in the training data. Yet, little is understood on the variation in mechanisms that cause subpopulation shifts, and how algorithms generalize across such diverse shifts at scale. In this work, we provide a fine-grained analysis of subpopulation shift. We first propose a unified framework that dissects and explains common shifts in subgroups. We then establish a comprehensive benchmark of 20 state-of-the-art algorithms evaluated on 12 real-world datasets in vision, language, and healthcare domains. With results obtained from training over 10,000 models, we reveal intriguing observations for future progress in this space. First, existing algorithms only improve subgroup robustness over certain types of shifts but not others. Moreover, while current algorithms rely on group-annotated validation data for model selection, we find that a simple selection criterion based on worst-class accuracy is surprisingly effective even without any group information. Finally, unlike existing works that solely aim to improve worst-group accuracy (WGA), we demonstrate the fundamental tradeoff between WGA and other important metrics, highlighting the need to carefully choose testing metrics. Code and data are available at: <a class="link-external link-https" href="https://github.com/YyzHarry/SubpopBench" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Artificial Intelligence,Computer Vision and Pattern Recognition
A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective

Jeng-Lin Li,Chih-Fan Hsu,Ming-Ching Chang,Wei-Chao Chen

2024-02-20

Abstract:Recent artificial intelligence (AI) technologies show remarkable evolution in various academic fields and industries. However, in the real world, dynamic data lead to principal challenges for deploying AI models. An unexpected data change brings about severe performance degradation in AI models. We identify two major related research fields, domain shift and concept drift according to the setting of the data change. Although these two popular research fields aim to solve distribution shift and non-stationary data stream problems, the underlying properties remain similar which also encourages similar technical approaches. In this review, we regroup domain shift and concept drift into a single research problem, namely the data change problem, with a systematic overview of state-of-the-art methods in the two research fields. We propose a three-phase problem categorization scheme to link the key ideas in the two technical fields. We thus provide a novel scope for researchers to explore contemporary technical strategies, learn industrial applications, and identify future directions for addressing data change challenges.

Machine Learning,Computer Vision and Pattern Recognition,Artificial Intelligence
Learning Fair and Interpretable Representations via Linear Orthogonalization

Yuzi He,Keith Burghardt,Kristina Lerman

DOI: https://doi.org/10.48550/arXiv.1910.12854

2019-12-18

Abstract:To reduce human error and prejudice, many high-stakes decisions have been turned over to machine algorithms. However, recent research suggests that this does not remove discrimination, and can perpetuate harmful stereotypes. While algorithms have been developed to improve fairness, they typically face at least one of three shortcomings: they are not interpretable, their prediction quality deteriorates quickly compared to unbiased equivalents, and they are not easily transferable across models. To address these shortcomings, we propose a geometric method that removes correlations between data and any number of protected variables. Further, we can control the strength of debiasing through an adjustable parameter to address the trade-off between prediction quality and fairness. The resulting features are interpretable and can be used with many popular models, such as linear regression, random forest, and multilayer perceptrons. The resulting predictions are found to be more accurate and fair compared to several state-of-the-art fair AI algorithms across a variety of benchmark datasets. Our work shows that debiasing data is a simple and effective solution toward improving fairness.

Computers and Society,Machine Learning

Representation Change in Machine Learning

Representation Learning for Fine-Grained Change Detection

From Latent Dynamics to Meaningful Representations

Representation Learning: A Statistical Perspective

State of the Art in Fair ML: From Moral Philosophy and Legislation to Fair Classifiers

Representation Learning: A Review and New Perspectives

Generalizing in the Real World with Representation Learning

When Representations Align: Universality in Representation Learning Dynamics

Modeling Techniques for Machine Learning Fairness: A Survey

Representation Matters: Assessing the Importance of Subgroup Allocations in Training Data

Closing the Gap in the Trade-off between Fair Representations and Accuracy

Transformative Machine Learning

An Investigation of Representation and Allocation Harms in Contrastive Learning

Fairness-aware machine learning: a perspective

Challenges in representation learning: A report on three machine learning contests

The representation landscape of few-shot learning and fine-tuning in large language models

Strategic Representation

Emergence of machine language: towards symbolic intelligence with neural networks

Change is Hard: A Closer Look at Subpopulation Shift

A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective

Learning Fair and Interpretable Representations via Linear Orthogonalization