Abstract:The concept of learning has multiple interpretations, ranging from acquiring knowledge or skills to constructing meaning and social development. Machine Learning (ML) is considered a branch of Artificial Intelligence (AI) and develops algorithms that can learn from data and generalize their judgment to new observations by exploiting primarily statistical methods. The new millennium has seen the proliferation of Artificial Neural Networks (ANNs), a formalism able to reach extraordinary achievements in complex problems such as computer vision and natural language recognition. In particular, designers claim that this formalism has a strong resemblance to the way the biological neurons operate. This work argues that although ML has a mathematical/statistical foundation, it cannot be strictly regarded as a science, at least from a methodological perspective. The main reason is that ML algorithms have notable prediction power although they cannot necessarily provide a causal explanation about the achieved predictions. For example, an ANN could be trained on a large dataset of consumer financial information to predict creditworthiness. The model takes into account various factors like income, credit history, debt, spending patterns, and more. It then outputs a credit score or a decision on credit approval. However, the complex and multi-layered nature of the neural network makes it almost impossible to understand which specific factors or combinations of factors the model is using to arrive at its decision. This lack of transparency can be problematic, especially if the model denies credit and the applicant wants to know the specific reasons for the denial. The model's "black box" nature means it cannot provide a clear explanation or breakdown of how it weighed the various factors in its decision-making process. Secondly, this work rejects the belief that a machine can simply learn from data, either in supervised or unsupervised mode, just by applying statistical methods. The process of learning is much more complex, as it requires the full comprehension of a learned ability or skill. In this sense, further ML advancements, such as reinforcement learning and imitation learning denote encouraging similarities to similar cognitive skills used in human learning.

Unmasking Clever Hans Predictors and Assessing What Machines Really Learn

The Clever Hans Effect in Unsupervised Learning

On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detection

Capturing the Complexity of Human Strategic Decision-Making with Machine Learning

Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models

The Challenges of Machine Learning: A Critical Review

Towards Benchmarking Explainable Artificial Intelligence Methods

Leaving the barn door open for Clever Hans: Simple features predict LLM benchmark answers

Building Machines That Learn and Think Like People

Making deep neural networks right for the right scientific reasons by interacting with their explanations

Naive Few-Shot Learning: Uncovering the fluid intelligence of machines

Machine Learning Explanations to Prevent Overtrust in Fake News Detection

Aligning Machine and Human Visual Representations across Abstraction Levels

"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans

Unraveling the Dilemma of AI Errors: Exploring the Effectiveness of Human and Machine Explanations for Large Language Models

Behavior-Based Machine-Learning: A Hybrid Approach for Predicting Human Decision Making

Deceptive AI Explanations: Creation and Detection

Seeing Through the Mask: Rethinking Adversarial Examples for CAPTCHAs

Using Machine Learning to Guide Cognitive Modeling: A Case Study in Moral Reasoning

PuzzLing Machines: A Challenge on Learning From Small Data

Towards Understanding How Machines Can Learn Causal Overhypotheses