Abstract:This chapter provides a unified view of learning and inference in structured environments that are formally expressed as constraints that involve both data and tasks. A preliminary discussion has been put forward in Section 1.1.5, where we began proposing an abstract interpretation of the ordinary notion of constraint that characterizes human-based learning, reasoning, and decision processes. Here we make an effort to formalize those processes and explore the corresponding computational aspects. A first fundamental remark for the formulation of a sound theory is that most interesting real-world problems correspond with learning environments that are heavily structured, a feature that has been mostly neglected in the previous chapters on linear and kernel machines, as well as on deep networks. So far we have been mostly concerned with machine learning models where the agent takes a decision on patterns represented by x ∈ R d , whereas we have mostly neglected the issue of constructing appropriate representations from the environmental information e ∈ E . The discussion in Section 1.1.5 has already stimulated the need of processing information organized as lists, trees, and graphs. Interestingly, in this chapter, it is shown that computational models, like recurrent neural networks and graph neural networks can also be regarded as a way for expressing appropriate constraints on environmental data by means of diffusion processes. In these cases the distinguishing feature of the computational model is that the focus is on uniform diffusion processes, whereas one can think of constraints that involve both data and tasks in a more general way. Basically, different vertexes of a graph that model the environment can be involved in different relations, thus giving rise to a different treatment. As a result, this yields richer computational mechanisms that involve the meaning attached to the different relations.

Linear threshold machines

Learning with constraints

Long cycles in linear thresholding systems

Analysis of Continuous Attractors for 2-D Linear Threshold Neural Networks

Robust Coordination of Linear Threshold Dynamics on Directed Weighted Networks

Non-deterministic linear thresholding systems reveal their deterministic origins

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

Linear-Threshold Network Models for Describing and Analyzing Brain Dynamics

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

On Ensuring that Intelligent Machines Are Well-Behaved

Diversity of emergent dynamics in competitive threshold-linear networks

Controllability of networked multiagent systems based on linearized Turing's model

Toward a `Standard Model' of Machine Learning

Machine Learning with Guarantees using Descriptive Complexity and SMT Solvers

Controllability of networked multiagent systems based on linearized Turing’s model

Human-in-the-loop machine learning: a state of the art

An overview of machine learning techniques in constraint solving

Generalized Convergence Analysis of Tsetlin Machines: A Probabilistic Approach to Concept Learning

Machines Explaining Linear Programs

Simple Models in Complex Worlds: Occam’s Razor and Statistical Learning Theory