Abstract:These are lecture notes for a course on machine learning with neural networks for scientists and engineers that I have given at Gothenburg University and Chalmers Technical University in Gothenburg, Sweden. The material is organised into three parts: Hopfield networks, supervised learning of labeled data, and learning algorithms for unlabeled data sets. Part I introduces stochastic recurrent networks: Hopfield networks and Boltzmann machines. The analysis of their learning rules sets the scene for the later parts. Part II describes supervised learning with multilayer perceptrons and convolutional neural networks. This part starts with a simple geometrical interpretation of the learning rule and leads to the recent successes of convolutional networks in object recognition, recurrent networks in language processing, and reservoir computers in time-series analysis. Part III explains what neural networks can learn about data that is not labeled. This part begins with a description of unsupervised learning techniques for clustering of data, non-linear projections, and embeddings. A section on autoencoders explains how to learn without labels using convolutional networks, and the last chapter is dedicated to reinforcement learning. The overall goal of the course is to explain the fundamental principles that allow neural networks to learn, emphasising ideas and concepts that are common to all three parts. The present version does not contain exercises (copyright owned by Cambridge University Press). The complete book is available at <a class="link-external link-https" href="https://www.cambridge.org/gb/academic/subjects/physics/statistical-physics/machine-learning-neural-networks-introduction-scientists-and-engineers?format=HB" rel="external noopener nofollow">this https URL</a>.

Six lectures on linearized neural networks

Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning

A New Neural Network Model And Its Application

Introduction to linear algebra for neural networks

A rigorous introduction to linear models

Standard neural network model and its application

TASI Lectures on Physics for Machine Learning

Neural Networks: Further Insights into Error Function, Generalized Weights and Others

Layer Dynamics of Linearised Neural Nets

Linear Model and Extensions

An introduction to computing with neural nets

Towards a Mathematical Understanding of Neural Network-Based Machine Learning: What We Know and What We Don't

Machine learning with neural networks

Linear Dynamics & Control of Brain Networks

Notes on Generalized Linear Models of Neurons

A Novel Explanation Against Linear Neural Networks

Mean Field Analysis of Neural Networks: A Law of Large Numbers

An Introduction to Nonlinear Analysis: Theory

Regularization of linear machine learning problems

Weak Correlations as the Underlying Principle for Linearization of Gradient-Based Learning Systems

Learning Curves for Deep Neural Networks: A Gaussian Field Theory Perspective