Abstract:This book introduces the mathematical foundations and techniques that lead to the development and analysis of many of the algorithms that are used in machine learning. It starts with an introductory chapter that describes notation used throughout the book and serve at a reminder of basic concepts in calculus, linear algebra and probability and also introduces some measure theoretic terminology, which can be used as a reading guide for the sections that use these tools. The introductory chapters also provide background material on matrix analysis and optimization. The latter chapter provides theoretical support to many algorithms that are used in the book, including stochastic gradient descent, proximal methods, etc. After discussing basic concepts for statistical prediction, the book includes an introduction to reproducing kernel theory and Hilbert space techniques, which are used in many places, before addressing the description of various algorithms for supervised statistical learning, including linear methods, support vector machines, decision trees, boosting, or neural networks. The subject then switches to generative methods, starting with a chapter that presents sampling methods and an introduction to the theory of Markov chains. The following chapter describe the theory of graphical models, an introduction to variational methods for models with latent variables, and to deep-learning based generative models. The next chapters focus on unsupervised learning methods, for clustering, factor analysis and manifold learning. The final chapter of the book is theory-oriented and discusses concentration inequalities and generalization bounds.

INTRODUCTION TO STATISTICAL LEARNING THEORY AND SUPPORT VECTOR MACHINES

INTRODUCTION TO STATISTICAL LEARNING THEORY AND SUPPORT VECTOR MACHINES

Statistical Learning Theory: Models, Concepts, and Results

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

Support Vector Pursuit Learning

An updating method for support vector learning

Using Svm To Model And Control Nonlinear Dynamical Systems

Research of Support Vector Machines

Support Vector Machine Algorithm in Machine Learning

Online support vector machines with vectors sieving method

SVM Classification:Its Contents and Challenges

Introduction to Machine Learning

Preliminary Discussion on Flood Forecast Model Based on Support Vector Machine

A comprehensive survey on support vector machine classification: Applications, challenges and trends

Statistical Mechanics of Support Vector Networks

Introduction to Supervised Machine Learning for Data Science

A Bayesian Perspective of Statistical Machine Learning for Big Data

Outline and application of statistical learning theory

Support Vector Regression Machines

A Novel Vectors Surgeon Machine Based on Statistical Learning Theory

Comprehensive Review On Twin Support Vector Machines