Abstract:These lecture notes aim at a post-Bachelor audience with a background at an introductory level in Applied Mathematics and Applied Statistics. They discuss the logic and methodology of the Bayes-Laplace approach to inductive statistical inference that places common sense and the guiding lines of the scientific method at the heart of systematic analyses of quantitative-empirical data. Following an exposition of exactly solvable cases of single- and two-parameter estimation problems, the main focus is laid on Markov Chain Monte Carlo (MCMC) simulations on the basis of Hamiltonian Monte Carlo sampling of posterior joint probability distributions for regression parameters occurring in generalised linear models for a univariate outcome variable. The modelling of fixed effects as well as of correlated varying effects via multi-level models in non-centred parametrisation is considered. The simulation of posterior predictive distributions is outlined. The assessment of a model's relative out-of-sample posterior predictive accuracy with information entropy-based criteria WAIC and LOOIC and model comparison with Bayes factors are addressed. A brief discussion on the description of the generation of stationary time series data by means of autoregressive models is contained. Concluding, a conceptual link to the behavioural subjective expected utility representation of a single decision-maker's choice behaviour in static one-shot decision problems is established. Vectorised codes for MCMC simulations of multi-dimensional posterior joint probability distributions with the Stan probabilistic programming language implemented in the statistical software R are provided. The lecture notes are fully hyperlinked. They direct the reader to original scientific research papers, online resources on inductive statistical inference, and to pertinent biographical information.

A Bayesian Redesign of the First Probability/Statistics Course

A Bayesian Statistics Course for Undergraduates: Bayesian Thinking, Computing, and Research

Combating anti-statistical thinking using simulation-based methods throughout the undergraduate curriculum

Bayesian Computing in the Undergraduate Statistics Curriculum

The Current State of Undergraduate Bayesian Education and Recommendations for the Future

Reconsidering Statistics Education: A National Science Foundation Conference

Introduction to Statistical Modelling and Inference

Combine Statistical Thinking With Open Scientific Practice: A Protocol of a Bayesian Research Project

Assessing the association between pre-course metrics of student preparation and student performance in introductory statistics: Results from early data on simulation-based inference vs. nonsimulation based inference

Practical Bayesian Inference in Neuroscience: Or How I Learned To Stop Worrying and Embrace the Distribution

Statistical Rethinking: A Bayesian Course with Examples in R and Stan

An Introduction to Inductive Statistical Inference: from Parameter Estimation to Decision-Making

Bayesian inference: More than Bayes's theorem

Rolling the DICE (Design, Interpret, Compute, Estimate): Interactive Learning of Biostatistics With Simulations

Statistical Inference: The Big Picture

Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician

It is Time to Stop Teaching Frequentism to Non-statisticians

An application of Bayesian inference to examine student retention and attrition in the STEM classroom

Quantitative critical thinking: Student activities using Bayesian updating

There is Nothing Magical about Bayesian Statistics: An Introduction to Epistemic Probabilities in Data Analysis for Psychology Starters

Introduction to probability and statistics: a computational framework of randomness