Abstract:The multilevel model (MLM) is the popular approach to describe dependences of hierarchically clustered observations. A main feature is the capability to estimate (cluster-specific) random effect parameters, while their distribution describes the variation across clusters. However, the MLM can only model positive associations among clustered observations, and it is not suitable for small sample sizes. The limitation of the MLM becomes apparent when estimation methods produce negative estimates for random effect variances, which can be seen as an indication that observations are negatively correlated. A gentle introduction to Bayesian Covariance Structure Modelling (BCSM) is given, which makes it possible to model also negatively correlated observations. The BCSM does not model dependences through random (cluster-specific) effects, but through a covariance matrix. We show that this makes the BCSM particularly useful for small data samples. We draw specific attention to detect effects of a personalized intervention. The effect of a personalized treatment can differ across individuals, and this can lead to negative associations among measurements of individuals who are treated by the same therapist. It is shown that the BCSM enables the modeling of negative associations among clustered measurements and aids in the interpretation of negative clustering effects. Through a simulation study and by analysis of a real data example, we discuss the suitability of the BCSM for small data sets and for exploring effects of individualized treatments, specifically when (standard) MLM software produces negative or zero variance estimates.

Using JAGS for Bayesian Cognitive Diagnosis Modeling: A Tutorial

A Tutorial on Bayesian Analysis of Count Data Using JAGS

Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models

Regularized Bayesian algorithms for Q‐matrix inference based on saturated cognitive diagnosis modelling

A Survey of Models for Cognitive Diagnosis: New Developments and Future Directions

A tutorial on fitting joint models of M/EEG and behavior to understand cognition

Assessing an Alternative for `Negative Variance Components': A Gentle Introduction to Bayesian Covariance Structure Modelling for Negative Associations Among Patients with Personalized Treatments

Exploring Multiple Strategic Problem Solving Behaviors in Educational Psychology Research by Using Mixture Cognitive Diagnosis Model

A tutorial for joint modeling of longitudinal and time-to-event data in R

Bayesian Latent Class Analysis Tutorial

Hypothesis Testing for Hierarchical Structures in Cognitive Diagnosis Models

Towards a New Generation of Cognitive Diagnosis

New development of cognitive diagnosis models

Bayesian Decision Curve Analysis With Bayesdca

HierCDF: A Bayesian Network-based Hierarchical Cognitive Diagnosis Framework

Cognitive Diagnostic Model Made More Practical by Genetic Algorithm.

Regularized Latent Class Analysis with Application in Cognitive Diagnosis

Partial-Mastery Cognitive Diagnosis Models

Bayesian Network Modeling of Causal Influence within Cognitive Domains and Clinical Dementia Severity Ratings for Western and Indian Cohorts

Bayesian inference for psychology. Part II: Example applications with JASP

Cognitive Diagnosis with Explicit Student Vector Estimation and Unsupervised Question Matrix Learning