Abstract:StepMix is an open-source Python package for the pseudo-likelihood estimation (one-, two- and three-step approaches) of generalized finite mixture models (latent profile and latent class analysis) with external variables (covariates and distal outcomes). In many applications in social sciences, the main objective is not only to cluster individuals into latent classes, but also to use these classes to develop more complex statistical models. These models generally divide into a measurement model that relates the latent classes to observed indicators, and a structural model that relates covariates and outcome variables to the latent classes. The measurement and structural models can be estimated jointly using the so-called one-step approach or sequentially using stepwise methods, which present significant advantages for practitioners regarding the interpretability of the estimated latent classes. In addition to the one-step approach, StepMix implements the most important stepwise estimation methods from the literature, including the bias-adjusted three-step methods with Bolk-Croon-Hagenaars and maximum likelihood corrections and the more recent two-step approach. These pseudo-likelihood estimators are presented in this paper under a unified framework as specific expectation-maximization subroutines. To facilitate and promote their adoption among the data science community, StepMix follows the object-oriented design of the scikit-learn library and provides an additional R wrapper.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in social science research, how to use the Python package StepMix to achieve pseudo - likelihood estimation of generalized mixture models with external variables (covariates and distal outcomes). Specifically, the goals of the paper include: 1. **Provide an open - source tool**: Provide researchers with an easy - to - use Python package StepMix for pseudo - likelihood estimation of generalized mixture models with external variables. 2. **Support multiple estimation methods**: StepMix not only implements the classic one - step estimation method, but also supports important step - by - step estimation methods, such as the three - step method with bias correction (BCH method and maximum - likelihood correction) and the relatively new two - step method. 3. **Improve model interpretability**: The step - by - step estimation method avoids the influence of distal outcomes on the definition of latent classes, thereby improving the interpretability of latent classes. 4. **Handle missing data**: StepMix supports the handling of missing data in indicators and distal outcomes through the full - information maximum - likelihood (FIML) method. 5. **Promote the adoption of the latest estimation methods**: By providing a Python package that follows the scikit - learn interface, more researchers can use the most advanced estimation methods. ### Specific problem description In social science research, mixture models are often used to analyze multivariate continuous and categorical data and discover hidden subgroups in the population. However, traditional estimation methods have some limitations, for example: - The one - step method directly maximizes the joint - likelihood function, which may lead to difficult - to - interpret latent classes. - The naive three - step method is prone to bias, especially in the case of misclassification. - There is a lack of step - by - step estimation methods with bias correction in open - source software. Therefore, this paper aims to solve these problems by developing the StepMix package, providing a more flexible and accurate estimation method, especially when dealing with complex models with covariates and distal outcomes. ### Summary The main goal of the paper is to introduce the StepMix package and provide a self - contained reference for pseudo - likelihood estimation of mixture models with external variables. By implementing the step - by - step estimation method with bias correction, StepMix aims to improve the interpretability of latent classes, handle missing data at the same time, and provide an easy - to - use open - source tool for researchers.

StepMix: A Python Package for Pseudo-Likelihood Estimation of Generalized Mixture Models with External Variables

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Bayesian estimation and prediction for certain mixtures

Auxiliary Variables in Mixture Modeling: Three-Step Approaches Using Mplus

Model-based cluster and discriminant analysis with the MIXMOD software

Mixture-Models: a one-stop Python Library for Model-based Clustering using various Mixture Models

Three-step estimation of latent Markov models with covariates

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components

Probabilistic Inference from Arbitrary Uncertainty using Mixtures of Factorized Generalized Gaussians

Prediction from Latent Classes: A Demonstration of Different Approaches to Include Distal Outcomes in Mixture Models

BELMM: Bayesian model selection and random walk smoothing in time-series clustering

Characterizing substructure via mixture modeling in large-scale genetic summary statistics

A modified EM-type algorithm to estimate semi-parametric mixtures of non-parametric regressions

Expectation-Maximization-Maximization: A Feasible MLE Algorithm for the Three-Parameter Logistic Model Based on a Mixture Modeling Reformulation

Estimation of Gaussian mixtures in small sample studies using $l_1$ penalization

An overview of mixture modelling for latent evolutions in longitudinal data: Modelling approaches, fit statistics and software

Latent Class Growth Analysis and Growth Mixture Modeling using R: A tutorial for two R-packages and a comparison with Mplus.

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

Maximum-penalized-likelihood estimation for independent and Markov-dependent mixture models.

Big Learning Expectation Maximization

Investigating Approaches to Estimating Covariate Effects in Growth Mixture Modeling: A Simulation Study