Abstract:As statistical approaches are getting increasingly used in linguistics, attention must be paid to the choice of methods and algorithms used. This is especially true since they require assumptions to be satisfied to provide valid results, and because scientific articles still often fall short of reporting whether such assumptions are met. Progress is being, however, made in various directions, one of them being the introduction of techniques able to model data that cannot be properly analyzed with simpler linear regression models. We report recent advances in statistical modeling in linguistics. We first describe linear mixed-effects regression models (LMM), which address grouping of observations, and generalized linear mixed-effects models (GLMM), which offer a family of distributions for the dependent variable. Generalized additive models (GAM) are then introduced, which allow modeling non-linear parametric or non-parametric relationships between the dependent variable and the predictors. We then highlight the possibilities offered by generalized additive models for location, scale, and shape (GAMLSS). We explain how they make it possible to go beyond common distributions, such as Gaussian or Poisson, and offer the appropriate inferential framework to account for 'difficult' variables such as count data with strong overdispersion. We also demonstrate how they offer interesting perspectives on data when not only the mean of the dependent variable is modeled, but also its variance, skewness, and kurtosis. As an illustration, the case of phonemic inventory size is analyzed throughout the article. For over 1,500 languages, we consider as predictors the number of speakers, the distance from Africa, an estimation of the intensity of language contact, and linguistic relationships. We discuss the use of random effects to account for genealogical relationships, the choice of appropriate distributions to model count data, and non-linear relationships. Relying on GAMLSS, we assess a range of candidate distributions, including the Sichel, Delaporte, Box-Cox Green and Cole, and Box-Cox t distributions. We find that the Box-Cox t distribution, with appropriate modeling of its parameters, best fits the conditional distribution of phonemic inventory size. We finally discuss the specificities of phoneme counts, weak effects, and how GAMLSS should be considered for other linguistic variables.

Autocorrelated Errors in Experimental Data in the Language Sciences: Some Solutions Offered by Generalized Additive Mixed Models

Modeling Linguistic Variables With Regression Models: Addressing Non-Gaussian Distributions, Non-independent Observations, and Non-linear Predictors With Random Effects and Generalized Additive Models for Location, Scale, and Shape

Spatial Autocorrelation: Trouble or New Paradigm?

Using Generalizability Theory to Disattenuate Correlation Coefficients for Multiple Sources of Measurement Error

An Ad Hoc Procedure for Testing Serial Correlation in Spatial Fixed-Effects Panels

Valid auto-models for spatially autocorrelated occupancy and abundance data

Generalized Linear Latent Variable Models for Repeated Measures of Spatially Correlated Multivariate Data

Mixed Effects Models are Sometimes Terrible

A General Method for Resampling Autocorrelated Spatial Data

Persisting challenges in multiple models: a note on commonly unnoticed issues regarding collinearity and spatial structure of ecological data

Spatial Autoregressive Model on a Dirichlet Distribution

Modeling Sequential Dependencies in Progressive Matrices: An Auto-Regressive Item Response Theory (AR-IRT) Approach

Bayesian analysis of linear regression models with autoregressive symmetrical errors and incomplete data

Reducing Attenuation Bias in Regression Analyses Involving Rating Scale Data via Psychometric Modeling

Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations

Spatial autoregressive model with measurement error in covariates

A Simulation Study of the Effects of Additive, Multiplicative, Correlated, and Uncorrelated Errors on Principal Component Analysis

Arrows of Time for Large Language Models

Data modelling in corpus linguistics: How low may we go?

A Latent Trait Model for Multivariate Longitudinal Data With Two Sources of Measurement Error

A Spatially Correlated Model with Generalized Autoregressive Conditionally Heteroskedastic Structure for Counts of Crimes