Abstract:<p>To understand how organisms adapt to their environment, a gene‐environmental association (GEA) analysis is commonly conducted. GEA methods based on mixed models, such as linear latent factor mixed models (LFMM) and LFMM2, have grown in popularity for their robust performance in terms of power and computational speed. However, it is unclear how the assumption of a Gaussian distribution for the response variables influences model performance. In this paper, we develop a generalized linear model (GLM) that allows for non‐Gaussian distribution in the genotypic response variables, and treatment of multiallelic nucleotide polymorphisms. Moreover, this multinomial logistic regression model (MLR) is combined with an admixture‐based model or principal components analysis to correct for population structure (MLR‐ADM and MLR‐PC). Using simulations, we evaluate the type I error, false discovery rates (FDR), and power to detect selected SNPs, to guide model choice and best practices. With genomic control, MLR‐PC and LFMM2 have similar type I error, FDRs, and power when analyzing biallelic SNPs, while dramatically outperforming models not accounting for population structure. Differences in performance occur under continuous population structure where MLR‐PC outperforms LFMM/LFMM2, especially when a larger number of clusters or triallelic SNPs are analyzed. The Human Genome Diversity Project (HGDP) dataset shows that both MLR‐PC and LFMM2 control the inflation of P‐values. Analysis of the 1000 Genome Project Phase III dataset illustrates that MLR‐PC and LFMM2 produce consistent results for most significant SNPs, while MLR‐PC discovered additional SNPs corresponding to certain genes, suggesting MLR‐PC may be a useful alternative to GEA inference.</p>

Analysis of a longitudinal multilevel experiment using GAMLSSs

Linear mixed effects models for non‐Gaussian continuous repeated measurement data

Hierarchical generalized additive models in ecology: an introduction with mgcv

Modeling data with zero inflation and overdispersion using GAMLSSs

Clustering populations by mixed linear models

Linear Mixed-Effects Models for Non-Gaussian Repeated Measurement Data

A hands-on approach for fitting long-term survival models under the GAMLSS framework

Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models

Multilevel modeling for longitudinal data: concepts and applications

An overview of mixture modelling for latent evolutions in longitudinal data: Modelling approaches, fit statistics and software

Generalized Estimating Equations in Longitudinal Studies: A Non-Parametric Alternative for Two-Way Repeated Measures Mixed ANOVA

On Fitting Generalized Linear Mixed-Effects Models for Binary Responses Using Different Statistical Packages.

A comprehensive analysis comparing linear and generalized linear models in detecting adaptive SNPs

Doubly Robust-Based Generalized Estimating Equations for the Analysis of Longitudinal Ordinal Missing Data

Subgroup detection in linear growth curve models with generalized linear mixed model (GLMM) trees

Generalized linear mixed-model (GLMM) trees: A flexible decision-tree method for multilevel and longitudinal data

Bayesian Regression Analysis of Data with Random Effects Covariates from Nonlinear Longitudinal Measurements

Multilevel Semiparametric Latent Variable Modeling in R with "galamm"

Understanding Variation in Longitudinal Data Using Latent Growth Mixture Modeling

Gaussian Markov random field spatial models in GAMLSS

Hierarchical mixed-model expedites genome-wide longitudinal association analysis