Abstract:Voxel-based lesion-symptom mapping (VLSM) is an important method for basic and translational human neuroscience research. VLSM leverages modern neuroimaging analysis techniques to build on the classic approach of examining the relationship between location of brain damage and cognitive deficits. Testing an association between deficit severity and lesion status in each voxel involves very many individual tests and requires statistical correction for multiple comparisons. Several strategies have been adapted from analysis of functional neuroimaging data, though VLSM faces a more difficult trade-off between avoiding false positives and statistical power (missing true effects). Non-parametric, permutation-based methods are generally preferable because they do not make assumptions that are likely to be violated by skewed distributions of behavioral deficit (symptom) scores and by the necessary spatial contiguity of stroke lesions. We used simulated and real deficit scores from a sample of approximately 100 individuals with left hemisphere stroke to evaluate two such permutation-based approaches. Using permutation to set a minimum cluster size identified a region that systematically extended well beyond the true region, even under the most conservative settings tested here, making it ill-suited to identifying brain-behavior relationships. In contrast, generalizing the standard permutation-based family-wise error correction approach provided a principled way to balance false positives and false negatives. An implementation of this continuous permutation-based FWER correction method is available at <a class="link-external link-https" href="https://gist.github.com/dmirman/05a92e0e9e0027f6fe6e528c648143d7" rel="external noopener nofollow">this https URL</a>

Small sample corrections for Wald tests in Latent Variable Models

Exploration of the MCMC Wald test with linear regression

Statistical power of likelihood ratio and Wald tests in latent class models with covariates

Corrections for multiple comparisons in voxel-based lesion-symptom mapping

Improved likelihood inference in generalized linear models

Linear Latent Variable Models: The lava-package

Sample size determination for logistic regression revisited

Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling

A Tutorial on Testing the Equality of Standardized Regression Coefficients in Structural Equation Models using Wald Tests with lavaan

The effect of latent and error non-normality on corrections to the test statistic in structural equation modeling

Distributional Latent Variable Models with an Application in Active Cognitive Testing

Testing and correcting for weak and pleiotropic instruments in two‐sample multivariable Mendelian randomization

Small Sample Methods for Multilevel Modeling: A Colloquial Elucidation of REML and the Kenward-Roger Correction

Tricks with metrics: combining statistics for improved inference in regression analysis

Comparison of Software Algorithms for Calculating Reml Wald Type Confidence Limits for the Between-Group Variance Component in A Small Sample One-Way Random Effects Model Example

Small sample adjustments for robust variance estimation with meta-regression.

A Bartlett Type Correction for Wald Test in Cox Regression Model

Corrections to LRT on Large Dimensional Covariance Matrix by RMT

Evaluating the robustness of repeated measures analyses: The case of small sample sizes and nonnormal data

Easy confidence interval formulas for network meta-analysis and adjustment of confidence intervals for a small number of studies

Evaluating two small-sample corrections for fixed-effects standard errors and inferences in multilevel models with heteroscedastic, unbalanced, clustered data