Regression analysis with compositional data containing zero values

Michail Tsagris

DOI: https://doi.org/10.48550/arXiv.1508.01913

2015-08-08

Methodology

Abstract:Regression analysis with compositional data containing zero values

What problem does this paper attempt to address?

A novel, divergence based, regression for compositional data

Michail Tsagris

DOI: https://doi.org/10.48550/arXiv.1511.07600

2015-11-24

Abstract:In compositional data, an observation is a vector with non-negative components which sum to a constant, typically 1. Data of this type arise in many areas, such as geology, archaeology, biology, economics and political science amongst others. The goal of this paper is to propose a new, divergence based, regression modelling technique for compositional data. To do so, a recently proved metric which is a special case of the Jensen-Shannon divergence is employed. A strong advantage of this new regression technique is that zeros are naturally handled. An example with real data and simulation studies are presented and are both compared with the log-ratio based regression suggested by Aitchison in 1986.

Methodology
Chapter 17 Regression Modelling Analysis on Compositional Data

Huiwen Wang,Jie Meng,Michel Tenenhaus

2010-01-01

Abstract:In data analysis of social, economic and technical fields, compositional data is widely used in problems of proportions to the whole. This paper develops regression modelling methods of compositional data, discussing the relationships of one compositional data to one or more than one compositional data and the interrelationship of multiple compositional data. By combining centered logratio transformation proposed by Aitchison (The Statistical Analysis of Compositional Data, Chapman and Hall, 1986) with Partial Least Squares (PLS) related techniques, that is PLS regression, hierarchical PLS and PLS path modelling, respectively, par- ticular difficulties in compositional data regression modelling such as sum to unit constraint, high multicollinearity of the transformed compositional data and hier- archical relationships of multiple compositional data, are all successfully resolved; moreover, the modelling results rightly satisfies the theoretical requirement of log- contrast. Accordingly, case studies of employment structure analysis of Beijing's three industries also illustrate high goodness-of-fit and powerful explainability of the models.
Spatial Hyperspheric Models for Compositional Data

Michael R. Schwob,Mevin B. Hooten,Nicholas M. Calzada

DOI: https://doi.org/10.48550/arXiv.2410.03648

2024-10-09

Abstract:Compositional data are an increasingly prevalent data source in spatial statistics. Analysis of such data is typically done on log-ratio transformations or via Dirichlet regression. However, these approaches often make unnecessarily strong assumptions (e.g., strictly positive components, exclusively negative correlations). An alternative approach uses square-root transformed compositions and directional distributions. Such distributions naturally allow for zero-valued components and positive correlations, yet they may include support outside the non-negative orthant and are not generative for compositional data. To overcome this challenge, we truncate the elliptically symmetric angular Gaussian (ESAG) distribution to the non-negative orthant. Additionally, we propose a spatial hyperspheric regression that contains fixed and random multivariate spatial effects. The proposed method also contains a term that can be used to propagate uncertainty that may arise from precursory stochastic models (i.e., machine learning classification). We demonstrate our method on a simulation study and on classified bioacoustic signals of the Dryobates pubescens (downy woodpecker).

Methodology,Applications,Computation
Study On Linear Regression Analysis Of Multivariate Compositional Data

Guo Lijuan,Yi Bin,Guan Rong

2009-01-01

Abstract:Compositional data analysis is used to reflect the proportion structure of research objects. In this paper constrained regression is applied to compositional data regression and a method of multivariate regression analysis, based on the inner product in space R-nxm, is put forward, which aims at the situation when dependent and independent variables are all correlated compositional data. This method transforms the unit-sum constraint within components into constrained regression, and eliminates the adverse effects from multicollinearity. At the same time, by keeping all the information from original variables, the method ensures the regression model can be explained by compositional data with different meanings.
Classical and Robust Regression Analysis with Compositional Data

K. G. van den Boogaart,P. Filzmoser,K. Hron,M. Templ,R. Tolosana-Delgado

DOI: https://doi.org/10.1007/s11004-020-09895-w

2020-10-06

Mathematical Geosciences

Abstract:Abstract Compositional data carry their relevant information in the relationships (logratios) between the compositional parts. It is shown how this source of information can be used in regression modeling, where the composition could either form the response, or the explanatory part, or even both. An essential step to set up a regression model is the way how the composition(s) enter the model. Here, balance coordinates will be constructed that support an interpretation of the regression coefficients and allow for testing hypotheses of subcompositional independence. Both classical least-squares regression and robust MM regression are treated, and they are compared within different regression models at a real data set from a geochemical mapping project.

geosciences, multidisciplinary,mathematics, interdisciplinary applications
Flexible non-parametric regression models for compositional data

Michail Tsagris,Abdulaziz Alenazi,Connie Stewart

DOI: https://doi.org/10.48550/arXiv.2002.05137

2023-09-06

Abstract:Compositional data arise in many real-life applications and versatile methods for properly analyzing this type of data in the regression context are needed. When parametric assumptions do not hold or are difficult to verify, non-parametric regression models can provide a convenient alternative method for prediction. To this end, we consider an extension to the classical $k$--$NN$ regression, termed $\alpha$--$k$--$NN$ regression, that yields a highly flexible non-parametric regression model for compositional data through the use of the $\alpha$-transformation. Unlike many of the recommended regression models for compositional data, zeros values (which commonly occur in practice) are not problematic and they can be incorporated into the proposed models without modification. Extensive simulation studies and real-life data analyses highlight the advantage of using these non-parametric regressions for complex relationships between the compositional response data and Euclidean predictor variables. Both suggest that $\alpha$--$k$--$NN$ regression can lead to more accurate predictions compared to current regression models which assume a, sometimes restrictive, parametric relationship with the predictor variables. In addition, the $\alpha$--$k$--$NN$ regression, in contrast to current regression techniques, enjoys a high computational efficiency rendering it highly attractive for use with large scale, massive, or big data.

Methodology
Multiple linear regression modeling for compositional data

Huiwen Wang,Liying Shangguan,Junjie Wu,Rong Guan

DOI: https://doi.org/10.1016/j.neucom.2013.05.025

IF: 6

2013-01-01

Neurocomputing

Abstract:Compositional data, containing relative information, occur regularly in many disciplines and practical situations. Multivariate statistics methods including regression analysis have been adopted to model compositional data, but the existing research is still scattered and fragmented. This paper contributes to modeling the linear regression relationship for compositional data as both dependent and independent variables. First, some operations in Simplex space, such as the perturbation operation, the power transformation, and the inner product, are defined for compositional-data vectors. The regression models are then built by the original compositional data and transformed data, respectively, after the introduction of the Isometric Logratio Transformation (ilr). By theoretical inference, it turns out that the two models are equivalent in essence using the ordinary least squares (OLS) method. Two measures for testing goodness of fit, i.e., the observed squared correlation coefficient R^2 and the cross validated squared correlation coefficient Q^2, are also proposed to evaluate the regression models. Besides, the estimated regression parameters are explained to indicate the notion of relative elasticity. An empirical analysis finally illustrates the usefulness of the multiple linear regression models for compositional-data variables.
Analysis of High Dimensional Compositional Data Containing Structural Zeros with Applications to Microbiome Data

Abhishek Kaul,Ori Davidov,Shyamal D. Peddada

DOI: https://doi.org/10.48550/arXiv.1605.06193

2016-05-20

Abstract:This paper is motivated by the recent interest in the analysis of high dimen- sional microbiome data. A key feature of this data is the presence of `structural zeros' which are microbes missing from an observation vector due to an underlying biological process and not due to error in measurement. Typical notions of missingness are insufficient to model these structural zeros. We define a general framework which allows for structural zeros in the model and propose methods of estimating sparse high dimensional covariance and precision matrices under this setup. We establish error bounds in the spectral and frobenius norms for the proposed esti- mators and empirically support them with a simulation study. We also apply the proposed methodology to the global human gut microbiome data of Yatsunenko (2012).

Applications,Quantitative Methods
Compositional data analysis -- linear algebra, visualization and interpretation

Michael Greenacre

DOI: https://doi.org/10.48550/arXiv.2110.12439

2021-10-24

Abstract:Compositional data analysis is concerned with multivariate data that have a constant sum, usually 1 or 100\%. These are data often found in biochemistry and geochemistry, but also in the social sciences, when relative values are of interest rather than the raw values. Recent applications are in the area of very high-dimensional "omics" data. Logratios are frequently used for this type of data, i.e. the logarithms of ratios of the components of the data vectors. These ratios raise interesting issues in matrix-vector representation, computation and interpretation, which will be dealt with in this chapter.

Methodology
Dirichlet composition distribution for compositional data with zero components: An application to fluorescence in situ hybridization (FISH) detection of chromosome

Man-Lai Tang,Qin Wu,Sheng Yang,Guo-Liang Tian

DOI: https://doi.org/10.1002/bimj.202000334

IF: 1.715

2022-01-01

Biometrical Journal

Abstract:Zeros in compositional data are very common and can be classified into rounded and essential zeros. The rounded zero refers to a small proportion or below detection limit value, while the essential zero refers to the complete absence of the component in the composition. In this article, we propose a new framework for analyzing compositional data with zero entries by introducing a stochastic representation. In particular, a new distribution, namely the Dirichlet composition distribution, is developed to accommodate the possible essential-zero feature in compositional data. We derive its distributional properties (e.g., its moments). The calculation of maximum likelihood estimates via the Expectation-Maximization (EM) algorithm will be proposed. The regression model based on the new Dirichlet composition distribution will be considered. Simulation studies are conducted to evaluate the performance of the proposed methodologies. Finally, our method is employed to analyze a dataset of fluorescence in situ hybridization (FISH) for chromosome detection.
A Simple Linear Regression Model Based on the Compositional Data

Wang Hui

IF: 2.034

2003-01-01

Systems Engineering

Abstract:In studies on the social, economic and technical problems, compositional data usually were used as the ratio development in each component of the whole. Based on the symmetrical logratio transformation and partial least squares regression, this paper proposed a simple linear regression modeling method. This method could overcome the difficulties that exist in the classic linear regression modeling. Furthermore, because of the symmetry of the mathematics transformation, the transformed variable can reflect the meaning of the original variable better, and so the mathematices model is easier to explain. Besides, this paper used the numerical forecast of employment in Beijing’s three industries as an example, illuminated the work process and application value of the regression modeling based on the compositional data, and made use of the result to verify the validity and rationality of this method.
Gaussian Asymptotic Limits for the α-transformation in the Analysis of Compositional Data

Yannis Pantazis,Michail Tsagris,Andrew T. A. Wood

DOI: https://doi.org/10.1007/s13171-018-00160-1

2019-02-01

Sankhya A

Abstract:Compositional data consists of vectors of proportions whose components sum to 1. Such vectors lie in the standard simplex, which is a manifold with boundary. One issue that has been rather controversial within the field of compositional data analysis is the choice of metric on the simplex. One popular possibility has been to use the metric implied by log-transforming the data, as proposed by Aitchison (Biometrika70, 57–65, 1983, 1986) and another popular approach has been to use the standard Euclidean metric inherited from the ambient space. Tsagris et al. (2011) proposed a one-parameter family of power transformations, the α-transformations, which include both the metric implied by Aitchison’s transformation and the Euclidean metric as particular cases. Our underlying philosophy is that, with many datasets, it may make sense to use the data to help us determine a suitable metric. A related possibility is to apply the α-transformations to a parametric family of distributions, and then estimate α along with the other parameters. However, as we shall see, when one follows this last approach with the Dirichlet family, some care is needed in a certain limiting case which arises (α → 0), as we found out when fitting this model to real and simulated data. Specifically, when the maximum likelihood estimator of α is close to 0, the other parameters tend to be large. The main purpose of the paper is to study this limiting case both theoretically and numerically and to provide insight into these numerical findings.

English Else
It's All Relative: New Regression Paradigm for Microbiome Compositional Data

Gen Li,Yan Li,Kun Chen

DOI: https://doi.org/10.48550/arXiv.2011.05951

2020-11-12

Abstract:Microbiome data are complex in nature, involving high dimensionality, compositionally, zero inflation, and taxonomic hierarchy. Compositional data reside in a simplex that does not admit the standard Euclidean geometry. Most existing compositional regression methods rely on transformations that are inadequate or even inappropriate in modeling data with excessive zeros and taxonomic structure. We develop a novel relative-shift regression framework that directly uses compositions as predictors. The new framework provides a paradigm shift for compositional regression and offers a superior biological interpretation. New equi-sparsity and taxonomy-guided regularization methods and an efficient smoothing proximal gradient algorithm are developed to facilitate feature aggregation and dimension reduction in regression. As a result, the framework can automatically identify clinically relevant microbes even if they are important at different taxonomic levels. A unified finite-sample prediction error bound is developed for the proposed regularized estimators. We demonstrate the efficacy of the proposed methods in extensive simulation studies. The application to a preterm infant study reveals novel insights of association between the gut microbiome and neurodevelopment.

Methodology,Applications
Compositional inverse Gaussian models with applications in compositional data analysis with possible zero observations

Pengyi Liu,Guo-Liang Tian,Kam Chuen Yuen,Yuan Sun,Chi Zhang

DOI: https://doi.org/10.1080/00949655.2023.2242550

IF: 1.225

2023-08-02

Journal of Statistical Computation and Simulation

Abstract:Compositional data (CoDa) often appear in various fields such as biology, medicine, geology, chemistry, economics, ecology and sociology. Although existing Dirichlet and related models are frequently employed in CoDa analysis, sometimes they may provide unsatisfactory performances in modelling CoDa as shown in our first real data example. First, this paper develops a multivariate compositional inverse Gaussian (CIG) model as a new tool for analysing CoDa. By incorporating the stochastic representation (SR), the expectation–maximization (EM) algorithm (aided by a one-step gradient descent algorithm) can be established to solve the parameter estimation for the proposed distribution (model). Next, zero observations may be often encountered in the real CoDa analysis. Therefore, the second aim of this paper is to propose a new model (called as ZCIG model) through a novel mixture SR based on both the CIG random vector and a so-called zero-truncated product Bernoulli random vector to model CoDa with zeros. Corresponding statistical inference methods are also developed for both cases without/with covariates. Two real data sets are analysed to illustrate the proposed statistical methods by comparing the proposed CIG and ZCIG models with existing Dirichlet and logistic-normal models.

statistics & probability,computer science, interdisciplinary applications
Units Recovery Methods in Compositional Data Analysis

J. A. Martín-Fernández,J. J. Egozcue,R. A. Olea,V. Pawlowsky-Glahn

DOI: https://doi.org/10.1007/s11053-020-09659-7

IF: 5.609

2020-03-24

Natural Resources Research

Abstract:Compositional data carry relative information. Hence, their statistical analysis has to be performed on coordinates with respect to a log-ratio basis. Frequently, the modeler is required to back-transform the estimates obtained with the modeling to have them in the original units such as euros, kg or mg/liter. Approaches for recovering original units need to be formally introduced and its properties explored. Here, we formulate and analyze the properties of two procedures: a simple approach consisting of adding a residual part to the composition and an approach based on the use of an auxiliary variable. Both procedures are illustrated using a geochemical data set where the original units are recovered when spatial models are applied.

geosciences, multidisciplinary
A Bayesian Zero-Inflated Dirichlet-Multinomial Regression Model for Multivariate Compositional Count Data

Matthew D. Koslovsky

DOI: https://doi.org/10.48550/arXiv.2302.12283

2023-02-24

Abstract:The Dirichlet-multinomial (DM) distribution plays a fundamental role in modern statistical methodology development and application. Recently, the DM distribution and its variants have been used extensively to model multivariate count data generated by high-throughput sequencing technology in omics research due to its ability to accommodate the compositional structure of the data as well as overdispersion. A major limitation of the DM distribution is that it is unable to handle excess zeros typically found in practice which may bias inference. To fill this gap, we propose a novel Bayesian zero-inflated DM model for multivariate compositional count data with excess zeros. We then extend our approach to regression settings and embed sparsity-inducing priors to perform variable selection for high-dimensional covariate spaces. Throughout, modeling decisions are made to boost scalability without sacrificing interpretability or imposing limiting assumptions. Extensive simulations and an application to a human gut microbiome data set are presented to compare the performance of the proposed method to existing approaches. We provide an accompanying R package with a user-friendly vignette to apply our method to other data sets.

Methodology,Applications,Computation
Quantile regression for compositional covariates

Xuejun Ma,Ping Zhang

DOI: https://doi.org/10.48550/arXiv.2006.00789

2020-06-01

Abstract:Quantile regression is a very important tool to explore the relationship between the response variable and its covariates. Motivated by mean regression with LASSO for compositional covariates proposed by Lin et al. (2014), we consider quantile regression with no-penalty and penalty function. We develop the computational algorithms based on linear programming. Numerical studies indicate that our methods provides the better alternative than mean regression under many settings, particularly for heavy-tailed or skewed distribution of the error term. Finally, we study the fat data using the proposed method.

Methodology
PLS Logistic Regression on Compositional Data and Its Application

龙文,王惠文

DOI: https://doi.org/10.3969/j.issn.1000-3894.2006.09.017

2006-01-01

Abstract:Ordinary logistic regression is not available when the independent variables are compositional data,which belong to a special data type with multicollinearity and constraint of constant sum.Based on the techniques of symmetrical logratio transformation and PLS logistic regression,this paper proposes a new method of PLS logistic regression on compositional data.Applied this method,a case of the structure of employment in China has been studied.The result indicated that the approach presented is applicable to solve the problems of logistic regression modeling related to structure problems.
A hyperspherical transformation forecasting model for compositional data

Huiwen Wang,Qiang Liu,Henry M. K. Mok,Linghui Fu,Wai Man Tse

DOI: https://doi.org/10.1016/j.ejor.2006.03.039

IF: 6.4

2007-01-01

European Journal of Operational Research

Abstract:Although Aitchison’s [Aitchison, J., 1986. The Statistical Analysis of Compositional Data, Chapman and Hall, London] method of logratio transformation of compositional data is widely used in various domains, it is limited by the assumption of a strict non-negativity of the components and the requirement of special treatments in practice of the zero components. We propose a dimension-reduction approach through a hyperspherical transformation that is capable of resolving the difficulty in maintaining non-negativity and unit-sum in forecasting compositional data over time. Applying the proposed model to a numerical simulation with a 4D compositional data embedded with zero components and forecasting the three production sectors in the Chinese economy both demonstrate the usefulness and validity of the new approach.
Regression Models for Compositional Data: General Log-Contrast Formulations, Proximal Optimization, and Microbiome Data Applications

Patrick L. Combettes,Christian L. Müller

DOI: https://doi.org/10.1007/s12561-020-09283-2

2020-06-19

Statistics in Biosciences

Abstract:Abstract Compositional data sets are ubiquitous in science, including geology, ecology, and microbiology. In microbiome research, compositional data primarily arise from high-throughput sequence-based profiling experiments. These data comprise microbial compositions in their natural habitat and are often paired with covariate measurements that characterize physicochemical habitat properties or the physiology of the host. Inferring parsimonious statistical associations between microbial compositions and habitat- or host-specific covariate data is an important step in exploratory data analysis. A standard statistical model linking compositional covariates to continuous outcomes is the linear log-contrast model. This model describes the response as a linear combination of log-ratios of the original compositions and has been extended to the high-dimensional setting via regularization. In this contribution, we propose a general convex optimization model for linear log-contrast regression which includes many previous proposals as special cases. We introduce a proximal algorithm that solves the resulting constrained optimization problem exactly with rigorous convergence guarantees. We illustrate the versatility of our approach by investigating the performance of several model instances on soil and gut microbiome data analysis tasks.

English Else

Regression analysis with compositional data containing zero values

A novel, divergence based, regression for compositional data

Chapter 17 Regression Modelling Analysis on Compositional Data

Spatial Hyperspheric Models for Compositional Data

Study On Linear Regression Analysis Of Multivariate Compositional Data

Classical and Robust Regression Analysis with Compositional Data

Flexible non-parametric regression models for compositional data

Multiple linear regression modeling for compositional data

Analysis of High Dimensional Compositional Data Containing Structural Zeros with Applications to Microbiome Data

Compositional data analysis -- linear algebra, visualization and interpretation

Dirichlet composition distribution for compositional data with zero components: An application to fluorescence in situ hybridization (FISH) detection of chromosome

A Simple Linear Regression Model Based on the Compositional Data

Gaussian Asymptotic Limits for the α-transformation in the Analysis of Compositional Data

It's All Relative: New Regression Paradigm for Microbiome Compositional Data

Compositional inverse Gaussian models with applications in compositional data analysis with possible zero observations

Units Recovery Methods in Compositional Data Analysis

A Bayesian Zero-Inflated Dirichlet-Multinomial Regression Model for Multivariate Compositional Count Data

Quantile regression for compositional covariates

PLS Logistic Regression on Compositional Data and Its Application

A hyperspherical transformation forecasting model for compositional data

Regression Models for Compositional Data: General Log-Contrast Formulations, Proximal Optimization, and Microbiome Data Applications