Abstract:Sparse models, though long preferred and pursued by social scientists, can be ineffective or unstable relative to large models, for example, in economic predictions (Giannone et al., 2021). To achieve sparsity for economic interpretation while exploiting big data for superior empirical performance, we introduce a general framework that jointly clusters observations (via new decision trees) and locally selects variables (with Bayesian priors) for modeling panel data with potential grouped heterogeneity. We derive analytical marginal likelihoods as global split criteria in our Bayesian Clustering Model (BCM), to incorporate economic guidance, address parameter and model uncertainties, and prevent overfitting. We apply BCM to asset pricing and estimate uncommon-factor models for data-driven asset clusters and macroeconomic regimes. We find (i) cross-sectional heterogeneity linked to (non-linear interactions of) return volatility, size, and value, (ii) structural changes in factor relevance predicted by market volatility and valuation, and (iii) MKTRF and SMB as common factors and multiple uncommon factors across characteristics-managed-market-timed clusters. BCM helps explain volatility- or size-related anomalies, exploit within-group tests, and mitigate the “factor zoo” problem. Overall, BCM outperforms benchmark common-factor models in pricing and investments in U.S. equities, e.g., attaining out-of-sample cross-sectional R2s exceeding 25% for multiple clusters and Sharpe ratio of tangency portfolios tripling built from ME-B/M 5 × 5 portfolios.Institutional subscribers to the NBER working paper series, and residents of developing countries may download this paper without additional charge at www.nber.org.

Uncommon Factors for Bayesian Asset Clusters

Sparse Modeling under Grouped Heterogeneity with an Application to Asset Pricing

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Bayesian Statistical Inference for Factor Analysis Models with Clustered Data

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Factor Model Based Clustering Approach for Cardinality Constrained Portfolio Selection

Bayesian factor-adjusted sparse regression

Statistical Analysis of the Model of Multi-factors CAPM

Factor Adjusted Spectral Clustering for Mixture Models

A Bayesian Approach to Clustering Matting Components in Spectral Matting

Bayesian Dynamic Factor Models for High-dimensional Matrix-valued Time Series

Model-based clustering via mixtures of unrestricted skew normal factor analyzers with complete and incomplete data

Overfitting Bayesian Mixtures of Factor Analyzers with an Unknown Number of Components

Emergent and Spontaneous Computation of Factor Relationships from A Large Factor Set

Winners from Winners: A Tale of Risk Factors

Asset selection via correlation blockmodel clustering

Comparing Asset Pricing Factor Models under Multivariate T-Distribution: Evidence from China

Factor correlation and the cross section of asset returns: A correlation-robust machine learning approach

Bayesian Clustering with Variable and Transformation Selections

Model scan of factors in U.K. stock returns

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components