Abstract:Categorical variables have no intrinsic ordering, and researchers often adopt a fixed-effect (FE) approach in empirical analysis. However, this approach has two significant limitations: it overlooks textual labels associated with the categorical variables; and it produces unstable results when there are only limited observations in a category. In this paper, we propose a novel method that utilizes recent advances in large language models (LLMs) to recover overlooked information in categorical variables. We apply this method to investigate labor market mismatch. Specifically, we task LLMs with simulating the role of a human resources specialist to assess the suitability of an applicant with specific characteristics for a given job. Our main findings can be summarized in three parts. First, using comprehensive administrative data from an online job posting platform, we show that our new match quality measure is positively correlated with several traditional measures in the literature, and at the same time, we highlight the LLM's capability to provide additional information conditional on the traditional measures. Second, we demonstrate the broad applicability of the new method with a survey data containing significantly less information than the administrative data, which makes it impossible to compute most of the traditional match quality measures. Our LLM measure successfully replicates most of the salient patterns observed in a hard-to-access administrative dataset using easily accessible survey data. Third, we investigate the gender gap in match quality and explore whether there exists gender stereotypes in the hiring process. We simulate an audit study, examining whether revealing gender information to LLMs influences their assessment. We show that when gender information is disclosed to the GPT, the model deems females better suited for traditionally female-dominated roles.Institutional subscribers to the NBER working paper series, and residents of developing countries may download this paper without additional charge at www.nber.org.

Reducing multi-collinearity in GLMS with categorical covariates

Facilitating heterogeneous effect estimation via statistically efficient categorical modifiers

Dimension Reduction and Alleviation of Confounding for Spatial Generalized Linear Mixed Models

Measuring the Severity of Multi-Collinearity in High Dimensions

A Random-effects Approach to Regression Involving Many Categorical Predictors and Their Interactions

Recovering Overlooked Information in Categorical Variables with LLMs: An Application to Labor Market Mismatch

Investigating Approaches to Estimating Covariate Effects in Growth Mixture Modeling: A Simulation Study

Comparing methods addressing multi-collinearity when developing prediction models

Reduced-rank clustered coefficient regression for addressing multicollinearity in heterogeneous coefficient estimation

A binarization approach to model interactions between categorical predictors in Generalized Linear Models

Measuring Variable Importance in Individual Treatment Effect Estimation with High Dimensional Data

Partitioned conditional generalized linear models for categorical data

Sparse Factor Analysis for Categorical Data with the Group-Sparse Generalized Singular Value Decomposition

A New Covariate Selection Strategy for High Dimensional Data in Causal Effect Estimation with Multivariate Treatments

Improving model choice in classification: an approach based on clustering of covariance matrices

Conjugate gradient methods for high-dimensional GLMMs

A Constructive Procedure for Modeling Categorical Variables: Log-Linear and Logit Models

Group penalized multinomial logit models and stock return direction prediction

A Simple Correction Procedure for High-Dimensional Generalized Linear Models with Measurement Error

Robust data integration from multiple external sources for generalized linear models with binary outcomes

Modeling Gene-Covariate Interactions in Sparse Regression with Group Structure for Genome-Wide Association Studies.