Abstract:Categorical variables have no intrinsic ordering, and researchers often adopt a fixed-effect (FE) approach in empirical analysis. However, this approach has two significant limitations: it overlooks textual labels associated with the categorical variables; and it produces unstable results when there are only limited observations in a category. In this paper, we propose a novel method that utilizes recent advances in large language models (LLMs) to recover overlooked information in categorical variables. We apply this method to investigate labor market mismatch. Specifically, we task LLMs with simulating the role of a human resources specialist to assess the suitability of an applicant with specific characteristics for a given job. Our main findings can be summarized in three parts. First, using comprehensive administrative data from an online job posting platform, we show that our new match quality measure is positively correlated with several traditional measures in the literature, and at the same time, we highlight the LLM's capability to provide additional information conditional on the traditional measures. Second, we demonstrate the broad applicability of the new method with a survey data containing significantly less information than the administrative data, which makes it impossible to compute most of the traditional match quality measures. Our LLM measure successfully replicates most of the salient patterns observed in a hard-to-access administrative dataset using easily accessible survey data. Third, we investigate the gender gap in match quality and explore whether there exists gender stereotypes in the hiring process. We simulate an audit study, examining whether revealing gender information to LLMs influences their assessment. We show that when gender information is disclosed to the GPT, the model deems females better suited for traditionally female-dominated roles.Institutional subscribers to the NBER working paper series, and residents of developing countries may download this paper without additional charge at www.nber.org.

Latent Ability Model: A Generative Probabilistic Learning Framework for Workforce Analytics

Deep Latent Variable Predictive Modeling with Online Bayesian Soft Attention Mechanism

Dynamic Probabilistic Latent Variable Model for Process Data Modeling and Regression Application

Latent Variable Models in the Era of Industrial Big Data: Extension and Beyond

Recovering Overlooked Information in Categorical Variables with LLMs: An Application to Labor Market Mismatch

LABOR-LLM: Language-Based Occupational Representations with Large Language Models

Large-Scale Talent Flow Forecast with Dynamic Latent Factor Model?

LLM Processes: Numerical Predictive Distributions Conditioned on Natural Language

WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Models

Latent Feature Mining for Predictive Model Enhancement with Large Language Models

Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation

Method for constructing work ability model, parameter calculation method thereof, and labor force evaluation and prediction device based on the model

Latent Logic Tree Extraction for Event Sequence Explanation from LLMs

A Latent Hawkes Process Model for Event Clustering and Temporal Dynamics Learning with Applications in GitHub.

Bayesian Active Learning for Discrete Latent Variable Models

Latent State Estimation Helps UI Agents to Reason

A Latent Moving Average Model for Network Regression

Leveraging Large Language Models for Hybrid Workplace Decision Support

Exploring Large Language Model for Graph Data Understanding in Online Job Recommendations