Abstract:Categorical variables have no intrinsic ordering, and researchers often adopt a fixed-effect (FE) approach in empirical analysis. However, this approach has two significant limitations: it overlooks textual labels associated with the categorical variables; and it produces unstable results when there are only limited observations in a category. In this paper, we propose a novel method that utilizes recent advances in large language models (LLMs) to recover overlooked information in categorical variables. We apply this method to investigate labor market mismatch. Specifically, we task LLMs with simulating the role of a human resources specialist to assess the suitability of an applicant with specific characteristics for a given job. Our main findings can be summarized in three parts. First, using comprehensive administrative data from an online job posting platform, we show that our new match quality measure is positively correlated with several traditional measures in the literature, and at the same time, we highlight the LLM's capability to provide additional information conditional on the traditional measures. Second, we demonstrate the broad applicability of the new method with a survey data containing significantly less information than the administrative data, which makes it impossible to compute most of the traditional match quality measures. Our LLM measure successfully replicates most of the salient patterns observed in a hard-to-access administrative dataset using easily accessible survey data. Third, we investigate the gender gap in match quality and explore whether there exists gender stereotypes in the hiring process. We simulate an audit study, examining whether revealing gender information to LLMs influences their assessment. We show that when gender information is disclosed to the GPT, the model deems females better suited for traditionally female-dominated roles.Institutional subscribers to the NBER working paper series, and residents of developing countries may download this paper without additional charge at www.nber.org.

Identifying Labor Market Competitors with Machine Learning Based on Maimai Platform

Monitoring Events of Market Competitors: A Text Mining Method for Analyzing Massive Firm-Generated Social Media

Automated Competitor Analysis Using Big Data Analytics

Aspect-Level Sentiment Analysis of Customer Reviews Based on Neural Multi-task Learning

AlphaMLDigger: A Novel Machine Learning Solution to Explore Excess Return on Investment

Recovering Overlooked Information in Categorical Variables with LLMs: An Application to Labor Market Mismatch

Unveiling the Potential of Sentiment: Can Large Language Models Predict Chinese Stock Price Movements?

Large Language Models at Work in China's Labor Market

Research of the machine learning method based on public opinion analysis

Occupation Prediction with Multimodal Learning from Tweet Messages and Google Street View Images

Analysis of Chinese Tourists in Japan by Text Mining of a Hotel Portal Site

Sentiment Analysis of Customer Reviews on E-commerce Platforms: A Machine Learning Approach

E-Commerce Platform User Evaluation Sentiment Analysis and Emotion-Oriented Marketing Strategy Research Based on Big Data Technology

Seeing the wood for the trees: How machine learning can help firms in identifying relevant electronic word-of-mouth in social media

Analysis of Stock Market Public Opinion Based on Web Crawler and Deep Learning Technologies Including 1DCNN and LSTM

Data-Driven Competitor Identification Using Text Mining And Word Network Analysis

Sentiment Analysis Of Social Networks' Comments To Predict Stock Return

Running a Sustainable Social Media Business: The Use of Deep Learning Methods in Online-Comment Short Texts

Analysis of psychological characteristics and emotional expression based on deep learning in higher vocational music education

The Current Status and Future Prospects of Machine Learning in the Chinese Stock Market