Abstract:Many empirical studies of labor market questions rely on estimating relatively simple predictive models using small, carefully constructed longitudinal survey datasets based on hand-engineered features. Large Language Models (LLMs), trained on massive datasets, encode vast quantities of world knowledge and can be used for the next job prediction problem. However, while an off-the-shelf LLM produces plausible career trajectories when prompted, the probability with which an LLM predicts a particular job transition conditional on career history will not, in general, align with the true conditional probability in a given population. Recently, Vafa et al. (2024) introduced a transformer-based "foundation model", CAREER, trained using a large, unrepresentative resume dataset, that predicts transitions between jobs; it further demonstrated how transfer learning techniques can be used to leverage the foundation model to build better predictive models of both transitions and wages that reflect conditional transition probabilities found in nationally representative survey datasets. This paper considers an alternative where the fine-tuning of the CAREER foundation model is replaced by fine-tuning LLMs. For the task of next job prediction, we demonstrate that models trained with our approach outperform several alternatives in terms of predictive performance on the survey data, including traditional econometric models, CAREER, and LLMs with in-context learning, even though the LLM can in principle predict job titles that are not allowed in the survey data. Further, we show that our fine-tuned LLM-based models' predictions are more representative of the career trajectories of various workforce subpopulations than off-the-shelf LLM models and CAREER. We conduct experiments and analyses that highlight the sources of the gains in the performance of our models for representative predictions.

Skill-LLM: Repurposing General-Purpose LLMs for Skill Extraction

Rethinking Skill Extraction in the Job Market Domain using Large Language Models

Large Language Models as Batteries-Included Zero-Shot ESCO Skills Matchers

SkillGPT: a RESTful API service for skill extraction and standardization using a Large Language Model

Comparative Analysis of Encoder-Based NER and Large Language Models for Skill Extraction from Russian Job Vacancies

LLMs in Biomedicine: A study on clinical Named Entity Recognition

Extreme Multi-Label Skill Extraction Training using Large Language Models

Distilling Large Language Models using Skill-Occupation Graph Context for HR-Related Tasks

NNOSE: Nearest Neighbor Occupational Skill Extraction

Augmenting NER Datasets with LLMs: Towards Automated and Refined Annotation

A Knowledge-Enhanced Medical Named Entity Recognition Method that Integrates Pre-Trained Language Models

Mixture-of-Skills: Learning to Optimize Data Usage for Fine-Tuning Large Language Models

Extraction of Research Objectives, Machine Learning Model Names, and Dataset Names from Academic Papers and Analysis of Their Interrelationships Using LLM and Network Analysis

LTNER: Large Language Model Tagging for Named Entity Recognition with Contextualized Entity Marking

Design of Negative Sampling Strategies for Distantly Supervised Skill Extraction

Skill Extraction from Job Postings using Weak Supervision

ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models

LABOR-LLM: Language-Based Occupational Representations with Large Language Models

SkillAggregation: Reference-free LLM-Dependent Aggregation

LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition