Tracking the Labor Market with "Big Data"

Tomaz Cajner,Leland Crane,Ryan Decker,Adrian Hamins-Puertolas,Christopher Kurz,

DOI: https://doi.org/10.17016/2380-7172.2441

2019-09-20

FEDS Notes

Abstract:In our research, we explore the information content of the ADP microdata alone by producing an estimate of employment changes independent from the BLS payroll series as well as from other data sources.

What problem does this paper attempt to address?

Using Big Data to Decode Private Sector Wage Growth

Ahu Yildirmaz

DOI: https://doi.org/10.48550/arXiv.1609.09067

2016-09-28

Abstract:The U.S. labor market is dynamic and complex, and understanding wage data across different segments of the workforce is critical to providing policymakers and business leaders with actionable insights. There is no labor index that assesses the labor market performance at such a detailed level as the ADP Research Institute's Workforce Vitality Report (WVR). Drawing on the actual, aggregated and anonymous payroll data of 24 million Americans paid by ADP, the WVR looks at key dynamics and market indicators including wage growth, hours worked and turnover rate. Unlike other data sets, the WVR calculates wage growth of individual workers on a quarter-to-quarter basis, avoiding the deviations caused by various workplace occurrences, like when new workers are hired and older ones retire. In this paper, Dr. Ahu Yildirmaz, head of the ADP Research Institute, drills down into wage growth by industry, age, gender and income level, as well as for both job holders and job switchers. Using WVR data, Ahu walks through those factors contributing to overall shifts in wage growth, the future of the labor market and what this data means for today's U.S. workforce.

Computers and Society
Tracking Employment Shocks Using Mobile Phone Data

Jameson L. Toole,Yu-Ru Lin,Erich Muehlegger,Daniel Shoag,Marta C. Gonzalez,David Lazer

DOI: https://doi.org/10.48550/arXiv.1505.06791

2015-05-26

Abstract:Can data from mobile phones be used to observe economic shocks and their consequences at multiple scales? Here we present novel methods to detect mass layoffs, identify individuals affected by them, and predict changes in aggregate unemployment rates using call detail records (CDRs) from mobile phones. Using the closure of a large manufacturing plant as a case study, we first describe a structural break model to correctly detect the date of a mass layoff and estimate its size. We then use a Bayesian classification model to identify affected individuals by observing changes in calling behavior following the plant's closure. For these affected individuals, we observe significant declines in social behavior and mobility following job loss. Using the features identified at the micro level, we show that the same changes in these calling behaviors, aggregated at the regional level, can improve forecasts of macro unemployment rates. These methods and results highlight promise of new data resources to measure micro economic behavior and improve estimates of critical economic indicators.

Social and Information Networks,Physics and Society
A general methodology to measure labour market dynamics

Davide Fiaschi,Cristina Tealdi

DOI: https://doi.org/10.48550/arXiv.2104.01097

2021-04-02

Abstract:We propose a general methodology to measure labour market dynamics, inspired by the search and matching framework, based on the estimate of the transition rates between labour market states. We show how to estimate instantaneous transition rates starting from discrete time observations provided in longitudinal datasets, allowing for any number of states. We illustrate the potential of such methodology using Italian labour market data. First, we decompose the unemployment rate fluctuations into inflow and outflow driven components; then, we evaluate the impact of the implementation of a labour market reform, which substantially changed the regulations of temporary contracts.

General Economics
Labor Space: A Unifying Representation of the Labor Market via Large Language Models

Seongwoon Kim,Yong-Yeol Ahn,Jaehyuk Park

DOI: https://doi.org/10.1145/3589334.3645464

2024-02-27

Abstract:The labor market is a complex ecosystem comprising diverse, interconnected entities, such as industries, occupations, skills, and firms. Due to the lack of a systematic method to map these heterogeneous entities together, each entity has been analyzed in isolation or only through pairwise relationships, inhibiting comprehensive understanding of the whole ecosystem. Here, we introduce $\textit{Labor Space}$, a vector-space embedding of heterogeneous labor market entities, derived through applying a large language model with fine-tuning. Labor Space exposes the complex relational fabric of various labor market constituents, facilitating coherent integrative analysis of industries, occupations, skills, and firms, while retaining type-specific clustering. We demonstrate its unprecedented analytical capacities, including positioning heterogeneous entities on an economic axes, such as `Manufacturing--Healthcare'. Furthermore, by allowing vector arithmetic of these entities, Labor Space enables the exploration of complex inter-unit relations, and subsequently the estimation of the ramifications of economic shocks on individual units and their ripple effect across the labor market. We posit that Labor Space provides policymakers and business leaders with a comprehensive unifying framework for labor market analysis and simulation, fostering more nuanced and effective strategic decision-making.

Physics and Society,Artificial Intelligence
A dynamic factor model approach to incorporate Big Data in state space models for official statistics

Caterina Schiavoni,Franz Palm,Stephan Smeekes,Jan van den Brakel

DOI: https://doi.org/10.1111/rssa.12626

2020-11-09

Abstract:<p>In this paper we consider estimation of unobserved components in state space models using a dynamic factor approach to incorporate auxiliary information from high‐dimensional data sources. We apply the methodology to unemployment estimation as done by Statistics Netherlands, who uses a multivariate state space model to produce monthly figures for unemployment using series observed with the labour force survey (LFS). We extend the model by including auxiliary series of Google Trends about job‐search and economic uncertainty, and claimant counts, partially observed at higher frequencies. Our factor model allows for nowcasting the variable of interest, providing reliable unemployment estimates in real‐time before LFS data become available.</p>

statistics & probability,social sciences, mathematical methods
Big data in economics

Bogdan Oancea

2024-06-17

Abstract:The term of big data was used since 1990s, but it became very popular around 2012. A recent definition of this term says that big data are information assets characterized by high volume, velocity, variety and veracity that need special analytical methods and software technologies to extract value form them. While big data was used at the beginning mostly in information technology field, now it can be found in every area of activity: in governmental decision-making processes, manufacturing, education, healthcare, economics, engineering, natural sciences, sociology. The rise of Internet, mobile phones, social media networks, different types of sensors or satellites provide enormous quantities of data that can have profound effects on economic research. The data revolution that we are facing transformed the way we measure the human behavior and economic activities. Unemployment, consumer price index, population mobility, financial transactions are only few examples of economic phenomena that can be analyzed using big data sources. In this paper we will start with a taxonomy of big data sources and show how these new data sources can be used in empirical analyses and to build economic indicators very fast and with reduced costs.

General Economics
What is a Labor Market? Classifying Workers and Jobs Using Network Theory

Jamie Fogel,Bernardo Modenesi

2023-11-02

Abstract:This paper develops a new data-driven approach to characterizing latent worker skill and job task heterogeneity by applying an empirical tool from network theory to large-scale Brazilian administrative data on worker--job matching. We microfound this tool using a standard equilibrium model of workers matching with jobs according to comparative advantage. Our classifications identify important dimensions of worker and job heterogeneity that standard classifications based on occupations and sectors miss. The equilibrium model based on our classifications more accurately predicts wage changes in response to the 2016 Olympics than a model based on occupations and sectors. Additionally, for a large simulated shock to demand for workers, we show that reduced form estimates of the effects of labor market shock exposure on workers' earnings are nearly 4 times larger when workers and jobs are classified using our classifications as opposed to occupations and sectors.

General Economics
Bayesian Dependent Functional Mixture Estimation for Area and Time-Indexed Data: An Application for the Prediction of Monthly County Employment

Terrance D. Savitsky,Matthew R. Williams

DOI: https://doi.org/10.1214/21-ba1274

2021-01-01

Bayesian Analysis

Abstract:The U.S. Bureau of Labor Statistics (BLS) publishes employment totals for all U.S. counties on a monthly basis. BLS use the Quarterly Census of Employment and Wages, where responses are received on a 6–7 month lagged basis and aggregated to county, and apply a time series forecast model to each county and project forward to the current month, which ignores the dependence among counties. Our approach treats these by-county employment time series as a collection of area indexed noisy functions that we co-model. Our model includes predictor, trend and seasonality terms indexed by county. This application is among the first in the U.S. Federal Statistical System to address the joint modeling of a collection of time series expressing heterogenous seasonality patterns between them. We demonstrate that use of a Fourier basis to model seasonality outperforms a locally-adaptive, intrinsic conditional autoregressive construction on our collection of time series where the degree of expressed seasonality varies. County-indexed parameters of the 3 terms are drawn from a dependent Dirichlet process (DDP) prior to allow the borrowing of information. We show that employment of both spatial and industry concentration predictors into the prior probabilities for co-clustering among the counties produces better prediction accuracy. Our DDP prior accounts for the possibility that nearby counties may express distinct underlying economic structures. A feature of our joint modeling framework is that it computes efficiently to support the monthly BLS production cycle. We compare the performances of alternative formulations for the dependent Dirichlet process prior on monthly, county employment data from 2002–2016.

statistics & probability,mathematics, interdisciplinary applications
CAREER: A Foundation Model for Labor Sequence Data

Keyon Vafa,Emil Palikot,Tianyu Du,Ayush Kanodia,Susan Athey,David M. Blei

DOI: https://doi.org/10.48550/arXiv.2202.08370

2024-03-01

Abstract:Labor economists regularly analyze employment data by fitting predictive models to small, carefully constructed longitudinal survey datasets. Although machine learning methods offer promise for such problems, these survey datasets are too small to take advantage of them. In recent years large datasets of online resumes have also become available, providing data about the career trajectories of millions of individuals. However, standard econometric models cannot take advantage of their scale or incorporate them into the analysis of survey data. To this end we develop CAREER, a foundation model for job sequences. CAREER is first fit to large, passively-collected resume data and then fine-tuned to smaller, better-curated datasets for economic inferences. We fit CAREER to a dataset of 24 million job sequences from resumes, and adjust it on small longitudinal survey datasets. We find that CAREER forms accurate predictions of job sequences, outperforming econometric baselines on three widely-used economics datasets. We further find that CAREER can be used to form good predictions of other downstream variables. For example, incorporating CAREER into a wage model provides better predictions than the econometric models currently in use.

Machine Learning,Econometrics
Interactive Exploration of the Employment Situation Report: From Fixed Tables to Dynamic Discovery

Peter Mancini,Benjamin Bengfort,Ben Shneiderman

DOI: https://doi.org/10.48550/arXiv.1608.03569

IF: 6.4588

2016-08-11

Human-Computer Interaction

Abstract:The monthly Bureau of Labor Statistics Employment Situation Report is widely anticipated by economists, journalists, and politicians as it is used to forecast the economic condition of the United States. The report has broad impact on public and corporate economic confidence; however, the online access to this data employs outdated techniques, using a PDF format containing solely text and fixed tabular information. Creating an interactive interface for dynamic discovery on the BLS website could elicit more dialogue between the public and government spheres, drawing more traffic to government websites and triggering greater civic engagement. Our work suggests that the implementation of interactive visual analysis techniques to enable dynamic discovery leads to rapid interpretation of data as well as provides the means to explore the data for further insights. This paper presents two inspirational prototypes: a dashboard of interactive visualizations and an interactive time series explorer, allowing for temporal and spatial analyses and enabling users to combine data sets to create their own customized visualization.
The Network Picture of Labor Flow

Eduardo López,Omar Guerrero,Robert L. Axtell

DOI: https://doi.org/10.1140/epjds/s13688-020-00251-w

2015-07-01

Abstract:We construct a data-driven model of flows in graphs that captures the essential elements of the movement of workers between jobs in the companies (firms) of entire economic systems such as countries. The model is based on the observation that certain job transitions between firms are often repeated over time, showing persistent behavior, and suggesting the construction of static graphs to act as the scaffolding for job mobility. Individuals in the job market (the workforce) are modelled by a discrete-time random walk on graphs, where each individual at a node can possess two states: employed or unemployed, and the rates of becoming unemployed and of finding a new job are node dependent parameters. We calculate the steady state solution of the model and compare it to extensive micro-datasets for Mexico and Finland, comprised of hundreds of thousands of firms and individuals. We find that our model possesses the correct behavior for the numbers of employed and unemployed individuals in these countries down to the level of individual firms. Our framework opens the door to a new approach to the analysis of labor mobility at high resolution, with the tantalizing potential for the development of full forecasting methods in the future.

Physics and Society,Statistical Mechanics,Social and Information Networks
Subcontracting Retreat: Early Estimates Using Administrative Data

Enrique Kato-Vidal,Paulina Hernández-Mendoza

DOI: https://doi.org/10.33776/rem.vi66.7699

2024-04-02

Revista de Economía Mundial

Abstract:Labor flexibility policies have increased temporary and subcontracted jobs. These types of employment are associated with lower quality jobs. In this paper, five-year economic census data and social security administrative data were collected to estimate, in non-census years, out-of-sample the percentage of subcontracted jobs. This evidence is relevant for assessing the impact of a legislation that banned subcontracting. Predictor variables such as time fixed effects, industry, and the rate of temporary workers were used. The results show a significant decrease in subcontracting, particularly in the secondary sector. These findings raise the need for future research on improvements in post-reform well-being in the labor market.

economics
Measuring Employer-to-Employer Reallocation

Shigeru Fujita,Giuseppe Moscarini,Fabien Postel-Vinay

DOI: https://doi.org/10.1257/mac.20210076

2024-07-01

Abstract:We revisit measurement of employer-to-employer (EE) transitions in the monthly Current Population Survey. The incidence of missing answers to the question on change of employer sharply increases starting with the introduction of a new software instrument to conduct interviews in January 2007 and of the Respondent Identification Policy in 2008–2009. We document nonrandom nonresponse selection by observable and unobservable worker characteristics that correlate with EE mobility. We propose a selection model and a procedure to impute missing answers. Our imputed EE aggregate series no longer trends down after 2000 and restores a close congruence with the business cycle after 2007. (JEL C83, E24, E32, J62)

economics
Enhancing the Demand for Labour survey by including skills from online job advertisements using model-assisted calibration

Maciej Beręsewicz,Greta Białkowska,Krzysztof Marcinkowski,Magdalena Maślak,Piotr Opiela,Robert Pater,Katarzyna Zadroga

DOI: https://doi.org/10.18148/srm/2021.v15i2.7670

2019-08-08

Abstract:In the article we describe an enhancement to the Demand for Labour (DL) survey conducted by Statistics Poland, which involves the inclusion of skills obtained from online job advertisements. The main goal is to provide estimates of the demand for skills (competences), which is missing in the DL survey. To achieve this, we apply a data integration approach combining traditional calibration with the LASSO-assisted approach to correct representation error in the online data. Faced with the lack of access to unit-level data from the DL survey, we use estimated population totals and propose a~bootstrap approach that accounts for the uncertainty of totals reported by Statistics Poland. We show that the calibration estimator assisted with LASSO outperforms traditional calibration in terms of standard errors and reduces representation bias in skills observed in online job ads. Our empirical results show that online data significantly overestimate interpersonal, managerial and self-organization skills while underestimating technical and physical skills. This is mainly due to the under-representation of occupations categorised as Craft and Related Trades Workers and Plant and Machine Operators and Assemblers.

General Economics,Applications
Predictive Analytics Supporting Labor Market Success: A Career Explorer for Job Seekers and Workforce Professionals in Michigan

Christopher J. O’Leary,Kevin Doyle,Ben Damerow,Kenneth J. Kline,Beth C. Truesdale,Salomon Orellana,Randall W. Eberts,Amy Meyers,Anna Wilcoxson,Scott Powell

DOI: https://doi.org/10.1177/08912424241271163

IF: 1.0769

2024-08-30

Economic Development Quarterly

Abstract:Economic Development Quarterly, Ahead of Print. Career Explorer provides customized career exploration tools for workforce development staff and job seekers in Michigan. There are two separate Career Explorer modules: a staff-mediated service and a self-service for job seekers. The system was developed by the Michigan Center for Data and Analytics in collaboration with the W.E. Upjohn Institute for Employment Research and Michigan Works! Southwest. It was funded by the U.S. Department of Labor's Office of Workforce Investment and the Schmidt Futures' Data for the American Dream (D4AD) project. In this paper, the authors describe the machine learning models behind the predictive analytics of the frontline staff-mediated version of Career Explorer. These models were trained on program administrative data. Additionally, the authors describe the self-service version of Career Explorer, which provides clients with customized labor market information based on published U.S. Bureau of Labor Statistics data. Career Explorer became an active feature of Michigan's online reemployment services system in June 2021.

economics,urban studies,development studies
A Members First Approach to Enabling LinkedIn's Labor Market Insights at Scale

Ryan Rogers,Adrian Rivera Cardoso,Koray Mancuhan,Akash Kaura,Nikhil Gahlawat,Neha Jain,Paul Ko,Parvez Ahammad

DOI: https://doi.org/10.48550/arXiv.2010.13981

2020-10-27

Abstract:We describe the privatization method used in reporting labor market insights from LinkedIn's Economic Graph, including the differentially private algorithms used to protect member's privacy. The reports show who are the top employers, as well as what are the top jobs and skills in a given country/region and industry. We hope this data will help governments and citizens track labor market trends during the COVID-19 pandemic while also protecting the privacy of our members.

Cryptography and Security
Bayesian Nonparametric Functional Mixture Estimation for Time-Series Data, With Application to Estimation of State Employment Totals

Terrance D. Savitsky

DOI: https://doi.org/10.48550/arXiv.1508.00615

2015-08-04

Abstract:The U.S. Bureau of Labor Statistics use monthly, by-state employment totals from the Current Population Survey (CPS) as a key input to develop employment estimates for counties within the states. The monthly CPS by-state totals, however, express high levels of volatility that compromise the accuracy of resulting estimates composed for the counties. Typically-employed models for small area estimation produce de-noised, state-level employment estimates by borrowing information over the survey months, but assume independence among the collection of by-state time series, which is typically violated due to similarities in their underlying economies. We construct Gaussian process and Gaussian Markov random field alternative functional prior specifications, each in a mixture of multivariate Gaussian distributions with a Dirichlet process (DP) mixing measure over the parameters of their covariance or precision matrices. Our DP mixture of functions models allow the data to simultaneously estimate a dependence among the months and between states. A feature of our models is that those functions assigned to the same cluster are drawn from a distribution with the same covariance parameters, so that they are similar, but don't have to be identical. We compare the performances of our two alternatives on synthetic data and apply them to recover de-noised, by-state CPS employment totals for data from $2000-2013$.

Methodology
Prediction of employment and unemployment rates from Twitter daily rhythms in the US

Eszter Bokányi,Zoltán Lábszki,Gábor Vattay

DOI: https://doi.org/10.1140/epjds/s13688-017-0112-x

IF: 3.63

2017-07-11

EPJ Data Science

Abstract:By modeling macro-economical indicators using digital traces of human activities on mobile or social networks, we can provide important insights to processes previously assessed via paper-based surveys or polls only. We collected aggregated workday activity timelines of US counties from the normalized number of messages sent in each hour on the online social network Twitter. In this paper, we show how county employment and unemployment statistics are encoded in the daily rhythm of people by decomposing the activity timelines into a linear combination of two dominant patterns. The mixing ratio of these patterns defines a measure for each county, that correlates significantly with employment (0.46±0.02\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$0.46\pm0.02$\end{document}) and unemployment rates (−0.34±0.02\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$-0.34\pm0.02$\end{document}). Thus, the two dominant activity patterns can be linked to rhythms signaling presence or lack of regular working hours of individuals. The analysis could provide policy makers a better insight into the processes governing employment, where problems could not only be identified based on the number of officially registered unemployed, but also on the basis of the digital footprints people leave on different platforms.

mathematics, interdisciplinary applications,social sciences, mathematical methods
Employment Growth through Labor Flow Networks

Omar A. Guerrero,Robert L. Axtell

DOI: https://doi.org/10.1371/journal.pone.0060808

IF: 3.7

2013-05-02

PLoS ONE

Abstract:It is conventional in labor economics to treat all workers who are seeking new jobs as belonging to a labor pool, and all firms that have job vacancies as an employer pool, and then match workers to jobs. Here we develop a new approach to study labor and firm dynamics. By combining the emerging science of networks with newly available employment micro-data, comprehensive at the level of whole countries, we are able to broadly characterize the process through which workers move between firms. Specifically, for each firm in an economy as a node in a graph, we draw edges between firms if a worker has migrated between them, possibly with a spell of unemployment in between. An economy's overall graph of firm-worker interactions is an object we call the labor flow network (LFN). This is the first study that characterizes a LFN for an entire economy. We explore the properties of this network, including its topology, its community structure, and its relationship to economic variables. It is shown that LFNs can be useful in identifying firms with high growth potential. We relate LFNs to other notions of high performance firms. Specifically, it is shown that fewer than 10% of firms account for nearly 90% of all employment growth. We conclude with a model in which empirically-salient LFNs emerge from the interaction of heterogeneous adaptive agents in a decentralized labor market.

multidisciplinary sciences
Opening the Black Box: Task and Skill Mix and Productivity Dispersion

G.Jacob Blackwood,Cindy Cunningham,Matt Dey,Lucia Foster,Cheryl Grim,John Haltiwanger,Rachel Nesbit,Sabrina Wulff Pabilonia,Jay Stewart,Cody Tuttle,Zoltan Wolf,John C. Haltiwanger

DOI: https://doi.org/10.2139/ssrn.4234908

2022-01-01

SSRN Electronic Journal

Abstract:An important gap in most empirical studies of establishment-level productivity is the limited information about workers' characteristics and their tasks. Skill-adjusted labor input measures have been shown to be important for aggregate productivity measurement. Moreover, the theoretical literature on differences in production technologies across businesses increasingly emphasizes the task content of production. Our ultimate objective is to open this black box of tasks and skills at the establishment-level by combining establishment-level data on occupations from the Bureau of Labor Statistics (BLS) with a restricted-access establishment-level productivity dataset created by the BLS-Census Bureau Collaborative Micro-productivity Project. We take a first step toward this objective by exploring the conceptual, specification, and measurement issues to be confronted. We provide suggestive empirical analysis of the relationship between within-industry dispersion in productivity and tasks and skills. We find that within-industry productivity dispersion is strongly positively related to within-industry task/skill dispersion.

Tracking the Labor Market with "Big Data"

Using Big Data to Decode Private Sector Wage Growth

Tracking Employment Shocks Using Mobile Phone Data

A general methodology to measure labour market dynamics

Labor Space: A Unifying Representation of the Labor Market via Large Language Models

A dynamic factor model approach to incorporate Big Data in state space models for official statistics

Big data in economics

What is a Labor Market? Classifying Workers and Jobs Using Network Theory

Bayesian Dependent Functional Mixture Estimation for Area and Time-Indexed Data: An Application for the Prediction of Monthly County Employment

CAREER: A Foundation Model for Labor Sequence Data

Interactive Exploration of the Employment Situation Report: From Fixed Tables to Dynamic Discovery

The Network Picture of Labor Flow

Subcontracting Retreat: Early Estimates Using Administrative Data

Measuring Employer-to-Employer Reallocation

Enhancing the Demand for Labour survey by including skills from online job advertisements using model-assisted calibration

Predictive Analytics Supporting Labor Market Success: A Career Explorer for Job Seekers and Workforce Professionals in Michigan

A Members First Approach to Enabling LinkedIn's Labor Market Insights at Scale

Bayesian Nonparametric Functional Mixture Estimation for Time-Series Data, With Application to Estimation of State Employment Totals

Prediction of employment and unemployment rates from Twitter daily rhythms in the US

Employment Growth through Labor Flow Networks

Opening the Black Box: Task and Skill Mix and Productivity Dispersion