Application of LLM Agents in Recruitment: A Novel Framework for Resume Screening

Chengguang Gan,Qinghao Zhang,Tatsunori Mori

2024-08-13

Abstract:The automation of resume screening is a crucial aspect of the recruitment process in organizations. Automated resume screening systems often encompass a range of natural language processing (NLP) tasks. This paper introduces a novel Large Language Models (LLMs) based agent framework for resume screening, aimed at enhancing efficiency and time management in recruitment processes. Our framework is distinct in its ability to efficiently summarize and grade each resume from a large dataset. Moreover, it utilizes LLM agents for decision-making. To evaluate our framework, we constructed a dataset from actual resumes and simulated a resume screening process. Subsequently, the outcomes of the simulation experiment were compared and subjected to detailed analysis. The results demonstrate that our automated resume screening framework is 11 times faster than traditional manual methods. Furthermore, by fine-tuning the LLMs, we observed a significant improvement in the F1 score, reaching 87.73\%, during the resume sentence classification phase. In the resume summarization and grading phase, our fine-tuned model surpassed the baseline performance of the GPT-3.5 model. Analysis of the decision-making efficacy of the LLM agents in the final offer stage further underscores the potential of LLM agents in transforming resume screening processes.

Computation and Language

What problem does this paper attempt to address?

This paper attempts to solve the problems of low efficiency and time - consuming in resume screening during the recruitment process. Specifically, the paper introduces an agent framework based on large - language models (LLMs), aiming to improve efficiency and time - management capabilities in the recruitment process. This framework can efficiently summarize and score a large number of resumes and use LLM agents for decision - making. By constructing a dataset of actual resumes and simulating the resume - screening process, the researchers evaluated the effectiveness of this framework. The experimental results show that, compared with the traditional manual method, this automated resume - screening framework is 11 times faster. In addition, by fine - tuning LLMs, the paper achieved an F1 score of 87.73% in the resume - sentence - classification stage, and its performance in the resume - summarization and - scoring stage also exceeded that of the GPT - 3.5 model. These results indicate that LLM agents have significant potential in the final hiring - decision - making stage and can effectively improve the resume - screening process.