Python based IT industry recruitment data automatic collection, warehousing, and analysis system

Xinkai Gao
DOI: https://doi.org/10.1117/12.2656731
2022-10-20
Abstract:How to improve the employment competitiveness, employment rate and employment quality of graduates is one of the essential concern of college educators. To achieve this goal, college educators must provide in-campus students with courses and training which are consistent with the job skills required by the recruitment market according to the recent industry trends, employers' recruitment demand and job competency requirements. As college educators, how to obtain thousands of enterprise recruitment information in the industry in an efficient and low-cost way, and then dig out the skills that students need to master most? One of the effective ways to achieve this goal is to collect, sort out, mine and analyze big data based on python[1]. Firstly, with a Python based crawler program, this research collects the companies, positions, academic requirements, work experience requirements and salary range of massive IT positions from June 2021 to June 2022 in Guangzhou published on zhaopin.com. Then matplotlib is used to analyze the total market demand, average salary, salary changing curve over experience, and the minimum academic requirements. Finally, some suggestions for college educators are supplied so as to provide better college IT training.
Engineering,Computer Science,Education
What problem does this paper attempt to address?