Scraping and Clustering Techniques for the Characterization of Linkedin Profiles

Kais Dai,Celia Gónzalez Nespereira,Ana Fernández Vilas,Rebeca P. Díaz Redondo
DOI: https://doi.org/10.5121/csit.2015.50101
2015-05-05
Abstract:The socialization of the web has undertaken a new dimension after the emergence of the Online Social Networks (OSN) concept. The fact that each Internet user becomes a potential content creator entails managing a big amount of data. This paper explores the most popular professional OSN: LinkedIn. A scraping technique was implemented to get around 5 Million public profiles. The application of natural language processing techniques (NLP) to classify the educational background and to cluster the professional background of the collected profiles led us to provide some insights about this OSN's users and to evaluate the relationships between educational degrees and professional careers.
Social and Information Networks,Computers and Society,Information Retrieval
What problem does this paper attempt to address?