Research and Application on Spark Clustering Algorithm in Campus Big Data Analysis

Qing Hou,Guangjian Wang,Xiaozheng Wang,Jiaxi Xu,Yang Xin
DOI: https://doi.org/10.30564/jcsr.v2i1.1808
2020-01-01
Journal of Computer Science Research
Abstract:Big data analysis has penetrated into all fields of society and has brought about profound changes. However, there is relatively little research on big data supporting student management regarding college and university’s big data. Taking the student card information as the research sample, using spark big data mining technology and K-Means clustering algorithm, taking scholarship evaluation as an example, the big data is analyzed. Data includes analysis of students’ daily behavior from multiple dimensions, and it can prevent the unreasonable scholarship evaluation caused by unfair factors such as plagiarism, votes of teachers and students, etc. At the same time, students’ absenteeism, physical health and psychological status in advance can be predicted, which makes student management work more active, accurate and effective.
What problem does this paper attempt to address?