Abstract:There is a growing opportunity for self-improvement within the realm of higher education, represented by the combination of big data technologies and higher education. The Education Big Data Processing Framework (EBDPF) is the name of the platform that is the subject of this article, which focuses on the development of an advanced big data processing platform. In order to process huge datasets in an effective manner, the platform makes use of Hadoop's big data storage architecture, in addition to Hive, Flume, and Sqoop for data collection and synchronization, respectively. In this study, the implementation of standard data mining techniques is investigated through the use of MapReduce programming. More specifically, the study investigates the execution efficiency and scalability of these algorithms within the Hadoop platform. The data clustering task in data mining is chosen as a representative problem in this study so that the effectiveness of the EBDPF may be evaluated accordingly. An implementation of the clustering job that is based on MapReduce is created and tested on the Hadoop platform. Extensive experiments are conducted with a range of cluster sizes and data sizes. The findings provide more evidence that Hadoop distributed systems are more efficient and successful than traditional methods when it comes to managing data mining applications. The extended performance analysis of computing power not only provides evidence that the platform is currently effective, but it also provides a signal that it has a significant amount of potential that has not yet been utilized. At the convergence of big data technology and higher education, the EBDPF emerges as a strong and promising framework, demonstrating considerable steps in accelerating data processing within educational contexts. In conclusion, the EBDPF is a framework that demonstrates significant progress.

Data Warehouse with Big Data Technology for Higher Education

Data Warehouse with Big Data Technology for Higher Education

Use of Data Warehouse and Data Mining for Academic Data : A Case Study at a National University

Tata Kelola Database Perguruan Tinggi Yang Optimal Dengan Data Warehouse

Hadoop-Based Political and Ideological Big Data Platform Architecture and Pattern Mining in Higher Education

Medical Big Data Warehouse: Architecture and System Design, a Case Study: Improving Healthcare Resources Distribution

eDWaaS: A Scalable Educational Data Warehouse as a Service

Adoption of Data Warehouse in University Management: Wasit University Case Study

The Application of Data Warehouse in Teaching Management in Colleges and Universities

Using Big Data in the Academic Environment

The Role and Application of Big Data Technology in Decision-Making Management of Colleges And Universities

A Data Warehouse Design for a Typical University Information System

Design and Development of Big Data Platform for Smart University

A Peta-Scale Data Movement and Analysis in Data Warehouse (APSDMADW)

Sustainable Competitive Advantage of Big Data Analytics in Higher Education Sector: An Overview

The anatomy of big data computing

Design and Implementation of Campus Data Governance Platform Based on Big Data Algorithm

Big Data Technology for Developing Learning Resources

Big Data Technologies and Management

An Approach to Handle Big Data Warehouse Evolution

A Brief Introduction on Big Data 5Vs Characteristics and Hadoop Technology