Abstract:Random forest is one of the most widely used machine learning algorithms. Decision trees used to construct the random forest may have low classification accuracies or high correlations, which affects the comprehensive performance of the random forest. Aiming at these problems, the authors proposed an improved random forest based on the classification accuracy and correlation measurement of decision trees in this paper. Its main idea includes two parts, one is retaining the classification and regression trees (CARTs) with better classification effects, the other is reducing the correlations between the CARTs. Specifically, in the classification effect evaluation part, each CART was applied to make predictions on three reserved data sets, then the average classification accuracies were achieved, respectively. Thus, all the CARTs were sorted in descending order according to their achieved average classification accuracies. In the correlation measurement part, the improved dot product method was proposed to calculate the cosine similarity, i.e., the correlation, between CARTs in the feature space. By using the achieved average classification accuracy as reference, the grid search method was used to find the inner product threshold. On this basis, the CARTs with low average classification accuracy among CART pairs whose inner product values are higher than the inner product threshold were marked as deletable. The achieved average classification accuracies and correlations of CARTs were comprehensively considered, those with high correlation and weak classification effect were deleted, and those with better quality were retained to construct the random forest. Multiple experiments show that, the proposed improved random forest achieved higher average classification accuracy than the five random forests used for comparison, and the lead was stable. The G-means and out-of-bag data (OBD) score obtained by the proposed improved random forest were also higher than the five random forests, and the lead was more obvious. In addition, the test results of three non-parametric tests show that, there were significant diversities between the proposed improved random forest and the other five random forests. This effectively proves the superiority and practicability of the proposed improved random forest.

MapReduce based distributed improved random forest model for graduates career classification

Teaching reform and innovation of vocational development and employment guidance courses in colleges and universities based on random forest model

An optimized random forest for multi class classification to classify the students using machine learning approaches

Optimizing the Isolation Forest Algorithm for Identifying Abnormal Behaviors of Students in Education Management Big Data

Performance assessment and fitness analysis of athletes using decision tree and data mining techniques

Big Data Quality Prediction in the Process Industry: A Distributed Parallel Modeling Framework

Prediction of learning behavior based on improved random forest algorithm

MR-ELM: a MapReduce-based framework for large-scale ELM training in big data era

Predicting academic performance using tree-based machine learning models: A case study of bachelor students in an engineering department in China

Optimization of Entrepreneurship Education for College Students Based on Improved Random Forest Algorithm

The Application of Data Mining to Build Classification Model for Predicting Graduate Employment

Clustering and Classification Based on Distributed Automatic Feature Engineering for Customer Segmentation

Application of Random Trees Model in Online Learning Perspective in Evaluating Learners’ Behavioral Engagement

Analysis and Prediction of College Students’ Employment based on Decision Tree Classification Algorithm

Distributed Model Reuse with Multiple Classifiers

Application of the Data Mining Model in Smart Mobile Education

Online English Teaching Course Score Analysis Based on Decision Tree Mining Algorithm

A New Random Forest Algorithm Based on Learning Automata

An improved random forest based on the classification accuracy and correlation measurement of decision trees

Improved differentiation classification of variable precision artificial intelligence higher education management

Personalized Overseas Chinese Education Model Based on Map-Reduce Model of Cloud Computing