Abstract:As an emulous alternative to deep neural networks, Deep Forest emerges with features like low complexity, fewer hyper-parameters, and good robustness, which are predominantly desired in distributed computing applications and ecosystems. Recently, an efficient distributed Deep Forest system, named ForestLayer, was proposed, designing a fine-grained sub-Forest-based task-parallel algorithm to improve the parallel computing efficiency of Deep Forest. However, the sub-Forest splitting of ForestLayer is static and one-off without adaptability to the computing environment, nevertheless, the size of splitting granularity has a significant impact on the system performance. To further improve the computing efficiency and scalability of the distributed Deep Forest, in this paper, we propose a novel distributed Deep Forest algorithm, named BLB-gcForest (Bag of Little Bootstraps-gcForest), which augments the gcForest (multi-Grained Cascade Forest) approach for constructing Deep Forest. BLB-gcForest carries out parallel computation for each tree in sub-Forests at a finer parallel granularity and integrates with the Bag of Little Bootstraps (BLB) mechanism to reduce massive transmitted feature instances for Cascade Forest Layers, utterly improving both computation efficiency and communication efficiency. Moreover, to solve the problem of the forest splitting granularity, we further design an adaptive sub-Forest splitting algorithm to ensure the maximum resource utilization for parallel computation of each sub-Forest. Experimental results on four well-known large-scale datasets, namely YEAST, LETTER, MNIST, CIFAR10, show that the training efficiency of BLB-gcForest achieves up to 20.3x and 1.64x speedups compared with the state-of-the-art gcForest and ForestLayer, respectively while guaranteeing higher accuracy and better robustness

Distributed Representation Learning with Skip-Gram Model for Trained Random Forests

Visualizing the Random Forest by 3D Techniques

Improved Parallel Random Forest Algorithm Combining Information Theory and Norm

A New Rotation Forest Ensemble Algorithm

Cooperative Profit Random Forests with Application in Ocean Front Recognition.

Parallel Random Forest Algorithm Combining Gain Ratio and Stacked Auto Encoders

Random Subsequence Forests

Application research of credit fraud detection based on distributed rotation deep forest

LionForests: Local Interpretation of Random Forests

Neural Forest Learning.

Deep Distributed Random Samplings for Supervised Learning: An Alternative to Random Forests?

A Parallel Conditional Random Fields Model Based on Spark Computing Environment

Diversity-Based Random Forests with Sample Weight Learning

Improving Deep Forest by Exploiting High-order Interactions

ForestLayer: Efficient Training of Deep Forests on Distributed Task-Parallel Platforms

Forest Floor Visualizations of Random Forests

Distributed Training for Conditional Random Fields.

Distributional Random Forests: Heterogeneity Adjustment and Multivariate Distributional Regression

FeatureForest: the power of foundation models, the usability of random forests

BLB-gcForest: A High-Performance Distributed Deep Forest with Adaptive Sub-Forest Splitting

DRWS: A Model for Learning Distributed Representations for Words and Sentences.