Optimization of Cluster Resource Fuzzy Clustering Partition Algorithm for Cloud Computing

DONG Shi-long,CHEN Ning-jiang,TAN Ying,HE Zi-long,ZHU Li-rong
DOI: https://doi.org/10.11896/j.issn.1002-137X.2014.09.020
2014-01-01
Computer Science
Abstract:The classic fuzzy clustering serial algorithm has the problems of heavy computation and low efficiency in dealing with high dimensional matrix operations,so it can't be applied effectively into the fuzzy clustering partition model in cloud computing environment,and it's hard to meet the time efficiency requirement of resource scheduling.Therefore,a transitive closure method was optimized based on the equivalence relation-based fuzzy clustering algorithm.What's more,a fuzzy clustering concurrent algorithm based on multi-threading for cloud resources was applied to the improvement strategies for Hadoop scheduler.The experimental results indicate that the optimization strategy can reduce the computation for solving square-based fuzzy equivalent matrix problem.Moreover,the concurrent algorithm can effectively solve the computation bottleneck of resource clustering on small and medium-sized clusters,and it has a better speed-up ratio.To solve the problem of heterogeneity which exists in the existing Hadoop schedulers,theoretical analyses of the concurrent optimization algorithm show that it can help to solve scheduling problems caused by heterogeneity.
What problem does this paper attempt to address?