Towards Resource Allocation Optimization for Big Data Test Field Application

BAI Ru-fan,LEI Jian-kun,ZHANG Liang
DOI: https://doi.org/10.3785/j.issn.1008-973x.2017.06.021
2017-01-01
Abstract:A two-phase optimization resource allocation solution was proposed to ensure fair and efficient allocation and meet the multiple users' requirement, who applied for limited resources.First, the trade-off point in term of performance and resources for each type of application was determined automatically according to prevous logs.Then, according to the Dominant Resource Fairness principle, the number of instances that could be put into operation was automatically determined for each class of application to realize implement global optimized allocation.Therefore, characterastics like sharing incentive, strategy-proofness, envy-freeness and Pareto equilibrium on the system level were reflected.The solution's generality was validated using the Clik+ benchmark package with Docker containers as operating environment.Results demonstrate that the two-phase optimization resource allocation solution can improve resource utilization, which can also optimize resource configuration when several users apply for resources simultaneously.Moreover, the feasibility and effectiveness of the proposed program was simulated and validated.
What problem does this paper attempt to address?