Abstract:The surging demand for cloud computing resources, driven by the rapid growth of sophisticated large-scale models and data centers, underscores the critical importance of efficient and adaptive resource allocation. As major tech enterprises deploy massive infrastructures with thousands of GPUs, existing cloud platforms still struggle with low resource utilization due to key challenges: capturing hierarchical indicator structures, modeling non-Gaussian distributions, and decision-making under uncertainty. To address these challenges, we propose HRAMONY, an adaptive Hierarchical Attention-based Resource Modeling and Decision-Making System. HARMONY combines hierarchical multi-indicator distribution forecasting and uncertainty-aware Bayesian decision-making. It introduces a novel hierarchical attention mechanism that comprehensively models complex inter-indicator dependencies, enabling accurate predictions that can adapt to evolving environment states. By transforming Gaussian projections into adaptive non-Gaussian distributions via Normalizing Flows. Crucially, HARMONY leverages the full predictive distributions in an adaptive Bayesian process, proactively incorporating uncertainties to optimize resource allocation while robustly meeting SLA constraints under varying conditions. Extensive evaluations across four large-scale cloud datasets demonstrate HARMONY's state-of-the-art performance, significantly outperforming nine established methods. A month-long real-world deployment validated HARMONY's substantial practical impact, realizing over 35,000 GPU hours in savings and translating to $100K+ in cost reduction, showcasing its remarkable economic value through adaptive, uncertainty-aware scaling. Our code is available at <a class="link-external link-https" href="https://github.com/Floating-LY/HARMONY1" rel="external noopener nofollow">this https URL</a>.

CloudHeatMap: Heatmap-Based Monitoring for Large-Scale Cloud Systems

Visual Analysis of Cloud Computing Performance Using Behavioral Lines

Machine Learning Algorithms for Active Monitoring of High Performance Computing as a Service (HPCaaS) Cloud Environments

Research on Heatmap for Big Data Based on Spark

On Challenges of Cloud Monitoring

CloudDet: Interactive Visual Analysis of Anomalous Performances in Cloud Computing Systems

Heatmapper: web-enabled heat mapping for all

Web-based Visualization and Analytics of Petascale data: Equity as a Tide that Lifts All Boats

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

JTangCMS: an Efficient Monitoring System for Cloud Platforms.

Application-aware latency monitoring for cloud tenants via CloudWatch+

Save It for the "Hot" Day: An LLM-Empowered Visual Analytics System for Heat Risk Management

Dynamic heatmap pyramid computation for massive high-parallel spatial streaming in urban environments

Evaluation of a new visualization and analytics solution for slow control data for large scale experiments

A System for Exploratory Analysis in Cloud

Data-Intensive Supercomputing in the Cloud: Global Analytics for Satellite Imagery

MonValley: an Unified Monitoring and Management Framework for Cloud Services

CWD: A Machine Learning based Approach to Detect Unknown Cloud Workloads

Intelligent Monitoring Framework for Cloud Services: A Data-Driven Approach

Adaptive Two-Stage Cloud Resource Scaling via Hierarchical Multi-Indicator Forecasting and Bayesian Decision-Making

Anomaly Detection in Large-Scale Cloud Systems: An Industry Case and Dataset