Abstract:With Dynamic Resource Management (DRM) the resources assigned to a job can be changed dynamically during its execution. From the system's perspective, DRM opens a new level of flexibility in resource allocation and job scheduling and therefore has the potential to improve system efficiency metrics such as the utilization rate, job throughput, energy efficiency, and responsiveness. From the application perspective, users can tailor the resources they request to their needs offering potential optimizations in queuing time or charged costs. Despite these obvious advantages and many attempts over the last decade to establish DRM in HPC, it remains a concept discussed in academia rather than being successfully deployed on production systems. This stems from the fact that support for DRM requires changes in all the layers of the HPC system software stack including applications, programming models, process managers, and resource management software, as well as an extensive and holistic co-design process to establish new techniques and policies for scheduling and resource optimization. In this work, we therefore start with the assumption that resources are accessible by processes executed either on them (e.g., on CPU) or controlling them (e.g., GPU-offloading). Then, the overall DRM problem can be decomposed into dynamic process management (DPM) and dynamic resource mapping or allocation (DRA). The former determines which processes (or which change in processes) must be managed and the latter identifies the resources where they will be executed. The interfaces for such \mbox{DPM/DPA} in these layers need to be standardized, which requires a careful design to be interoperable while providing high flexibility. Based on a survey of existing approaches we propose design principles, that form the basis of a holistic approach to DMR in HPC and provide a prototype implementation using MPI.

Scalable Resource Management And Load Assignment For Grid And Peer-To-Peer Services

Sdrd: A Novel Approach To Resource Discovery In Grid Environments

A scalable resource discovery model in grids

The Design and Implementation of Distributed Resource Manager in Optical Grid Networks

A Distributed Grid Resource Management Model of P2P-based

Distributed Resource Discovery Model Based on Modified DHT

Distributed Resource Discovery in the Machine-to-Machine Applications

Decentralized Grid Resource Discovery Based on Resource Information Community

Scalable DHT- and Ontology-Based Information Service for Large-Scale Grids

DIRSS-G: an Intelligent Resource Scheduling System for Grid Environment Based on Dynamic Pricing

An Effective Decentralized Organization Mechanism for Resources in Grid

Design Principles of Dynamic Resource Management for High-Performance Parallel Programming Models

Distributed Resource Directory Architecture in Machine-to-Machine Communications.

Distributed Grid Resource Registry Meta-Service: Design And Implementation

A Resource Discovery Algorithm With Probe Feedback Mechanism In Multi-Domain Grid Environment

3-Hierarchical Resource Management Model on Web Grid Service Architecture

Research on the Distributed Resource Discovery of Grid Computing

Resource Management Model and ResourceDiscovery Algorithm for P2PGrid

DRMS: Massive Digital Resource Management System Based on OSS

Comprehensive Analysis of Performance, Fault-Tolerance and Scalability in Grid Resource Management System

A Grid Resource Discovery Scheme Based on Resource Classification