Abstract:The multicore evolution has stimulated renewed interests in scaling up applications on shared-memory multiprocessors, significantly improving the scalability of many applications. But the scalability is limited within a single node; therefore programmers still have to redesign applications to scale out over multiple nodes. This paper revisits the design and implementation of distributed shared memory (DSM) as a way to scale out applications optimized for non-uniform memory access (NUMA) architecture over a well-connected cluster. This paper presents MAGI, an efficient DSM system that provides a transparent shared address space with scalable performance on a cluster with fast network interfaces. MAGI is unique in that it presents a NUMA abstraction to fully harness the multicore resources in each node through hierarchical synchronization and memory management. MAGI also exploits the memory access patterns of big-data applications and leverages a set of optimizations for remote direct memory access (RDMA) to reduce the number of page faults and the cost of the coherence protocol. MAGI has been implemented as a user-space library with pthread-compatible interfaces and can run existing multithreaded applications with minimized modifications. We deployed MAGI over an 8-node RDMAenabled cluster. Experimental evaluation shows that MAGI achieves up to 9.25x speedup compared with an unoptimized implementation, leading to a scalable performance for large-scale data-intensive applications.

The ganglia distributed monitoring system: design, implementation, and experience

Realtime monitoring for the next generation of radiotelescopes

The Design and Implementation of Scalable Information Services in a Grid Environment

Multi-discipline computations and collaborative visualization on the campus grid

A Way to Improve the Performance of Integrated Real-Time Monitoring System in Power Grid by Distributed Shared Memory Technology

A DHT-based grid monitoring system

Aocms: an Adaptive and Scalable Monitoring System for Large-Scale Clusters

Supporting automatic deployment of monitoring service in grid environment

An Agent-based Grid Monitoring System Featuring Dynamic and On-demand Sensor Deployment and Management

MASS STORAGE SYSTEM PERFORMANCE MANAGEMENT AND MONITORING METHODS RESEARCH

GANGA: a user-Grid interface for Atlas and LHCb

Design and Implementation of Scalable Grid Monitor System

Design and Implementation of Distributed Electric Power Monitoring Experiment System Based on Grid Computing

Grid-based Approaches for Distributed Data Mining Applications

A Mechanism of Automated Monitoring Deployment in Grid Environment.

Scaling out NUMA-Aware Applications with RDMA-Based Distributed Shared Memory

WBCMon: A Research and Implementation of the Web-based Monitoring System for Cluster

Towards a Uniform Monitoring Framework Supporting Interoperability in Grid

MANETs monitoring with a distributed hybrid architecture

A Design of Distributed Directory Service Based on GMA

The Node Management in a Geospatial Data Grid