Abstract:Distributed systems store data objects redundantly to balance the data access load over multiple nodes. Load balancing performance depends mainly on 1) the level of storage redundancy and 2) the assignment of data objects to storage nodes. We analyze the performance implications of these design choices by considering four practical storage schemes that we refer to as clustering, cyclic, block and random design. We formulate the problem of load balancing as maintaining the load on any node below a given threshold. Regarding the level of redundancy, we find that the desired load balance can be achieved in a system of $n$ nodes only if the replication factor $d = \Omega(\log(n)^{1/3})$, which is a necessary condition for any storage design. For clustering and cyclic designs, $d = \Omega(\log(n))$ is necessary and sufficient. For block and random designs, $d = \Omega(\log(n))$ is sufficient but unnecessary. Whether $d = \Omega(\log(n)^{1/3})$ is sufficient remains open. The assignment of objects to nodes essentially determines which objects share the access capacity on each node. We refer to the number of nodes jointly shared by a set of objects as the \emph{overlap} between those objects. We find that many consistently slight overlaps between the objects (block, random) are better than few but occasionally significant overlaps (clustering, cyclic). However, when the demand is ''skewed beyond a level'' the impact of overlaps becomes the opposite. We derive our results by connecting the load-balancing problem to mathematical constructs that have been used to study other problems. For a class of storage designs containing the clustering and cyclic design, we express load balance in terms of the maximum of moving sums of i.i.d. random variables, which is known as the scan statistic. For random design, we express load balance by using the occupancy metric for random allocation with complexes.

On Distributed Storage Allocations for Memory-Limited Systems

Symmetric Allocations for Distributed Storage

Storage Allocation for Multi-Class Distributed Data Storage Systems

Study on Reduced Space SQP Algorithm Based on Limited Memory Method

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Fast Centralized Integer Resource Allocation Algorithm and Its Distributed Extension over Digraphs

Distributed storage allocations for neighborhood-based data access

Tradeoff for Heterogeneous Distributed Storage Systems between Storage and Repair Cost

Distributed storage algorithms with optimal tradeoffs

A Dual Splitting Algorithm For Distributed Resource Allocation Problems

Special Focus on Distributed Storage Coding.

Optimal Storage Allocation for Wireless Cloud Caching Systems with a Limited Sum Storage Capacity

Cross-object Coding and Allocation (COCA) for Distributed Storage Systems

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Controlling Data Access Load in Distributed Systems

Joint Storage Assignment for D2d Offloading Systems

A Distributed Storage Model for Sensor Networks

DAO2: Overcoming Overall Storage Overflow in Intermittently Connected Sensor Networks

Storage, Communication, and Load Balancing Trade-off in Distributed Cache Networks

Dynamic discretization discovery under hard node storage constraints

Latency optimal storage and scheduling of replicated fragments for memory-constrained servers