Abstract:Coded distributed computing (CDC), proposed by Li et al., offers significant potential for reducing the communication load in MapReduce computing systems. In the setting of the cascaded CDC that consisting of $K$ nodes, $N$ input files, and $Q$ output functions, the objective is to compute each output function through $s\geq 1$ nodes with a computation load $r\geq 1$, enabling the application of coding techniques during the Shuffle phase to achieve minimum communication load. However, a significant limitation in most existing cascaded CDC schemes is their demand for splitting the original data into an exponentially growing number of input files and requiring an exponentially large number of output functions, which imposes stringent requirements for implementation. In this paper, we focus on the cascaded case of $K/s\in\mathbb{N}$, deliberately designing the strategy of data placement and output functions assignment based on a grouping method, such that a low-complexity Shuffle strategy is achievable. The main advantages of the proposed scheme include: 1) the multicast gains equal to $(r+s-1)(1-1/s)$ and $r+s-1$ which is approximate to $r+s-1$ when $s$ is relatively large, and the communication load is quite approximate to or surprisingly better than the optimal state-of-the-art scheme proposed by Li et al.; 2) the proposed scheme requires significantly less number of input files and output functions; 3) all the operations are implemented over the minimum binary field $\mathbb{F}_2$ in the one-shot fashion. Finally, we derive a new converse bound for the cascaded CDC framework, under the given strategies of data placement and output functions assignment. We demonstrate that the communication load of the proposed scheme is order optimal within a factor of $2$; and is also approximately optimal when $K$ is sufficiently large for a given $r$.

2D-SAZD: A Novel 2D Coded Distributed Computing Framework for Matrix-Matrix Multiplication

A New Coding Scheme for Matrix-Vector Multiplication Via Universal Decodable Matrices.

Coded Computing for Resilient, Secure, and Privacy-Preserving Distributed Matrix Multiplication

Cross Subspace Alignment Codes for Coded Distributed Batch Computation

Coded Sparse Matrix Multiplication

Coded Distributed Computing: Fundamental Limits and Practical Challenges

Compressed Coded Distributed Computing

Asymptotically Optimal Coded Distributed Computing via Combinatorial Designs

Cascaded Coded Distributed Computing Schemes Based on Placement Delivery Arrays

Distributed Matrix Computations with Low-weight Encodings

Sharper Asymptotically Optimal CDC Schemes via Combinatorial Designs

Successive Approximation Coding for Distributed Matrix Multiplication

Variable Coded Batch Matrix Multiplication

A High Throughput Spatially Coupled Low Density Generator Matrix Coding System.

FLCD: A Flexible Low Complexity Design of Coded Distributed Computing

A Construction of Asymptotically Optimal Cascaded CDC Schemes via Combinatorial Designs

Breaking the Computational Bottleneck: Design of Near-Optimal High-Memory Spatially-Coupled Codes

Cascaded Code Distributed Computing With Low Complexity and Improved Flexibility

Multi-Dimensional Spatially-Coupled Code Design: Enhancing the Cycle Properties

Low overhead vector codes with combination property and zigzag decoding for edge‐aided computing in UAV network

Hierarchical Coded Matrix Multiplication in Heterogeneous Multihop Networks