Abstract:Large matrix multiplications are central to large-scale machine learning applications. These operations are often carried out on a distributed computing platform with a master server and multiple workers in the cloud operating in parallel. For such distributed platforms, it has been recently shown that coding over the input data matrices can reduce the computational delay, yielding a trade-off between recovery threshold, i.e., the number of workers required to recover the matrix product, and communication load, i.e., the total amount of data to be downloaded from the workers. In this paper, in addition to exact recovery requirements, we impose security and privacy constraints on the data matrices, and study the recovery threshold as a function of the communication load. We first assume that both matrices contain private information and that workers can collude to eavesdrop on the content of these data matrices. For this problem, we introduce a novel class of secure codes, referred to as secure generalized PolyDot (SGPD) codes, that generalize state-of-the-art non-secure codes for matrix multiplication. SGPD codes allow a flexible trade-off between recovery threshold and communication load for a fixed maximum number of colluding workers while providing perfect secrecy for the two data matrices. We then study a connection between secure matrix multiplication and private information retrieval. We specifically assume that one of the data matrices is taken from a public set known to all the workers. In this setup, the identity of the matrix of interest should be kept private from the workers. For this model, we present a variant of generalized PolyDot codes that can guarantee both secrecy of one matrix and privacy for the identity of the other matrix for the case of no colluding servers.

Efficient Recovery of a Shared Secret via Cooperation: Applications to SDMM and PIR

A Communication-Efficient Distributed Matrix Multiplication Scheme with Privacy, Security, and Resiliency

Private and Secure Distributed Matrix Multiplication With Flexible Communication Load

More is Merrier: Relax the Non-Collusion Assumption in Multi-Server PIR

Private and Secure Distributed Matrix Multiplication Schemes for Replicated or MDS-Coded Servers

Information-Theoretically Private Matrix Multiplication From MDS-Coded Storage

Secure Distributed Matrix Multiplication with Precomputation

Outsourcing Eigen-Decomposition and Singular Value Decomposition of Large Matrix to a Public Cloud

Minimizing Computation and Communication Costs of Two-Sided Secure Distributed Matrix Multiplication under Arbitrary Collusion Pattern

A Systematic Approach Towards Efficient Private Matrix Multiplication

EPP-DMM: An Efficient and Privacy-Protected Delegation Scheme for Matrix Multiplication

Reduce to the Max: A Simple Approach for Massive-Scale Privacy-Preserving Collaborative Network Measurements (Extended Version)

Efficient Generalized Selective Private Function Evaluation With Applications In Biometric Authentication

Sparsity and Privacy in Secret Sharing: A Fundamental Trade-Off

SOCI^+: An Enhanced Toolkit for Secure OutsourcedComputation on Integers

SOCI+: An Enhanced Toolkit for Secure Outsourced Computation on Integers

Private Multiple Linear Computation: A Flexible Communication-Computation Tradeoff

Sparse and Private Distributed Matrix Multiplication with Straggler Tolerance

Fully Privacy-Preserving Distributed Optimization Based on Secret Sharing

Verifiable inner product computation on outsourced database for authenticated multi-user data sharing

Efficient Algorithms for Secure Outsourcing of Bilinear Pairings