Abstract:Large matrix multiplications are central to large-scale machine learning applications. These operations are often carried out on a distributed computing platform with a master server and multiple workers in the cloud operating in parallel. For such distributed platforms, it has been recently shown that coding over the input data matrices can reduce the computational delay, yielding a trade-off between recovery threshold, i.e., the number of workers required to recover the matrix product, and communication load, i.e., the total amount of data to be downloaded from the workers. In this paper, in addition to exact recovery requirements, we impose security and privacy constraints on the data matrices, and study the recovery threshold as a function of the communication load. We first assume that both matrices contain private information and that workers can collude to eavesdrop on the content of these data matrices. For this problem, we introduce a novel class of secure codes, referred to as secure generalized PolyDot (SGPD) codes, that generalize state-of-the-art non-secure codes for matrix multiplication. SGPD codes allow a flexible trade-off between recovery threshold and communication load for a fixed maximum number of colluding workers while providing perfect secrecy for the two data matrices. We then study a connection between secure matrix multiplication and private information retrieval. We specifically assume that one of the data matrices is taken from a public set known to all the workers. In this setup, the identity of the matrix of interest should be kept private from the workers. For this model, we present a variant of generalized PolyDot codes that can guarantee both secrecy of one matrix and privacy for the identity of the other matrix for the case of no colluding servers.

EVA-S3PC: Efficient, Verifiable, Accurate Secure Matrix Multiplication Protocol Assembly and Its Application in Regression

EPVM: efficient and publicly verifiable computation for matrix multiplication with privacy preservation

Privacy Preserving PCA for Multiparty Modeling

Secret Sharing based Secure Regressions with Applications

EPP-DMM: An Efficient and Privacy-Protected Delegation Scheme for Matrix Multiplication

SHAPER: A General Architecture for Privacy-Preserving Primitives in Secure Machine Learning.

VEPP:A Verifiable, Highly Efficient and Privacy-Preserving Protocol for Outsourcing Large Matrix Multiplication

Private and Secure Distributed Matrix Multiplication With Flexible Communication Load

Md-Vc(Matrix): an Efficient Scheme for Publicly Verifiable Computation of Outsourced Matrix Multiplication

An Efficient Matrix Multiplication with Enhanced Privacy Protection in Cloud Computing and Its Applications

New Publicly Verifiable Computation for Batch Matrix Multiplication

Privacy preserving, verifiable and efficient outsourcing algorithm for matrix multiplication to a malicious cloud server

BYEE: Batch Fully Private Scheme for Coded Distributed Matrix Multiplication.

Research on the Secure Multi-Party Computation of Some Linear Algebra Problems

SecureML: A System for Scalable Privacy-Preserving Machine Learning

A Systematic Approach Towards Efficient Private Matrix Multiplication

Efficient Mixed-Protocol Secure Four-Party Computation with Private Robustness

A Communication-Efficient Distributed Matrix Multiplication Scheme with Privacy, Security, and Resiliency

Information-Theoretically Private Matrix Multiplication From MDS-Coded Storage

Secure Multiparty Matrix Multiplication Based on Strassen-Winograd Algorithm

Publicly Verifiable Delegation of Matrix Operation