Abstract:Data confidentiality is becoming a significant concern, especially in the cloud computing era. Memory access patterns have been demonstrated to leak critical information such as security keys and a program's spatial and temporal information. This information leak poses an even more significant privacy challenge in machine learning models with embedding tables. Embedding tables are routinely used to learn categorical features from training data. Even knowing the locations of the embedding table entries accessed, not the data within the embedding table, will compromise categorical input data to the model. Embedding entries are privacy-sensitive since they disclose valuable properties about the user. Oblivious RAM (ORAM), and its enhanced variants such as PathORAM have emerged as viable solutions to hide leakage from memory access streams. In this work, we present LAORAM, an ORAM framework explicitly designed to protect user privacy during embedding table training. LAORAM exploits the unique property of training, the training samples used in the future are known beforehand. LAORAM preprocesses the training samples to identify the memory blocks which are accessed together in the near future. The system tries to assign these blocks to as few paths as possible within the PathORAM infrastructure. LAORAM does this operation by combining multiple blocks accessed together as superblocks. To further increase performance, LAORAM uses a fat-tree structure for PathORAM reducing the number of background evictions required, which improves the stash usage. We have evaluated LAORAM using both a recommendation model (DLRM) and a NLP model (XLM-R) embedding table configurations. LAORAM performs 5 times faster than PathORAM on a recommendation dataset (Kaggle) and 5.4x faster on a NLP dataset (XNLI), while guaranteeing the same security guarantees as the original PathORAM.

Bulkor: Enabling Bulk Loading for Path ORAM

Fork Path: Batching ORAM Requests to Remove Redundant Memory Accesses

Fork Path: Improving Efficiency Of Oram By Removing Redundant Memory Accesse

Etoram: A More Efficient ORAM for Secure Computation

Palermo: Improving the Performance of Oblivious Memory using Protocol-Hardware Co-Design

Optimizing TLB for Access Pattern Privacy Protection in Data Outsourcing.

DivORAM: Towards a Practical Oblivious RAM with Variable Block Size

Hitchhiker: Accelerating ORAM with Dynamic Scheduling

Single Round-trip Hierarchical ORAM via Succinct Indices

Efficient ORAM Based on Binary Tree without Data Overflow and Evictions.

LAORAM: A Look Ahead ORAM Architecture for Training Large Embedding Tables

SqORAM: Read-Optimized Sequential Write-Only Oblivious RAM

A rORAM scheme with logarithmic bandwidth and logarithmic locality

Flat ORAM: A Simplified Write-Only Oblivious RAM Construction for Secure Processors

Shadow Block: Accelerating ORAM Accesses with Data Duplication

Fast ORAM with server-aided preprocessing and pragmatic privacy-efficiency trade-off

Optimal Offline ORAM with Perfect Security via Simple Oblivious Priority Queues

OBI: a multi-path oblivious RAM for forward-and-backward-secure searchable encryption

Reo: Enhancing Reliability and Efficiency of Object-based Flash Caching

A Practical Oblivious Map Data Structure with Secure Deletion and History Independence

Opca: Enabling Optimistic Concurrent Access for Multiple Users in Oblivious Data Storage