Abstract:Data confidentiality is becoming a significant concern, especially in the cloud computing era. Memory access patterns have been demonstrated to leak critical information such as security keys and a program's spatial and temporal information. This information leak poses an even more significant privacy challenge in machine learning models with embedding tables. Embedding tables are routinely used to learn categorical features from training data. Even knowing the locations of the embedding table entries accessed, not the data within the embedding table, will compromise categorical input data to the model. Embedding entries are privacy-sensitive since they disclose valuable properties about the user. Oblivious RAM (ORAM), and its enhanced variants such as PathORAM have emerged as viable solutions to hide leakage from memory access streams. In this work, we present LAORAM, an ORAM framework explicitly designed to protect user privacy during embedding table training. LAORAM exploits the unique property of training, the training samples used in the future are known beforehand. LAORAM preprocesses the training samples to identify the memory blocks which are accessed together in the near future. The system tries to assign these blocks to as few paths as possible within the PathORAM infrastructure. LAORAM does this operation by combining multiple blocks accessed together as superblocks. To further increase performance, LAORAM uses a fat-tree structure for PathORAM reducing the number of background evictions required, which improves the stash usage. We have evaluated LAORAM using both a recommendation model (DLRM) and a NLP model (XLM-R) embedding table configurations. LAORAM performs 5 times faster than PathORAM on a recommendation dataset (Kaggle) and 5.4x faster on a NLP dataset (XNLI), while guaranteeing the same security guarantees as the original PathORAM.

Optimizing TLB for Access Pattern Privacy Protection in Data Outsourcing.

Fork Path: Batching ORAM Requests to Remove Redundant Memory Accesses

Opca: Enabling Optimistic Concurrent Access for Multiple Users in Oblivious Data Storage

Fork Path: Improving Efficiency Of Oram By Removing Redundant Memory Accesse

Hitchhiker: Accelerating ORAM with Dynamic Scheduling

Palermo: Improving the Performance of Oblivious Memory using Protocol-Hardware Co-Design

Reo: Enhancing Reliability and Efficiency of Object-based Flash Caching

SqORAM: Read-Optimized Sequential Write-Only Oblivious RAM

Optimal Offline ORAM with Perfect Security via Simple Oblivious Priority Queues

Shadow Block: Accelerating ORAM Accesses with Data Duplication

H$_2$O$_2$RAM: A High-Performance Hierarchical Doubly Oblivious RAM

A rORAM scheme with logarithmic bandwidth and logarithmic locality

Fast ORAM with server-aided preprocessing and pragmatic privacy-efficiency trade-off

Bulkor: Enabling Bulk Loading for Path ORAM

Etoram: A More Efficient ORAM for Secure Computation

Asymmetric-access aware optimization for STT-RAM caches with process variations.

A Practical Oblivious Map Data Structure with Secure Deletion and History Independence

NodeLeaper: Lower Overhead Oblivious AVL Tree

IRO: Integrity–Reliability enhanced Ring ORAM

LAORAM: A Look Ahead ORAM Architecture for Training Large Embedding Tables

Oblivious Demand Paging with Ring ORAM in RISC-V Trusted Execution Environments