Abstract:Data confidentiality is becoming a significant concern, especially in the cloud computing era. Memory access patterns have been demonstrated to leak critical information such as security keys and a program's spatial and temporal information. This information leak poses an even more significant privacy challenge in machine learning models with embedding tables. Embedding tables are routinely used to learn categorical features from training data. Even knowing the locations of the embedding table entries accessed, not the data within the embedding table, will compromise categorical input data to the model. Embedding entries are privacy-sensitive since they disclose valuable properties about the user. Oblivious RAM (ORAM), and its enhanced variants such as PathORAM have emerged as viable solutions to hide leakage from memory access streams. In this work, we present LAORAM, an ORAM framework explicitly designed to protect user privacy during embedding table training. LAORAM exploits the unique property of training, the training samples used in the future are known beforehand. LAORAM preprocesses the training samples to identify the memory blocks which are accessed together in the near future. The system tries to assign these blocks to as few paths as possible within the PathORAM infrastructure. LAORAM does this operation by combining multiple blocks accessed together as superblocks. To further increase performance, LAORAM uses a fat-tree structure for PathORAM reducing the number of background evictions required, which improves the stash usage. We have evaluated LAORAM using both a recommendation model (DLRM) and a NLP model (XLM-R) embedding table configurations. LAORAM performs 5 times faster than PathORAM on a recommendation dataset (Kaggle) and 5.4x faster on a NLP dataset (XNLI), while guaranteeing the same security guarantees as the original PathORAM.

NeuralD: Detecting Indistinguishability Violations of Oblivious RAM With Neural Distinguishers

DRAMD: Detect Advanced DRAM-based Stealthy Communication Channels with Neural Networks

Etoram: A More Efficient ORAM for Secure Computation

Security Enhancement for RRAM Computing System through Obfuscating Crossbar Row Connections

On-line Fault Protection for ReRAM-based Neural Networks

A Practical Oblivious Map Data Structure with Secure Deletion and History Independence

SqORAM: Read-Optimized Sequential Write-Only Oblivious RAM

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

DivORAM: Towards a Practical Oblivious RAM with Variable Block Size

Shadow Block: Accelerating ORAM Accesses with Data Duplication

The Inherent Adversarial Robustness of Analog In-Memory Computing

LAORAM: A Look Ahead ORAM Architecture for Training Large Embedding Tables

Fork Path: Improving Efficiency Of Oram By Removing Redundant Memory Accesse

Flat ORAM: A Simplified Write-Only Oblivious RAM Construction for Secure Processors

H$_2$O$_2$RAM: A High-Performance Hierarchical Doubly Oblivious RAM

Palermo: Improving the Performance of Oblivious Memory using Protocol-Hardware Co-Design

The Pyramid Scheme: Oblivious RAM for Trusted Processors

Fast ORAM with server-aided preprocessing and pragmatic privacy-efficiency trade-off

Bayesian Neural Network Realization by Exploiting Inherent Stochastic Characteristics of Analog RRAM

OBI: a multi-path oblivious RAM for forward-and-backward-secure searchable encryption

Memory Backdoor Attacks on Neural Networks