Abstract:The dynamic vision sensors or event-cameras are bio-inspired vision platforms with independent and asynchronous pixels. Their unique design enables a number of advantages over traditional RGB cameras, including high temporal resolution for capturing high speed motion without blur and high dynamic range for sensing under challenging lighting conditions. As the outputs of the event-cameras are discrete and asynchronous events, termed as event-streams, rather than traditional high-quality video frames, they are regarded as low privacy-intrusive. However, research on reconstruction from events has revealed that event-streams can be converted to high quality video frames by sophisticated reconstruction algorithms, so that the claim on privacy-preserving does not hold anymore. In this paper, we focus on the privacy issue of event-streams used in EV-based classification tasks and propose, EV-Perturb, an event-stream perturbation mechanism to protect event-streams from reconstruction attacks. EV-Perturb flips polarities of events in a random manner and the theoretical proof shows that it provides differential-private guarantee on the perturbed event-streams. We also evaluate the utility (classification accuracy) and privacy (video reconstruction error) of EV-Perturb on EV-based classification tasks with multiple publicly available datasets using deep learning models. In summary, this work has several technical contributions. First, by proposing EV-Perturb, we consider the privacy issue of event-streams under reconstruction attack, which is the first piece of work focusing on solving this specific privacy issue. The approach is based on randomized response, which is both efficient and effective, shown as our evaluation. We also provide a theoretical proof that EV-Perturb is differential-private and derive the strict privacy guarantee with respect to the probability of change. Lastly, the results of the extensive evaluations show that EV-Perturb is can effectively protect event-streams from reconstruction attacks while preserving comparable accuracy on classification.

Event Encryption: Rethinking Privacy Exposure for Neuromorphic Imaging

Event Encryption for Neuromorphic Vision Sensors: Framework, Algorithm, and Evaluation

Neuromorphic Encryption: Combining Speckle Correlography and Event Data for Enhanced Security

EM Eye: Characterizing Electromagnetic Side-channel Eavesdropping on Embedded Cameras

Privacy Protection of Sensitive Bioinformation Based on Event Cameras

Neuromorphic Imaging With Joint Image Deblurring and Event Denoising

Neuromorphic Imaging With Density-Based Spatiotemporal Denoising

Harnessing Noise for Materials Differentiation in Computational Neuromorphic Imaging

AnonyNoise: Anonymizing Event Data with Smart Noise to Outsmart Re-Identification and Preserve Privacy

Person Re-Identification without Identification via Event Anonymization

NeuroBiometric: an Eye Blink Based Biometric Authentication System Using an Event-Based Neuromorphic Vision Sensor

Event Probability Mask (EPM) and Event Denoising Convolutional Neural Network (EDnCNN) for Neuromorphic Cameras

Non-Uniform Exposure Imaging via Neuromorphic Shutter Control

EV-Perturb: Event-Stream Perturbation for Privacy-Preserving Classification with Dynamic Vision Sensors

NeuroZoom: Denoising and Super Resolving Neuromorphic Events and Spikes.

In situ cryptography in a neuromorphic vision sensor based on light-driven memristors

Neuromorphic Imaging and Classification with Graph Learning

Adversarial attacks on spiking convolutional neural networks for event-based vision

OpEnCam: Lensless Optical Encryption Camera