Abstract:We investigate privacy-preserving, video-based action recognition in deep learning, a problem with growing importance in smart camera applications. A novel adversarial training framework is formulated to learn an anonymization transform for input videos such that the trade-off between target utility task performance and the associated privacy budgets is explicitly optimized on the anonymized videos. Notably, the privacy budget, often defined and measured in task-driven contexts, cannot be reliably indicated using any single model performance because strong protection of privacy should sustain against any malicious model that tries to steal private information. To tackle this problem, we propose two new optimization strategies of model restarting and model ensemble to achieve stronger universal privacy protection against any attacker models. Extensive experiments have been carried out and analyzed. On the other hand, given few public datasets available with both utility and privacy labels, the data-driven (supervised) learning cannot exert its full power on this task. We first discuss an innovative heuristic of cross-dataset training and evaluation, enabling the use of multiple single-task datasets (one with target task labels and the other with privacy labels) in our problem. To further address this dataset challenge, we have constructed a new dataset, termed PA-HMDB51, with both target task labels (action) and selected privacy attributes (skin color, face, gender, nudity, and relationship) annotated on a per-frame basis. This first-of-its-kind video dataset and evaluation protocol can greatly facilitate visual privacy research and open up other opportunities. Our codes, models, and the PA-HMDB51 dataset are available at <a class="link-external link-https" href="https://github.com/VITA-Group/PA-HMDB51" rel="external noopener nofollow">this https URL</a>.

CL-Shield: A Continuous Learning System for Protecting User Privacy

RECL: Responsive Resource-Efficient Continuous Learning for Video Analytics

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Adaptive Streaming Continuous Learning System for Video Analytics

A Comprehensive Study of Privacy Risks in Curriculum Learning

Efficient Task-driven Video Data Privacy Protection for Smart Camera Surveillance System

Enhancing Video Surveillance and Behavior Recognition With Deep Learning While Ensuring Privacy Protection

Safeguarding Data in Multimodal AI: A Differentially Private Approach to CLIP Training

CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Search

Privacy-preserving video fall detection using visual shielding information

TS-ACL: A Time Series Analytic Continual Learning Framework for Privacy-Preserving and Class-Incremental Pattern Recognition

An Efficient Privacy Protection Scheme for Data Security in Video Surveillance.

Privacy-Preserving Deep Action Recognition: An Adversarial Learning Framework and A New Dataset

Learning to Prevent Input Leakages in the Mobile Cloud Inference

Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

Learning to Anonymize Faces for Privacy Preserving Action Detection

CausalVE: Face Video Privacy Encryption via Causal Video Prediction

Towards Privacy-Preserving Visual Recognition via Adversarial Training: A Pilot Study

Fawkes: Protecting Privacy against Unauthorized Deep Learning Models

Visor: Privacy-Preserving Video Analytics as a Cloud Service