Abstract:Background: High-resolution medical images that include facial regions can be used to recognize the subject's face when reconstructing 3-dimensional (3D)-rendered images from 2-dimensional (2D) sequential images, which might constitute a risk of infringement of personal information when sharing data. According to the Health Insurance Portability and Accountability Act (HIPAA) privacy rules, full-face photographic images and any comparable image are direct identifiers and considered as protected health information. Moreover, the General Data Protection Regulation (GDPR) categorizes facial images as biometric data and stipulates that special restrictions should be placed on the processing of biometric data. Objective: This study aimed to develop software that can remove the header information from Digital Imaging and Communications in Medicine (DICOM) format files and facial features (eyes, nose, and ears) at the 2D sliced-image level to anonymize personal information in medical images. Methods: A total of 240 cranial magnetic resonance (MR) images were used to train the deep learning model (144, 48, and 48 for the training, validation, and test sets, respectively, from the Alzheimer's Disease Neuroimaging Initiative [ADNI] database). To overcome the small sample size problem, we used a data augmentation technique to create 576 images per epoch. We used attention-gated U-net for the basic structure of our deep learning model. To validate the performance of the software, we adapted an external test set comprising 100 cranial MR images from the Open Access Series of Imaging Studies (OASIS) database. Results: The facial features (eyes, nose, and ears) were successfully detected and anonymized in both test sets (48 from ADNI and 100 from OASIS). Each result was manually validated in both the 2D image plane and the 3D-rendered images. Furthermore, the ADNI test set was verified using Microsoft Azure's face recognition artificial intelligence service. By adding a user interface, we developed and distributed (via GitHub) software named "Deface program" for medical images as an open-source project. Conclusions: We developed deep learning-based software for the anonymization of MR images that distorts the eyes, nose, and ears to prevent facial identification of the subject in reconstructed 3D images. It could be used to share medical big data for secondary research while making both data providers and recipients compliant with the relevant privacy regulations.

PyFaceWipe: a new defacing tool for almost any MRI contrast

A face-off of MRI research sequences by their need for de-facing

DeepDefacer: Automatic Removal of Facial Features via U-Net Image Segmentation

Assessing the Impact of Defacing Algorithms on Brain Volumetry Accuracy in MRI Analyses

Defacing biases visual quality assessments of structural MRI

Fast refacing of MR images with a generative neural network lowers re‐identification risk and preserves volumetric consistency

Fast refacing of MR images with a generative neural network lowers re-identification risk and preserves volumetric consistency

De-Identification of Facial Features in Magnetic Resonance Images: Software Development Using Deep Learning Technology

Obscuring surface anatomy in volumetric imaging data

Quality Assessment of Brain MRI Defacing Using Machine Learning

Implementation and validation of face de‐identification (de‐facing) in ADNI4

De‐identification procedures for magnetic resonance images and the impact on structural brain measures at different ages

Face recognition from research brain PET: An unexpected PET problem

De-Identification of Medical Imaging Data: A Comprehensive Tool for Ensuring Patient Privacy

Anonymization and validation of three-dimensional volumetric renderings of computed tomography data using commercially available T1-weighted magnetic resonance imaging-based algorithms

Re-identification of anonymised MRI head images with publicly available software: investigation of the current risk to patient privacy

Reduction of artifacts in susceptibility-weighted MR venography of the brain.

A Method for Efficient De-identification of DICOM Metadata and Burned-in Pixel Text

Pyclipse, a library for deidentification of free-text clinical notes

Deepfakes for Medical Video De-Identification: Privacy Protection and Diagnostic Information Preservation

Motion Artifact Removal in Pixel-Frequency Domain via Alternate Masks and Diffusion Model