Abstract:Background: Artificial intelligence (AI)-based computer perception technologies (e.g., digital phenotyping and affective computing) promise to transform clinical approaches to personalized care in psychiatry and beyond by offering more objective measures of emotional states and behavior, enabling precision treatment, diagnosis, and symptom monitoring. At the same time, passive and continuous nature by which they often collect data from patients in non-clinical settings raises ethical issues related to privacy and self-determination. Little is known about how such concerns may be exacerbated by the integration of neural data, as parallel advances in computer perception, AI, and neurotechnology enable new insights into subjective states. Here, we present findings from a multi-site NCATS-funded study of ethical considerations for translating computer perception into clinical care and contextualize them within the neuroethics and neurorights literatures. Methods: We conducted qualitative interviews with patients ( n = 20), caregivers ( n = 20), clinicians ( n = 12), developers ( n = 12), and clinician developers ( n = 2) regarding their perspective toward using PC in clinical care. Transcripts were analyzed in MAXQDA using Thematic Content Analysis. Results: Stakeholder groups voiced concerns related to (1) perceived invasiveness of passive and continuous data collection in private settings; (2) data protection and security and the potential for negative downstream/future impacts on patients of unintended disclosure; and (3) ethical issues related to patients' limited versus hyper awareness of passive and continuous data collection and monitoring. Clinicians and developers highlighted that these concerns may be exacerbated by the integration of neural data with other computer perception data. Discussion: Our findings suggest that the integration of neurotechnologies with existing computer perception technologies raises novel concerns around dignity-related and other harms (e.g., stigma, discrimination) that stem from data security threats and the growing potential for reidentification of sensitive data. Further, our findings suggest that patients' awareness and preoccupation with feeling monitored via computer sensors ranges from hypo- to hyper-awareness, with either extreme accompanied by ethical concerns (consent vs. anxiety and preoccupation). These results highlight the need for systematic research into how best to implement these technologies into clinical care in ways that reduce disruption, maximize patient benefits, and mitigate long-term risks associated with the passive collection of sensitive emotional, behavioral and neural data.

Beyond neural data: Cognitive biometrics and mental privacy

U.S. public perceptions of the sensitivity of brain data

Neurorights between ethical and legal implications

Privacy for Personal Neuroinformatics

Ethical considerations for integrating multimodal computer perception and neurotechnology

Advocating for neurodata privacy and neurotechnology regulation

A Mathematical Framework for the Problem of Security for Cognition in Neurotechnology

Privacy-Protecting Techniques for Behavioral Biometric Data: A Survey

Emerging Biometric Modalities and their Use: Loopholes in the Terminology of the GDPR and Resulting Privacy Risks

Emotional AI, soft biometrics and the surveillance of emotional life: An unusual consensus on privacy

Exploring Human Biometrics: A Focus on Security Concerns and Deep Neural Networks

The spectrum of data sharing policies in neuroimaging data repositories

Digital Biomarkers in Psychiatric Research: Data Protection Qualifications in a Complex Ecosystem

A Survey on Brain Biometrics

Towards a Governance Framework for Brain Data

Minding Rights: Mapping Ethical and Legal Foundations of 'Neurorights'

Privacy-Preserving Linear Regression for Brain-Computer Interface Applications.

Uncovering the Neural Processes of Privacy: A Neurally Informed Behavioral Intervention to Protect Information Privacy

Artificial Intelligence in Clinical Neuroscience: Methodological and Ethical Challenges

Machine learning for cognitive behavioral analysis: datasets, methods, paradigms, and research directions