Abstract:Background: Artificial intelligence (AI)-based computer perception technologies (e.g., digital phenotyping and affective computing) promise to transform clinical approaches to personalized care in psychiatry and beyond by offering more objective measures of emotional states and behavior, enabling precision treatment, diagnosis, and symptom monitoring. At the same time, passive and continuous nature by which they often collect data from patients in non-clinical settings raises ethical issues related to privacy and self-determination. Little is known about how such concerns may be exacerbated by the integration of neural data, as parallel advances in computer perception, AI, and neurotechnology enable new insights into subjective states. Here, we present findings from a multi-site NCATS-funded study of ethical considerations for translating computer perception into clinical care and contextualize them within the neuroethics and neurorights literatures. Methods: We conducted qualitative interviews with patients ( n = 20), caregivers ( n = 20), clinicians ( n = 12), developers ( n = 12), and clinician developers ( n = 2) regarding their perspective toward using PC in clinical care. Transcripts were analyzed in MAXQDA using Thematic Content Analysis. Results: Stakeholder groups voiced concerns related to (1) perceived invasiveness of passive and continuous data collection in private settings; (2) data protection and security and the potential for negative downstream/future impacts on patients of unintended disclosure; and (3) ethical issues related to patients' limited versus hyper awareness of passive and continuous data collection and monitoring. Clinicians and developers highlighted that these concerns may be exacerbated by the integration of neural data with other computer perception data. Discussion: Our findings suggest that the integration of neurotechnologies with existing computer perception technologies raises novel concerns around dignity-related and other harms (e.g., stigma, discrimination) that stem from data security threats and the growing potential for reidentification of sensitive data. Further, our findings suggest that patients' awareness and preoccupation with feeling monitored via computer sensors ranges from hypo- to hyper-awareness, with either extreme accompanied by ethical concerns (consent vs. anxiety and preoccupation). These results highlight the need for systematic research into how best to implement these technologies into clinical care in ways that reduce disruption, maximize patient benefits, and mitigate long-term risks associated with the passive collection of sensitive emotional, behavioral and neural data.

From Therapy to Technological Enhancement: A Socio-Ethical Perspective

Striking the Balance: Embracing Technology While Upholding Humanistic Principles in Neurorehabilitation

Revolutionizing Human Augmentation: The Future of Neuroprosthetics and Brain-Computer Interface Technologies

Regulating the Use of Cognitive Enhancement: an Analytic Framework

The Ethical and Responsible Development and Application of Advanced Brain Machine Interfaces

Neuromodulation and memory: exploring ethical ramifications in memory modification treatment via implantable neurotechnologies

Enhanced Cognition, Enhanced Self? On Neuroenhancement and Subjectivity

The Social and Economic Impacts of Cognitive Enhancement

Ethical considerations for integrating multimodal computer perception and neurotechnology

Ethical considerations for the use of brain–computer interfaces for cognitive enhancement

Neurorights: The Debate About New Legal Safeguards to Protect the Mind

Pharmacological Human Enhancement: An Overview of the Looming Bioethical and Regulatory Challenges

The impact of neuroscience on society: cognitive enhancement in neuropsychiatric disorders and in healthy people

Restoration of neurological functions by neuroprosthetic technologies: future prospects and trends towards micro-, nano-, and biohybrid systems

Neurotechnologies, Ethics, and the Limits of Free Will

Understanding the Ethical Issues of Brain-Computer Interfaces (BCIs): A Blessing or the Beginning of a Dystopian Future?

Ethical Analysis on the Application of Neurotechnology for Human Augmentation in Physicians and Surgeons

Cognitive Enhancement: Unanswered Questions About Human Psychology and Social Behavior

Moral attitudes and willingness to induce cognitive enhancement and repair with brain stimulation

The Ethical Reflection on Enhancement Technology

Neurotechnologies for Human Cognitive Augmentation: Current State of the Art and Future Prospects