No General Code of Ethics for All: Ethical Considerations in Human-bot Psycho-counseling

Lizhi Ma,Tong Zhao,Huachuan Qiu,Zhenzhong Lan
2024-04-22
Abstract:The pervasive use of AI applications is increasingly influencing our everyday decisions. However, the ethical challenges associated with AI transcend conventional ethics and single-discipline approaches. In this paper, we propose aspirational ethical principles specifically tailored for human-bot psycho-counseling during an era when AI-powered mental health services are continually emerging. We examined the responses generated by EVA2.0, GPT-3.5, and GPT-4.0 in the context of psycho-counseling and mental health inquiries. Our analysis focused on standard psycho-counseling ethical codes (respect for autonomy, non-maleficence, beneficence, justice, and responsibility) as well as crisis intervention strategies (risk assessment, involvement of emergency services, and referral to human professionals). The results indicate that although there has been progress in adhering to regular ethical codes as large language models (LLMs) evolve, the models' capabilities in handling crisis situations need further improvement. Additionally, we assessed the linguistic quality of the generated responses and found that misleading responses are still produced by the models. Furthermore, the ability of LLMs to encourage individuals to introspect in the psycho-counseling setting remains underdeveloped.
Human-Computer Interaction,Computers and Society
What problem does this paper attempt to address?
The paper attempts to address the ethical challenges faced when using AI chatbots in psychological counseling services. Specifically, the paper focuses on the following aspects: 1. **Lack of specialized ethical guidelines**: Existing general ethical guidelines are insufficient to adequately guide human-machine interactions in psychological counseling services, especially when dealing with complex situations such as crisis intervention. 2. **Ethical performance of language models**: The paper evaluates the ethical performance of several large language models (such as EVA2.0, GPT-3.5, and GPT-4.0) in psychological counseling services, particularly in routine interventions and crisis interventions. 3. **Limitations of language models**: The study finds that although these models perform well in certain aspects, they still have shortcomings in handling crisis situations, providing accurate information, maintaining the relevance of the conversation, and clearly disclosing their AI identity. 4. **Proposal of an ethical evaluation framework**: The paper proposes an ethical evaluation framework for human-machine psychological counseling services, including principles such as respect for autonomy, non-maleficence, beneficence, fairness, and responsibility, and defines specific operational standards for these principles in detail. Through these studies, the paper aims to provide more specific ethical guidance for the application of artificial intelligence in psychological counseling services to ensure that these technologies can serve users safely and effectively.