Investigating the Key Success Factors of Chatbot-Based Positive Psychology Intervention with Retrieval- and Generative Pre-Trained Transformer (GPT)-Based Chatbots
Ivan LiuFangyuan LiuYuting XiaoYajia HuangShuming WuShiguang Nia Department of Psychology,Faculty of Arts and Science,Beijing Normal University at Zhuhai,Chinab Faculty of Psychology,Beijing Normal University,Chinac Shenzhen International Graduate School,Tsinghua University,ChinaIvan Liu is a researcher and lecturer at the Department of Psychology,Faculty of Arts and Science,Beijing Normal University at Zhuhai,China. His research focuses on artificial intelligence,large language models,chatbots,affective computing,multimodal emotion recognition,and positive psychology.Fangyuan Liu is an undergraduate student in the Department of Psychology,Faculty of Arts and Science,Beijing Normal University at Zhuhai,China. Her research interests include multimodal emotion recognition,AI agents,and psychology.Yuting Xiao is a postgraduate student in the Faculty of Psychology at Beijing Normal University,China. Her research interests include positive psychological intervention,generative chatbots,large language models,and natural language processing.Yajia Huang,MSc,graduated from the Faculty of Psychology at Beijing Normal University,China. She works as a human factors engineer in the vehicle engineering department for an electric car manufacturer in Shanghai,China.Shuming Wu is a postgraduate student in the Faculty of Psychology at Beijing Normal University,China. Her research interests include brand marketing,storytelling brand archetypes,natural language processing,and AIGC.Shiguang Ni is a professor at the Shenzhen International Graduate School,Tsinghua University. His research focuses on the human-computer interface,serious games,multimodal emotion recognition,and computational positive psychology.
DOI: https://doi.org/10.1080/10447318.2023.2300015
IF: 4.92
2024-01-08
International Journal of Human-Computer Interaction
Abstract:Technologically assisted methods have been extensively utilized in positive psychology interventions (PPIs), which aim to elevate the happiness levels of the widespread and diverse general public, a population that traditional methodologies struggle to comprehend and impact. Nevertheless, the literature provides insufficient insights into the effectiveness of chatbot-based PPIs (Chat-PPIs). This study endeavors to fill this void by employing both retrieval-based and generative pre-trained transformer (GPT)-based chatbots and executing three randomized controlled trials involving 326 participants to investigate the hypothesized effectiveness mechanisms. The statistical analysis affirms the effectiveness of Chat-PPI. Moreover, our results indicate that personalized PPI recommendations, adaptive multi-round dialogues, and real-time feedback significantly augment the efficacy of Chat-PPI. Besides exploring and confirming the mechanisms behind Chat-PPI, this study also endorses the use of generative chatbots, which, although less controllable, provide more natural interaction that can boost the efficacy of Chat-PPI.
computer science, cybernetics,ergonomics