Abstract:Cancer patients often struggle to transition swiftly to treatment due to limited institutional resources, lack of sophisticated professional guidance, and low health literacy. The emergence of Large Language Models (LLMs) offers new opportunities for such patients to access the wealth of existing patient education materials. The current paper presents the development process for an LLM-based chatbot focused on prostate cancer education, including needs assessment, co-design, and usability studies. The resulting application, MedEduChat, integrates with patients' electronic health record data and features a closed-domain, semi-structured, patient-centered approach to address real-world needs. This paper contributes to the growing field of patient-LLM interaction by demonstrating the potential of LLM-based chatbots to enhance prostate cancer patient education and by offering co-design guidelines for future LLM-based healthcare downstream applications.

What problem does this paper attempt to address?

### Problems the Paper Aims to Address This paper aims to address a series of challenges faced by prostate cancer patients in terms of education and support. Specifically: 1. **Current Challenges in Prostate Cancer Patient Education**: - Patients often struggle to transition quickly to the treatment phase due to a lack of institutional resources, insufficient professional guidance, and low health literacy. - Current cancer treatment plans often lack comprehensive and timely educational components, leaving patients without the necessary support during these challenging and stressful times. 2. **Patients' Need for Information and Social Support**: - Patients need to understand the specific details of potential biomedical treatments, as well as receive psychological and social support. - Due to the limited time and capacity of clinical professionals within the healthcare system, patients find it difficult to have sufficient conversations with them to understand personal and cognitive needs. 3. **Potential Application of Large Language Models (LLM) in Patient Education**: - LLM can serve as a conversational companion for patients, providing medical information and emotional support. - Utilizing LLM's capabilities in information summarization, explanation, and real-time interaction, personalized chatbots can be developed to respond to patient inquiries. 4. **Research Questions**: - **RQ1**: What are the current challenges in prostate cancer patient education? - **RQ2**: How can we collaborate with patients, AI practitioners, and medical experts to design and develop LLM-based educational tools? - **RQ3**: Can LLM-based chatbots enhance the educational experience of prostate cancer patients? To answer these questions, the paper undertakes the following tasks: - **Needs Assessment Survey**: Conducting a survey among prostate cancer patients currently using e-learning modules to understand their educational needs and experiences. - **Co-Design Study**: Collaborating with clinical professionals, AI researchers, and patient advocates to develop design guidelines for an LLM-based chatbot. - **Usability Study**: Evaluating the effectiveness of the chatbot through usability testing with 7 patients and feedback from 3 clinical professionals. ### Main Contributions 1. **Identifying Current Challenges and Scenarios**: Clarifying the challenges and specific scenarios faced by prostate cancer patients in the educational process. 2. **Co-Design Process**: Designing a patient-centered, closed-domain, semi-structured cancer education chatbot (MedEduChat) through multidisciplinary team collaboration. 3. **Effectiveness Evaluation**: Validating the effectiveness of the chatbot in patient education through feedback from actual patients and evaluations by clinical professionals. In summary, this paper demonstrates the potential of LLM-based chatbots in prostate cancer patient education through a comprehensive design and evaluation approach and proposes directions for future research.

Outlining the Borders for LLM Applications in Patient Education: Developing an Expert-in-the-Loop LLM-Powered Chatbot for Prostate Cancer Patient Education

Learnings from a Large-Scale Deployment of an LLM-Powered Expert-in-the-Loop Healthcare Chatbot

The Emerging Role of Large Language Models in Improving Prostate Cancer Literacy

Leveraging LLM: Implementing an Advanced AI Chatbot for Healthcare

Performance of large language models (LLMs) in providing prostate cancer information

An LLM-Driven Chatbot in Higher Education for Databases and Information Systems

Prompt matters: evaluation of large language model chatbot responses related to Peyronie's disease

Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

Prompt matters: evaluation of large language model chatbot responses related to Peyronie’s disease

Leveraging Large Language Model as Simulated Patients for Clinical Education

Design of an Educational Chatbot Using Artificial Intelligence in Radiotherapy

An artificial intelligence-based chatbot for prostate cancer education: Design and patient evaluation study

LLM-empowered Chatbots for Psychiatrist and Patient Simulation: Application and Evaluation

Enhancing Clinical Accuracy of Medical Chatbots with Large Language Models

Can Large Language Models Aid Caregivers of Pediatric Cancer Patients in Information Seeking? A Cross-Sectional Investigation

Ethical Considerations in Human-Centered AI: Advancing Oncology Chatbots Through Large Language Models

ChatGPT as a Tool for Medical Education and Clinical Decision-Making on the Wards: Case Study

CataractBot: An LLM-Powered Expert-in-the-Loop Chatbot for Cataract Patients

The use of large language models to enhance cancer clinical trial educational materials

Testing and Validation of a Custom Trained Large Language Model for HN Patients with Guardrails

Evaluating the Efficacy of AI Chatbots as Tutors in Urology: A Comparative Analysis of Responses to the 2022 In-Service Assessment of the European Board of Urology