AI as a Medical Ally: Evaluating ChatGPT's Usage and Impact in Indian Healthcare

Aryaman Raina,Prateek Mishra,Harshit goyal,Dhruv Kumar

2024-01-28

Abstract:This study investigates the integration and impact of Large Language Models (LLMs), like ChatGPT, in India's healthcare sector. Our research employs a dual approach, engaging both general users and medical professionals through surveys and interviews respectively. Our findings reveal that healthcare professionals value ChatGPT in medical education and preliminary clinical settings, but exercise caution due to concerns about reliability, privacy, and the need for cross-verification with medical references. General users show a preference for AI interactions in healthcare, but concerns regarding accuracy and trust persist. The study underscores the need for these technologies to complement, not replace, human medical expertise, highlighting the importance of developing LLMs in collaboration with healthcare providers. This paper enhances the understanding of LLMs in healthcare, detailing current usage, user trust, and improvement areas. Our insights inform future research and development, underscoring the need for ethically compliant, user-focused LLM advancements that address healthcare-specific challenges.

Human-Computer Interaction,Computers and Society

What problem does this paper attempt to address?

The paper discusses the application and impact of large-scale language models (using ChatGPT as an example) in the field of healthcare in India. The study adopts a mixed-methods approach, involving surveys and interviews with both lay users and healthcare professionals, to understand how these models are utilized and the benefits and challenges they bring. The research finds that healthcare professionals value ChatGPT in medical education, initial clinical settings, and patient communication, but hold cautious attitudes towards its reliability and privacy concerns, necessitating cross-validation with medical reference materials. Lay users tend to use AI in healthcare interactions but still doubt its accuracy and trustworthiness.

The study emphasizes that these technologies should serve as complementary knowledge to human medical expertise rather than substitutes, and proposes the need for collaboration with healthcare providers in developing LLMs. The paper employs a mixed-methods research design, including the collection and analysis of 46 survey questionnaires and 6 in-depth interviews, aiming to provide guidance for future research and development, emphasizing the need for the development of ethical, user-centered LLM advances to address healthcare-specific challenges.

The results of the study suggest that ChatGPT has potential in healthcare diagnosis aid, drug discovery, and virtual medical assistants, but also raises concerns about accuracy, ethics, and privacy. Moreover, its role in public health awareness and medication management is also explored. Despite being popular in medical education, caution is needed in its application to clinical decision-making. The paper presents insights and recommendations for improving the integration of LLMs in healthcare systems to ensure safe and effective assistance in human medical services.