How Does ChatGPT Use Source Information Compared With Google? A Text Network Analysis of Online Health Information

Oscar Y. Shen,Jayanth S. Pratap,Xiang Li,Neal C. Chen,Abhiram R. Bhashyam
DOI: https://doi.org/10.1097/corr.0000000000002995
IF: 4.755
2024-03-23
Clinical Orthopaedics and Related Research
Abstract:The lay public is increasingly using ChatGPT (a large language model) as a source of medical information. Traditional search engines such as Google provide several distinct responses to each search query and indicate the source for each response, but ChatGPT provides responses in paragraph form in prose without providing the sources used, which makes it difficult or impossible to ascertain whether those sources are reliable. One practical method to infer the sources used by ChatGPT is text network analysis. By understanding how ChatGPT uses source information in relation to traditional search engines, physicians and physician organizations can better counsel patients on the use of this new tool.
surgery,orthopedics
What problem does this paper attempt to address?