Abstract:Introduction: With the rise of machine learning applications in health care, shifts in medical fields that rely on precise prognostic models and pattern detection tools are anticipated in the near future. Chat Generative Pretrained Transformer (ChatGPT) is a recent machine learning innovation known for producing text that mimics human conversation. To gauge ChatGPT's capability in addressing patient inquiries, the authors set out to juxtapose it with Google Search, America's predominant search engine. Their comparison focused on: 1) the top questions related to clinical practice guidelines from the American Academy of Family Physicians by category and subject; 2) responses to these prevalent questions; and 3) the top questions that elicited a numerical reply. Methods: Utilizing a freshly installed Google Chrome browser (version 109.0.5414.119), the authors conducted a Google web search (www.google.com) on March 4, 2023, ensuring minimal influence from personalized search algorithms. Search phrases were derived from the clinical guidelines of the American Academy of Family Physicians. The authors prompted ChatGPT with: "Search Google using the term '(refer to search terms)' and document the top four questions linked to the term." The same 25 search terms were employed. The authors cataloged the primary 4 questions and their answers for each term, resulting in 100 questions and answers. Results: Of the 100 questions, 42% (42 questions) were consistent across all search terms. ChatGPT predominantly sourced from academic (38% vs 15%, p = 0.0002) and government (50% vs 39%, p = 0.12) domains, whereas Google web searches leaned toward commercial sources (32% vs 11%, p = 0.0002). Thirty-nine percent (39 questions) of the questions yielded divergent answers between the 2 platforms. Notably, 16 of the 39 distinct answers from ChatGPT lacked a numerical reply, instead advising a consultation with a medical professional for health guidance. Conclusion: Google Search and ChatGPT present varied questions and answers for both broad and specific queries. Both patients and doctors should exercise prudence when considering ChatGPT as a digital health adviser. It's essential for medical professionals to assist patients in accurately communicating their online discoveries and ensuing inquiries for a comprehensive discussion.

S359 Chat GPT vs Traditional Search Engines: A New Era in Diverticulitis Information Retrieval

ChatGPT vs. web search for patient questions: what does ChatGPT do better?

Evaluating ChatGPT's Utility in Medicine Guidelines Through Web Search Analysis

ChatGPT as a Source of Patient Information for Lumbar Spinal Fusion and Laminectomy

Dr. Google to Dr. ChatGPT: assessing the content and quality of artificial intelligence-generated medical information on appendicitis

S2155 Comparative Evaluation of Various Artificially Intelligent Chatbots for Management Recommendations of Common Gastroenterology Diseases

S175 Evaluation of ChatGPT in Risk Stratification and Management of Choledocholithiasis

Head-to-Head Comparison of ChatGPT Versus Google Search for Medical Knowledge Acquisition

Digesting Digital Health: A Study of Appropriateness and Readability of ChatGPT-Generated Gastroenterological Information

S205 Assessing the Ability of ChatGPT 4.0 as an Educational Tool for Patients With Pancreatic Cysts

ChatGPTs' Journey in Medical Revolution: A Potential Panacea or a Hidden Pathogen?

S2148 Assessment of ChatGPT-4's Efficacy in Providing Guideline-Directed Assistance to Residents and Fellows for Critical GI Conditions in Acute Settings

ChatGPT: A Conceptual Review of Applications and Utility in the Field of Medicine

May ChatGPT be a tool producing medical information for common inflammatory bowel disease patients’ questions? An evidence-controlled analysis

ChatGPT in surgery: a revolutionary innovation?

Evaluating ChatGPT as a patient resource for frequently asked questions about lung cancer surgery-a pilot study

ChatGPT in Clinical Medicine, Urology and Academia: A Review

ChatGPT in Urology: Bridging Knowledge and Practice for Tomorrow's Healthcare, a Comprehensive Review

Potential for GPT Technology to Optimize Future Clinical Decision-Making Using Retrieval-Augmented Generation

Utility of ChatGPT in Clinical Practice

Evaluating the reliability of ChatGPT as a tool for imaging test referral: a comparative study with a clinical decision support system