Comments on the misuse of SPMDs in recent articles by Springman et al. (2008a,b) and Short et al. (2008).

P. Boehm,D. Page,J. Neff

DOI: https://doi.org/10.1016/j.marenvres.2009.03.005

IF: 3.737

2009-03-14

Marine Environmental Research

Abstract:

What problem does this paper attempt to address?

Can ChatGPT help patients understand their andrological diseases?

İsmail Emre Ergin,Adem Sancı

DOI: https://doi.org/10.22514/j.androl.2024.010

Abstract:We aimed to assess the reliability of Chat Generative Pre-training Transformer (ChatGPT)'s andrology information and its suitability for informing patients and medical students accurately about andrology topics. We presented a series of systematically organized frequently asked questions on andrology topics and sentences containing strong recommendations from the European Association of Urology (EAU) Guideline to ChatGPT-3.5 and 4.0 as questions. These questions encompassed Male Hypogonadism, Erectile Dysfunction and Sexual Desire Disorder, Disorders of Ejaculation, Penile Curvature and Penile Size Abnormalities, Priapism, and Male Infertility. Two expert urologists independently evaluated and assigned scores ranging from 1 to 4 to each response based on its accuracy, with the following ratings: (1) Completely true, (2) Accurate but insufficient, (3) A mixture of accurate and misleading information, and (4) Completely false. A total of 120 questions were included in the study. Among these questions, 50.0% received a grade of 1 (completely correct) (55.4% for 4.0 version). The combined rate of correct answers (grades 1 and 2) was 85.2% for frequently asked questions (88.8% for 4.0 version) and 81.5% for questions obtained from the guideline. The rate of completely incorrect answers (grade 4) was 1.8% for frequently asked questions (0% for 4.0 version) and 5.2% for questions based on strong recommendations. The response rate of version 4.0 to questions created from sentences containing strong recommendations from the EAU guideline was the same as version 3.5. ChatGPT provided satisfactory answers to the questions asked, although some responses lacked completeness. It may be beneficial to utilize ChatGPT under the guidance of a urologist to enhance patients' comprehension of their andrology issues.
Use of ChatGPT in Urology and its Relevance in Clinical Practice: Is it useful?

Antonio Vitor Nascimento Martinelli Braga,Noel Charlles Nunes,Emanoel Nascimento Santos,Maria Luiza Veiga,Ana Aparecida Nascimento Martinelli Braga,Glicia Estevam de Abreu,Jose de Bessa Júnior,Luis Henrique Braga,Andrew J Kirsch,Ubirajara Barroso Júnior

DOI: https://doi.org/10.1590/S1677-5538.IBJU.2023.0570

Abstract:Purpouse: One of the many artificial intelligence based tools that has gained popularity is the Chat-Generative Pre-Trained Transformer (ChatGPT). Due to its popularity, incorrect information provided by ChatGPT will have an impact on patient misinformation. Furthermore, it may cause misconduct as ChatGPT can mislead physicians on the decision-making pathway. Therefore, the aim of this study is to evaluate the accuracy and reproducibility of ChatGPT answers regarding urological diagnoses. Materials and methods: ChatGPT 3.5 version was used. The questions asked for the program involved Primary Megaureter (pMU), Enuresis and Vesicoureteral Reflux (VUR). There were three queries for each topic. The queries were inserted twice, and both responses were recorded to examine the reproducibility of ChatGPT's answers. Afterwards, both answers were combined. Finally, those rwere evaluated qualitatively by a board of three specialists. A descriptive analysis was performed. Results and conclusion: ChatGPT simulated general knowledge on the researched topics. Regarding Enuresis, the provided definition was partially correct, as the generic response allowed for misinterpretation. For VUR, the response was considered appropriate. For pMU it was partially correct, lacking essential aspects of its definition such as the diameter of the dilatation of the ureter. Unnecessary exams were suggested, for Enuresis and pMU. Regarding the treatment of the conditions mentioned, it specified treatments for Enuresis that are ineffective, such as bladder training. Therefore, ChatGPT responses present a combination of accurate information, but also incomplete, ambiguous and, occasionally, misleading details.
ChatGPT v4 outperforming v3.5 on cancer treatment recommendations in quality, clinical guideline, and expert opinion concordance

Chung-You Tsai,Pai-Yu Cheng,Juinn-Horng Deng,Fu-Shan Jaw,Shyi-Chun Yii

DOI: https://doi.org/10.1177/20552076241269538

2024-08-14

Abstract:Objectives: To assess the quality and alignment of ChatGPT's cancer treatment recommendations (RECs) with National Comprehensive Cancer Network (NCCN) guidelines and expert opinions. Methods: Three urologists performed quantitative and qualitative assessments in October 2023 analyzing responses from ChatGPT-4 and ChatGPT-3.5 to 108 prostate, kidney, and bladder cancer prompts using two zero-shot prompt templates. Performance evaluation involved calculating five ratios: expert-approved/expert-disagreed and NCCN-aligned RECs against total ChatGPT RECs plus coverage and adherence rates to NCCN. Experts rated the response's quality on a 1-5 scale considering correctness, comprehensiveness, specificity, and appropriateness. Results: ChatGPT-4 outperformed ChatGPT-3.5 in prostate cancer inquiries, with an average word count of 317.3 versus 124.4 (p < 0.001) and 6.1 versus 3.9 RECs (p < 0.001). Its rater-approved REC ratio (96.1% vs. 89.4%) and alignment with NCCN guidelines (76.8% vs. 49.1%, p = 0.001) were superior and scored significantly better on all quality dimensions. Across 108 prompts covering three cancers, ChatGPT-4 produced an average of 6.0 RECs per case, with an 88.5% approval rate from raters, 86.7% NCCN concordance, and only a 9.5% disagreement rate. It achieved high marks in correctness (4.5), comprehensiveness (4.4), specificity (4.0), and appropriateness (4.4). Subgroup analyses across cancer types, disease statuses, and different prompt templates were reported. Conclusions: ChatGPT-4 demonstrated significant improvement in providing accurate and detailed treatment recommendations for urological cancers in line with clinical guidelines and expert opinion. However, it is vital to recognize that AI tools are not without flaws and should be utilized with caution. ChatGPT could supplement, but not replace, personalized advice from healthcare professionals.
Urological Cancers and ChatGPT: Assessing the Quality of Information and Possible Risks for Patients

Faruk Ozgor,Ufuk Caglar,Ahmet Halis,Hakan Cakir,Ufuk Can Aksu,Ali Ayranci,Omer Sarilar

DOI: https://doi.org/10.1016/j.clgc.2023.12.017

IF: 3.121

2024-01-23

Clinical Genitourinary Cancer

Abstract:Introduction OpenAI has created ChatGPT, an artificial intelligence language model that has gained considerable recognition for its capacity to produce text responses resembling human language. Consequently, this study seeks to evaluate the effectiveness of ChatGPT's responses in addressing publicly accessible queries related to prostate, kidney, bladder , and testicular cancers. Material and Methods A comprehensive compilation of frequently asked questions (FAQs) pertaining to prostate, bladder, kidney, and testicular cancers was gathered from diverse sources. Additionally, the recommendations outlined in the European Association of Urology (EAU) 2023 Guideline Oncology were consulted. The chosen questions for evaluation were presented to the ChatGPT 4.0 premium version. The quality of ChatGPT responses was appraised using the global quality score (GQS). Each ChatGPT response was independently reviewed by a panel of physicians, who assigned a GQS score to assess its overall quality. Results For prostate cancer, 64.6% of the questions had a GQS score of 5, compared to 62.9 % for bladder, 68.1% for kidney, and 63.9% for testicular cancers, whereas none of the responses had a GQS score of 1. Meanwhile, the category with the lowest proportion of responses, with a GQS score of 5 for each disease, was prognosis and follow-up. The mean GQS score of the answers given to EAU guideline questions was statistically significantly lower than the average score of the answers given to FAQs. Conclusion ChatGPT is a valuable tool for addressing general inquiries regarding urological cancers, boasting commendable accuracy rates. Nonetheless, its performance in responding to questions aligned with the EAU guideline was deemed unsatisfactory.

oncology,urology & nephrology
Performance of ChatGPT-3.5 and ChatGPT-4 on the European Board of Urology (EBU) exams: a comparative analysis

Justine Schoch,H-U Schmelz,Angelina Strauch,Hendrik Borgmann,Tim Nestler

DOI: https://doi.org/10.1007/s00345-024-05137-4

2024-07-26

Abstract:Background and objective: In the transformative era of artificial intelligence, its integration into various spheres, especially healthcare, has been promising. The objective of this study was to analyze the performance of ChatGPT, as open-source Large Language Model (LLM), in its different versions on the recent European Board of Urology (EBU) in-service assessment questions. Design and setting: We asked multiple choice questions of the official EBU test books to ChatGPT-3.5 and ChatGPT-4 for the following exams: exam 1 (2017-2018), exam 2 (2019-2020) and exam 3 (2021-2022). Exams were passed with ≥60% correct answers. Results: ChatGPT-4 provided significantly more correct answers in all exams compared to the prior version 3.5 (exam 1: ChatGPT-3.5 64.3% vs. ChatGPT-4 81.6%; exam 2: 64.5% vs. 80.5%; exam 3: 56% vs. 77%, p < 0.001, respectively). Test exam 3 was the only exam ChatGPT-3.5 did not pass. Within the different subtopics, there were no significant differences of provided correct answers by ChatGPT-3.5. Concerning ChatGPT-4, the percentage in test exam 3 was significantly decreased in the subtopics Incontinence (exam 1: 81.6% vs. exam 3: 53.6%; p = 0.026) and Transplantation (exam 1: 77.8% vs. exam 3: 0%; p = 0.020). Conclusion: Our findings indicate that ChatGPT, especially ChatGPT-4, has the general ability to answer complex medical questions and might pass FEBU exams. Nevertheless, there is still the indispensable need for human validation of LLM answers, especially concerning health care issues.
Performance of ChatGPT in providing patient information about upper tract urothelial carcinoma

Jan Łaszkiewicz,Wojciech Krajewski,Wojciech Tomczak,Joanna Chorbińska,Łukasz Nowak,Adam Chełmoński,Piotr Krajewski,Aleksandra Sójka,Bartosz Małkiewicz,Tomasz Szydełko

DOI: https://doi.org/10.5114/wo.2024.141567

Abstract:Introduction: The aim was to evaluate ChatGPT generated responses to patient-important questions regarding upper tract urothelial carcinoma (UTUC). Material and methods: Fifteen common inquiries asked by patients regarding UTUC were assigned to 4 categories: general information; symptoms and diagnosis; treatment; and prognosis. These questions were entered into ChatGPT and its responses were recorded. In every answer 5 criteria (adequate length, comprehensible language, precision in addressing the question, compliance with European Association of Urology guidelines and safety of the response for the patient) were assessed by the urologists using a numerical scale of 1-5 (a score of 5 being the best). Results: Sixteen questionnaires were included. A score of five was assigned 336 times (28.0%); 4 - 527 times, (43.9%); 3 - 268 times (22.3%); 2 - 53 ti- mes (4.4%); and 1 - 16 times (1.3%). The average overall score was 3.93. Responses to each question received average scores within the range 3.34-4.18. Answers regarding "general information" were graded the highest - mean score 4.14. Artificial intelligence scored the lowest in the "treatment" category - mean score 3.68. A mean score of 4.02 was given for the safety of the response. However, a few urologists considered several answers as unsafe for the patient, by grading them 1 or 2 in this criterion. Conclusions: ChatGPT does not provide fully adequate information on UTUC, and inquiries regarding treatment can be misleading for the patients. In particular cases, patients might receive potentially unsafe answers. However, ChatGPT can be used with caution to provide basic information regarding epidemiology and risk factors of UTUC.
Performance of ChatGPT on Solving Orthopedic Board-Style Questions: A Comparative Analysis of ChatGPT 3.5 and ChatGPT 4

Sung Eun Kim,Ji Han Lee,Byung Sun Choi,Hyuk-Soo Han,Myung Chul Lee,Du Hyun Ro

DOI: https://doi.org/10.4055/cios23179

Abstract:Background: The application of artificial intelligence and large language models in the medical field requires an evaluation of their accuracy in providing medical information. This study aimed to assess the performance of Chat Generative Pre-trained Transformer (ChatGPT) models 3.5 and 4 in solving orthopedic board-style questions. Methods: A total of 160 text-only questions from the Orthopedic Surgery Department at Seoul National University Hospital, conforming to the format of the Korean Orthopedic Association board certification examinations, were input into the ChatGPT 3.5 and ChatGPT 4 programs. The questions were divided into 11 subcategories. The accuracy rates of the initial answers provided by Chat GPT 3.5 and ChatGPT 4 were analyzed. In addition, inconsistency rates of answers were evaluated by regenerating the responses. Results: ChatGPT 3.5 answered 37.5% of the questions correctly, while ChatGPT 4 showed an accuracy rate of 60.0% (p < 0.001). ChatGPT 4 demonstrated superior performance across most subcategories, except for the tumor-related questions. The rates of inconsistency in answers were 47.5% for ChatGPT 3.5 and 9.4% for ChatGPT 4. Conclusions: ChatGPT 4 showed the ability to pass orthopedic board-style examinations, outperforming ChatGPT 3.5 in accuracy rate. However, inconsistencies in response generation and instances of incorrect answers with misleading explanations require caution when applying ChatGPT in clinical settings or for educational purposes.
Evaluating the performance and clinical decision‐making impact of ChatGPT‐4 in reproductive medicine

Rouzhu Chen,Danling Zeng,Yi Li,Rui Huang,Dejuan Sun,Tingting Li

DOI: https://doi.org/10.1002/ijgo.15959

2024-11-12

International Journal of Gynecology & Obstetrics

Abstract:Background ChatGPT, a sophisticated language model developed by OpenAI, has the potential to offer professional and patient‐friendly support. We aimed to assess the accuracy and reproducibility of ChatGPT‐4 in answering questions related to knowledge, management, and support within the field of reproductive medicine. Methods ChatGPT‐4 was used to respond to queries sourced from a domestic attending physician examination database, as well as to address both local and international treatment guidelines within the field of reproductive medicine. Each response generated by ChatGPT‐4 was independently evaluated by a trio of experts specializing in reproductive medicine. The experts used four qualitative measures—relevance, accuracy, completeness, and understandability—to assess each response. Results We found that ChatGPT‐4 demonstrated extensive knowledge in reproductive medicine, with median scores for relevance, accuracy, completeness, and comprehensibility of objective questions being 4, 3.5, 3, and 3, respectively. However, the composite accuracy rate for multiple‐choice questions was 63.38%. Significant discrepancies were observed among the three experts' scores across all four measures. Expert 1 generally provided higher and more consistent scores, while Expert 3 awarded lower scores for accuracy. ChatGPT‐4's responses to both domestic and international guidelines showed varying levels of understanding, with a lack of knowledge on regional guideline variations. However, it offered practical and multifaceted advice regarding next steps and adjusting to new guidelines. Conclusions We analyzed the strengths and limitations of ChatGPT‐4's responses on the management of reproductive medicine and relevant support. ChatGPT‐4 might serve as a supplementary informational tool for patients and physicians to improve outcomes in the field of reproductive medicine.

obstetrics & gynecology
The Accuracy of Artificial Intelligence ChatGPT in Oncology Examination Questions

Ronald Chow,Shaakir Hasan,Ajay Zheng,Chenxi Gao,Gilmer Valdes,Francis Yu,Arpit Chhabra,Srinivas Raman,J. Isabelle Choi,Haibo Lin,Charles B. Simone

DOI: https://doi.org/10.1016/j.jacr.2024.07.011

IF: 6.24

2024-08-28

Journal of the American College of Radiology

Abstract:The aim of this study is to assess the accuracy of Chat Generative Pretrained Transformer (ChatGPT) in response to oncology examination questions in the setting of one-shot learning. Consecutive national radiation oncology in-service multiple-choice examinations were collected and inputted into ChatGPT 4o and ChatGPT 3.5 to determine ChatGPT's answers. ChatGPT's answers were then compared with the answer keys to determine whether ChatGPT correctly or incorrectly answered each question and to determine if improvements in responses were seen with the newer ChatGPT version. A total of 600 consecutive questions were inputted into ChatGPT. ChatGPT 4o answered 72.2% questions correctly, whereas 3.5 answered 53.8% questions correctly. There was a significant difference in performance by question category ( P < .01). ChatGPT performed poorer with respect to knowledge of landmark studies and treatment recommendations and planning. ChatGPT is a promising technology, with the latest version showing marked improvement. Although it still has limitations, with further evolution, it may be considered a reliable resource for medical training and decision making in the oncology space.

radiology, nuclear medicine & medical imaging
Analyzing the performance of ChatGPT in answering inquiries about cervical cancer

Engin Yurtcu,Seyfettin Ozvural,Betul Keyif

DOI: https://doi.org/10.1002/ijgo.15861

2024-08-19

International Journal of Gynecology & Obstetrics

Abstract:Objective To analyze the knowledge of ChatGPT about cervical cancer (CC). Methods Official websites of professional health institutes, and websites created by patients and charities underwent strict screening. Using CC‐related keywords, common inquiries by the public and comments about CC were searched in social media applications with these data, a list of frequently asked questions (FAQs) was prepared. When preparing question about CC, the European Society of Gynecological Oncology (ESGO), European Society for Radiotherapy and Oncology (ESTRO), and European Society of Pathology (ESP) guidelines were used. The answers given by ChatGPT were scored according to the Global Quality Score (GQS). Results When all ChatGPT answers to FAQs about CC were evaluated with regard to GQS, 68 ChatGPT answers were classified as score 5, and none of ChatGPT answers for FAQs were scored as 2 or 1. Moreover, ChatGPT answered 33 of 53 (62.3%) CC‐related questions based on ESGO, ESTRO, and ESP guidelines with completely accurate and satisfactory responses (GQS 5). In addition, eight answers (15.1%), seven answers (13.2%), four answers (7.5%), and one answer (1.9%) were categorized as GQS 4, GQS 3, GQS 2, and GQS 1, respectively. The reproducibility rate of ChatGPT answers about CC‐related FAQs and responses about those guideline‐based questions was 93.2% and 88.7%, respectively. Conclusion ChatGPT had an accurate and satisfactory response rate for FAQs about CC with regards to GQS. However, the accuracy and quality of ChatGPT answers significantly decreased for questions based on guidelines.

obstetrics & gynecology
Digital implementation of general purpose fuzzy logic controller for photovoltaic maximum power point tracker

A. Eltamaly,A. Alolah,M. Abdulghany

DOI: https://doi.org/10.1109/SPEEDAM.2010.5542207

2010-06-14

Abstract:This paper introduces an implementation of a general purpose fuzzy logic controller for use with general purpose embedded processors. This controller is used in the applications of maximum power point tracker of photovoltaic energy system as an application. However, the proposed model is very flexible to be applied in various and different applications. The design is made to be scalable in terms of number of inputs and number of membership functions (MFs) in both inputs side and output side. The proposed model was written in C language due its popularity and efficiency in embedded and control applications. An example of maximum power point tracker of photovoltaic energy system with 2-inputs/7-MFs each and 1-output/7-MFs is used for demonstration and verification purpose. The general purpose fuzzy logic controller shows consistency with the result obtained from simulation.
Artificial intelligence performance in clinical neurology queries: the ChatGPT model

Erman Altunisik,Yasemin Ekmekyapar Firat,Emine Kilicparlar Cengiz,Gulsum Bayana Comruk

DOI: https://doi.org/10.1080/01616412.2024.2334118

2024-03-26

Neurological Research

Abstract:Introduction The use of artificial intelligence technology is progressively expanding and advancing in the health and biomedical literature. Since its launch, ChatGPT has rapidly gained popularity and become one of the fastest-growing artificial intelligence applications in history. This study evaluated the accuracy and comprehensiveness of ChatGPT-generated responses to medical queries in clinical neurology.

neurosciences,clinical neurology
Diagnosis of rabies by polymerase chain reaction with nested primers.

Nuanthip Kamolvarin,Thaweesak Tirawatnpong,Ratree Rattanasiwamoke,S. Tirawatnpong,Taweeporn Panpanich,T. Hemachudha

DOI: https://doi.org/10.1093/INFDIS/167.1.207

Abstract:A simple, sensitive, and specific polymerase chain reaction (PCR) protocol for detection of rabies virus is described. The process consists of sample preparation, reverse transcription, two-step DNA amplification, and detection of the amplified product. RNA was extracted from animal and human brain by phenol-chloroform using guanidinium thiocyanate. Viral RNA was then amplified in a two-step PCR that used two sets of nested primers designed to amplify rabies nucleocapsid (N) sequence. Rabies nucleocapsid sequence was amplified from all brain samples from 95 dogs and 3 humans with rabies confirmed by fluorescent antibody (FAT) and mouse inoculation tests (MIT). Rabies-negative brain samples (110 dogs, 2 humans) were PCR-negative. The process requires < 24 h. Detection of viral RNA was still possible in brain material that was left at room temperature for 72 h. As little as 8 pg of rabies virus RNA could be detected. This technique could have practical applications as a confirmatory test to FAT at busy rabies diagnostic centers.
Combining Local and Global Expertise in Services

H. Salmela,J. Pärnistö

DOI: https://doi.org/10.4018/978-1-60566-026-4.CH097

Abstract:Since the 1990s, services characterized by a considerable geographical distance between the service person and the customer have become increasingly commonplace. Banks and insurance companies are introducing call centers or service centers to complement, or even replace, the old regional service organization. In the information and communication technology (ICT) sector, companies such as Fujitsu and IBM provide part of the end-user support for their clients from a few centralized call centers. Telecommunications operators have established call centers to serve their customers in conducting basic business transactions. To a large extent, the change in the 1990s can be attributed to ICT development. As call centers and local offices have equal access to all the information, many of the services that previously had to be provided locally can now come from a call center. Furthermore, this decade will bring new technologies that will further enhance capabilities to serve customers over long distances. They will, for instance, provide increasingly rich media for interaction between customers and remote service personnel. This article investigates factors that need to be considered when moving service production from regional offices to service centers. The empirical part of the study comprises a longitudinal analysis of the ways how Fujitsu Invia, a European IS company within Fujitsu Group, has transformed its service organization. The company has moved a long way from local, site-specific service units to national service centers, and ultimately to a few global centers that provide services to thousands of computer users worldwide. In retrospect, it can be said that the decision to centralize service production turned out to be very successful. However, the reasons why Fujitsu Invia decided to return part of the end-user support closer to customer sites illustrates the complexities associated with centralizing services that were previously produced locally. Background
Is ChatGPT accurate and reliable in answering questions regarding head and neck cancer?

Oğuz Kuşcu,A. Erim Pamuk,Nilda Sütay Süslü,Sefik Hosal

DOI: https://doi.org/10.3389/fonc.2023.1256459

IF: 4.7

2023-12-01

Frontiers in Oncology

Abstract:Background and objective Chat Generative Pre-trained Transformer (ChatGPT) is an artificial intelligence (AI)-based language processing model using deep learning to create human-like text dialogue. It has been a popular source of information covering vast number of topics including medicine. Patient education in head and neck cancer (HNC) is crucial to enhance the understanding of patients about their medical condition, diagnosis, and treatment options. Therefore, this study aims to examine the accuracy and reliability of ChatGPT in answering questions regarding HNC. Methods 154 head and neck cancer-related questions were compiled from sources including professional societies, institutions, patient support groups, and social media. These questions were categorized into topics like basic knowledge, diagnosis, treatment, recovery, operative risks, complications, follow-up, and cancer prevention. ChatGPT was queried with each question, and two experienced head and neck surgeons assessed each response independently for accuracy and reproducibility. Responses were rated on a scale: (1) comprehensive/correct, (2) incomplete/partially correct, (3) a mix of accurate and inaccurate/misleading, and (4) completely inaccurate/irrelevant. Discrepancies in grading were resolved by a third reviewer. Reproducibility was evaluated by repeating questions and analyzing grading consistency. Results ChatGPT yielded “comprehensive/correct” responses to 133/154 (86.4%) of the questions whereas, rates of “incomplete/partially correct” and “mixed with accurate and inaccurate data/misleading” responses were 11% and 2.6%, respectively. There were no “completely inaccurate/irrelevant” responses. According to category, the model provided “comprehensive/correct” answers to 80.6% of questions regarding “basic knowledge”, 92.6% related to “diagnosis”, 88.9% related to “treatment”, 80% related to “recovery – operative risks – complications – follow-up”, 100% related to “cancer prevention” and 92.9% related to “other”. There was not any significant difference between the categories regarding the grades of ChatGPT responses (p=0.88). The rate of reproducibility was 94.1% (145 of 154 questions). Conclusion ChatGPT generated substantially accurate and reproducible information to diverse medical queries related to HNC. Despite its limitations, it can be a useful source of information for both patients and medical professionals. With further developments in the model, ChatGPT can also play a crucial role in clinical decision support to provide the clinicians with up-to-date information.

oncology
ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents

Michal A. Mankowski,Ian S. Jaffe,Jingzhi Xu,Sunjae Bae,Eric K. Oermann,Yindalon Aphinyanaphongs,Mara A. McAdams‐DeMarco,Bonnie E. Lonze,Babak J. Orandi,Darren Stewart,Macey Levan,Allan Massie,Sommer Gentry,Dorry L. Segev

DOI: https://doi.org/10.1111/ctr.15466

2024-09-29

Clinical Transplantation

Abstract:Introduction ChatGPT has shown the ability to answer clinical questions in general medicine but may be constrained by the specialized nature of kidney transplantation. Thus, it is important to explore how ChatGPT can be used in kidney transplantation and how its knowledge compares to human respondents. Methods We prompted ChatGPT versions 3.5, 4, and 4 Visual (4 V) with 12 multiple‐choice questions related to six kidney transplant cases from 2013 to 2015 American Society of Nephrology (ASN) fellowship program quizzes. We compared the performance of ChatGPT with US nephrology fellowship program directors, nephrology fellows, and the audience of the ASN's annual Kidney Week meeting. Results Overall, ChatGPT 4 V correctly answered 10 out of 12 questions, showing a performance level comparable to nephrology fellows (group majority correctly answered 9 of 12 questions) and training program directors (11 of 12). This surpassed ChatGPT 4 (7 of 12 correct) and 3.5 (5 of 12). All three ChatGPT versions failed to correctly answer questions where the consensus among human respondents was low. Conclusion Each iterative version of ChatGPT performed better than the prior version, with version 4 V achieving performance on par with nephrology fellows and training program directors. While it shows promise in understanding and answering kidney transplantation questions, ChatGPT should be seen as a complementary tool to human expertise rather than a replacement.

surgery,transplantation
Training ChatGPT Models in Assisting Urologists in Daily Practice

Ioannis Manolitsis,Georgios Feretzakis,Lazaros Tzelves,Dimitris Kalles,Stamatis Katsimperis,Panagiotis Angelopoulos,Athanasios Anastasiou,Dimitrios Koutsouris,Thanos Kosmidis,Vassilios S Verykios,Andreas Skolarikos,Ioannis Varkarakis

DOI: https://doi.org/10.3233/SHTI230562

2023-06-29

Abstract:Artificial Intelligence (AI) has shown the ability to enhance the accuracy and efficiency of physicians. ChatGPT is an AI chatbot that can interact with humans through text, over the internet. It is trained with machine learning algorithms, using large datasets. In this study, we compare the performance of using a ChatGPT API 3.5 Turbo model to a general model, in assisting urologists in obtaining accurate, valid medical information. The API was accessed through a Python script that was applied specifically for this study based on 2023 EAU guidelines in PDF format. This custom-trained model leads to providing doctors with more precise, prompt answers about specific urologic subjects, thus helping them, ultimately, providing better patient care.
Biosynthesis and photodynamic efficacy of protoporphyrin IX (PpIX) generated by 5-aminolevulinic acid (ALA) or its hexylester (hALA) in rat bladder carcinoma cells.

I. Cosserat-Gérardin,L. Bezdetnaya,D. Notter,C. Vigneron,François Guillemin

DOI: https://doi.org/10.1016/S1011-1344(00)00142-1

2000-12-01

Abstract:
Evaluating the performance of ChatGPT in clinical pharmacy: A comparative study of ChatGPT and clinical pharmacists

Xiaoru Huang,Dannya Estau,Xuening Liu,Yang Yu,Jiguang Qin,Zijian Li

DOI: https://doi.org/10.1111/bcp.15896

2023-08-27

British Journal of Clinical Pharmacology

Abstract:Aim To evaluate the performance of chat generative pre‐trained transformer (ChatGPT) in key domains of clinical pharmacy practice, including prescription review, patient medication education, adverse drug reaction (ADR) recognition, ADR causality assessment, and drug counseling. Methods Questions and clinical pharmacist' answers were collected from real clinical cases and clinical pharmacist competency assessment. ChatGPT's responses were generated by inputting the same question into the "New Chat" box of "ChatGPT Mar 23 Version". Five licensed clinical pharmacists independently rated these answers on a scale of 0 (completely incorrect) to 10 (completely correct). The mean scores of ChatGPT and clinical pharmacists were compared using a paired two‐tailed Student's t‐test. The text content of the answers was also descriptively summarized together. Results The quantitative results indicated that ChatGPT was excellent in drug counseling (ChatGPT: 8.77 vs. clinical pharmacist: 9.50, p=0.0791) and weak in prescription review (5.23 vs. 9.90, p=0.0089), patient medication education (6.20 vs. 9.07, p=0.0032), ADR recognition (5.07 vs. 9.70, p=0.0483), and ADR causality assessment (4.03 vs. 9.73, p=0.023). The capabilities and limitations of ChatGPT in clinical pharmacy practice were summarized based on the completeness and accuracy of the answers. ChatGPT revealed robust retrieval, information integration, and dialogue capabilities. It lacked medicine‐specific datasets as well as the ability for handling advanced reasoning and complex instructions. Conclusions While ChatGPT holds promise in clinical pharmacy practice as a supplementary tool, the ability of ChatGPT to handle complex problems needs further improvement and refinement.

pharmacology & pharmacy
Performance of ChatGPT on Factual Knowledge Questions Regarding Clinical Pharmacy

Merel van Nuland,Abdullah Erdogan,Cenkay Aςar,Ramon Contrucci,Sven Hilbrants,Lamyae Maanach,Toine Egberts,Paul D. van der Linden

DOI: https://doi.org/10.1002/jcph.2443

2024-04-18

The Journal of Clinical Pharmacology

Abstract:ChatGPT is a language model that was trained on a large dataset including medical literature. Several studies have described the performance of ChatGPT on medical exams. In this study, we examine its performance in answering factual knowledge questions regarding clinical pharmacy. Questions were obtained from a Dutch application that features multiple‐choice questions to maintain a basic knowledge level for clinical pharmacists. In total, 264 clinical pharmacy‐related questions were presented to ChatGPT and responses were evaluated for accuracy, concordance, quality of the substantiation, and reproducibility. Accuracy was defined as the correctness of the answer, and results were compared to the overall score by pharmacists over 2022. Responses were marked concordant if no contradictions were present. The quality of the substantiation was graded by two independent pharmacists using a 4‐point scale. Reproducibility was established by presenting questions multiple times and on various days. ChatGPT yielded accurate responses for 79% of the questions, surpassing pharmacists' accuracy of 66%. Concordance was 95%, and the quality of the substantiation was deemed good or excellent for 73% of the questions. Reproducibility was consistently high, both within day and between days (>92%), as well as across different users. ChatGPT demonstrated a higher accuracy and reproducibility to factual knowledge questions related to clinical pharmacy practice than pharmacists. Consequently, we posit that ChatGPT could serve as a valuable resource to pharmacists. We hope the technology will further improve, which may lead to enhanced future performance.

pharmacology & pharmacy

Comments on the misuse of SPMDs in recent articles by Springman et al. (2008a,b) and Short et al. (2008).

Can ChatGPT help patients understand their andrological diseases?

Use of ChatGPT in Urology and its Relevance in Clinical Practice: Is it useful?

ChatGPT v4 outperforming v3.5 on cancer treatment recommendations in quality, clinical guideline, and expert opinion concordance

Urological Cancers and ChatGPT: Assessing the Quality of Information and Possible Risks for Patients

Performance of ChatGPT-3.5 and ChatGPT-4 on the European Board of Urology (EBU) exams: a comparative analysis

Performance of ChatGPT in providing patient information about upper tract urothelial carcinoma

Performance of ChatGPT on Solving Orthopedic Board-Style Questions: A Comparative Analysis of ChatGPT 3.5 and ChatGPT 4

Evaluating the performance and clinical decision‐making impact of ChatGPT‐4 in reproductive medicine

The Accuracy of Artificial Intelligence ChatGPT in Oncology Examination Questions

Analyzing the performance of ChatGPT in answering inquiries about cervical cancer

Digital implementation of general purpose fuzzy logic controller for photovoltaic maximum power point tracker

Artificial intelligence performance in clinical neurology queries: the ChatGPT model

Diagnosis of rabies by polymerase chain reaction with nested primers.

Combining Local and Global Expertise in Services

Is ChatGPT accurate and reliable in answering questions regarding head and neck cancer?

ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents

Training ChatGPT Models in Assisting Urologists in Daily Practice

Biosynthesis and photodynamic efficacy of protoporphyrin IX (PpIX) generated by 5-aminolevulinic acid (ALA) or its hexylester (hALA) in rat bladder carcinoma cells.

Evaluating the performance of ChatGPT in clinical pharmacy: A comparative study of ChatGPT and clinical pharmacists

Performance of ChatGPT on Factual Knowledge Questions Regarding Clinical Pharmacy