Abstract:e13660 Background: Language Learning Models (LLM), are programs that can respond to queries without previous exposure to the input. This is because the programs are actually generative mathematical models trained on hundreds of terabytes of textual data. The output is thus a statistical assessment of the corpus of human generated text likely indicating the correct answer. ChatGPT is an example of an LLM that can understand questions and synthesize responses based on probability. However Chat GPT’s potential to accurately assist physicians with a diagnosis, remains yet to be determined. The goal of this study is to elucidate AI’s potential in proposing both feasible and accurate treatment plans specifically for patients with cancer. Methods: Fifty patients at a medical oncology practice were recruited for this study. For each patient, the physician’s shorthand notes were recorded and organized. ChatGPT was then asked to come up with a potential treatment plan using these notes according to a predetermined set workflow for each individual. The responses were then reviewed by a medical oncologist for accuracy and feasibility via a qualtrics survey. Results: ChatGPT correctly proposed a treatment plan in agreement with the physician for a total of 18 cancer patients allowing for the agreement rate to be 36%. For the rest of the 32 patients, the physician disagreed with the proposed ChatGPT treatment plan on the basis of lack of personalization, inhibitive cost, incorrect recommendation, and greater alternative options. Thirteen patients fell into the ‘Lack of Personalization in Treatment' category, twelve in the ‘Incorrect Recommendation’ category, four in ‘Inhibitive Cost' category, and three in the ‘Greater Alternative Options’ category. Most patients however fell in the category of personalization, suggesting ChatGPT’s unfamiliarity with the subject of generating personal treatment plans. Conclusions: In the current study, ChatGPT was expected to create a treatment plan with only the clinician’s abridged shorthand notes and without any familiarity with the physician’s personal preferences for treatment. This knowledge gap can account for an agreement rate less than 50%. Despite its flaws, ChatGPT was, however, able to generate an adjusted and corrected version of the treatment plan when prompted further outside the set workflow. This highlights the invaluable role of clinical experience in synthesizing an accurate treatment plan. With its encroachment into the medical field, ChatGPT has shown potential in proposing feasible and accurate treatment plans, especially in the oncology clinical setting. Despite the low agreement rate obtained from this study, ChatGPT has shown promise in developing an agreeable treatment plan with the oversight of the attending physician.

In vitro interaction of codeine and diclofenac.

Fairness in AI-Driven Oncology: Investigating Racial and Gender Biases in Large Language Models

Ethical Considerations of Artificial Intelligence in Health Care: Examining the Role of Generative Pretrained Transformer-4

The ethics of ChatGPT in medicine and healthcare: a systematic review on Large Language Models (LLMs)

Antenatal diagnosis and early surgery for choledochal cyst.

Potential applications and implications of large language models in primary care

Exploring the landscape of AI-assisted decision-making in head and neck cancer treatment: a comparative analysis of NCCN guidelines and ChatGPT responses

Large language models as decision aids in neuro-oncology: a review of shared decision-making applications

ChatGPT and Artificial Intelligence in Medical Writing: Concerns and Ethical Considerations

What Should ChatGPT Mean for Bioethics?

Making sense of artificial intelligence and large language models—including ChatGPT—in pediatric hematology/oncology

Use of American Society of Anesthesiologists physical status classification to assess perioperative risk in patients undergoing radical nephrectomy for renal cell carcinoma.

AI as a Medical Ally: Evaluating ChatGPT's Usage and Impact in Indian Healthcare

Large language models and generative AI in telehealth: a responsible use lens

The ethical dimensions of utilizing Artificial Intelligence in palliative care

Ethical Concerns About ChatGPT in Healthcare: A Useful Tool or the Tombstone of Original and Reflective Thinking?

Towards Healthy AI: Large Language Models Need Therapists Too

Implementing large language model-based artificial intelligence (AI) technology in proposing effective treatment plans in patients with cancer.

The effect of glutathione on the determination of blood-sugar.

ChatGPT and Beyond: An overview of the growing field of large language models and their use in ophthalmology