Abstract:Introduction: Large language model (LLM) chatbots have many applications in medical settings. However, these tools can potentially perpetuate racial and gender biases through their responses, worsening disparities in healthcare. With the ongoing discussion of LLM chatbots in oncology and the widespread goal of addressing cancer disparities, this study focuses on biases propagated by LLM chatbots in oncology. Methods: Chat Generative Pre-trained Transformer (Chat GPT; OpenAI, San Francisco, CA, USA) was asked to determine what occupation a generic description of "assesses cancer patients" would correspond to for different demographics. Chat GPT, Gemini (Alphabet Inc., Mountain View, CA, USA), and Bing Chat (Microsoft Corp., Redmond, WA, USA) were prompted to provide oncologist recommendations in the top U.S. cities and demographic information (race, gender) of recommendations was compared against national distributions. Chat GPT was also asked to generate a job description for oncologists with different demographic backgrounds. Finally, Chat GPT, Gemini, and Bing Chat were asked to generate hypothetical cancer patients with race, smoking, and drinking histories. Results: LLM chatbots are about two times more likely to predict Blacks and Native Americans as oncology nurses than oncologists, compared to Asians (p < 0.01 and < 0.001, respectively). Similarly, they are also significantly more likely to predict females than males as oncology nurses (p < 0.001). Chat GPT's real-world oncologist recommendations overrepresent Asians by almost double and underrepresent Blacks by double and Hispanics by seven times. Chatbots also generate different job descriptions based on demographics, including cultural competency and advocacy and excluding treatment administration for underrepresented backgrounds. AI-generated cancer cases are not fully representative of real-world demographic distributions and encode stereotypes on substance abuse, such as Hispanics having a greater proportion of smokers than Whites by about 20% in Chat GPT breast cancer cases. Conclusion: To our knowledge, this is the first study of its kind to investigate racial and gender biases of such a diverse set of AI chatbots, and that too, within oncology. The methodology presented in this study provides a framework for targeted bias evaluation of LLMs in various fields across medicine.

[Extra-pancreatic lesions of autoimmune pancreatitis and diagnostic procedures].

Patterns of photoassimilate translocation to reproductive shoots from adjacent shoots in Camelliasasanqua by manipulation of sink-source balance between the shoots

Gender bias in generative artificial intelligence text-to-image depiction of medical students

Gender and ethnicity bias in generative artificial intelligence text-to-image depiction of pharmacists

Optical coherence tomography findings in niacin maculopathy.

Bias in Generative AI

Generative Artificial Intelligence Biases, Limitations and Risks in Nuclear Medicine: An Argument for Appropriate Use Framework and Recommendations

Artificial Intelligence Portrayals in Orthopaedic Surgery

The Face of a Surgeon: An Analysis of Demographic Representation in Three Leading Artificial Intelligence Text-to-Image Generators

Effect of 1,25-dihydroxyvitamin D deficiency on the metabolic clearance rate of 1,25-dihydroxyvitamin D3: studies using pigs with vitamin D-dependent rickets type 1.

Smiling Women Pitching Down: Auditing Representational and Presentational Gender Biases in Image Generative AI

AI depictions of psychiatric diagnoses: a preliminary study of generative image outputs in Midjourney V.6 and DALL-E 3

AI-generated faces influence gender stereotypes and racial homogenization

Perpetuation of Gender Bias in Visual Representation of Professions in the Generative AI Tools DALL·E and Bing Image Creator

Gender Bias Evaluation in Text-to-image Generation: A Survey

Analyzing Quality, Bias, and Performance in Text-to-Image Generative Models

Multilingual Text-to-Image Generation Magnifies Gender Stereotypes and Prompt Engineering May Not Help You

Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigation

The Limits of Fair Medical Imaging AI In The Wild

Fairness in AI-Driven Oncology: Investigating Racial and Gender Biases in Large Language Models

Generated Bias: Auditing Internal Bias Dynamics of Text-To-Image Generative Models