Patterns of photoassimilate translocation to reproductive shoots from adjacent shoots in Camelliasasanqua by manipulation of sink-source balance between the shoots

Hiroki Oitate,K. Noguchi,Kosei Sone,I. Terashima,A. A. Suzuki

DOI: https://doi.org/10.1007/s10265-010-0362-1

Journal of Plant Research

Abstract:

What problem does this paper attempt to address?

[Extra-pancreatic lesions of autoimmune pancreatitis and diagnostic procedures].

S. Kawa,Takayuki Watanabe,M. Maruyama,Tetsuya Ito,T. Muraki,H. Hamano,Norikazu Arakura

2012-06-01

Abstract:はじめに自己免疫性膵炎は免疫学的機序が発症に関与していると考えられる特殊な膵炎で,さまざまな血清学的異常,膵管狭細像・膵腫大像などの画像所見,リンパ球・形質細胞浸潤などの病理所見,良好なステロイド反応性を認め,膵癌との鑑別困難例が存在する.本症の特徴として,血中 IgG4 値上昇と病変局所への IgG4 陽性形質細胞浸潤,多彩な膵外病変の合併,を認める.膵外病変は涙腺・唾液腺炎,硬化性胆管炎,後腹膜線維症,尿細管間質性腎炎,肺線維症などがあり,膵病変と同様の病理所見,ステロイド反応性を示す.したがって,膵病変と同様の病態が背景に存在する可能性が考えられ,これらを包括する全身性疾患,IgG4 関連疾患(IgG4-related disease)が想定された. 今日では自己免疫性膵炎ならびに個々の膵外病変は,IgG4 関連疾患の構成疾患とみなされるようになった.しかし,歴史的経緯を踏まえて,本稿では自己免疫性膵炎の膵外病変として,個々の病変を紹介する. I 自己免疫性膵炎と膵外病変,IgG4 関連疾患自己免疫性膵炎には多彩な膵外病変が合併するが,症例報告程度のものから組織学的に詳細な検証がなされたもの,独自の疾患単位として診断基準が作成されたものまでさまざまである(Table
Gender bias in generative artificial intelligence text-to-image depiction of medical students

Geoffrey Currie,Josie Currie,Sam Anderson,Johnathan Hewis

DOI: https://doi.org/10.1177/00178969241274621

2024-08-30

Health Education Journal

Abstract:Health Education Journal, Ahead of Print. Introduction:In Australia, 54.3% of medical students are women yet they remain under-represented in stereotypical perspectives of medicine. While potentially transformative, generative artificial intelligence (genAI) has the potential for errors, misrepresentations and bias. GenAI text-to-image production could reinforce gender biases making it important to evaluate DALL-E 3 (the text-to-image genAI supported through ChatGPT) representations of Australian medical students.Method:In March 2024, DALL-E 3 was utilised via GPT-4 to generate a series of individual and group images of medical students, specifically Australian undergraduate medical students to eliminate potential confounders. Multiple iterations of images were generated using a variety of prompts. Collectively, 47 images were produced for evaluation of which 33 were individual characters and the remaining 14 images were comprised of multiple (5 to 67) characters. All images were independently analysed by three reviewers for apparent gender and skin tone. Consequently, 33 feature individuals were evaluated and a further 417 characters in groups were evaluated (N = 448). Discrepancies in responses were resolved by consensus.Results:Collectively (individual and group images), 58.8% (N = 258) of medical students were depicted as men, 39.9% (N = 175) as women, 92.0% (N = 404) with a light skin tone, 7.7% (N = 34) with mid skin tone and 0% with dark skin tone. The gender distribution was a statistically significant variation from that of actual Australian medical students for individual images, for group images and for collective images. Among the images of individual medical students (N = 25), DALL-E 3 generated 92% (N = 23) as men and 100% were of light skin tone (N = 25).Conclusion:This evaluation reveals the gender associated with genAI text-to-image generation using DALL-E 3 among Australian undergraduate medical students. Generated images included a disproportionately high proportion of white male medical students which is not representative of the diversity of medical students in Australia. The use of DALL-E 3 to produce depictions of medical students for education or promotion purposes should be done with caution.

public, environmental & occupational health,education & educational research
Gender and ethnicity bias in generative artificial intelligence text-to-image depiction of pharmacists

Geoffrey Currie,George John,Johnathan Hewis

DOI: https://doi.org/10.1093/ijpp/riae049

2024-11-14

Abstract:Introduction: In Australia, 64% of pharmacists are women but continue to be under-represented. Generative artificial intelligence (AI) is potentially transformative but also has the potential for errors, misrepresentations, and bias. Generative AI text-to-image production using DALL-E 3 (OpenAI) is readily accessible and user-friendly but may reinforce gender and ethnicity biases. Methods: In March 2024, DALL-E 3 was utilized to generate individual and group images of Australian pharmacists. Collectively, 40 images were produced with DALL-E 3 for evaluation of which 30 were individual characters and the remaining 10 images were comprised of multiple characters (N = 155). All images were independently analysed by two reviewers for apparent gender, age, ethnicity, skin tone, and body habitus. Discrepancies in responses were resolved by third-observer consensus. Results: Collectively for DALL-E 3, 69.7% of pharmacists were depicted as men, 29.7% as women, 93.5% as a light skin tone, 6.5% as mid skin tone, and 0% as dark skin tone. The gender distribution was a statistically significant variation from that of actual Australian pharmacists (P < .001). Among the images of individual pharmacists, DALL-E 3 generated 100% as men and 100% were light skin tone. Conclusions: This evaluation reveals the gender and ethnicity bias associated with generative AI text-to-image generation using DALL-E 3 among Australian pharmacists. Generated images have a disproportionately high representation of white men as pharmacists which is not representative of the diversity of pharmacists in Australia today.
Optical coherence tomography findings in niacin maculopathy.

H. Dajani,A. Lauer

DOI: https://doi.org/10.1139/I06-008

2006-04-01

Abstract:CASE REPORT We present the case of 54-year-old male who developed bilateral cystoid macular thickening while taking 3 g of niacin per day, and we describe the optical coherence tomography (OCT) features of niacin (nicotinic acid) maculopathy. COMMENTS Cystoid spaces were seen in both the outer plexiform and inner nuclear layers of both eyes. The cystoid spaces were largest and central in the outer plexiform layer, whereas a broader distribution of smaller cysts was seen in the inner nuclear layer. With cessation of niacin, his vision improved and the OCT features normalized.
The Face of a Surgeon: An Analysis of Demographic Representation in Three Leading Artificial Intelligence Text-to-Image Generators

Ali,R.,Tang,O. Y.,Connolly,I. D.,Abdulrazeq,H. A.,Mirza,F. N.,Lim,R. K.,Johnston,B. R.,Groff,M. W.,Williamson,T.,Svokos,K.,Libby,T. J.,Shin,J. H.,Gokaslan,Z. L.,Doberstein,C. E.,Zou,J.,Asaad,Z. F.

DOI: https://doi.org/10.1101/2023.05.24.23290463

2023-05-30

MedRxiv

Abstract:Background: This study investigates the accuracy of three prominent artificial intelligence (AI) text-to-image generators-DALL-E 2, Midjourney, and Stable Diffusion-in representing the demographic realities in the surgical profession, addressing raised concerns about the perpetuation of societal biases, especially profession-based stereotypes. Methods: A cross-sectional analysis was conducted on 2,400 images generated across eight surgical specialties by each model. An additional 1,200 images were evaluated based on geographic prompts for three countries. Images were generated using a prompt template, "A photo of the face of a [blank]", with blank replaced by a surgical specialty. Geographic-based prompting was evaluated by specifying the most populous countries for three continents (United States, Nigeria, and China). Results: There was a significantly higher representation of female (average=35.8% vs. 14.7%, P<0.001) and non-white (average=37.4% vs. 22.8%, P<0.001) surgeons among trainees than attendings. DALL-E 2 reflected attendings' true demographics for female surgeons (15.9% vs. 14.7%, P=0.386) and non-white surgeons (22.6% vs. 22.8%, P=0.919) but underestimated trainees' representation for both female (15.9% vs. 35.8%, P<0.001) and non-white (22.6% vs. 37.4%, P<0.001) surgeons. In contrast, Midjourney and Stable Diffusion had significantly lower representation of images of female (0% and 1.8%, respectively) and non-white (0.5% and 0.6%, respectively) surgeons than DALL-E 2 or true demographics (all P<0.001). Geographic-based prompting increased non-white surgeon representation (all P<0.001), but did not alter female representation (P=0.779). Conclusions: While Midjourney and Stable Diffusion amplified societal biases by depicting over 98% of surgeons as white males, DALL-E 2 depicted more accurate demographics, although all three models underestimated trainee representation. These findings underscore the necessity for guardrails and robust feedback systems to prevent AI text-to-image generators from exacerbating profession-based stereotypes, and the importance of bolstering the representation of the evolving surgical field in these models' future training sets.
Artificial Intelligence Portrayals in Orthopaedic Surgery

Mary Morcos,Jessica Duggan,Jason Young,Shaina A. Lipa

DOI: https://doi.org/10.2106/jbjs.24.00150

2024-07-18

Journal of Bone and Joint Surgery

Abstract:Background: The increasing accessibility of artificial intelligence (AI) text-to-image generators offers a novel avenue for exploring societal perceptions. The present study assessed AI-generated images to examine the representation of gender and racial diversity among orthopaedic surgeons. Methods: Five prominent text-to-image generators (DALL·E 2, Runway, Midjourney, ImagineAI, and JasperArt) were utilized to create images for the search queries “Orthopedic Surgeon,” “Orthopedic Surgeon’s Face,” and “Portrait of an Orthopedic Surgeon.” Each query produced 80 images, resulting in a total of 240 images per generator. Two independent reviewers categorized race, sex, and age in each image, with a third reviewer resolving discrepancies. Images with incomplete or multiple faces were excluded. The demographic proportions (sex, race, and age) of the AI-generated images were then compared with those of the 2018 American Academy of Orthopaedic Surgeons (AAOS) census. Results: In our examination across all AI platforms, 82.8% of the images depicted surgeons as White, 12.3% as Asian, 4.1% as Black, and 0.75% as other; 94.5% of images were men; and a majority (64.4%) appeared ≥50 years old. DALL·E 2 exhibited significantly increased diversity in representation of both women and non-White surgeons compared with the AAOS census, whereas Midjourney, Runway, and ImagineAI exhibited significantly decreased representation. Conclusions: The present study highlighted distortions in AI portrayal of orthopaedic surgeon diversity, influencing public perceptions and potentially reinforcing disparities. DALL·E 2 and JasperArt show encouraging diversity, but limitations persist in other generators. Future research should explore strategies for improving AI to promote a more inclusive and accurate representation of the evolving demographics of orthopaedic surgery, mitigating biases related to race and gender. Clinical Relevance: This study is clinically relevant as it investigates the accuracy of AI-generated images in depicting diversity among orthopaedic surgeons. The findings reveal significant discrepancies in representation by race and gender, which could impact societal perceptions and exacerbate existing disparities in health care.

surgery,orthopedics
Generative Artificial Intelligence Biases, Limitations and Risks in Nuclear Medicine: An Argument for Appropriate Use Framework and Recommendations

Geoffrey M Currie,K Elizabeth Hawk,Eric M Rohren

DOI: https://doi.org/10.1053/j.semnuclmed.2024.05.005

2024-06-07

Abstract:Generative artificial intelligence (AI) algorithms for both text-to-text and text-to-image applications have seen rapid and widespread adoption in the general and medical communities. While limitations of generative AI have been widely reported, there remain valuable applications in patient and professional communities. Here, the limitations and biases of both text-to-text and text-to-image generative AI are explored using purported applications in medical imaging as case examples. A direct comparison of the capabilities of four common text-to-image generative AI algorithms is reported and recommendations for the most appropriate use, DALL-E 3, justified. The risks use and biases are outlined, and appropriate use guidelines framed for use of generative AI in nuclear medicine. Generative AI text-to-text and text-to-image generation includes inherent biases, particularly gender and ethnicity, that could misrepresent nuclear medicine. The assimilation of generative AI tools into medical education, image interpretation, patient education, health promotion and marketing in nuclear medicine risks propagating errors and amplification of biases. Mitigation strategies should reside inside appropriate use criteria and minimum standards for quality and professionalism for the application of generative AI in nuclear medicine.
Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis

Agostina J. Larrazabal,Nicolás Nieto,Victoria Peterson,Diego H. Milone,Enzo Ferrante

DOI: https://doi.org/10.1073/pnas.1919012117

IF: 11.1

2020-05-26

Proceedings of the National Academy of Sciences

Abstract:Artificial intelligence (AI) systems for computer-aided diagnosis and image-based screening are being adopted worldwide by medical institutions. In such a context, generating fair and unbiased classifiers becomes of paramount importance. The research community of medical image computing is making great efforts in developing more accurate algorithms to assist medical doctors in the difficult task of disease diagnosis. However, little attention is paid to the way databases are collected and how this may influence the performance of AI systems. Our study sheds light on the importance of gender balance in medical imaging datasets used to train AI systems for computer-assisted diagnosis. We provide empirical evidence supported by a large-scale study, based on three deep neural network architectures and two well-known publicly available X-ray image datasets used to diagnose various thoracic diseases under different gender imbalance conditions. We found a consistent decrease in performance for underrepresented genders when a minimum balance is not fulfilled. This raises the alarm for national agencies in charge of regulating and approving computer-assisted diagnosis systems, which should include explicit gender balance and diversity recommendations. We also establish an open problem for the academic medical image computing community which needs to be addressed by novel algorithms endowed with robustness to gender imbalance.

multidisciplinary sciences
Smiling Women Pitching Down: Auditing Representational and Presentational Gender Biases in Image Generative AI

Luhang Sun,Mian Wei,Yibing Sun,Yoo Ji Suh,Liwei Shen,Sijia Yang

2023-05-18

Abstract:Generative AI models like DALL-E 2 can interpret textual prompts and generate high-quality images exhibiting human creativity. Though public enthusiasm is booming, systematic auditing of potential gender biases in AI-generated images remains scarce. We addressed this gap by examining the prevalence of two occupational gender biases (representational and presentational biases) in 15,300 DALL-E 2 images spanning 153 occupations, and assessed potential bias amplification by benchmarking against 2021 census labor statistics and Google Images. Our findings reveal that DALL-E 2 underrepresents women in male-dominated fields while overrepresenting them in female-dominated occupations. Additionally, DALL-E 2 images tend to depict more women than men with smiling faces and downward-pitching heads, particularly in female-dominated (vs. male-dominated) occupations. Our computational algorithm auditing study demonstrates more pronounced representational and presentational biases in DALL-E 2 compared to Google Images and calls for feminist interventions to prevent such bias-laden AI-generated images to feedback into the media ecology.

Computer Vision and Pattern Recognition,Artificial Intelligence,Computers and Society
Bias in Generative AI

Mi Zhou,Vibhanshu Abhishek,Timothy Derdenger,Jaymo Kim,Kannan Srinivasan

2024-03-05

Abstract:This study analyzed images generated by three popular generative artificial intelligence (AI) tools - Midjourney, Stable Diffusion, and DALLE 2 - representing various occupations to investigate potential bias in AI generators. Our analysis revealed two overarching areas of concern in these AI generators, including (1) systematic gender and racial biases, and (2) subtle biases in facial expressions and appearances. Firstly, we found that all three AI generators exhibited bias against women and African Americans. Moreover, we found that the evident gender and racial biases uncovered in our analysis were even more pronounced than the status quo when compared to labor force statistics or Google images, intensifying the harmful biases we are actively striving to rectify in our society. Secondly, our study uncovered more nuanced prejudices in the portrayal of emotions and appearances. For example, women were depicted as younger with more smiles and happiness, while men were depicted as older with more neutral expressions and anger, posing a risk that generative AI models may unintentionally depict women as more submissive and less competent than men. Such nuanced biases, by their less overt nature, might be more problematic as they can permeate perceptions unconsciously and may be more difficult to rectify. Although the extent of bias varied depending on the model, the direction of bias remained consistent in both commercial and open-source AI generators. As these tools become commonplace, our study highlights the urgency to identify and mitigate various biases in generative AI, reinforcing the commitment to ensuring that AI technologies benefit all of humanity for a more inclusive future.

General Economics,Artificial Intelligence,Computers and Society
Effect of 1,25-dihydroxyvitamin D deficiency on the metabolic clearance rate of 1,25-dihydroxyvitamin D3: studies using pigs with vitamin D-dependent rickets type 1.

J. Fox,A. Care

DOI: https://doi.org/10.1042/CS0690549

1985-11-01

Clinical Science

Abstract:We have used pigs with inherited vitamin D-dependent rickets type 1 to study the effect of 1,25-dihydroxyvitamin D deficiency on the metabolic clearance rate of 3H-1,25-dihydroxyvitamin D3 infused to steady-state levels in plasma. Plasma levels of 1,25-dihydroxyvitamin D were 24 +/- 1 (SEM) pmol/l in the hypocalcaemic, homozygous piglets and 196 +/- 27 pmol/l in their normocalcaemic, heterozygous siblings. The metabolic clearance rate of 1,25-dihydroxyvitamin D3 was the same in both normal heterozygous (0.90 +/- 0.02) and hypocalcaemic, homozygous piglets (0.90 +/- 0.01 ml-1 min-1 kg-1 metabolic body size). We conclude that a deficiency of circulating 1,25-dihydroxyvitamin D does not influence the clearance of 1,25-dihydroxyvitamin D3 from the circulation of pigs.
Analyzing Racial Differences in Imaging Joint Replacement Registries Using Generative Artificial Intelligence: Advancing Orthopaedic Data Equity

Bardia Khosravi,Pouria Rouzrokh,Bradley J Erickson,Hillary W Garner,Doris E Wenger,Michael J Taunton,Cody C Wyles

DOI: https://doi.org/10.1016/j.artd.2024.101503

2024-09-23

Abstract:Background: Discrepancies in medical data sets can perpetuate bias, especially when training deep learning models, potentially leading to biased outcomes in clinical applications. Understanding these biases is crucial for the development of equitable healthcare technologies. This study employs generative deep learning technology to explore and understand radiographic differences based on race among patients undergoing total hip arthroplasty. Methods: Utilizing a large institutional registry, we retrospectively analyzed pelvic radiographs from total hip arthroplasty patients, characterized by demographics and image features. Denoising diffusion probabilistic models generated radiographs conditioned on demographic and imaging characteristics. Fréchet Inception Distance assessed the generated image quality, showing the diversity and realism of the generated images. Sixty transition videos were generated that showed transforming White pelvises to their closest African American counterparts and vice versa while controlling for patients' sex, age, and body mass index. Two expert surgeons and 2 radiologists carefully studied these videos to understand the systematic differences that are present in the 2 races' radiographs. Results: Our data set included 480,407 pelvic radiographs, with a predominance of White patients over African Americans. The generative denoising diffusion probabilistic model created high-quality images and reached an Fréchet Inception Distance of 6.8. Experts identified 6 characteristics differentiating races, including interacetabular distance, osteoarthritis degree, obturator foramina shape, femoral neck-shaft angle, pelvic ring shape, and femoral cortical thickness. Conclusions: This study demonstrates the potential of generative models for understanding disparities in medical imaging data sets. By visualizing race-based differences, this method aids in identifying bias in downstream tasks, fostering the development of fairer healthcare practices.
Perpetuation of Gender Bias in Visual Representation of Professions in the Generative AI Tools DALL·E and Bing Image Creator

Teresa Sandoval-Martin,Ester Martínez-Sanzo

DOI: https://doi.org/10.3390/socsci13050250

2024-05-02

The Social Sciences

Abstract:Artificial intelligence (AI)-based generative imaging systems such as DALL·E, Midjourney, Stable Diffusion, and Adobe Firefly, which work by transforming natural language descriptions into images, are revolutionizing computer vision. In this exploratory and qualitative research, we have replicated requests for images of women in different professions by comparing these representations in previous studies with DALL·E, observing that this model continues to provide in its last version, DALL·E 3, inequitable results in terms of gender. In addition, Bing Image Creator, Microsoft's free tool that is widely used among the population and runs under DALL·E, has been tested for the first time. It also presents a sexualization of women and stereotypical children's representations. The results reveal the following: 1. A slight improvement in terms of the presence of women in professions previously shown only with men. 2. They continue to offer biased results in terms of the objectification of women by showing sexualized women. 3. The representation of children highlights another level of gender bias, reinforcing traditional stereotypes associated with gender roles from childhood, which can impact future decisions regarding studies and occupations.
The Limits of Fair Medical Imaging AI In The Wild

Yuzhe Yang,Haoran Zhang,Judy W Gichoya,Dina Katabi,Marzyeh Ghassemi

2023-12-12

Abstract:As artificial intelligence (AI) rapidly approaches human-level performance in medical imaging, it is crucial that it does not exacerbate or propagate healthcare disparities. Prior research has established AI's capacity to infer demographic data from chest X-rays, leading to a key concern: do models using demographic shortcuts have unfair predictions across subpopulations? In this study, we conduct a thorough investigation into the extent to which medical AI utilizes demographic encodings, focusing on potential fairness discrepancies within both in-distribution training sets and external test sets. Our analysis covers three key medical imaging disciplines: radiology, dermatology, and ophthalmology, and incorporates data from six global chest X-ray datasets. We confirm that medical imaging AI leverages demographic shortcuts in disease classification. While correcting shortcuts algorithmically effectively addresses fairness gaps to create "locally optimal" models within the original data distribution, this optimality is not true in new test settings. Surprisingly, we find that models with less encoding of demographic attributes are often most "globally optimal", exhibiting better fairness during model evaluation in new test environments. Our work establishes best practices for medical imaging models which maintain their performance and fairness in deployments beyond their initial training contexts, underscoring critical considerations for AI clinical deployments across populations and sites.

Computers and Society,Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning
Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Yuzhe Yang,Yujia Liu,Xin Liu,Avanti Gulhane,Domenico Mastrodicasa,Wei Wu,Edward J Wang,Dushyant W Sahani,Shwetak Patel

2024-02-23

Abstract:Advances in artificial intelligence (AI) have achieved expert-level performance in medical imaging applications. Notably, self-supervised vision-language foundation models can detect a broad spectrum of pathologies without relying on explicit training annotations. However, it is crucial to ensure that these AI models do not mirror or amplify human biases, thereby disadvantaging historically marginalized groups such as females or Black patients. The manifestation of such biases could systematically delay essential medical care for certain patient subgroups. In this study, we investigate the algorithmic fairness of state-of-the-art vision-language foundation models in chest X-ray diagnosis across five globally-sourced datasets. Our findings reveal that compared to board-certified radiologists, these foundation models consistently underdiagnose marginalized groups, with even higher rates seen in intersectional subgroups, such as Black female patients. Such demographic biases present over a wide range of pathologies and demographic attributes. Further analysis of the model embedding uncovers its significant encoding of demographic information. Deploying AI systems with these biases in medical imaging can intensify pre-existing care disparities, posing potential challenges to equitable healthcare access and raising ethical questions about their clinical application.

Computers and Society,Machine Learning,Computer Vision and Pattern Recognition,Artificial Intelligence
Coding Inequity: Assessing GPT-4's Potential for Perpetuating Racial and Gender Biases in Healthcare

Travis Zack,Eric Lehman,Mirac Suzgun,Jorge A. Rodriguez,Leo Anthony Celi,Judy Gichoya,Dan Jurafsky,Peter Szolovits,David W. Bates,Raja-Elie E. Abdulnour,Atul J. Butte,Emily Alsentzer,David W Bates

DOI: https://doi.org/10.1101/2023.07.13.23292577

2023-07-17

MedRxiv

Abstract:Background. Large language models (LLMs) such as GPT-4 hold great promise as transformative tools in healthcare, ranging from automating administrative tasks to augmenting clinical decision-making. However, these models also pose a serious danger of perpetuating biases and delivering incorrect medical diagnoses, which can have a direct, harmful impact on medical care. Methods. Using the Azure OpenAI API, we tested whether GPT-4 encodes racial and gender biases and examined the impact of such biases on four potential applications of LLMs in the clinical domain---namely, medical education, diagnostic reasoning, plan generation, and patient assessment. We conducted experiments with prompts designed to resemble typical use of GPT-4 within clinical and medical education applications. We used clinical vignettes from NEJM Healer and from published research on implicit bias in healthcare. GPT-4 estimates of the demographic distribution of medical conditions were compared to true U.S. prevalence estimates. Differential diagnosis and treatment planning were evaluated across demographic groups using standard statistical tests for significance between groups. Findings. We find that GPT-4 does not appropriately model the demographic diversity of medical conditions, consistently producing clinical vignettes that stereotype demographic presentations. The differential diagnoses created by GPT-4 for standardized clinical vignettes were more likely to include diagnoses that stereotype certain races, ethnicities, and gender identities. Assessment and plans created by the model showed significant association between demographic attributes and recommendations for more expensive procedures as well as differences in patient perception. Interpretation. Our findings highlight the urgent need for comprehensive and transparent bias assessments of LLM tools like GPT-4 for every intended use case before they are integrated into clinical care. We discuss the potential sources of these biases and potential mitigation strategies prior to clinical implementation.
Medical imaging data science competitions should report dataset demographics and evaluate for bias

Sean P. Garin,Vishwa S. Parekh,Jeremias Sulam,Paul H. Yi

DOI: https://doi.org/10.1038/s41591-023-02264-0

IF: 82.9

2023-04-04

Nature Medicine

Abstract:Artificial intelligence (AI) has promise for automating the diagnosis of diseases from medical imaging, with some deep learning models demonstrating performance comparable to that of expert physicians 1 . However, AI models have also demonstrated biases due to the under-representation of certain demographic groups in the datasets used to develop them 2 , which have the potential to exacerbate pre-existing racial and gender disparities in clinical care 2,3 . Identifying potential biases in the early stages of dataset and model development should be standard practice.

biochemistry & molecular biology,cell biology,medicine, research & experimental
Gender Bias Evaluation in Text-to-image Generation: A Survey

Yankun Wu,Yuta Nakashima,Noa Garcia

2024-08-21

Abstract:The rapid development of text-to-image generation has brought rising ethical considerations, especially regarding gender bias. Given a text prompt as input, text-to-image models generate images according to the prompt. Pioneering models such as Stable Diffusion and DALL-E 2 have demonstrated remarkable capabilities in producing high-fidelity images from natural language prompts. However, these models often exhibit gender bias, as studied by the tendency of generating man from prompts such as "a photo of a software developer". Given the widespread application and increasing accessibility of these models, bias evaluation is crucial for regulating the development of text-to-image generation. Unlike well-established metrics for evaluating image quality or fidelity, the evaluation of bias presents challenges and lacks standard approaches. Although biases related to other factors, such as skin tone, have been explored, gender bias remains the most extensively studied. In this paper, we review recent work on gender bias evaluation in text-to-image generation, involving bias evaluation setup, bias evaluation metrics, and findings and trends. We primarily focus on the evaluation of recent popular models such as Stable Diffusion, a diffusion model operating in the latent space and using CLIP text embedding, and DALL-E 2, a diffusion model leveraging Seq2Seq architectures like BART. By analyzing recent work and discussing trends, we aim to provide insights for future work.

Computers and Society
Demographic Reporting in Publicly Available Chest Radiograph Data Sets: Opportunities for Mitigating Sex and Racial Disparities in Deep Learning Models

Paul H Yi,Tae Kyung Kim,Eliot Siegel,Noushin Yahyavi-Firouz-Abadi

DOI: https://doi.org/10.1016/j.jacr.2021.08.018

Abstract:Objective: Data sets with demographic imbalances can introduce bias in deep learning models and potentially amplify existing health disparities. We evaluated the reporting of demographics and potential biases in publicly available chest radiograph (CXR) data sets. Methods: We reviewed publicly available CXR data sets available on February 1, 2021, with >100 CXRs and performed a thorough search of various repositories, including Radiopaedia and Kaggle. For each data set, we recorded the total number of images and whether the data set reported demographic variables (age, race or ethnicity, sex, insurance status) in aggregate and on an image-level basis. Results: Twenty-three CXR data sets were included (range, 105-371,858 images). Most data sets reported demographics in some form (19 of 23; 82.6%) and on an image level (17 of 23; 73.9%). The majority reported age (19 of 23; 82.6%) and sex (18 of 23; 78.2%), but a minority reported race or ethnicity (2 of 23; 8.7%) and insurance status (1 of 23; 4.3%). Of the 13 data sets with sex distribution readily available, the average breakdown was 55.2% male subjects, ranging from 47.8% to 69.7% male representation. Of these, 8 (61.5%) overrepresented male subjects and 5 (38.5%) overrepresented female subjects. Discussion: Although most publicly available CXR data sets report age and sex on an image-basis level, few report race or ethnicity and insurance status. Furthermore, these data sets frequently underrepresent one of the sexes, more frequently the female sex. We recommend that data sets report standard demographic variables, and when possible, balance demographic representation to mitigate bias. Furthermore, for researchers using these data sets, we recommend that attention be paid to balancing demographic labels in addition to disease labels, as well as developing training methods that can account for these imbalances.
Addressing Artificial Intelligence Bias in Retinal Disease Diagnostics

Philippe Burlina,Neil Joshi,William Paul,Katia D. Pacheco,Neil M. Bressler

DOI: https://doi.org/10.48550/arXiv.2004.13515

2020-12-02

Abstract:This study evaluated generative methods to potentially mitigate AI bias when diagnosing diabetic retinopathy (DR) resulting from training data imbalance, or domain generalization which occurs when deep learning systems (DLS) face concepts at test/inference time they were not initially trained on. The public domain Kaggle-EyePACS dataset (88,692 fundi and 44,346 individuals, originally diverse for ethnicity) was modified by adding clinician-annotated labels and constructing an artificial scenario of data imbalance and domain generalization by disallowing training (but not testing) exemplars for images of retinas with DR warranting referral (DR-referable) and from darker-skin individuals, who presumably have greater concentration of melanin within uveal melanocytes, on average, contributing to retinal image pigmentation. A traditional/baseline diagnostic DLS was compared against new DLSs that would use training data augmented via generative models for debiasing. Accuracy (95% confidence intervals [CI]) of the baseline diagnostics DLS for fundus images of lighter-skin individuals was 73.0% (66.9%, 79.2%) vs. darker-skin of 60.5% (53.5%, 67.3%), demonstrating bias/disparity (delta=12.5%) (Welch t-test t=2.670, P=.008) in AI performance across protected subpopulations. Using novel generative methods for addressing missing subpopulation training data (DR-referable darker-skin) achieved instead accuracy, for lighter-skin, of 72.0% (65.8%, 78.2%), and for darker-skin, of 71.5% (65.2%,77.8%), demonstrating closer parity (delta=0.5%) in accuracy across subpopulations (Welch t-test t=0.111, P=.912). Findings illustrate how data imbalance and domain generalization can lead to disparity of accuracy across subpopulations, and show that novel generative methods of synthetic fundus images may play a role for debiasing AI.

Artificial Intelligence,Computer Vision and Pattern Recognition,Image and Video Processing

Patterns of photoassimilate translocation to reproductive shoots from adjacent shoots in Camelliasasanqua by manipulation of sink-source balance between the shoots

[Extra-pancreatic lesions of autoimmune pancreatitis and diagnostic procedures].

Gender bias in generative artificial intelligence text-to-image depiction of medical students

Gender and ethnicity bias in generative artificial intelligence text-to-image depiction of pharmacists

Optical coherence tomography findings in niacin maculopathy.

The Face of a Surgeon: An Analysis of Demographic Representation in Three Leading Artificial Intelligence Text-to-Image Generators

Artificial Intelligence Portrayals in Orthopaedic Surgery

Generative Artificial Intelligence Biases, Limitations and Risks in Nuclear Medicine: An Argument for Appropriate Use Framework and Recommendations

Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis

Smiling Women Pitching Down: Auditing Representational and Presentational Gender Biases in Image Generative AI

Bias in Generative AI

Effect of 1,25-dihydroxyvitamin D deficiency on the metabolic clearance rate of 1,25-dihydroxyvitamin D3: studies using pigs with vitamin D-dependent rickets type 1.

Analyzing Racial Differences in Imaging Joint Replacement Registries Using Generative Artificial Intelligence: Advancing Orthopaedic Data Equity

Perpetuation of Gender Bias in Visual Representation of Professions in the Generative AI Tools DALL·E and Bing Image Creator

The Limits of Fair Medical Imaging AI In The Wild

Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Coding Inequity: Assessing GPT-4's Potential for Perpetuating Racial and Gender Biases in Healthcare

Medical imaging data science competitions should report dataset demographics and evaluate for bias

Gender Bias Evaluation in Text-to-image Generation: A Survey

Demographic Reporting in Publicly Available Chest Radiograph Data Sets: Opportunities for Mitigating Sex and Racial Disparities in Deep Learning Models

Addressing Artificial Intelligence Bias in Retinal Disease Diagnostics