Recent analytical methodologies on equilibrium, kinetics, and dynamics at liquid/liquid interface.

S. Tsukahara

DOI: https://doi.org/10.1016/J.ACA.2005.05.050

IF: 6.911

2006-01-18

Analytica Chimica Acta

Abstract:

What problem does this paper attempt to address?

Variations in breast cancer detection rates during mammogram-reading sessions: does experience have an impact?

Abdulaziz S Alshabibi,Moayyad E Suleiman,Salman M Albeshan,Robert Heard,Patrick C Brennan

DOI: https://doi.org/10.1259/bjr.20210895

2022-01-01

Abstract:Objectives: To examine whether radiologists’ performances are consistent throughout a reading session and whether any changes in performance over the reading task differ depending on experience of the reader. Methods: The performance of ten radiologists reading a test set of 60 mammographic cases without breaks was assessed using an ANOVA, 2 × 3 factorial design. Participants were categorized as more (≥2,000 mammogram readings per year) or less (<2,000 readings per year) experienced. Three series of 20 cases were chosen to ensure comparable difficulty and presented in the same sequence to all readers. It usually takes around 30 min for a radiologist to complete each of the 20-case series, resulting in a total of 90 min for the 60 mammographic cases. The sensitivity, specificity, lesion sensitivity, and area under the ROC curve were calculated for each series. We hypothesized that the order in which a series was read (i.e. fixed-series sequence) would have a significant main effect on the participants’ performance. We also determined if significant interactions exist between the fixed-series sequence and radiologist experience. Results: Significant linear interactions were found between experience and the fixed sequence of the series for sensitivity (F[1] =5.762, p = .04, partial η 2 = .41) and lesion sensitivity. (F[1] =6.993, p = .03, partial η 2 = .46). The two groups’ mean scores were similar for the first series but progressively diverged. By the end of the third series, significant differences in sensitivity and lesion sensitivity were evident, with the more experienced individuals demonstrating improving and the less experienced declining performance. Neither experience nor series sequence significantly affected the specificity or the area under the ROC curve. Conclusions: Radiologists’ performance may change considerably during a reading session, apparently as a function of experience, with less experienced radiologists declining in sensitivity and lesion sensitivity while more experienced radiologists actually improve. With the increasing demands on radiologists to undertake high-volume reporting, we suggest that junior radiologists be made aware of possible sensitivity and lesion sensitivity deterioration over time so they can schedule breaks during continuous reading sessions that are appropriate to them, rather than try to emulate their more experienced colleagues. Advances in knowledge: Less-experienced radiologists demonstrated a reduction in mammographic diagnostic accuracy in later stages of the reporting sessions. This may suggest that extending the duration of reporting sessions to compensate for increasing workloads may not represent the optimal solution for less-experienced radiologists.

radiology, nuclear medicine & medical imaging
On soft-decision iterative decoding algorithms by using algebraic decoding for RS codes

H. Tokushige,Ippei Hisadomi,T. Kasami

DOI: https://doi.org/10.1109/GLOCOM.2002.1188353

2002-11-17

Abstract:We consider an iterative decoding algorithm by using algebraic decoding for non-binary codes. In the decoding algorithm, algebraic decoding are carried out with respect to successively chosen input words, called the search centers. We present a new method for selecting sequences of search centers of algebraic decoding. Over the AWGN channel using BPSK signaling, we show simulation results on the error performances of the iterative decoding algorithms whose search centers are given by the proposed method, abbreviated IAD, for Reed-Solomon codes. From the simulation results, IAD provides considerably better error performance than GMD and CGA decoding with the same number of iterations.
[Ambulatory 24-hour blood pressure monitoring in patients with resistant hypertension].

M. Sznajderman,W. Popławska,I. Cybulska,J. Niegowska,M. Makowiecka-ciesla,R. Baranowski

Kardiologia Polska

Abstract:The aim of the study was to assess the usefulness of 24-hour blood pressure (BP) and heart rate (HR) monitoring in patients with "resistant" hypertension. 30 patients (44.1 +/- 9.9 years) with diastolic BP 100 mm Hg or more in spite of treatment with three or more antihypertensive drugs were studied. Ambulatory recording of BP and HR was performed by means of Del Mar Avionics monitoring system 9000. Mean recording time was 21.5 hours and mean number of measurements during one recording--56.7. Mean ambulatory systolic and diastolic BP values were significantly lower than mean value of three casual measurements (146.0 +/- 24.6 vs 171.5 +/- 21.2 mm Hg for systolic and 97.2 +/- 11.3 vs 110.4 +/- 7.5 mm Hg for diastolic BP p less than 0.01) In 14 (46.6%) systolic BP and in 10 patients (33.3%) diastolic BP were normal. The patients with normal and abnormal ambulatory BP recordings did not differ in regard to age and mean clinic BP levels. However, patients with abnormal ambulatory BP recordings were more often overweight and showed a greater frequency of left ventricular hypertrophy and family history of hypertension and its complications. The results of the study show that ambulatory BP monitoring may be of value in assessing the response to antihypertensive treatment in patients with so called resistant hypertension as judged on the basis of clinic pressure.
Title Structure of the C-terminal domain of the multifunctionalICP 27 protein from herpes simplex virus 1

V. Patel,S. Dahlroth,V. Rajakannan,H. Ho,T. Cornvik,P. Nordlund

Abstract:Herpesviruses are nuclear-replicating viruses that have successfully evolved to evade the immune system of humans, establishing lifelong infections. ICP27 from herpes simplex virus is a multifunctional regulatory protein that is functionally conserved in all known human herpesviruses. It has the potential to interact with an array of cellular proteins, as well as intronless viral RNAs. ICP27 plays an essential role in viral transcription, nuclear export of intronless RNAs, translation of viral transcripts, and virion host shutoff function. It has also been implicated in several signaling pathways and the prevention of apoptosis. Although much is known about its central role in viral replication and infection, very little is known about the structure and mechanistic properties of ICP27 and its homologs. We present the first crystal structure of ICP27 C-terminal domain at a resolution of 2.0 Å. The structure reveals the C-terminal half of ICP27 to have a novel fold consisting of -helices and long loops, along with a unique CHCC-type of zinc-binding motif. The two termini of this domain extend from the central core and hint to possibilities of making interactions. ICP27 essential domain is capable of forming self-dimers as seen in the structure, which is confirmed by analytical ultracentrifugation study. Preliminary in vitro phosphorylation assays reveal that this domain may be regulated by
Exploring the impact of work experience on the detection of specific cancers across different breast density levels on screening mammograms

Phuong D. (Yun) Trieu,Melissa Barron,Dania Abu Awwad,Sarah J. Lewis

DOI: https://doi.org/10.1016/j.ejrad.2024.111776

IF: 4.531

2024-10-05

European Journal of Radiology

Abstract:Purpose This study explores the attributes of true positive and false positive rates in screening mammogram test sets assessed by breast screening radiologists in order to identify the combined impact of prior images, breast density and lesion features with experience factors linked to diagnostic performance. Methods 869 radiologists' first-time readings across nine mammogram BREAST test sets with 361 normal and 179 cancer mammograms were collected between 2014 and 2023. Participants viewed digital mammograms on diagnostic monitors and localized abnormal lesions. The performances of readers in normal and cancer cases were compared with the ground truth and analyzed in four quartiles of breast density, lesion types and the availability of prior images using Man-Whitney U and Kruskal Wallis tests. The general linear model was applied to determine independent and significant covariates that affected the true positives and false positives. The correlation of the readers' experience with the performances in different case and lesion features was explored using Spearman test. Results The combination of lesion appearance and the availability of prior images had a significant impact on false positive results (P=0.033). The model that included lesion appearance, breast density, and no prior image status significantly influenced case true positives of readers (P=0.026). Meanwhile, the model considering only lesion appearance and breast density (P=0.002) had a significant effect on lesion true positives. There was a positive correlation observed between the number of cases read per week and readers' performances, including TP rates and lesion sensitivity across various lesion types (P<0.05). Radiologists reading over 100 cases weekly achieved 80 % true positive rate for architectural distortion, asymmetric density, and masses, while this threshold increased to over 150 cases for calcifications. Detecting mixed lesion types required reading more than 60 cases weekly. Radiologists with over 5 years' experience achieved 70–75 % accuracy in localizing cancer lesions. Conclusion Findings highlight the significant combined impact of breast density, prior image availability, lesion characteristics, and breast screening readers' experience on breast cancer detection.

radiology, nuclear medicine & medical imaging
National Performance Benchmarks for Modern Diagnostic Digital Mammography: Update from the Breast Cancer Surveillance Consortium

Brian L Sprague,Robert F Arao,Diana L Miglioretti,Louise M Henderson,Diana S M Buist,Tracy Onega,Garth H Rauscher,Janie M Lee,Anna N A Tosteson,Karla Kerlikowske,Constance D Lehman,Breast Cancer Surveillance Consortium

DOI: https://doi.org/10.1148/radiol.2017161519

IF: 19.7

Radiology

Abstract:Purpose To establish contemporary performance benchmarks for diagnostic digital mammography with use of recent data from the Breast Cancer Surveillance Consortium (BCSC). Materials and Methods Institutional review board approval was obtained for active or passive consenting processes or to obtain a waiver of consent to enroll participants, link data, and perform analyses. Data were obtained from six BCSC registries (418 radiologists, 92 radiology facilities). Mammogram indication and assessments were prospectively collected for women undergoing diagnostic digital mammography and linked with cancer diagnoses from state cancer registries. The study included 401 548 examinations conducted from 2007 to 2013 in 265 360 women. Results Overall diagnostic performance measures were as follows: cancer detection rate, 34.7 per 1000 (95% confidence interval [CI]: 34.1, 35.2); abnormal interpretation rate, 12.6% (95% CI: 12.5%, 12.7%); positive predictive value (PPV) of a biopsy recommendation (PPV2), 27.5% (95% CI: 27.1%, 27.9%); PPV of biopsies performed (PPV3), 30.4% (95% CI: 29.9%, 30.9%); false-negative rate, 4.8 per 1000 (95% CI: 4.6, 5.0); sensitivity, 87.8% (95% CI: 87.3%, 88.4%); and specificity, 90.5% (95% CI: 90.4%, 90.6%). Among cancers detected, 63.4% were stage 0 or 1 cancers, 45.6% were minimal cancers, the mean size of invasive cancers was 21.2 mm, and 69.6% of invasive cancers were node negative. Performance metrics varied widely across diagnostic indications, with cancer detection rate (64.5 per 1000) and abnormal interpretation rate (18.7%) highest for diagnostic mammograms obtained to evaluate a breast problem with a lump. Compared with performance during the screen-film mammography era, diagnostic digital performance showed increased abnormal interpretation and cancer detection rates and decreasing PPVs, with less than 70% of radiologists within acceptable ranges for PPV2 and PPV3. Conclusion These performance measures can serve as national benchmarks that may help transform the marked variation in radiologists' diagnostic performance into targeted quality improvement efforts. © RSNA, 2017 Online supplemental material is available for this article.
Protocol for evaluating the fitness for purpose of an artificial intelligence product for radiology reporting in the BreastScreen New South Wales breast cancer screening programme

Warner-Smith,M.,Ren,K.,Mistry,C.,Walton,R.,Roder,D.,Bhola,N.,McGill,S.,OBrien,T. A.

DOI: https://doi.org/10.1136/bmjopen-2023-082350

IF: 3.006

2024-05-29

BMJ Open

Abstract:Introduction Radiologist shortages threaten the sustainability of breast cancer screening programmes. Artificial intelligence (AI) products that can interpret mammograms could mitigate this risk. While previous studies have suggested this technology has accuracy comparable to radiologists most have been limited by using 'enriched' datasets and/or not considering the interaction between the algorithm and human readers. This study will address these limitations by comparing the accuracy of a workflow using AI alongside radiologists on a large consecutive cohort of examinations from a breast cancer screening programme. The study will combine the strengths of a large retrospective design with the benefit of prospective data collection. It will test this technology without risk to screening programme participants nor the need to wait for follow-up data. With a sample of 2 years of consecutive screening examinations, it is likely the largest test of this technology to date. The study will help determine whether this technology can safely be introduced into the BreastScreen New South Wales (NSW) population-based screening programme to address radiology workforce risks without compromising cancer detection rates or increasing false-positive recalls. Methods and analysis A retrospective, consecutive cohort of digital mammography screens from 658 207 examinations from BreastScreen NSW will be reinterpreted by the Lunit Insight MMG AI product. The cohort includes 4383 screen-detected and 1171 interval cancers. The results will be compared with radiologist single reading and the AI results will also be used to replace the second reader in a double-reading model. New adjudication reading will be performed where the AI disagrees with the first reader. Recall rates and cancer detection rates of combined AI–radiologist reading will be compared with the rates obtained at the time of screening. Ethics and dissemination This study has ethical approval from the NSW Health Population Health Services Research Ethics Committee (2022/ETH02397). Findings will be published in peer-reviewed journals and presented at conferences. The findings of this evaluation will be provided to programme managers, governance bodies and other stakeholders in Australian breast cancer screening programmes.

medicine, general & internal
Does it matter for the radiologists’ performance whether they read short or long batches in organized mammographic screening?

Heinrich A. Backmann,Marthe Larsen,Anders S. Danielsen,Solveig Hofvind

DOI: https://doi.org/10.1007/s00330-021-08010-9

IF: 7.034

2021-06-10

European Radiology

Abstract:Abstract Objective To analyze the association between radiologists’ performance and image position within a batch in screen reading of mammograms in Norway. Method We described true and false positives and true and false negatives by groups of image positions and batch sizes for 2,937,312 screen readings performed from 2012 to 2018. Mixed-effects models were used to obtain adjusted proportions of true and false positive, true and false negative, sensitivity, and specificity for different image positions. We adjusted for time of day and weekday and included the individual variation between the radiologists as random effects. Time spent reading was included in an additional model to explore a possible mediation effect. Result True and false positives were negatively associated with image position within the batch, while the rates of true and false negatives were positively associated. In the adjusted analyses, the rate of true positives was 4.0 per 1000 (95% CI: 3.8–4.2) readings for image position 10 and 3.9 (95% CI: 3.7–4.1) for image position 60. The rate of true negatives was 94.4% (95% CI: 94.0–94.8) for image position 10 and 94.8% (95% CI: 94.4–95.2) for image position 60. Per 1000 readings, the rate of false negative was 0.60 (95% CI: 0.53–0.67) for image position 10 and 0.62 (95% CI: 0.55–0.69) for image position 60. Conclusion There was a decrease in the radiologists’ sensitivity throughout the batch, and although this effect was small, our results may be clinically relevant at a population level or when multiplying the differences with the number of screen readings for the individual radiologists. Key Points • True and false positive reading scores were negatively associated with image position within a batch. • A decreasing trend of positive scores indicated a beneficial effect of a certain number of screen readings within a batch. • False negative scores increased throughout the batch but the association was not statistically significant.

radiology, nuclear medicine & medical imaging
Impact of Different Mammography Systems on Artificial Intelligence Performance in Breast Cancer Screening

Clarisse F de Vries,Samantha J Colosimo,Roger T Staff,Jaroslaw A Dymiter,Joseph Yearsley,Deirdre Dinneen,Moragh Boyle,David J Harrison,Lesley A Anderson,Gerald Lip,iCAIRD Radiology Collaboration

DOI: https://doi.org/10.1148/ryai.220146

2023-03-22

Abstract:Artificial intelligence (AI) tools may assist breast screening mammography programs, but limited evidence supports their generalizability to new settings. This retrospective study used a 3-year dataset (April 1, 2016-March 31, 2019) from a U.K. regional screening program. The performance of a commercially available breast screening AI algorithm was assessed with a prespecified and site-specific decision threshold to evaluate whether its performance was transferable to a new clinical site. The dataset consisted of women (aged approximately 50-70 years) who attended routine screening, excluding self-referrals, those with complex physical requirements, those who had undergone a previous mastectomy, and those who underwent screening that had technical recalls or did not have the four standard image views. In total, 55 916 screening attendees (mean age, 60 years ± 6 [SD]) met the inclusion criteria. The prespecified threshold resulted in high recall rates (48.3%, 21 929 of 45 444), which reduced to 13.0% (5896 of 45 444) following threshold calibration, closer to the observed service level (5.0%, 2774 of 55 916). Recall rates also increased approximately threefold following a software upgrade on the mammography equipment, requiring per-software version thresholds. Using software-specific thresholds, the AI algorithm would have recalled 277 of 303 (91.4%) screen-detected cancers and 47 of 138 (34.1%) interval cancers. AI performance and thresholds should be validated for new clinical settings before deployment, while quality assurance systems should monitor AI performance for consistency. Keywords: Breast, Screening, Mammography, Computer Applications-Detection/Diagnosis, Neoplasms-Primary, Technology Assessment Supplemental material is available for this article. © RSNA, 2023.
Variability in mammographic images quality evaluation and Predictive factors affecting it

Norsuddin N Mohd,ZX Toh,IN Che Isa,Zain N Mohd

DOI: https://doi.org/10.1016/j.jmir.2022.10.129

2022-12-01

Journal of Medical Imaging and Radiation Sciences

Abstract:Introduction Performance of radiographers in producing high-quality mammographic images is crucial for the reliable detection of subtle lesions in the breast. This study evaluated the inter- and intra-agreement of PGMI classification system among radiographers and the predictive confounding factors of the variability. Methods A total of 28 radiographers evaluated 30 mammographic cases (120 images) by using the PGMI classification system through an online system. The Fleiss’ Kappa was used to analyze the inter-rater agreement while the intra-class correlation (ICC) was used to measure the intra-rater agreement among radiographers evaluating mammographic image quality using PGMI (Perfect, Good, Moderate, Inadequate) classification system. A multiple regression analysis was used to determine the effect of predictive factors on the inter-variability of image quality scores. Results Poor inter-rater agreement (overall kappa value of 0.10) and moderate intra-rater agreement (ICC value of 0.63) were observed among radiographers evaluating mammographic image quality using PGMI classification system. No significant influence was seen from different age groups, working institution, year of involvement in mammography, education background, the number of cases performed per year, place of recognition PGMI system and frequency of practicing PGMI on the image quality scores among radiographers evaluating mammographic image quality (p>0.05). Conclusion This study found poor inter-rater agreement and moderate intra-rater agreement among radiographers using the PGMI classification system. Although there is no significant influence from the predicting factors, the findings imply that radiographers perceive the image quality of a mammogram differently and inconsistently. Hence, if left unchecked can lead to failure of quality control in mammography. A more robust visual scale needs developing and validating for use in practice.
Preliminary clinical evaluation: Where are we? An international scoping review

J Harcus,B Stevens,V Pantic,J Hewis

DOI: https://doi.org/10.1016/j.radi.2024.08.008

Abstract:Background: The College of Radiographers' vision was that diagnostic radiographers in the UK would be writing preliminary clinical evaluations (PCE) on images. Their 2013 policy supporting the use of PCE has not been updated in a decade and it might be suggested PCE practices in the UK have not really moved on, though elsewhere it appears to have gained traction. The aim of this scoping review was to establish the current global status of the use of PCE. Method: The Arksey and O'Malley scoping review framework and PRISMA-ScR guidelines were used to develop a protocol to identify studies between January 2013 to January 2024 using six databases. Collated literature was analysed using content analysis to identify themes. Results: 52 relevant studies were identified for inclusion. Studies focused predominantly on evaluating accuracy, education, perceptions, and new initiatives. Themes identified a developing role in the use of PCE internationally, perhaps more than in the UK, and in a range of modalities and clinical settings though projectional radiography remains the mainstay. Barriers and drivers to the use of PCE were identified in addition to some quality mechanisms used to support PCE implementation, though impact of implementation was not well explored. Conclusion: Considering PCE has been an aspiration for more than a decade, it remains relatively infrequently researched. There is growing scope internationally, particularly in Australia, yet there is no real evaluation of the impact and role that PCE may have. Implications for practice: Until further research into the potential impact of PCE and barriers to its implementation, it is likely practices may not evolve with the risk AI technologies may supersede necessity for the practice.
Evaluation of Combined Artificial Intelligence and Radiologist Assessment to Interpret Screening Mammograms

Thomas Schaffter,Diana S M Buist,Christoph I Lee,Yaroslav Nikulin,Dezso Ribli,Yuanfang Guan,William Lotter,Zequn Jie,Hao Du,Sijia Wang,Jiashi Feng,Mengling Feng,Hyo-Eun Kim,Francisco Albiol,Alberto Albiol,Stephen Morrell,Zbigniew Wojna,Mehmet Eren Ahsen,Umar Asif,Antonio Jimeno Yepes,Shivanthan Yohanandan,Simona Rabinovici-Cohen,Darvin Yi,Bruce Hoff,Thomas Yu,Elias Chaibub Neto,Daniel L Rubin,Peter Lindholm,Laurie R Margolies,Russell Bailey McBride,Joseph H Rothstein,Weiva Sieh,Rami Ben-Ari,Stefan Harrer,Andrew Trister,Stephen Friend,Thea Norman,Berkman Sahiner,Fredrik Strand,Justin Guinney,Gustavo Stolovitzky,and the DM DREAM Consortium,Lester Mackey,Joyce Cahoon,Li Shen,Jae Ho Sohn,Hari Trivedi,Yiqiu Shen,Ljubomir Buturovic,Jose Costa Pereira,Jaime S Cardoso,Eduardo Castro,Karl Trygve Kalleberg,Obioma Pelka,Imane Nedjar,Krzysztof J Geras,Felix Nensa,Ethan Goan,Sven Koitka,Luis Caballero,David D Cox,Pavitra Krishnaswamy,Gaurav Pandey,Christoph M Friedrich,Dimitri Perrin,Clinton Fookes,Bibo Shi,Gerard Cardoso Negrie,Michael Kawczynski,Kyunghyun Cho,Can Son Khoo,Joseph Y Lo,A Gregory Sorensen,Hwejin Jung

DOI: https://doi.org/10.1001/jamanetworkopen.2020.0265

2020-03-02

Abstract:Importance: Mammography screening currently relies on subjective human interpretation. Artificial intelligence (AI) advances could be used to increase mammography screening accuracy by reducing missed cancers and false positives. Objective: To evaluate whether AI can overcome human mammography interpretation limitations with a rigorous, unbiased evaluation of machine learning algorithms. Design, setting, and participants: In this diagnostic accuracy study conducted between September 2016 and November 2017, an international, crowdsourced challenge was hosted to foster AI algorithm development focused on interpreting screening mammography. More than 1100 participants comprising 126 teams from 44 countries participated. Analysis began November 18, 2016. Main outcomes and measurements: Algorithms used images alone (challenge 1) or combined images, previous examinations (if available), and clinical and demographic risk factor data (challenge 2) and output a score that translated to cancer yes/no within 12 months. Algorithm accuracy for breast cancer detection was evaluated using area under the curve and algorithm specificity compared with radiologists' specificity with radiologists' sensitivity set at 85.9% (United States) and 83.9% (Sweden). An ensemble method aggregating top-performing AI algorithms and radiologists' recall assessment was developed and evaluated. Results: Overall, 144 231 screening mammograms from 85 580 US women (952 cancer positive ≤12 months from screening) were used for algorithm training and validation. A second independent validation cohort included 166 578 examinations from 68 008 Swedish women (780 cancer positive). The top-performing algorithm achieved an area under the curve of 0.858 (United States) and 0.903 (Sweden) and 66.2% (United States) and 81.2% (Sweden) specificity at the radiologists' sensitivity, lower than community-practice radiologists' specificity of 90.5% (United States) and 98.5% (Sweden). Combining top-performing algorithms and US radiologist assessments resulted in a higher area under the curve of 0.942 and achieved a significantly improved specificity (92.0%) at the same sensitivity. Conclusions and relevance: While no single AI algorithm outperformed radiologists, an ensemble of AI algorithms combined with radiologist assessment in a single-reader screening environment improved overall accuracy. This study underscores the potential of using machine learning methods for enhancing mammography screening interpretation.
Artificial intelligence and radiographer preliminary image evaluation: What might the future hold for radiographers providing x-ray interpretation in the acute setting?

Clare Rainey

DOI: https://doi.org/10.1002/jmrs.821

2024-09-20

Abstract:In a stretched healthcare system, radiographer preliminary image evaluation in the acute setting can be a means to optimise patient care by reducing error and increasing efficiencies in the patient journey. Radiographers have shown impressive accuracies in the provision of these initial evaluations, however, barriers such as a lack of confidence and increased workloads have been cited as a reason for radiographer reticence in engagement with this practice. With advances in Artificial Intelligence (AI) technology for assistance in clinical decision-making, and indication that this may increase confidence in diagnostic decision-making with reporting radiographers, the author of this editorial wonders what the impact of this technology might be on clinical decision-making by radiographers in the provision of Preliminary Image Evaluation (PIE).
Measuring The Performance Of Screening Mammography In Community Practice With Medicare Claims Data

Jean L Freeman,James S Goodwin,Dong Zhang,Ann B Nattinger,Daniel H Freeman

DOI: https://doi.org/10.1300/J013v37n02_01

2003-01-01

Women & Health

Abstract:Background: Few studies have examined the outcomes of screening mammography in community practice, particularly the extent of false positive exams among older asymptomatic women.Research Design: Subjects were female Medicare beneficiaries, age 67 or older, residing in one of eleven SEER areas, with no evidence of breast cancer. Medicare claims data were used to identify their screening mammograms over two time periods, 1993-1995 and 1996-1998, and to measure their use of follow-up diagnostic testing (diagnostic mammography, breast ultrasound and breast biopsy) within three months of the screening mammogram.Results: There were significant differences among the rates of diagnostic testing for each age group (67-74; 75+) by year, but no clear trend toward higher or lower rates over time. Although rates of diagnostic testing differed significantly by geographic region in both time periods 1993-1995 and 1996-1998, estimates of specificity for all regions were within AHRQ clinical practice guidelines (specificity greater than 90%). Specificity significantly improved with the volume of the radiologist's practice for the latter time period (1996-1998) but not for the former (1993-1995).Conclusion: Medicare claims offer an accessible population-based source of data for mammography performance indicators. As such, they offer a low cost method for evaluating individual mammography practices as well as monitoring the impact of reimbursement policies, practice guidelines and laws mandating requirements for accrediting facilities. (C) 2003 by The Haworth Press, Inc. All rights reserved.
Initial interpretation scores of screening mammograms and cancer detection in BreastScreen Norway

Tone Hovda,Silje Sagstad,Nataliia Moshina,Einar Vigeland,Solveig Hofvind

DOI: https://doi.org/10.1016/j.ejrad.2024.111662

Abstract:Purpose: To explore the association between radiologists' interpretation scores, early performance measures and cumulative reading volume in mammographic screening. Method: We analyzed 1,689,731 screening examinations (3,379,462 breasts) from BreastScreen Norway 2012-2020, all breasts scored 1-5 by two independent radiologists. Score 1 was considered negative/benign and score ≥2 positive in this scoring system. We performed descriptive analyses of recall, screen-detected cancer, positive predictive value (PPV) 1, mammographic features and histopathological characteristics by breast-based interpretation scores, and cumulative reading volume by examination-based interpretation scores. Results: Counting breasts and not women, 3.9 % (132,570/3,379,462) had a score of ≥2 by one or both radiologists. Of these, 84.8 % (112,440/132,570) were given a maximum score 2. Total recall rate was 1.6 % (53,735/3,379,462), 69.3 % (37,220/53,735) given maximum score 2. Among the 0.3 % (9733/3,379,462) diagnosed with screen-detected cancer, 34.6 % (3369/9733) had maximum score 3. The percentages of recall, screen-detected cancer and PPV-1 increased by increasing the sum of scores assigned by two radiologists (p < 0.001 for trend). Higher proportions of masses were observed among recalls and screen-detected cancers with low scores, and higher proportions of spiculated masses were observed for high scores (p < 0.001). Proportions of invasive carcinoma, histological grade 3 and lymph node positive tumors were higher for high versus low scores (p < 0.001). The proportion of examinations scored 1 increased by cumulative reading volume. Conclusions: We observed higher rates of recall and screen-detected cancer and less favorable histopathological tumor characteristics for high versus low interpretation scores. However, a considerable number of recalls and screen-detected cancers had low interpretation scores.
Familiarity, confidence and preference of artificial intelligence feedback and prompts by Australian breast cancer screening readers

Phuong Dung Yun Trieu,Melissa L Barron,Zhengqiang Jiang,Seyedamir Tavakoli Taba,Ziba Gandomkar,Sarah J Lewis

DOI: https://doi.org/10.1071/AH23275

Abstract:Objectives This study explored the familiarity, perceptions and confidence of Australian radiology clinicians involved in reading screening mammograms, regarding artificial intelligence (AI) applications in breast cancer detection. Methods Sixty-five radiologists, breast physicians and radiology trainees participated in an online survey that consisted of 23 multiple choice questions asking about their experience and familiarity with AI products. Furthermore, the survey asked about their confidence in using AI outputs and their preference for AI modes applied in a breast screening context. Participants' responses to questions were compared using Pearson's χ 2 test. Bonferroni-adjusted significance tests were used for pairwise comparisons. Results Fifty-five percent of respondents had experience with AI in their workplaces, with automatic density measurement powered by machine learning being the most familiar AI product (69.4%). The top AI outputs with the highest ranks of perceived confidence were 'Displaying suspicious areas on mammograms with the percentage of cancer possibility' (67.8%) and 'Automatic mammogram classification (normal, benign, cancer, uncertain)' (64.6%). Radiology and breast physicians preferred using AI as second-reader mode (75.4% saying 'somewhat happy' to 'extremely happy') over triage (47.7%), pre-screening and first-reader modes (both with 26.2%) (P < 0.001). Conclusion The majority of screen readers expressed increased confidence in utilising AI for highlighting suspicious areas on mammograms and for automatically classifying mammograms. They considered AI as an optimal second-reader mode being the most ideal use in a screening program. The findings provide valuable insights into the familiarities and expectations of radiologists and breast clinicians for the AI products that can enhance the effectiveness of the breast cancer screening programs, benefitting both healthcare professionals and patients alike.
Potential Impact of an Artificial Intelligence-based Mammography Triage Algorithm on Performance and Workload in a Population-based Screening Sample

Alyssa T Watanabe,Hoanh Vu,Chi Y Chim,Andrew W Litt,Tara Retson,Ray C Mayo

DOI: https://doi.org/10.1093/jbi/wbae056

2024-09-08

Abstract:Objective: To evaluate potential screening mammography performance and workload impact using a commercial artificial intelligence (AI)-based triage device in a population-based screening sample. Methods: In this retrospective study, a sample of 2129 women who underwent screening mammograms were evaluated. The performance of a commercial AI-based triage device was compared with radiologists' reports, actual outcomes, and national benchmarks using commonly used mammography metrics. Up to 5 years of follow-up examination results were evaluated in cases to establish benignity. The algorithm sorted cases into groups of "suspicious" and "low suspicion." A theoretical workload reduction was calculated by subtracting cases triaged as "low suspicion" from the sample. Results: At the default 93% sensitivity setting, there was significant improvement (P <.05) in the following triage simulation mean performance measures compared with actual outcome: 45.5% improvement in recall rate (13.4% to 7.3%; 95% CI, 6.2-8.3), 119% improvement in positive predictive value (PPV) 1 (5.3% to 11.6%; 95% CI, 9.96-13.4), 28.5% improvement in PPV2 (24.6% to 31.6%; 95% CI, 24.8-39.1), 20% improvement in sensitivity (83.3% to 100%; 95% CI, 100-100), and 7.2% improvement in specificity (87.2% to 93.5%; 95% CI, 92.4-94.5). A theoretical 62.5% workload reduction was possible. At the ultrahigh 99% sensitivity setting, a theoretical 27% workload reduction was possible. No cancers were missed by the algorithm at either sensitivity. Conclusion: Artificial intelligence-based triage in this simulation demonstrated potential for significant improvement in mammography performance and predicted substantial theoretical workload reduction without any missed cancers.
An experimental machine learning study investigating the decision-making process of students and qualified radiographers when interpreting radiographic images

Clare Rainey,Angelina T Villikudathil,Jonathan McConnell,Ciara Hughes,Raymond Bond,Sonyia McFadden,Angelina T. Villikudathil

DOI: https://doi.org/10.1371/journal.pdig.0000229

2023-10-27

PLOS Digital Health

Abstract:AI is becoming more prevalent in healthcare and is predicted to be further integrated into workflows to ease the pressure on an already stretched service. The National Health Service in the UK has prioritised AI and Digital health as part of its Long-Term Plan. Few studies have examined the human interaction with such systems in healthcare, despite reports of biases being present with the use of AI in other technologically advanced fields, such as finance and aviation. Understanding is needed of how certain user characteristics may impact how radiographers engage with AI systems in use in the clinical setting to mitigate against problems before they arise. The aim of this study is to determine correlations of skills, confidence in AI and perceived knowledge amongst student and qualified radiographers in the UK healthcare system. A machine learning based AI model was built to predict if the interpreter was either a student (n = 67) or a qualified radiographer (n = 39) in advance, using important variables from a feature selection technique named Boruta. A survey, which required the participant to interpret a series of plain radiographic examinations with and without AI assistance, was created on the Qualtrics survey platform and promoted via social media (Twitter/LinkedIn), therefore adopting convenience, snowball sampling This survey was open to all UK radiographers, including students and retired radiographers. Pearson's correlation analysis revealed that males who were proficient in their profession were more likely than females to trust AI. Trust in AI was negatively correlated with age and with level of experience. A machine learning model was built, the best model predicted the image interpreter to be qualified radiographers with 0.93 area under curve and a prediction accuracy of 93%. Further testing in prospective validation cohorts using a larger sample size is required to determine the clinical utility of the proposed machine learning model. Artificial Intelligence (AI) is becoming increasingly integrated into healthcare systems. Radiology, as a technologically advanced profession, is one area where AI has proved useful for myriad tasks. Developments in computer vision have allowed for applications in computer aided diagnosis using radiographic images. The integration and development of AI has been supported by healthcare providers and government agencies, such as the NHS in the UK. With the introduction of these systems in the clinical setting it is imperative to understand the nuances of the interaction between the clinicians using the technology and the system. Trust has been cited as a potentially significant issue in the effective integration of AI in radiology. Our research pinpoints the factors which have an impact on trust in radiographers and clarifies the strength of these associations. The means of analysis (Boruta) used provides an assessment of any correlations, allowing for intervention to be made. We found that females were less likely to trust AI that males and that trust in AI was negatively correlated with age and level of experience, indicating areas were further investigation and intervention are needed to ensure balanced trust and effective integration of AI in clinical radiography.
Incorporation of Eye-Tracking and Gaze Feedback to Characterize and Improve Radiologist Search Patterns of Chest X-rays: A Randomized Controlled Clinical Trial

Carolina Ramirez-Tamayo,Syed Hasib Akhter Faruqui,Stanford Martinez,Angel Brisco,Nicholas Czarnek,Adel Alaeddini,Jeffrey R. Mock,Edward J. Golob,Kal L. Clark

2023-08-05

Abstract:Diagnostic errors in radiology often occur due to incomplete visual assessments by radiologists, despite their knowledge of predicting disease classes. This insufficiency is possibly linked to the absence of required training in search patterns. Additionally, radiologists lack consistent feedback on their visual search patterns, relying on ad-hoc strategies and peer input to minimize errors and enhance efficiency, leading to suboptimal patterns and potential false negatives. This study aimed to use eye-tracking technology to analyze radiologist search patterns, quantify performance using established metrics, and assess the impact of an automated feedback-driven educational framework on detection accuracy. Ten residents participated in a controlled trial focused on detecting suspicious pulmonary nodules. They were divided into an intervention group (received automated feedback) and a control group. Results showed that the intervention group exhibited a 38.89% absolute improvement in detecting suspicious-for-cancer nodules, surpassing the control group's improvement (5.56%, p-value=0.006). Improvement was more rapid over the four training sessions (p-value=0.0001). However, other metrics such as speed, search pattern heterogeneity, distractions, and coverage did not show significant changes. In conclusion, implementing an automated feedback-driven educational framework improved radiologist accuracy in detecting suspicious nodules. The study underscores the potential of such systems in enhancing diagnostic performance and reducing errors. Further research and broader implementation are needed to consolidate these promising results and develop effective training strategies for radiologists, ultimately benefiting patient outcomes.

Human-Computer Interaction,Image and Video Processing
Computer-aided diagnosis for (123I)FP-CIT imaging: impact on clinical reporting

Jonathan Christopher Taylor,Charles Romanowski,Eleanor Lorenz,Christine Lo,Oliver Bandmann,John Fenner

DOI: https://doi.org/10.1186/s13550-018-0393-5

2018-05-08

Abstract:Background: For (123I)FP-CIT imaging, a number of algorithms have shown high performance in distinguishing normal patient images from those with disease, but none have yet been tested as part of reporting workflows. This study aims to evaluate the impact on reporters' performance of a computer-aided diagnosis (CADx) tool developed from established machine learning technology. Three experienced (123I)FP-CIT reporters (two radiologists and one clinical scientist) were asked to visually score 155 reconstructed clinical and research images on a 5-point diagnostic confidence scale (read 1). Once completed, the process was then repeated (read 2). Immediately after submitting each image score for a second time, the CADx system output was displayed to reporters alongside the image data. With this information available, the reporters submitted a score for the third time (read 3). Comparisons between reads 1 and 2 provided evidence of intra-operator reliability, and differences between reads 2 and 3 showed the impact of the CADx. Results: The performance of all reporters demonstrated a degree of variability when analysing images through visual analysis alone. However, inclusion of CADx improved consistency between reporters, for both clinical and research data. The introduction of CADx increased the accuracy of the radiologists when reporting (unfamiliar) research images but had less impact on the clinical scientist and caused no significant change in accuracy for the clinical data. Conclusions: The outcomes for this study indicate the value of CADx as a diagnostic aid in the clinic and encourage future development for more refined incorporation into clinical practice.

Recent analytical methodologies on equilibrium, kinetics, and dynamics at liquid/liquid interface.

Variations in breast cancer detection rates during mammogram-reading sessions: does experience have an impact?

On soft-decision iterative decoding algorithms by using algebraic decoding for RS codes

[Ambulatory 24-hour blood pressure monitoring in patients with resistant hypertension].

Title Structure of the C-terminal domain of the multifunctionalICP 27 protein from herpes simplex virus 1

Exploring the impact of work experience on the detection of specific cancers across different breast density levels on screening mammograms

National Performance Benchmarks for Modern Diagnostic Digital Mammography: Update from the Breast Cancer Surveillance Consortium

Protocol for evaluating the fitness for purpose of an artificial intelligence product for radiology reporting in the BreastScreen New South Wales breast cancer screening programme

Does it matter for the radiologists’ performance whether they read short or long batches in organized mammographic screening?

Impact of Different Mammography Systems on Artificial Intelligence Performance in Breast Cancer Screening

Variability in mammographic images quality evaluation and Predictive factors affecting it

Preliminary clinical evaluation: Where are we? An international scoping review

Evaluation of Combined Artificial Intelligence and Radiologist Assessment to Interpret Screening Mammograms

Artificial intelligence and radiographer preliminary image evaluation: What might the future hold for radiographers providing x-ray interpretation in the acute setting?

Measuring The Performance Of Screening Mammography In Community Practice With Medicare Claims Data

Initial interpretation scores of screening mammograms and cancer detection in BreastScreen Norway

Familiarity, confidence and preference of artificial intelligence feedback and prompts by Australian breast cancer screening readers

Potential Impact of an Artificial Intelligence-based Mammography Triage Algorithm on Performance and Workload in a Population-based Screening Sample

An experimental machine learning study investigating the decision-making process of students and qualified radiographers when interpreting radiographic images

Incorporation of Eye-Tracking and Gaze Feedback to Characterize and Improve Radiologist Search Patterns of Chest X-rays: A Randomized Controlled Clinical Trial

Computer-aided diagnosis for (123I)FP-CIT imaging: impact on clinical reporting