[HLA B27 antigen in ankylosing vertebral hyperostosis (author's transl)].

V. Svec,Š. Nyulassy,D. Žlnay,M. Buc,P. Schultz

1979-04-27

Abstract:

What problem does this paper attempt to address?

The Progression of Disparities within the Criminal Justice System: Differential Enforcement and Risk Assessment Instruments

Miri Zilka,Riccardo Fogliato,Jiri Hron,Bradley Butcher,Carolyn Ashurst,Adrian Weller

DOI: https://doi.org/10.1145/3593013.3594099

2023-05-13

Abstract:Algorithmic risk assessment instruments (RAIs) increasingly inform decision-making in criminal justice. RAIs largely rely on arrest records as a proxy for underlying crime. Problematically, the extent to which arrests reflect overall offending can vary with the person's characteristics. We examine how the disconnect between crime and arrest rates impacts RAIs and their evaluation. Our main contribution is a method for quantifying this bias via estimation of the amount of unobserved offenses associated with particular demographics. These unobserved offenses are then used to augment real-world arrest records to create part real, part synthetic crime records. Using this data, we estimate that four currently deployed RAIs assign 0.5--2.8 percentage points higher risk scores to Black individuals than to White individuals with a similar \emph{arrest} record, but the gap grows to 4.5--11.0 percentage points when we match on the semi-synthetic \emph{crime} record. We conclude by discussing the potential risks around the use of RAIs, highlighting how they may exacerbate existing inequalities if the underlying disparities of the criminal justice system are not taken into account. In light of our findings, we provide recommendations to improve the development and evaluation of such tools.

Computers and Society
Racial/ethnic disparities of the pact in predicting recidivism and court dispositions for justice-involved youth.

Nan Li,Sascha Hein,Diana Quintana,Matthew Shelton,Elena L. Grigorenko

DOI: https://doi.org/10.1037/lhb0000533

2023-06-16

Law and Human Behavior

Abstract:Objective: Responding to the concern about racial/ethnic disparities (R/ED) in the use of risk assessment instruments (RAIs) in justice systems, previous research has overwhelmingly tested the extent to which RAI scores consistently predict recidivism across race and ethnicity (predictive bias). However, little is known about R/ED in the association between RAI measures and court dispositions (disparate application) for justice-involved youths. This study investigated predictive bias and disparate application of three risk measures—criminal history, social history, and the overall risk level—produced by the Positive Achievement Change Tool (PACT) for White, Black, and Hispanic justice-involved youths. Hypotheses: Given the mixed evidence in existing research for predictive bias and lack of evidence for disparate application, we did not make any specific hypothesis but conducted exploratory analyses. From a clinical perspective, however, we anticipated little or no evidence to support predictive bias and disparate application of the PACT among White, Black, and Hispanic youths in the jurisdiction we examined. Method: The sample consisted of 5,578 youths (11.4% White, 43.9% Black, and 44.7% Hispanic) who completed the PACT while in the Harris County Juvenile Probation Department, Texas. The outcome variables included recidivism (general and violent reoffending) and court dispositions (deferred adjudication, probation without placement, and probation with placement). We ran a series of moderating binary logistic regression models and moderating ordinal logistic regression models to evaluate predictive bias and disparate application. Results: Race and ethnicity influenced how the criminal history score related to violent recidivism: This compromised the validity of the score as a predictor of recidivism. Moreover, evidence showed that the overall risk of reoffending was associated with harsher sanctioning decisions for Black and Hispanic youths than for White youths. Conclusion: Ensuring that RAI results are consistently interpreted and used in informing decisions is as important as ensuring that RAI scores function equally well in predicting recidivism regardless of race and ethnicity. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

law,psychology, social
Implications of bias in automated writing quality scores for fair and equitable assessment decisions.

Michael Matta,Sterett H. Mercer,Milena A. Keller-Margulis

DOI: https://doi.org/10.1037/spq0000517

2023-05-16

School Psychology

Abstract:Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to implementing unfair practices with negative consequences on student learning. The goal of this study was to investigate score bias of writeAlizer, a free and open-source automated writing evaluation program. For 421 students in Grades 4 and 7 who completed a state writing exam that included composition and multiple choice revising and editing questions, writeAlizer was used to generate automated writing quality scores for the composition section. Then, we used multiple regression models to investigate whether writeAlizer scores demonstrated differential predictions of the composition and overall scores on the state-mandated writing exam for students from different racial or ethnic groups. No evidence of bias for automated scores was observed. However, after controlling for automated scores in Grade 4, we found statistically significant group differences in regression models predicting overall state test scores 3 years later but not the essay composition scores. We hypothesize that the multiple choice revising and editing sections, rather than the scoring approach used for the essay portion, introduced construct-irrelevant variance and might lead to differential performance among groups. Implications for assessment development and score use are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

psychology, educational
Examining risks of racial biases in NLP tools for child protective services

Anjalie Field,Amanda Coston,Nupoor Gandhi,Alexandra Chouldechova,Emily Putnam-Hornstein,David Steier,Yulia Tsvetkov

DOI: https://doi.org/10.1145/3593013.3594094

2023-05-31

Abstract:Although much literature has established the presence of demographic bias in natural language processing (NLP) models, most work relies on curated bias metrics that may not be reflective of real-world applications. At the same time, practitioners are increasingly using algorithmic tools in high-stakes settings, with particular recent interest in NLP. In this work, we focus on one such setting: child protective services (CPS). CPS workers often write copious free-form text notes about families they are working with, and CPS agencies are actively seeking to deploy NLP models to leverage these data. Given well-established racial bias in this setting, we investigate possible ways deployed NLP is liable to increase racial disparities. We specifically examine word statistics within notes and algorithmic fairness in risk prediction, coreference resolution, and named entity recognition (NER). We document consistent algorithmic unfairness in NER models, possible algorithmic unfairness in coreference resolution models, and little evidence of exacerbated racial bias in risk prediction. While there is existing pronounced criticism of risk prediction, our results expose previously undocumented risks of racial bias in realistic information extraction systems, highlighting potential concerns in deploying them, even though they may appear more benign. Our work serves as a rare realistic examination of NLP algorithmic fairness in a potential deployed setting and a timely investigation of a specific risk associated with deploying NLP in CPS settings.

Computation and Language
Detecting and Reducing Bias in a High Stakes Domain

Ruiqi Zhong,Yanda Chen,Desmond Patton,Charlotte Selous,Kathy McKeown

DOI: https://doi.org/10.48550/arXiv.1908.11474

2019-10-24

Abstract:Gang-involved youth in cities such as Chicago sometimes post on social media to express their aggression towards rival gangs and previous research has demonstrated that a deep learning approach can predict aggression and loss in posts. To address the possibility of bias in this sensitive application, we developed an approach to systematically interpret the state of the art model. We found, surprisingly, that it frequently bases its predictions on stop words such as "a" or "on", an approach that could harm social media users who have no aggressive intentions. To tackle this bias, domain experts annotated the rationales, highlighting words that explain why a tweet is labeled as "aggression". These new annotations enable us to quantitatively measure how justified the model predictions are, and build models that drastically reduce bias. Our study shows that in high stake scenarios, accuracy alone cannot guarantee a good system and we need new evaluation methods.

Computation and Language
Almost Politically Acceptable Criminal Justice Risk Assessment

Richard A. Berk,Ayya A. Elzarka

DOI: https://doi.org/10.48550/arXiv.1910.11410

2019-10-25

Abstract:In criminal justice risk forecasting, one can prove that it is impossible to optimize accuracy and fairness at the same time. One can also prove that it is impossible optimize at once all of the usual group definitions of fairness. In the policy arena, one is left with tradeoffs about which many stakeholders will adamantly disagree. In this paper, we offer a different approach. We do not seek perfectly accurate and fair risk assessments. We seek politically acceptable risk assessments. We describe and apply to data on 300,000 offenders a machine learning approach that responds to many of the most visible charges of "racial bias." Regardless of whether such claims are true, we adjust our procedures to compensate. We begin by training the algorithm on White offenders only and computing risk with test data separately for White offenders and Black offenders. Thus, the fitted algorithm structure is exactly the same for both groups; the algorithm treats all offenders as if they are White. But because White and Black offenders can bring different predictors distributions to the white-trained algorithm, we provide additional adjustments if needed. Insofar are conventional machine learning procedures do not produce accuracy and fairness that some stakeholders require, it is possible to alter conventional practice to respond explicitly to many salient stakeholder claims even if they are unsupported by the facts. The results can be a politically acceptable risk assessment tools.

Applications
Can AI Help Reduce Disparities in General Medical and Mental Health Care?

Irene Y Chen,Peter Szolovits,Marzyeh Ghassemi

DOI: https://doi.org/10.1001/amajethics.2019.167

2019-02-01

AMA Journal of Ethics

Abstract:Background: As machine learning becomes increasingly common in health care applications, concerns have been raised about bias in these systems' data, algorithms, and recommendations. Simply put, as health care improves for some, it might not improve for all.Methods: Two case studies are examined using a machine learning algorithm on unstructured clinical and psychiatric notes to predict intensive care unit (ICU) mortality and 30-day psychiatric readmission with respect to race, gender, and insurance payer type as a proxy for socioeconomic status.Results: Clinical note topics and psychiatric note topics were heterogenous with respect to race, gender, and insurance payer type, which reflects known clinical findings. Differences in prediction accuracy and therefore machine bias are shown with respect to gender and insurance type for ICU mortality and with respect to insurance policy for psychiatric 30-day readmission.Conclusions: This analysis can provide a framework for assessing and identifying disparate impacts of artificial intelligence in health care.
People Perceive Algorithmic Assessments as Less Fair and Trustworthy Than Identical Human Assessments

Lillio Mok,Sasha Nanda,Ashton Anderson

DOI: https://doi.org/10.1145/3610100

2023-09-28

Proceedings of the ACM on Human-Computer Interaction

Abstract:Algorithmic risk assessments are being deployed in an increasingly broad spectrum of domains including banking, medicine, and law enforcement. However, there is widespread concern about their fairness and trustworthiness, and people are also known to display algorithm aversion, preferring human assessments even when they are quantitatively worse. Thus, how does the framing of who made an assessment affect how people perceive its fairness? We investigate whether individual algorithmic assessments are perceived to be more or less accurate, fair, and interpretable than identical human assessments, and explore how these perceptions change when assessments are obviously biased against a subgroup. To this end, we conducted an online experiment that manipulated how biased risk assessments are in a loan repayment task, and reported the assessments as being made either by a statistical model or a human analyst. We find that predictions made by the model are consistently perceived as less fair and less interpretable than those made by the analyst despite being identical. Furthermore, biased predictive errors were more likely to widen this perception gap, with the algorithm being judged even more harshly for making a biased mistake. Our results illustrate that who makes risk assessments can influence perceptions of how acceptable those assessments are - even if they are identically accurate and identically biased against subgroups. Additional work is needed to determine whether and how decision aids should be presented to stakeholders so that the inherent fairness and interpretability of their recommendations, rather than their framing, determines how they are perceived.
Interventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment

Chelsea Barabas,Karthik Dinakar,Joichi Ito,Madars Virza,Jonathan Zittrain

DOI: https://doi.org/10.48550/arXiv.1712.08238

2018-07-15

Abstract:Actuarial risk assessments might be unduly perceived as a neutral way to counteract implicit bias and increase the fairness of decisions made at almost every juncture of the criminal justice system, from pretrial release to sentencing, parole and probation. In recent times these assessments have come under increased scrutiny, as critics claim that the statistical techniques underlying them might reproduce existing patterns of discrimination and historical biases that are reflected in the data. Much of this debate is centered around competing notions of fairness and predictive accuracy, resting on the contested use of variables that act as "proxies" for characteristics legally protected against discrimination, such as race and gender. We argue that a core ethical debate surrounding the use of regression in risk assessments is not simply one of bias or accuracy. Rather, it's one of purpose. If machine learning is operationalized merely in the service of predicting individual future crime, then it becomes difficult to break cycles of criminalization that are driven by the iatrogenic effects of the criminal justice system itself. We posit that machine learning should not be used for prediction, but rather to surface covariates that are fed into a causal model for understanding the social, structural and psychological drivers of crime. We propose an alternative application of machine learning and causal inference away from predicting risk scores to risk mitigation.

Machine Learning,Computers and Society,Applications
Bias Analysis of AI Models for Undergraduate Student Admissions

Kelly Van Busum,Shiaofen Fang

DOI: https://doi.org/10.1007/s00521-024-10762-6

2024-12-04

Abstract:Bias detection and mitigation is an active area of research in machine learning. This work extends previous research done by the authors to provide a rigorous and more complete analysis of the bias found in AI predictive models. Admissions data spanning six years was used to create an AI model to determine whether a given student would be directly admitted into the School of Science under various scenarios at a large urban research university. During this time, submission of standardized test scores as part of an application became optional which led to interesting questions about the impact of standardized test scores on admission decisions. We developed and analyzed AI models to understand which variables are important in admissions decisions, and how the decision to exclude test scores affects the demographics of the students who are admitted. We then evaluated the predictive models to detect and analyze biases these models may carry with respect to three variables chosen to represent sensitive populations: gender, race, and whether a student was the first in his or her family to attend college. We also extended our analysis to show that the biases detected were persistent. Finally, we included several fairness metrics in our analysis and discussed the uses and limitations of these metrics.

Artificial Intelligence
Evaluating Algorithmic Bias in Models for Predicting Academic Performance of Filipino Students

Valdemar Švábenský,Mélina Verger,Maria Mercedes T. Rodrigo,Clarence James G. Monterozo,Ryan S. Baker,Miguel Zenon Nicanor Lerias Saavedra,Sébastien Lallé,Atsushi Shimada

DOI: https://doi.org/10.5281/zenodo.12729936

2024-07-15

Abstract:Algorithmic bias is a major issue in machine learning models in educational contexts. However, it has not yet been studied thoroughly in Asian learning contexts, and only limited work has considered algorithmic bias based on regional (sub-national) background. As a step towards addressing this gap, this paper examines the population of 5,986 students at a large university in the Philippines, investigating algorithmic bias based on students' regional background. The university used the Canvas learning management system (LMS) in its online courses across a broad range of domains. Over the period of three semesters, we collected 48.7 million log records of the students' activity in Canvas. We used these logs to train binary classification models that predict student grades from the LMS activity. The best-performing model reached AUC of 0.75 and weighted F1-score of 0.79. Subsequently, we examined the data for bias based on students' region. Evaluation using three metrics: AUC, weighted F1-score, and MADD showed consistent results across all demographic groups. Thus, no unfairness was observed against a particular student group in the grade predictions.

Machine Learning,Computers and Society
Predicting suicidal thoughts and behavior among adolescents using the risk and protective factor framework: A large-scale machine learning approach

Orion Weller,Luke Sagers,Carl Hanson,Michael Barnes,Quinn Snell,E. Shannon Tass

DOI: https://doi.org/10.1371/journal.pone.0258535

IF: 3.7

2021-11-03

PLoS ONE

Abstract:Introduction Addressing the problem of suicidal thoughts and behavior (STB) in adolescents requires understanding the associated risk factors. While previous research has identified individual risk and protective factors associated with many adolescent social morbidities, modern machine learning approaches can help identify risk and protective factors that interact (group) to provide predictive power for STB. This study aims to develop a prediction algorithm for STB among adolescents using the risk and protective factor framework and social determinants of health. Methods The sample population consisted of more than 179,000 high school students living in Utah and participating in the Communities That Care (CTC) Youth Survey from 2011-2017. The dataset includes responses to 300+ questions from the CTC and 8000+ demographic factors from the American Census Survey for a total of 1.2 billion values. Machine learning techniques were employed to extract the survey questions that were best able to predict answers indicative of STB, using recent work in interpretable machine learning. Results Analysis showed strong predictive power, with the ability to predict individuals with STB with 91% accuracy. After extracting the top ten questions that most affected model predictions, questions fell into four main categories: familial life, drug consumption, demographics, and peer acceptance at school. Conclusions Modern machine learning approaches provide new methods for understanding the interaction between root causes and outcomes, such as STB. The model developed in this study showed significant improvement in predictive accuracy compared to previous research. Results indicate that certain risk and protective factors, such as adolescents being threatened or harassed through digital media or bullied at school, and exposure or involvement in serious arguments and yelling at home are the leading predictors of STB and can help narrow and reaffirm priority prevention programming and areas of focused policymaking.

multidisciplinary sciences
Biceps tendinitis caused by an osteochondroma in the bicipital groove: a rare cause of shoulder pain in a baseball player.

T. Onga,Tetsuji Yamamoto,T. Akisue,T. Marui,M. Kurosaka

DOI: https://doi.org/10.1097/01.BLO.0000146542.46031.F6

IF: 4.755

2005-02-01

Clinical Orthopaedics and Related Research

Abstract:Tendinitis of the long head of the biceps brachii muscle is commonly seen in athletes who do repetitive overhead motions. Common causes of biceps tendinitis include impingement syndrome, subluxation of the biceps tendon, and attrition tendinitis, whereas biceps tendinitis secondary to a bone neoplasm is rare. A case of biceps tendinitis caused by an osteochondroma arising in the left humeral bicipital groove in a 25-year-old male baseball player is reported. The tumor was hook-shaped, originated from the inferomedial portion of the humeral lesser tubercle, and surrounded the biceps tendon. Symptoms of increasing pain and inability to throw resulted from direct irritation of the biceps tendon by the tumor. Total excision of the tumor relieved the symptoms within 3 weeks. To our knowledge, there have been no reported cases in the English-language literature of biceps tendinitis caused by an osteochondroma.
[Posture taken by members of the nursing staff during blood collection, intravenous drug administration and serotherapy].

L. D. Bernardina,M. Marziale,E. C. de Carvalho

Revista da Escola de Enfermagem da USP

Abstract:The members of the Nursing Team are submitted, many times, to posture attacks either due to the own requirement of the action or the utilization of improper corporeal posture during its execution. The present study aims at inquiring the type, length, frequency and posture changes adopted by the members of the Nursing Team during the execution of blood collection techniques, administering of intravenous medication and serotherapy. Through direct observation were recorded 10 activities corresponding to each one of the mentioned techniques, realized in attendance of patients from a University Hospital internment unit. The results evidenced that blood collection activity was 50, 35% effectuated in the inclined standing position, followed by the standing straight position, 49, 64%. Intravenous medication administering was executed with frequent adoption of the standing straight posture, 51, 09% (in special with the arm in frontal expansion), 45, 74% in the inclined standing position and 3, 15% seated. Serotherapy technique was executed with predominant adoption of standing position (86, 88%) in special with the arms in frontal expansion and 13, 11% in the inclined standing position. The unnecessary adoption, many times, of inclined standing posture indicates that Nursing personnel have been making possible the happening of spinal column attacks mainly due to the bad utilization of corporeal mechanic. The authors suggest more attention to these aspects, mainly at Nursing courses.
Effects of splenectomy on the retention of Salmonella enteritidis and on the hemopoietic response to Salmonella infection.

T. Kirikae,M. Yoshida,H. Sawada,H. Tezuka,J. Fujita,K. Mori

Abstract:Salmonella infection induces a marked increase in the splenic granulopoiesis, but causes a reduction in hemopoiesis in the bone marrow. In this study, effects of Salmonella enteritidis infection on hemopoietic stem cells were examined in splenectomized (SX-) mice. Splenectomy emphasized hemopoietic damage in the bone marrow caused by Salmonella infection. Total nucleated cells, pluripotent stem cells (CFUs) and granulocyte-macrophage progenitor cells (GM-CFC) in the bone marrow of SX-mice all decreased markedly compared with sham-splenectomized (NX-) mice, and the recovery from the decline was also delayed. Thus, neither enhancement of the granulopoiesis nor granulopoietic recovery in the bone marrow was observed to compensate the granulopoietic response in the spleen. Splenectomy also resulted in a longlasting retention of Salmonella in the liver. The observations indicate that the spleen is the major organ to respond to bacterial invasion in regard to enhanced granulopoiesis and hence enhanced bacterial clearance.
A comparative user study of human predictions in algorithm-supported recidivism risk assessment

Manuel Portela,Carlos Castillo,Songül Tolan,Marzieh Karimi-Haghighi,Antonio Andres Pueyo

DOI: https://doi.org/10.1007/s10506-024-09393-y

IF: 4.1

2024-03-16

Artificial Intelligence and Law

Abstract:In this paper, we study the effects of using an algorithm-based risk assessment instrument (RAI) to support the prediction of risk of violent recidivism upon release. The instrument we used is a machine learning version of RiskCanvi used by the Justice Department of Catalonia, Spain . It was hypothesized that people can improve their performance on defining the risk of recidivism when assisted with a RAI. Also, that professionals can perform better than non-experts on the domain. Participants had to predict whether a person who has been released from prison will commit a new crime leading to re-incarceration, within the next two years. This user study is done with (1) general participants from diverse backgrounds recruited through a crowdsourcing platform, (2) targeted participants who are students and practitioners of data science, criminology, or social work and professionals who work with RisCanvi. We also run focus groups with participants of the targeted study, including people who use RisCanvi in a professional capacity, to interpret the quantitative results. Among other findings, we observe that algorithmic support systematically leads to more accurate predictions from all participants, but that statistically significant gains are only seen in the performance of targeted participants with respect to that of crowdsourced participants. Among other comments, professional participants indicate that they would not foresee using a fully-automated system in criminal risk assessment, but do consider it valuable for training, standardization, and to fine-tune or double-check their predictions on particularly difficult cases. We found that the revised prediction by using a RAI increases the performance of all groups, while professionals show a better performance in general. And, a RAI can be considered for extending professional capacities and skills along their careers.

computer science, artificial intelligence, interdisciplinary applications,law
Accuracy and Fairness for Juvenile Justice Risk Assessments

Richard Berk

DOI: https://doi.org/10.1111/jels.12206

2019-02-18

Journal of Empirical Legal Studies

Abstract:Risk assessment algorithms used in criminal justice settings are often said to introduce “bias.” But such charges can conflate an algorithm's performance with bias in the data used to train the algorithm with bias in the actions undertaken with an algorithm's output. In this article, algorithms themselves are the focus. Tradeoffs between different kinds of fairness and between fairness and accuracy are illustrated using an algorithmic application to juvenile justice data. Given potential bias in training data, can risk assessment algorithms improve fairness and, if so, with what consequences for accuracy? Although statisticians and computer scientists can document the tradeoffs, they cannot provide technical solutions that satisfy all fairness and accuracy objectives. In the end, it falls to stakeholders to do the required balancing using legal and legislative procedures, just as it always has.

law
Risk of Training Diagnostic Algorithms on Data with Demographic Bias

Samaneh Abbasi-Sureshjani,Ralf Raumanns,Britt E. J. Michels,Gerard Schouten,Veronika Cheplygina

DOI: https://doi.org/10.48550/arXiv.2005.10050

2020-06-17

Abstract:One of the critical challenges in machine learning applications is to have fair predictions. There are numerous recent examples in various domains that convincingly show that algorithms trained with biased datasets can easily lead to erroneous or discriminatory conclusions. This is even more crucial in clinical applications where the predictive algorithms are designed mainly based on a limited or given set of medical images and demographic variables such as age, sex and race are not taken into account. In this work, we conduct a survey of the MICCAI 2018 proceedings to investigate the common practice in medical image analysis applications. Surprisingly, we found that papers focusing on diagnosis rarely describe the demographics of the datasets used, and the diagnosis is purely based on images. In order to highlight the importance of considering the demographics in diagnosis tasks, we used a publicly available dataset of skin lesions. We then demonstrate that a classifier with an overall area under the curve (AUC) of 0.83 has variable performance between 0.76 and 0.91 on subgroups based on age and sex, even though the training set was relatively balanced. Moreover, we show that it is possible to learn unbiased features by explicitly using demographic variables in an adversarial training setup, which leads to balanced scores per subgroups. Finally, we discuss the implications of these results and provide recommendations for further research.

Machine Learning,Artificial Intelligence
A Feasibility Study Using a Machine Learning Suicide Risk Prediction Model Based on Open-Ended Interview Language in Adolescent Therapy Sessions

Joshua Cohen,Jennifer Wright-Berryman,Lesley Rohlfs,Donald Wright,Marci Campbell,Debbie Gingrich,Daniel Santel,John Pestian

DOI: https://doi.org/10.3390/ijerph17218187

IF: 4.614

2020-11-05

International Journal of Environmental Research and Public Health

Abstract:Background: As adolescent suicide rates continue to rise, innovation in risk identification is warranted. Machine learning can identify suicidal individuals based on their language samples. This feasibility pilot was conducted to explore this technology’s use in adolescent therapy sessions and assess machine learning model performance. Method: Natural language processing machine learning models to identify level of suicide risk using a smartphone app were tested in outpatient therapy sessions. Data collection included language samples, depression and suicidality standardized scale scores, and therapist impression of the client’s mental state. Previously developed models were used to predict suicidal risk. Results: 267 interviews were collected from 60 students in eight schools by ten therapists, with 29 students indicating suicide or self-harm risk. During external validation, models were trained on suicidal speech samples collected from two separate studies. We found that support vector machines (AUC: 0.75; 95% CI: 0.69–0.81) and logistic regression (AUC: 0.76; 95% CI: 0.70–0.82) lead to good discriminative ability, with an extreme gradient boosting model performing the best (AUC: 0.78; 95% CI: 0.72–0.84). Conclusion: Voice collection technology and associated procedures can be integrated into mental health therapists’ workflow. Collected language samples could be classified with good discrimination using machine learning methods.

public, environmental & occupational health,environmental sciences

[HLA B27 antigen in ankylosing vertebral hyperostosis (author's transl)].

The Progression of Disparities within the Criminal Justice System: Differential Enforcement and Risk Assessment Instruments

Racial/ethnic disparities of the pact in predicting recidivism and court dispositions for justice-involved youth.

Implications of bias in automated writing quality scores for fair and equitable assessment decisions.

Examining risks of racial biases in NLP tools for child protective services

Detecting and Reducing Bias in a High Stakes Domain

Almost Politically Acceptable Criminal Justice Risk Assessment

Can AI Help Reduce Disparities in General Medical and Mental Health Care?

People Perceive Algorithmic Assessments as Less Fair and Trustworthy Than Identical Human Assessments

Interventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment

Bias Analysis of AI Models for Undergraduate Student Admissions

Evaluating Algorithmic Bias in Models for Predicting Academic Performance of Filipino Students

Predicting suicidal thoughts and behavior among adolescents using the risk and protective factor framework: A large-scale machine learning approach

Biceps tendinitis caused by an osteochondroma in the bicipital groove: a rare cause of shoulder pain in a baseball player.

[Posture taken by members of the nursing staff during blood collection, intravenous drug administration and serotherapy].

Effects of splenectomy on the retention of Salmonella enteritidis and on the hemopoietic response to Salmonella infection.

A comparative user study of human predictions in algorithm-supported recidivism risk assessment

Accuracy and Fairness for Juvenile Justice Risk Assessments

Risk of Training Diagnostic Algorithms on Data with Demographic Bias

A Feasibility Study Using a Machine Learning Suicide Risk Prediction Model Based on Open-Ended Interview Language in Adolescent Therapy Sessions