Abstract:As schools increasingly adopt universal social, emotional, and behavioral screening, more research is needed to examine the effects of between-teacher differences due to error and bias on students' teacher-rated screening scores. The current study examined predictors of between-teacher differences in students' teacher-rated risk across one global and three narrow domains of behavioral functioning. Participants included 2450 students (52.1% male, 54.2% White) and 160 teachers (92.1% female, 80.3% White) from four elementary schools in one Southeastern U.S. school district. Teachers rated student behavior on the Behavior Assessment System for Children (Third Edition) Behavioral and Emotional Screening System (BESS)-Teacher Form and completed a survey about their training and perspectives of common behavior problems. Results of multilevel linear regression found between-teacher effects to be greater for internalizing risk scores (intraclass correlation = 0.23) than for externalizing risk scores (intraclass correlation = 0.12) or adaptive behavior scores (intraclass correlation = 0.14). Statistically significant student predictors in most models included student grade, gender, race and/or ethnicity, office discipline referrals, and course grades. We also detected effects of several teacher-level variables in one or more of the models, including teacher gender, teacher ratings of problem severity and concern for hypothetical children displaying behavior problems, and the covariance of random teacher intercept and teacher random slopes for students' office discipline referrals. Although these factors explained some teacher-level variance in students' risk scores, a notable amount of variance between teachers remains unexplained. Future research is needed to fully understand, reduce, and account for differences between teacher ratings due to error and bias.

Using a one-minute screener to identify students at risk for academic difficulties

Psychometric Properties of the Behavior Assessment System for Children-3 Behavioral and Emotional Screening System Student-Report Form among a Predominantly Latinx Elementary School Sample

The Kindergarten Academic and Behavior Readiness Screener: The utility of single-item teacher ratings of kindergarten readiness.

Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems

The Brief Evaluation of Adolescents and Children Online (BEACON): Psychometric development of a mental health screening measure for school students

Classes of Student Emotion as Predictive of Academic Achievement

Screening for Social, Emotional, and Behavioral Problems at Kindergarten Entry: Utility and Incremental Validity of Parent Report

The predictive utility of a brief kindergarten screening measure of child behavior problems.

Two-Stage Screening for Math Problem-Solving Difficulty Using Dynamic Assessment of Algebraic Learning

Between-teacher variance of students' teacher-rated risk for emotional, behavioral, and adaptive functioning

An Analysis of SRSS-IE Externalizing Cut Scores to Facilitate Data-Informed Decision-Making in K–12 Schools

Timing and frequency of screening in schools: A latent variable analysis of behavioral stability over time.

Assessing Noncognitive Aspects of School Readiness: The Predictive Validity of Brief Teacher Rating Scales of Social–Emotional Competence and Approaches to Learning

Additional Evidence of Predictive Validity of SRSS-IE Scores With Elementary Students

Base Rates of Non‐Proficiency in Reading and Math: Implications for Universal Screening

Evaluating a gated screening approach for identifying risk in kindergarten mathematics.

Universal screening for social-emotional and behavioral risk: Differential item functioning on the SAEBRS

Brief Report: Psychometric Properties of the Brief Problem Monitor-Parent (BPM-P) 6–18 in a Sample of Children Referred to an Autism Specialty Clinic

A short executive functioning questionnaire in the context of early childhood screening: psychometric properties

Sensitivity and Specificity of an Executive Function Screener at Identifying Children With ADHD and Reading Disability

A Reanalysis: SRSS-IE Internalizing Cut Scores to Support Data-Informed Decision-Making Efforts in Elementary Schools