Development and validation of an observational tool to measure engagement in telepractice early intervention

Felipe Retamal-Walter,Monique Waite,Nerina Scarinci

DOI: https://doi.org/10.1080/09638288.2024.2432921

2024-11-28

Disability and Rehabilitation

Abstract:Purpose To develop and validate an evidence-based observational tool to measure engagement in telepractice early intervention (EI).

rehabilitation

What problem does this paper attempt to address?

Exploring engagement in telepractice early intervention for young children with developmental disability and their families: a qualitative systematic review

Felipe Retamal-Walter,Monique Waite,Nerina Scarinci

DOI: https://doi.org/10.1080/17483107.2022.2048098

2022-03-14

Abstract:This review aimed to (1) describe the nature of engagement in telepractice early intervention (EI) for families of young children with developmental disabilities; and (2) identify major barriers and facilitators for developing and maintaining engagement via telepractice.A qualitative systematic review was conducted, searching systematically across six databases (i.e., PUBMED, CINAHL, PsycINFO, Web of Science, EMBASE, and Scopus). The search identified 14 studies which met the inclusion criteria of peer-reviewed studies exploring EI professionals', families', managers', or service's views of engagement in telepractice EI using qualitative methodologies. The studies were appraised using the Critical Appraisal Skills Programme and data were analysed using thematic synthesis.The synthesised data were grouped into four main themes reflecting the nuances of engagement in telepractice EI: (1) children and family engagement is facilitated and enhanced during telepractice interaction; (2) engagement may enhance therapy outcomes through telepractice multidisciplinary collaboration and communication; (3) there are challenges to engagement in the telepractice environment; and (4) preparation in telepractice can improve the development of engagement.This review provides a comprehensive characterisation of engagement and describes a set of conceptual recommendations for establishing and maintaining engagement when using telepractice in EI.Building and maintaining engagement with families of young children with developmental disability/delay through telepractice is feasible.Despite some similarities between in-person and telepractice engagement, there are certain unique features of telepractice engagement that professionals and families may need to consider while providing/receiving early intervention services remotely.Preparation and training on how to engage in telepractice is recommended for professionals and families of young children with developmental disability/delay.Understanding how professionals and families engage with one another during telepractice interactions may improve targeted child and family intervention outcomes.
Diversified caregiver input to upgrade the Young Children's Participation and Environment Measure for equitable pediatric re/habilitation practice

Vivian C Villegas,Dianna L Bosak,Zurisadai Salgado,Michelle Phoenix,Natalie Parde,Rachel Teplicky,Mary A Khetani,High Value Early Intervention Research Group,L Kuznicki,A Pedrow,A Howell

DOI: https://doi.org/10.1186/s41687-023-00627-2

2023-08-28

Abstract:Background: Practitioner and family experiences of pediatric re/habilitation can be inequitable. The Young Children's Participation and Environment Measure (YC-PEM) is an evidence-based and promising electronic patient-reported outcome measure that was designed with and for caregivers for research and practice. This study examined historically minoritized caregivers' responses to revised YC-PEM content modifications and their perspectives on core intelligent virtual agent functionality needed to improve its reach for equitable service design. Methods: Caregivers were recruited during a routine early intervention (EI) service visit and met five inclusion criteria: (1) were 18 + years old; (2) identified as the parent or legal guardian of a child 0-3 years old enrolled in EI services for 3 + months; (3) read, wrote, and spoke English; (4) had Internet and telephone access; and (5) identified as a parent or legal guardian of a Black, non-Hispanic child or as publicly insured. Three rounds of semi-structured cognitive interviews (55-90 min each) used videoconferencing to gather caregiver feedback on their responses to select content modifications while completing YC-PEM, and their ideas for core intelligent virtual agent functionality. Interviews were transcribed verbatim, cross-checked for accuracy, and deductively and inductively content analyzed by multiple staff in three rounds. Results: Eight Black, non-Hispanic caregivers from a single urban EI catchment and with diverse income levels (Mdn = $15,001-20,000) were enrolled, with children (M = 21.2 months, SD = 7.73) enrolled in EI. Caregivers proposed three ways to improve comprehension (clarify item wording, remove or simplify terms, add item examples). Environmental item edits prompted caregivers to share how they relate and respond to experiences with interpersonal and institutional discrimination impacting participation. Caregivers characterized three core functions of a virtual agent to strengthen YC-PEM navigation (read question aloud, visual and verbal prompts, more examples and/or definitions). Conclusions: Results indicate four ways that YC-PEM content will be modified to strengthen how providers screen for unmet participation needs and determinants to design pediatric re/habilitation services that are responsive to family priorities. Results also motivate the need for user-centered design of an intelligent virtual agent to strengthen user navigation, prior to undertaking a community-based pragmatic trial of its implementation for equitable practice.
Caregiver Perspectives on Telehealth Assessment and Other Supports for Infants with Early Developmental Concerns

Daltrey Schmidt,Chloe Urias,Sarah Dufek,Meagan R Talbott

DOI: https://doi.org/10.1007/s10803-024-06483-3

2024-07-27

Abstract:This study examined the experiences of families of children with developmental concerns in the first year of life, before formal diagnostic evaluations are typically conducted. We aimed to understand the impact of participation in a telehealth-based research evaluation in infancy, identify existing community-based supports perceived favorably by caregivers, and identify suggestions for future directions. Participants were recruited from an prior study evaluating a telehealth assessment for infants with early social communication delays. Here, we interviewed caregivers (n = 19) who participated in follow-up study in toddlerhood. Transcripts from the semi-structured interviews were transcribed and analyzed using both inductive thematic and content coding approaches. Analysis of these interviews resulted in four core themes describing caregiving during this time: (1) Caregivers felt lonely, overwhelmed, and dismissed by providers, leading to feelings of uncertainty about their child's development and future; (2) Telehealth assessments were appreciated because external supports are minimal, complex to navigate, and do not address all areas of need; (3) Desire for additional community and connection; and (4) Information is power. Caregivers reported participating in the telehealth assessments helped them to feel reassured, validated and supported. Outside the study, they sought a wide variety of services and resources. The most frequent requests were for parent coaching sessions and family navigation. Caregivers experienced uncertainty and disempowerment during the pre-diagnostic period and sought education and guidance during this time. Findings reflect the importance of centering family priorities when developing early intervention services for infants with elevated likelihood of autism.
The development and psychometric properties of a shared book reading observational tool: The Emergent Literacy and Language Early Childhood Checklist for Teachers (ELLECCT)

Tessa Weadman,Tanya Serry,Pamela C. Snow

DOI: https://doi.org/10.1177/01427237211056735

2021-11-30

First Language

Abstract:Shared book reading in preschool settings plays an influential role in supporting children’s oral language and emergent literacy skills. Early childhood teachers can provide high-quality shared book reading experiences using extratextual utterances (reading beyond the story text) to maximise these learning outcomes. We report on the development and psychometric properties of the ‘Emergent Literacy and Language Early Childhood Checklist for Teachers’ (ELLECCT) tool, a comprehensive observational checklist designed to document early childhood teachers’ extratextual oral language and emergent literacy strategies during shared book reading. The ELLECCT measures teachers’ dialogic reading prompts, vocabulary promotion strategies, responsive statements, print knowledge and phonological awareness. The ELLECCT also contains a rating scale examining paralinguistic and nonverbal strategies used by early childhood teachers to support engagement during shared book reading interactions. The psychometric properties of the ELLECCT were measured in a four-phase process. Content validity was tested using the Content Validity Index and a three-round Delphi process was used to measure face validity. Both intra-rater and inter-rater reliability were evaluated from a sample of 32 shared book reading observations. The study findings provide preliminary evidence for the psychometric properties of the ELLECCT, such that it is judged as suitable for evaluation of early childhood teachers’ use of extratextual and paralinguistic strategies while engaged in shared book reading. We describe the ELLECCT’s potential application in both classroom coaching and training, and as a research tool, to support early childhood teachers’ skill-development during shared book reading.

linguistics,psychology, developmental
Observation Worksheet for the Development of Self-regulation of 2- to 3-year-old Children (AOS)

Alicja Barbara Potorska

DOI: https://doi.org/10.17951/lrp.2022.41.1.207-224

2022-04-19

Lubelski Rocznik Pedagogiczny

Abstract:Introduction : This article presents the results of verifying the psychometric validity of a tool developed to investigate the developmental changes taking place in children aged 2 to 3 years attending nurseries. It discusses the theoretical underpinnings of the concept of diagnosing early education environments and the assumptions designating the structure of the questionnaire measuring the effects of development of young children in the scope of self-regulation. Research Aim: The studies served to empirically validate the concept of the diagnosis of early care and education milieus and verify the validity of the psychometric tools to diagnose the effects of development of children aged 2 to 3 years. Method : The pedagogical monograph method was used in the study. In order to carry out the longitudinal research with two measurements, 5 tools were developed. A total of 131 children of toddler age attending 10 groups in 4 institutions and 20 caregivers working with them on a regular basis were included in the study. Results : The results of the verification of the psychometric validity of the tool were presented: Cronbach’s alpha reliability coefficient, average correlations between items in both measures, and Pearson’s (r) correlation coefficient. The psychometric validity of a scale is confirmed by data concerning high reliability and accuracy. Conclusions: The psychometric values obtained for the tool suggest that it can be aptly applied to forecast and monitor the development of the self-regulation of young children and may contribute to creating more conducive conditions for the development of this ability.
Feasibility and initial psychometric properties of the Observe, Reflect, Improve Children’s Learning Tool (ORICL) for Early Childhood Services: A tool for building capacity in infant and toddler educators

Kate Williams,Magdalena Janus,Linda Harrison,Sandie Wong,Sheena Elwick,Laura McFarland

DOI: https://doi.org/10.35542/osf.io/64unt

2021-11-17

Abstract:Child observation is a critical component of quality pedagogical practice in early childhood education and care (ECEC). Yet there are very few tools that support educators to systematically undertake observations to better understand the individual experiences of very young children within ECEC services. The ORICL (Observe, Reflect, Improve Children’s Learning) tool was co-designed by ECEC experts, service providers and educators to be used for this purpose by educators working with children aged under three years. It is a unique 117-item educator report across five domains of learning and well-being that rates the experiences of individual children, and the responses of educators and peers to the child’s initiatives, actions and communications. This paper describes the first feasibility study of ORICL in 12 ECEC services across Australia with a focus on the quantitative child data collected, and early psychometric properties of the tool. ORICL records were provided by 21 educators for a total of 66 children. Findings suggest that the ORICL items can be readily observed and rated by educators for children aged under three years, the rating scale is appropriate, and there is early evidence to support the domain structure of the tool. Further research on the ways such a tool can provide useful data for both educators and researchers, and stimulate enhanced practice in infant-toddler ECEC, is warranted.
Observational Tools for Measuring Parent–Infant Interaction: A Systematic Review

Annett Lotzin,Xiaoxing Lu,Levente Kriston,Julia Schiborr,Teresa Musal,Georg Romer,Brigitte Ramsauer

DOI: https://doi.org/10.1007/s10567-015-0180-z

IF: 7.41

2015-04-03

Clinical Child and Family Psychology Review

Abstract:The quality of the parent–infant interaction is essential for the infant’s development and is most objectively measured by observation. The existing observational tools for assessing parent–infant interaction were identified and described, and their psychometric soundness was evaluated. Twenty electronic databases from inception through June 2013 were searched. Validity was evaluated in five domains (test content, response process, internal structure, relations to other variables, and consequences). Of the 23,961 citations identified, 24 tools were included. Most tools demonstrated a valid rating procedure, reproducibility, and discriminant validity, based on studies with credible quality. The tools lacked factorial and predictive validity, and standardized norms. Further refinement of the existing tools is needed, particularly in the domains of content validity and consequential validity. The synthesized validity evidence and descriptions of the tools reported in this review might guide clinicians and researchers in the selection of an appropriate tool.

psychology, clinical
Development and Validation of Telehealth Competency Questionnaire-Provider

Steven Taylor,Lauren M Little

DOI: https://doi.org/10.1089/tmj.2023.0472

Abstract:Background: Given the rapid increase in telehealth utilization, health care providers are being increasingly trained to deliver services virtually. However, there are limited measures available to assess the extent to which structured trainings influence competency domains associated with telehealth delivery. Methods: The authors developed the Telehealth Competency Questionnaire-Provider (TCQ-P) using a multistep process, including a literature review and expert reviewers. Using two datasets, we used exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) to validate and refine the tool, respectively. The final version contained 17 items. Model fit was evaluated using the comparative fit index (CFI) (>0.90), Tucker-Lewis index (TLI) (>0.80), standardized root mean square residual (SRMR) (<0.08) and root mean square of error of approximation (RMSEA) (<0.08). Results: Participants included n = 701 in the exploratory study and n = 721 in the confirmatory study. Two items were revised, and one item was deleted as a result of the EFA, and the CFA of 17 number of items supported a 3-factor model (i.e., Evaluation, Rapport, Troubleshooting). Model fit was good, with CFI = 0.984, TLI = 0.978, RMSEA = 0.051, and SRMR = 0.035. Discussion: The TCQ-P measures three essential domains of telehealth competency, which is essential for future health care providers. The measure may be used to assess telehealth training outcomes.
Feasibility and acceptability of a low-resource-intensive, transdiagnostic intervention for children with social-communication challenges in early childhood education settings

Michael Siller,Lindee Morgan,Sally Fuhrmeister,Quentin Wedderburn,Brooke Schirmer,Emma Chatson,Scott Gillespie

DOI: https://doi.org/10.1177/13623613231179289

Autism

Abstract:Preschool classrooms provide a unique context for supporting the development of children with social-communication challenges. This study is an uncontrolled clinical trial of an adapted professional development intervention for preschool teachers (Social Emotional Engagement-Knowledge & Skills-Early Childhood). Social Emotional Engagement-Knowledge & Skills-Early Childhood is a low-resource-intensive, transdiagnostic intervention to address the learning needs of children with social-communication challenges and consists of four asynchronous online modules and three synchronous coaching sessions. The current research evaluated the feasibility and acceptability of intervention and research procedures, implemented in authentic early childhood education settings. Participants included one teacher and one target child with social-communication challenges from 25 preschool classrooms, sampled to maximize variability. Overall, the current research revealed high levels of feasibility, with 9 out of 10 benchmarks met: (a) procedures for participant recruitment reliably identified a neurodiverse sample of children with teacher-reported social-communication challenges; (b) teachers showed high levels of program engagement and Social Emotional Engagement-Knowledge & Skills-Early Childhood completion (76%); and (c) results revealed a robust pattern of gains in Social Emotional Engagement-Knowledge & Skills-Early Childhood classrooms and associations among key outcome measures (including active engagement, student teacher relationship, social-communication competencies). Implications for the design of a subsequent, larger effectiveness-implementation hybrid trial (Type 1) are discussed.
Psychometric Testing of an Instrument Assessing Family Knowledge, Contemplation, Confidence and Readiness for Engaging in Early Mobilisation of Critically Ill Patients: A Multi-Site Cross-Sectional Design

Sasithorn Mukpradab,Michael Ireland,Georgia Tobiano,Kristen Ranse,Fiona Coyer,Kellie Sosnowski,Daren K Heyland,Andrea P Marshall

DOI: https://doi.org/10.1111/jan.16415

2024-09-03

Abstract:Background: Early mobilisation is beneficial to support recovery among critically ill patients. The literature highlights the benefits of family engagement in early mobilisation, yet this practice remains underutilised. Effective implementation depends on understanding the key antecedents that influence family engagement in early mobilisation, specifically families' knowledge, contemplation, confidence and readiness. However, no measurement tools currently exist to assess these. Therefore, developing a psychometrically supported instrument is essential to understanding and enhancing families' factors influencing their engagement in early mobilisation. Aim: To develop and evaluate the psychometric properties of an instrument to assess families' knowledge, contemplation, confidence and readiness to engage in early mobilisation. Design: A multi-site cross-sectional survey design. Methods: Based on established psychological theory (Social Cognitive Theories and Behaviour Change Theories), an item pool was developed to assess families' knowledge, contemplation, confidence and readiness to participate in early mobilisation. To psychometrically evaluate the new tool, a multi-site cross-sectional survey was undertaken from May 2020 to June 2022 across five intensive care units in Australia. Data from 370 families of critically ill patients were used to evaluate the structural, convergent and discriminant validity as well as the reliability of the new instrument. Results: Confirmatory factor analysis indicated good model fit, supporting the proposed structure. All items displayed high standardised factor loadings except one, which improved upon freeing an error covariance. Positive inter-factor correlations were moderate to strong and were substantially lower than the square root of the average variance extracted, supporting both convergent and discriminant validity, respectively. Additionally, all subscales demonstrated well to excellent reliability. Conclusion: The findings provide preliminary support for the multiple types of validity evidence and the reliability of the instrument. This new instrument is suitable for use in clinical and research applications to assess families' knowledge, contemplation, confidence and readiness for their engagement in early mobilisation. Impact: Family engagement in early mobilisation activities may have multiple benefits but it is not commonly implemented in the ICU. Factors influencing family engagement in early mobilisation are poorly understood. Influential psychological theories highlight the likely importance of knowledge, contemplation, confidence and readiness. A readily available instrument designed to assess these constructs among family members is needed to deepen research understanding and guide clinical practice. The proposed instrument is designed to measure factors influencing family engagement in early mobilisation, which may support healthcare professionals and health services to identify and tailor strategies to support family engagement in early mobilisation. Reporting method: Recommendations for reporting the results of studies of instrument and scale development and testing was followed to report this study. Patient or public contribution: Family members of adult critically ill patients participated in this study, and they provided the data through the survey.
A tool to profile neural, sensory and motor development in children at school entry, identifying possible barriers to learning and emotional well‐being in early childhood

Penelope Hannant,Rachael Gartland,Helen Eales,Sophia Mooncey

DOI: https://doi.org/10.1111/1467-9604.12455

2023-09-20

Support for Learning

Abstract:The objective of the study was to develop a prototype for an accessible, high quality, cost and time‐effective 'Development Profiling Tool' for use in reception classes. This would build a unique picture of every individual child's developmental at the beginning of their educational journey, meaning that interventions for any comparable areas of difficulty could be started early in the child's schooling. In this study, a prototype of the tool was developed and tested for reliability, validity and usability. Through content analysis of a range of screeners and the merging of targeted expertise, a single 54 question observational questionnaire was constructed that incorporated the five developmental domains considered to impact on learning and emotional well‐being: auditory skills; internal senses (proprioception and vestibular input); external senses (auditory, visual and tactile responsivity); fine motor skills and gross motor skills. Thus, the Development Profiling Tool was created. Key points For a child to learn successfully a number of developmental building blocks need to be present. These include effective sensory responsivity and motor coordination. This study develops a Developmental Profiling Tool to map every child's development at the start of their schooling. The study also tests the prototype for reliability, validity and usability.
Testing a Communication Assessment Tool for Ethically Sensitive Scenarios: Protocol of a Validation Study

Thierry Daboval,Natalie Ward,Jordan R Schoenherr,Gregory P Moore,Caitlin Carew,Alicia Lambrinakos-Raymond,Emanuela Ferretti

DOI: https://doi.org/10.2196/12039

2019-05-08

Abstract:Background: Although well-designed instruments to assess communication during medical interviews and complex encounters exist, assessment tools that differentiate between communication, empathy, decision-making, and moral judgment are needed to assess different aspects of communication during situations defined by ethical conflict. To address this need, we developed an assessment tool that differentiates competencies associated with practice in ethically challenging situations. The competencies are grouped into three distinct categories: communication skills, civility and respectful behavior, clinical and ethical judgment and decision-making. Objective: The overall objective of this project is to develop an assessment tool for ethically sensitive scenarios that measures the degree of respect for the attitudes and beliefs of patients and family members, the demands of clinical decision-making, and the success in dealing with ethical conflicts in the clinical context. In this article, we describe the research method we will use during the pilot-test study using the neonatal context to provide validity evidence to support the features of the Assessment Communication Tool for Ethics (ACT4Ethics) instrument. Methods: This study is part of a multiphase project designed according to modern validity principles including content, response process, internal structure, relation to other variables, and social consequences. The design considers threats to validity such as construct underrepresentation and factors exerting nonrandom influence on scores. This study consists of two primary steps: (1) train the raters in the use of the new tool and (2) pilot-test a simulation using an Objective Structured Clinical Examination. We aim to obtain a total of 90 independent assessments based on the performance of 30 trainees rated by 15 trained raters for analysis. A comparison of raters' responses will allow us to compute a measure of interrater reliability. We will additionally compare the results of ACT4Ethics with another existing instrument. Results: This study will take approximately 18 months to complete and the results should be available by September 2019. Conclusions: ACT4Ethics should allow clinician-teachers to assess and monitor the development of competency of trainees' judgments and communication skills when facing ethically sensitive clinical situations. The instrument will also guide the provision of meaningful feedback to ensure that trainees develop specific communication, empathy, decision-making, and ethical competencies. International registered report identifier (irrid): PRR1-10.2196/12039.
Virtual reality informs clinical observation tool

Francis J Real,Dominick DeBlasio,Nicholas J Ollberding,Kimberley Sikora,Rachel Herbst,Monica Whitehead,Brittany L Rosen,Andrea Meisman,Lori E Crosby,Melissa D Klein

DOI: https://doi.org/10.1111/tct.13575

Abstract:Background: Assessing trainees' skills via workplace-based assessments is challenging given the lack of psychometrically valid instruments. Our team previously developed an observation instrument to assess residents' competencies in behavioral health anticipatory guidance (BHAG) and motivational interviewing (MI) though its reliable usage required expert raters (e.g., paediatric psychologists). Our purpose was to establish validity evidence for a modified tool for clinicians. Approach: This study utilised data from a prior educational trial of a virtual reality (VR)-based behavioural health curriculum for paediatric residents. First, group interviews were conducted with clinicians to modify the expert instrument. Next, recorded VR simulations (n = 10) were scored to assess interrater reliability between clinicians. Finally, a physician used the tool to assess its ability to discriminate between residents' skill levels (n = 55). Evaluation: Modifications during group interviews included a change from frequency counts for items related to MI to the binary outcome of present/absent and the addition of an entrustment item. On interrater-reliability testing, the clinician tool demonstrated mostly substantial or near perfect agreement for items related to BHAG. MI items demonstrated a range of agreement. Using 55 recorded VR simulations, the clinician tool discriminated between trained versus untrained residents in BHAG skills (p = 0.002) and level of entrustment (p = 0.001). Differences between groups in MI adherence was not statistically significant (p = 0.095) as it was on the expert instrument. Implications: VR demonstrated potential as a novel approach for obtaining validity evidence for tool development to support workplace-based assessments. Further work assessing usage of the clinician tool in real-world settings is warranted.
Implementing a Uniform Outcome Measurement Approach for Early Interventions of Autism Spectrum Disorders

Deanna Swain,Yi Li,Hallie R Brown,Eva Petkova,Catherine Lord,Sally J Rogers,Annette Estes,Connie Kasari,So Hyun Kim

DOI: https://doi.org/10.1016/j.jaac.2024.06.004

2024-07-02

Abstract:Objective: Naturalistic developmental behavioral interventions for children with autism spectrum disorder show evidence for effectiveness for specific social communication targets such as joint attention or engagement. However, combining evidence from different studies and comparing intervention effects across those studies have not been feasible due to lack of a standardized outcome measure of broader social communication skills that can be applied uniformly across trials. This investigation examined the usefulness of the Brief Observation of Social Communication Change (BOSCC) as a common outcome measure of general social communication skills based on secondary analyses of data obtained from previously conducted randomized controlled trials of 3 intervention models, Early Social Intervention (ESI), Early Start Denver Model (ESDM) and Joint Attention Symbolic Play Engagement and Regulation (JASPER). Method: The subset of datasets from the 3 randomized controlled trials was created to examine differences in the BOSCC scores between intervention and control groups over the course of the interventions. Results: Based on 582 videos from 207 caregiver-child dyads, the BOSCC noted significant differences between intervention vs control groups in broad social communication skills within 2 of the 3 intervention models, which were longer in duration and focused on a broad range of developmental skills. Conclusion: The BOSCC offers the potential to take a uniform measurement approach across different intervention models to capture the effect of intervention on general social communication skills but may not pick up the effects of some brief interventions targeting proximal outcomes. Clinical trial registration information: Comparing Parent-Implemented Interventions for Toddlers With Autism Spectrum Disorders; https://www. Clinicaltrials: gov/; NCT00760812. Intensive Intervention for Toddlers With Autism (EARLY STEPS); https://www. Clinicaltrials: gov/; NCT00698997. Social and Communication Outcomes for Young Children With Autism; https://www. Clinicaltrials: gov/; NCT00953095.
Development and Initial Psychometrics of a Generic Treatment Integrity Measure Designed to Assess Practice Elements Targeting Social, Emotional, and Behavioral Outcomes in Early Childhood Settings

Bryce D McLeod,Kevin S Sutherland,Michael Broda,Kristen L Granger,Ruben G Martinez,Maureen A Conroy,Patricia A Snyder,Michael A Southam-Gerow

DOI: https://doi.org/10.1007/s11121-021-01304-w

Abstract:Though treatment integrity measurement is important for research intended to promote social and behavioral outcomes of children at risk for emotional and behavioral disorders (EBDs) in early childhood settings, measurement gaps exist in the field. This paper reports on the development and preliminary psychometric assessment of the treatment integrity measure for early childhood settings (TIMECS), an observational measure designed to address existing measurement gaps related to treatment integrity with tier 2 interventions in the early childhood field. To assess the preliminary score reliability (interrater) and validity (construct, discriminant) of the TIMECS, live observations (N = 650) in early childhood classrooms from 54 teachers (92.6% female, 7.4% male; 61.1% White) and 91 children (M age = 4.53 years, SD = .44; 45.1% female, 54.9% male; 45.1% Black) at risk for EBDs were scored by 12 coders using the TIMECS and an observational measure designed to assess teacher-child interactions. Teachers also self-reported on the quality of the teacher-child relationship. Interrater reliability (intraclass correlation coefficients, ICC [2,2]) for the quantity (i.e., adherence) item scores had a mean of .81 (SD = .07; range from .68 to .95), and the quality (i.e., competence) item scores had a mean of .69 (SD = .08; range from .52 to .80). Scores on the TIMECS Quantity and Quality items and scales showed evidence of construct validity, with the magnitude of the correlations suggesting that the quantity and quality items assess distinct components of treatment integrity. A TIMECS quantity scale also showed promise for intervention evaluation research by discriminating between teachers who had and had not been trained in a specific evidence-based intervention targeting social and behavioral skills in early childhood. The findings support the potential of the TIMECS to assess treatment integrity of teacher-delivered practices designed to address child social and behavioral outcomes of children at risk for EBDs in early childhood settings.
Development of an assessment tool to measure communication skills among family medicine residents in the context of electronic medical record use

DOI: https://doi.org/10.1186/s12909-023-04216-1

IF: 3.263

2023-04-15

BMC Medical Education

Abstract:The introduction of the electronic medical record (EMR) has led to new communication skills that need to be taught and assessed. There is scarce literature on validated instruments measuring electronic-specific communication skills. The aim is to develop an assessment checklist that assesses the general and EMR-specific communication skills and evaluates their content validity and reliability.

education & educational research,education, scientific disciplines
Psychometric Properties of the Early Feeding Skills Assessment Tool

Suzanne M. Thoyre,Britt Frisk Pados,Catherine S. Shaker,Kristy Fuller,Jinhee Park,Shaker, Catherine S.,Fuller, Kristy,Thoyre, Suzanne M.,Pados, Britt Frisk,Park, Jinhee

DOI: https://doi.org/10.1097/ANC.0000000000000537

2019-10-03

Advances in Neonatal Care

Abstract:Background: Supporting infants as they develop feeding skills is an essential component of neonatal and pediatric care. Selecting appropriate and supportive interventions begins with a thorough assessment of the infant's skills. The Early Feeding Skills (EFS) tool is a clinician-reported instrument developed to assess the emergence of early feeding skills and identify domains in need of intervention. Purpose: The purpose of this study was to identify the factor structure of the EFS and test its psychometric properties, including internal consistency reliability and construct validity. Methods: EFS-trained interprofessional clinicians in 3 settings scored 142 feeding observations of infants 33 to 50 weeks' postmenstrual age. Redundant and rarely endorsed items were removed. Factor analysis methods clustered items into subscales. Construct validity was examined through the association of the EFS with (1) concurrently scored Infant-Driven Feeding Scale-Quality (IDFS-Q), (2) infant birth risk (gestational age), and (3) maturity (postmenstrual age). Results: Principal components analysis with varimax rotation supported a 5-factor structure. The total EFS demonstrated good internal consistency reliability (Cronbach α= 0.81). The total EFS score had construct validity with the IDFS-Q (r =−0.73; P < .01), and with gestational age of a subsample of premature infants (r = 0.22; P < .05). Implications for Practice: As a valid and reliable tool, the EFS can assist the interprofessional feeding team to organize feeding assessment and plan care. Implications for Research: The strong psychometric properties of the EFS support its use in future research.

nursing
Development and validation of the Telehealth Etiquette Competency Checklist: A Delphi study

Rachel Pittmann,Nicole Danaher-Garcia,Bobbie Ann Adair White,Anne Thompson

DOI: https://doi.org/10.1177/1357633x241279494

2024-09-25

Journal of Telemedicine and Telecare

Abstract:Journal of Telemedicine and Telecare, Ahead of Print. BackgroundProviding telehealth care requires unique professionalism skills (i.e. telehealth etiquette) to ensure patients have a positive experience. Given the effect of patient–provider relationships on healthcare outcomes and the limited evidence for healthcare professionals to learn and practice these skills, developing a telehealth etiquette competency tool is necessary.MethodsThis multiround Delphi study utilized subject matter experts' opinions to validate a telehealth etiquette competency checklist, using Lawshe's content validity measurements. Panelists were diverse in professional backgrounds, years of experience, telehealth teaching, clinical experience, and involvement in telehealth professional society and governmental policy making.ResultsConsensus and validation were achieved on the checklist by the 17 panelists in Round 1 for 19 of 20 competencies. Following revisions based on their expert opinions, consensus was achieved by all 16 panelists in Round 2 for 20 competencies.DiscussionThe Telehealth Etiquette Competency Checklist (TECC) provides a validated telehealth etiquette tool that can be used by health professionals to improve their telehealth videoconsultations, thus enhancing patient satisfaction.

health care sciences & services
Evidence-Based Implementation of the Family-Centered Model and the Use of Tele-Intervention in Early Childhood Services: A Systematic Review

Estibaliz Jimenez-Arberas,Yara Casais-Suarez,Alba Fernandez-Mendez,Sara Menendez-Espina,Sergio Rodriguez-Menendez,Jose Antonio Llosa,Jose Antonio Prieto-Saborit

DOI: https://doi.org/10.3390/healthcare12010112

2024-01-03

Health Care

Abstract:Background: The purpose of this review is to explore the evidence and efficacy of two trends in early childhood intervention services: the family-centered model and the use of tele-intervention. Methods: A systematic review was carried out following the PRISMA methodology and using three databases: Web of Science, PubMed and Scopus. The studies included were those aimed at children from 0 to 6 years of age, focused on early intervention, and which alluded to the family-centered model and/or tele-intervention. Results: a total of 33 studies were included. Five main themes were identified: (1) The participation of children and family is facilitated and improved by the family-centered model of care; (2) the feeling of competence, self-efficacy, satisfaction and empowerment in professionals and families have a positive impact on quality of life; (3) the use of tele-intervention as a tool for prevention and intervention; (4) preparation for telepractice can improve the development of commitment; (5) tele-intervention as a possible solution to contextual barriers. Conclusions: Tele-intervention in pediatrics is presented as a tool inherent to the family-centered model since its implementation involves several common strategies. Future lines of research should explore the use of this tool as a possible solution to contextual barriers.

health care sciences & services,health policy & services
Just-in-Time: A Caregiver-Mediated Intervention for Toddlers With Autism

Kathryn M. Bailey,Mary E. Rodgers,Emily D. Quinn,Suzanne Thompson,Jennifer Nietfeld,Ann P. Kaiser

DOI: https://doi.org/10.1044/2023_ajslp-23-00279

2024-02-14

American Journal of Speech-Language Pathology

Abstract:Purpose: We investigated effects of an adaptive telehealth coaching model on caregiver implementation of enhanced milieu teaching (EMT) with newly diagnosed toddlers with autism. Method: Three caregiver–child dyads participated in a multiple-baseline-across-behaviors, single-case design. Caregivers were taught EMT via telehealth using the teach–model–coach–review approach. EMT strategies were taught sequentially in four components corresponding to design tiers. Caregivers reported their needs for support and adaptation via weekly surveys. Primary outcomes were measures of caregiver's implementation, including (a) a fidelity checklist for wholistic use of EMT and (b) a percentage of correct use of a subset of key EMT strategies (e.g., matched turns, target talk, expansions, play actions, milieu episodes). Generalization and maintenance of caregiver strategy use in uncoached home activities were measured. The number of different words used by children was measured as a secondary, descriptive outcome. Social validity data were collected through ratings and interviews at the end of the study. Results: There was a functional relation between the intervention and caregiver's implementation of EMT for all dyads. Caregiver's use of EMT strategies often generalized and maintained post-intervention. Child response to intervention was variable. Social validity data indicated that the model was beneficial to caregivers and children. Conclusions: An adaptive telehealth coaching model is effective for teaching caregivers of toddlers with autism to implement EMT and potentially helps to bridge the gap between diagnosis and comprehensive intervention. Further exploration of the relation between caregiver fidelity and dosage of active ingredients and child spoken language outcomes is needed. Supplemental Material: https://doi.org/10.23641/asha.25156223

rehabilitation,audiology & speech-language pathology,linguistics

Development and validation of an observational tool to measure engagement in telepractice early intervention

Exploring engagement in telepractice early intervention for young children with developmental disability and their families: a qualitative systematic review

Diversified caregiver input to upgrade the Young Children's Participation and Environment Measure for equitable pediatric re/habilitation practice

Caregiver Perspectives on Telehealth Assessment and Other Supports for Infants with Early Developmental Concerns

The development and psychometric properties of a shared book reading observational tool: The Emergent Literacy and Language Early Childhood Checklist for Teachers (ELLECCT)

Observation Worksheet for the Development of Self-regulation of 2- to 3-year-old Children (AOS)

Feasibility and initial psychometric properties of the Observe, Reflect, Improve Children’s Learning Tool (ORICL) for Early Childhood Services: A tool for building capacity in infant and toddler educators

Observational Tools for Measuring Parent–Infant Interaction: A Systematic Review

Development and Validation of Telehealth Competency Questionnaire-Provider

Feasibility and acceptability of a low-resource-intensive, transdiagnostic intervention for children with social-communication challenges in early childhood education settings

Psychometric Testing of an Instrument Assessing Family Knowledge, Contemplation, Confidence and Readiness for Engaging in Early Mobilisation of Critically Ill Patients: A Multi-Site Cross-Sectional Design

A tool to profile neural, sensory and motor development in children at school entry, identifying possible barriers to learning and emotional well‐being in early childhood

Testing a Communication Assessment Tool for Ethically Sensitive Scenarios: Protocol of a Validation Study

Virtual reality informs clinical observation tool

Implementing a Uniform Outcome Measurement Approach for Early Interventions of Autism Spectrum Disorders

Development and Initial Psychometrics of a Generic Treatment Integrity Measure Designed to Assess Practice Elements Targeting Social, Emotional, and Behavioral Outcomes in Early Childhood Settings

Development of an assessment tool to measure communication skills among family medicine residents in the context of electronic medical record use

Psychometric Properties of the Early Feeding Skills Assessment Tool

Development and validation of the Telehealth Etiquette Competency Checklist: A Delphi study

Evidence-Based Implementation of the Family-Centered Model and the Use of Tele-Intervention in Early Childhood Services: A Systematic Review

Just-in-Time: A Caregiver-Mediated Intervention for Toddlers With Autism