Robotising Psychometrics: Validating Wellbeing Assessment Tools in Child-Robot Interactions

Nida Itrat Abbasi,Guy Laban,Tamsin Ford,Peter B Jones,Hatice Gunes

2024-02-28

Abstract:The interdisciplinary nature of Child-Robot Interaction (CRI) fosters incorporating measures and methodologies from many established domains. However, when employing CRI approaches to sensitive avenues of health and wellbeing, caution is critical in adapting metrics to retain their safety standards and ensure accurate utilisation. In this work, we conducted a secondary analysis to previous empirical work, investigating the reliability and construct validity of established psychological questionnaires such as the Short Moods and Feelings Questionnaire (SMFQ) and three subscales (generalised anxiety, panic and low mood) of the Revised Child Anxiety and Depression Scale (RCADS) within a CRI setting for the assessment of mental wellbeing. Through confirmatory principal component analysis, we have observed that these measures are reliable and valid in the context of CRI. Furthermore, our analysis revealed that scales communicated by a robot demonstrated a better fit than when self-reported, underscoring the efficiency and effectiveness of robot-mediated psychological assessments in these settings. Nevertheless, we have also observed variations in item contributions to the main factor, suggesting potential areas of examination and revision (e.g., relating to physiological changes, inactivity and cognitive demands) when used in CRI. Findings from this work highlight the importance of verifying the reliability and validity of standardised metrics and assessment tools when employed in CRI settings, thus, aiming to avoid any misinterpretations and misrepresentations.

Human-Computer Interaction,Robotics

What problem does this paper attempt to address?

The main issue this paper attempts to address is the validation of the effectiveness and reliability of using standardized psychological questionnaires (such as the Short Mood and Feelings Questionnaire (SMFQ) and three subscales of the Revised Child Anxiety and Depression Scale (RCADS)) to assess mental health in Child-Robot Interaction (CRI) environments. Specifically, the researchers explored the reliability and construct validity of these psychological measurement tools in CRI environments through secondary analysis of previously collected empirical data. The main objectives of the study include:

1. **Validating the reliability of psychological measurement tools**: The researchers assessed the internal consistency and random error of the SMFQ and RCADS when conveyed by robots, ensuring that these tools can still accurately measure mental health status in CRI environments.

2. **Evaluating construct validity**: Through confirmatory Principal Component Analysis (PCA), the researchers examined the factor structure of these psychological measurement tools in CRI environments to determine whether they can effectively capture the intended dimensions of mental health.

3. **Comparing the impact of different data collection methods**: The study also compared the performance differences of these psychological measurement tools when conveyed by robots versus self-reporting, to understand the impact of data collection methods on measurement results.

Through these analyses, the study aims to ensure that the use of these standardized psychological measurement tools in CRI environments can avoid misunderstandings and misuse, thereby providing a reliable basis for future research and practice.