Abstract:This article explores in-depth the metatheoretical and methodological foundations on which rating scales-by their very conception, design and application-are built and traces their historical origins. It brings together independent lines of critique from different scholars and disciplines to map out the problem landscape, which centres on the failed distinction between psychology's study phenomena (e.g., experiences, everyday constructs) and the means of their exploration (e.g., terms, data, scientific constructs)-psychologists' cardinal error. Rigorous analyses reveal a dense network of 12 complexes of problematic concepts, misconceived assumptions and fallacies that support each other, making it difficult to be identified and recognised by those (unwittingly) relying on them (e.g., various forms of reductionism, logical errors of operationalism, constructification, naïve use of language, quantificationism, statisticism, result-based data generation, misconceived nomotheticism). Through the popularity of rating scales for efficient quantitative data generation, uncritically interpreted as psychological measurement, these problems have become institutionalised in a wide range of research practices and perpetuate psychology's crises (e.g., replication, confidence, validation, generalizability). The article provides an in-depth understanding that is needed to get to the root of these problems, which preclude not just measurement but also the scientific exploration of psychology's study phenomena and thus its development as a science. From each of the 12 problem complexes; specific theoretical concepts, methodologies and methods are derived as well as key directions of development. The analyses-based on three central axioms for transdisciplinary research on individuals, (1) complexity, (2) complementarity and (3) anthropogenicity-highlight that psychologists must (further) develop an explicit metatheory and unambiguous terminology as well as concepts and theories that conceive individuals as living beings, open self-organising systems with complementary phenomena and dynamic interrelations across their multi-layered systemic contexts-thus, theories not simply of elemental properties and structures but of processes, relations, dynamicity, subjectivity, emergence, catalysis and transformation. Philosophical and theoretical foundations of approaches suited for exploring these phenomena must be developed together with methods of data generation and methods of data analysis that are appropriately adapted to the peculiarities of psychologists' study phenomena (e.g., intra-individual variation, momentariness, contextuality). Psychology can profit greatly from its unique position at the intersection of many other disciplines and can learn from their advancements to develop research practices that are suited to tackle its crises holistically.

The development of the Epistemic Trust Rating System (ETRS)

Development and validation of a self-report measure of epistemic trust

Initial Validation of an Ecological Momentary Assessment Measure of Self-Efficacy to Manage Negative Emotions

Trust under development: The Italian validation of the Epistemic Trust, Mistrust, and Credulity Questionnaire (ETMCQ) for adolescents

Epistemic Trust, Mistrust and Credulity Questionnaire (ETMCQ) validation in French language: Investigating association with loneliness

Validation of the Argentine version of the epistemic trust, mistrust, and credulity questionnaire

Development of a measure quantifying adverse psychotherapeutic ingredients: The Experiences of Therapy Questionnaire (ETQ)

Iranian adaptation of the Epistemic Trust, Mistrust, and Credulity Questionnaire (ETMCQ): Validity, reliability, discriminant ability, and sex invariance

Epistemic Trust: a Keyword for Contemporary Clinical Practice and Psychopathology

Emotion-Focused Therapy–Therapist Fidelity Scale (EFT-TFS): Conceptual Development and Content Validity

Development and Validation of a Measure of Expectations Toward Romantic Relationships (ETRR)

Assessment of professional self‐efficacy in psychological interventions and psychotherapy sessions: Development of the Therapist Self‐Efficacy Scale (T‐SES) and its application for eTherapy

Development and Validation of the System Trustworthiness Scale

Emotion Regulation of Others and Self (EROS): The Development and Validation of a New Individual Difference Measure

Transformational process scale: An initial validation and application to the first psychotherapy session.

Development and Psychometric Validation of the Body Trust Scale

Measuring trust in medical researchers

A new scale for the measurement of interpersonal trust.

Measuring trust in one's physician: A scoping review

Therapist interventions using the Psychodynamic Interventions Rating Scale (PIRS) in dynamic therapy, psychoanalysis and CBT

Rating scales institutionalise a network of logical errors and conceptual problems in research practices: A rigorous analysis showing ways to tackle psychology's crises