Abstract:Aim: To present a conceptual and measurement strategy that allows to objectively, sensitively evaluate intervention progress based on data of participants' perceptions of presenting problems. Methods: We used as an example an organization development intervention at a United States Veterans Affairs medical center. Within a year, the intervention addressed the hospital's initially serious problems and multiple stakeholders (employees, management, union representatives) reported satisfaction with progress made. Traditional quantitative outcome measures, however, failed to capture the strong positive impact consistently reported by several types of stakeholders in qualitative interviews. To address the paradox, full interview data describing the medical center pre- and post- intervention were examined applying a validated theoretical framework from another discipline: Psychotherapy research. The Assimilation model is a clinical-developmental theory that describes empirically grounded change levels in problematic experiences, e.g., problems reported by participants. The model, measure Assimilation of Problematic Experiences Scale (APES), and rating procedure have been previously applied across various populations and problem types, mainly in clinical but also in non-clinical settings. We applied the APES to the transcribed qualitative data of intervention participants' interviews, using the method closely replicating prior assimilation research (the process whereby trained clinicians familiar with the Assimilation model work with full, transcribed interview data to assign the APES ratings). The APES ratings summarized levels of progress which was defined as participants' assimilation level of problematic experiences, and compared from pre- to post-intervention. Results: The results were consistent with participants' own reported perceptions of the intervention impact. Increase in APES levels from pre- to post-intervention suggested improvement, missed in the previous quantitative measures (the Maslach Burnout Inventory and the Work Environment Scale). The progress specifically consisted of participants' moving from the APES stages where the problematic experience was avoided, to the APES stages where awareness and attention to the problems were steadily sustained, although the problems were not yet fully processed or resolved. These results explain why the conventional outcome measures failed to reflect the intervention progress; they narrowly defined progress as resolution of the presenting problems and alleviation of symptomatic distress. In the Assimilation model, this definition only applies to a sub-segment of the change continuum, specifically the latest APES stages. The model defines progress as change in psychological processes used in response to the problem, i.e., a growing ability to deal with problematic issues non-defensively, manifested differently depending on APES stages. At early stages, progress is an increased ability to face the problem rather than turning away. At later APES stages, progress involves naming, understanding and successfully addressing the problem. The assimilation approach provides a broader developmental context compared to exclusively symptom, problem-, or behavior- focused approaches that typically inform outcome measurement in interpersonally based interventions. In our data, this made the difference between reflecting (APES) vs missing (Maslach Burnout Inventory, Work Environment Scale) the pre-post change that was strongly perceived by the intervention recipients. Conclusion: The results illustrated a working solution to the challenge of objectively evaluating progress in subjectively experienced problems. This approach informs measuring change in psychologically based interventions.

Changes in symptom intensity and emotion valence during the process of assimilation of a problematic experience: A quantitative study of a good outcome case of cognitive-behavioral therapy

Changes in symptom intensity and emotion valence-1 Changes in symptom intensity and emotion valence during the process of assimilation of a problematic experience : A quantitative study of a good outcome case of CBT

Assimilation approach to measuring organizational change from pre- to post-intervention

Processes of Change in Trauma-Focused Cognitive Behavioral Therapy for Youth: An Emotional Processing Theory Informed Approach

Innovative Moments and Change in Emotion-Focused Therapy: The Case of Lisa

Therapist interventions and client ambivalence in two cases of narrative therapy for depression

How and when immersion and distancing are useful in emotion focused therapy for depression

Change in emotion-based narrative as a potential mechanism of change in a brief treatment for borderline personality disorder

Narrative exploration of empathy acceptance on emotional communication changes between mother and child relationships

Nomothetic and idiographic symptom change trajectories in acute-phase cognitive therapy for recurrent depression.

How does emotion regulation change during psychotherapy? A daily diary study of adults in a transdiagnostic partial hospitalization program.

Patterns of cognitive-emotional change after cognitive-behavioural treatment in emotional disorders: A 12-month longitudinal cluster analysis

Outcome prediction in psychological therapy with continuous time dynamic modeling of affective states and emotion regulation.

Affective Change in Psychodynamic Psychotherapy: Theoretical Models and Clinical Approaches to Changing Emotions

Unraveling the optimal balance of problem-related affective experiences and need satisfaction in cognitive-behavioral therapy: A response surface analysis

Network analyses of ecological momentary emotion and avoidance assessments before and after cognitive behavioral therapy for anxiety disorders

Searching for change mechanisms in emotion-focused work with adolescents and parents: An example from multidimensional family therapy.

Understanding change from the patient perspective in a transdiagnostic Internet-based intervention for emotional disorders: a qualitative content analysis

Mentalization, session-to-session negative emotion expression, symbolic play, and affect regulation in psychodynamic child psychotherapy.

Change processes associated with functional improvement in a web-based version of Skills Training in Affective and Interpersonal Regulation (webSTAIR) for trauma-exposed veterans.

Integrating Cognitive-Behavioral Therapy With Compassion-Focused Therapy for the Treatment of Social Anxiety Disorder: An Evidence-Based Case Study