The effects of Routine Outcome Monitoring (ROM) in the course of an implementation process - A randomized clinical trial

Abstract

This study investigated the effects of the Partners for Change Outcome Management System (PCOMS) in adult outpatient treatment at a hospital-based mental health clinic. It also investigated whether the effects differed with the timing of the treatment within a 4-year implementation period, with clients’ initial distress levels, and between therapists. Adult clients (N = 170) were randomized to treatment as usual (TAU) or routine outcome monitoring (ROM). Twenty therapists provided therapy in both conditions. Therapy outcome was measured by the Behavior and Symptoms Identification Scale (BASIS-32). Data were analyzed in a series of multilevel models (MLMs). Clients in the ROM condition were 2.5 times more likely to demonstrate improvement than those in the TAU condition. Controlling for therapist variability, the overall effect size (ES) in favor of ROM was small (d = 0.26, p = .037). The superiority for ROM over TAU increased significantly over the duration of the study. ROM effects were not moderated by clients’ initial distress levels. Differences between therapists accounted for 9%–10% of the variability in outcomes, and there were no significant differences in ROM effects between therapists. ROM was associated with better treatment outcomes independent of clients’ initial distress levels. Clients treated later in the study benefitted more from ROM than those treated earlier.