2 Emily Jones and Katharina Manassis Outcomes for cognitive behavioral therapy (CBT) and other evidence-based psychotherapies have been evaluated extensively, but the research literature on methods of training in these therapies and on disseminating them is relatively sparse. Recent changes in the mandates of governments, mental health agencies, and research associations have, however, sharpened the focus on knowledge translation and evidence-based practices. Therefore research has started to examine what constitutes effective training for CBT and how to best help trainees implement CBT in real-world conditions of practice when working with clients of various ages who suffer from internalizing disorders. This chapter examines training methods generally, then more specifically in relation to the treatment of anxiety disorders, depression, children and adolescents. It concludes with a review of obstacles to effective training. Effective strategies for presenting training material have been derived from learning models. Three different but complementary models are reviewed and then linked to specific training methods. Beidas and Kendall (2010) seek to understand how training models affect the translation of evidence-based practices (EBP) through a systems-contextual perspective. Theirs is considered a broad, holistic approach that emphasizes that an individual works within a system and thus quality of training, organizational supports, therapist variables, and client variables interact to effectively translate EBP. Provisional evidence from Beidas and Kendall’s (2010) literature review suggests that, when all levels of the systems-contextual model are addressed, therapists reach proficiency levels in competence, adherence, and skill that facilitate effective client change. Bennett-Levy (2006) presents a cognitive model for training therapists that emphasizes changes in therapists’ information processing and reflection. In Bennett-Levy’s model there are three principal systems at work: declarative, procedural, and reflective (DPR). The declarative system consists of factual information typically learned through didactic teaching, observed learning, supervision, and reading assignments. The procedural system consists of applied skills; and the reflective system consists of metacognitive skills that include observations, interpretations, and evaluations of one’s self in the past, present, and future. Bennett-Levy demonstrates how this model accounts for a new therapist’s progressive learning until he or she becomes an expert. The new therapist begins by relying on the declarative system using didactic learning, modeling, practice, and feedback but further develops clinical expertise through the procedural system. Finally, he or she moves to the stage of clinician, as a teacher or expert, through the reflective system. The transition to becoming an expert happens when the therapist goes from reflection-on-action (retrospective review of therapeutic interventions) to reflection-in-action (reflection that occurs during therapy sessions). Other theoretical reviews – such as Milne, Aylott, Fitzpatrick, and Ellis (2008) and Rakovshik and McManus (2010) – emphasize the relationship between trainee changes and methods of instruction. Here it is found that trainees in CBT need supervision that provides not only didactic teaching but also experiential learning methods such as role-play, cotherapy, and modeling. Further, Rakovshik and McManus (2010) provide evidence to suggest that, if supervision is removed prior to consolidation, then the learned skills can deteriorate over time. On the basis of these learning models, many types of training have emerged. Bennett-Levy, McManus, Westling, and Fennell (2009) examine which training methods are most effective, testing the didactic versus experiential distinction described above. Although their study relies on therapists’ perceptions, it does allow for predictions to be made about the effect of training methods on CBT skills and competence. In this study, 120 therapists were surveyed regarding the effectiveness of 6 popular training methods and 11 different CBT skills. Bennett-Levy and colleagues found that different methods of learning were perceived to be effective across different CBT skills. Passive training strategies such as reading manuals and books, attending lectures and workshops, and completing non-interactive online training increased declarative knowledge and some conceptual and technical skills. Active training strategies such as role-play, reflective practice, self-experiential work, graded training and supervision were found to increase the therapist–client exchange and the level of technical, interpersonal, procedural, and reflective skills. Herschell, Kolko, Baumann, and Davis (2010) reviewed 55 different studies on training therapists in psychosocial treatments. Their review found that passive training – such as reading and workshops – develops knowledge but is not sufficient for achieving competence, as skills learnt through these methods do not reliably persist over time. The addition of skill feedback and short-term consultation or supervision after a workshop was shown to increase both knowledge and skills. In particular, clinical supervision and consultation with field experts consistently produced superior training outcomes, despite difficulties that may arise with cost and availability. Overall, Herschell and colleagues concluded that multi-component training programs are superior to other (single-component) training methods. With the advent of online training, new hybrid training methods that incorporate both passive and active learning methods have become popular (Dimeff et al. 2009; Granpeesheh et al. 2010; Sholomskas and Carroll 2006; Sholomskas et al. 2005; Weingardt 2004; Weingardt, Cucciare, Bellotti, and Lai 2009). For example, Dimeff et al. (2009) investigated the efficacy of three different training methods for dialectical behavior therapy (DBT): (i) a 20-hour interactive online training (OLT) session; (ii) a two-day instructor-led training (ILT) session; and (iii) reading two treatment manuals. These researchers made sure the OLT was interactive and sophisticated, as they felt that variable results in other studies might be due to OLT’s being presented like a book on a screen. Specifically, the OLT included audio and visual presentation as well as a fictional DBT skills group for participants to observe and learn from, expert insights, practical exercises, and knowledge quizzes. Participants were evaluated before and after training, and also in a 90-day follow-up, regarding their knowledge of DBT, satisfaction with training, referencing of materials, and clinical performance in role-play. Dimeff and colleagues found that OLT significantly out-performed both the ILT method and the method of training through manuals. The duration of training is, potentially, a factor to be considered when investigating effective training methods. However, conclusions on duration are difficult to draw, as the majority of studies do not address this topic. Those studies that do mention training duration only give broad temporal descriptions and vary widely in approach, which makes them difficult to compare. In Rakovshik and McManus (2010), 37 different training programs are compared; but researchers point to a lack of agreement on the terminology that describes the training. For example, they argue that a comparison between a “workshop” that was didactic and interactive and contained role-play and case discussions and a “workshop” that was strictly didactic would be imprecise. Finally, specifying the nature of competence and its measurement presents its own challenges (see below). Therefore further research is needed on measuring competence and on the optimal duration of training. Nevertheless, most training studies reviewed above support multi-component programs that include active learning methods as well as didactic teaching. Training models in cognitive behavioral therapy (CBT) vary (see previous section), and competencies achieved by trainees are not clearly defined in all studies. Roth and Pilling (2008), however, developed a systematic model of the competencies needed by a therapist in order to treat anxiety and depression in adult populations; to do this, they used a Delphi technique that draws on sharing and refining contributions from individual field experts so as to arrive at a consensus. Roth and Pilling’s model describes five increasingly specific domains of competence: general psychotherapeutic competencies; basic CBT competencies (related to the structure and content of CBT); specific CBT techniques; problem-specific competencies; and competencies that allow adaptation to individual client needs while maintaining treatment fidelity (these are termed “meta-competencies”). The authors highlight that achieving meta-competencies generally requires the highest CBT expertise and the greatest amount of experience, which makes these competencies the most challenging ones to impart to trainees. Studies of anxious and depressed clients generally emphasize treatment methods and client outcomes (chiefly symptomatic improvement, but also client perceptions of therapy in some studies, as for instance in Hepner, Paddock, Zhou, and Watkins 2011). The therapist’s competence is not consistently measured and evaluated on that basis, and, when measured, this is usually a side issue, subordinated to client outcomes rather than representing a separate goal. Training methods, in the most relevant studies, reflect the multi-component approach recommended more broadly in the training literature – an approach consisting of a blend of didactic teaching, interactive learning, and supervision. Computer-assisted training that incorporates didactic seminars with skills practice, role-play, and videos of “bad” therapy techniques, as well as training via tele-health, are becoming increasingly popular and participants show positive gains in competence and adherence (Reese and Gillam, 2001; Rose et al. 2011). Individual supervision, in particular the kind that focuses on the ongoing refinement of the trainee’s skills on the basis of the supervisor’s input, has shown superiority to other training methods in some studies (e.g., Mannix et al. 2006). Further to these training findings, Karlin et al. (2010), in collaboration with post-traumatic stress disorder (PTSD) therapists, found that incorporating collaborative consultation on actual cases in a training program increased therapists’ competence and helped enhance the adoption of therapy into practice. It is, however, more time-consuming than other learning methods. As an alternative, group supervision models have the potential to optimize the use of a supervisor’s time, but they have received limited evaluation (Manassis et al. 2009; Newton and Yardley 2007). An approach that diverts from the multi-component recommendation is that of training through participation in cotherapy. For example, Hepner and colleagues (2011) trained addiction counselors in depression-focused CBT group by using a co-therapy model where an inexperienced therapist conducted a treatment program together with an experienced therapist prior to implementing the program independently. The authors were able to demonstrate trainees’ ability to lead depression-focused CBT groups with high fidelity to treatment protocols, without training in individual CBT methods first. This cotherapy option may be a viable addition to other recommended multi-component approaches. When direct evaluation of therapist competence has been incorporated into studies of CBT, the Cognitive Therapy Scale (Dobson, Shaw, and Vallis 1985) has been the most frequently reported measure of competence. In this measure, expert raters evaluate videotapes of CBT sessions by using an 11-item scale. Reliability of ratings increases with the number of raters and the number of videotapes rated. Other measures of therapist competence include the Cognitive Formulation Rating Scale, the Cognitive Therapy Awareness Scale, and the CBT Supervision Checklist (Sudak, Beck, and Wright 2003). Nevertheless, there is a paucity of research into standardized measures of therapist competence. In the depression and anxiety literature, CBT skills and the ability to structure sessions are the aspects of competence that have been regularly linked to therapeutic change (Simons et al. 2010). The literature is not entirely consistent, however, possibly due to difficulty separating the effects of therapist competence from other client- and therapist-related factors. For example, Trepka, Rees, Shapiro, Hardy, and Barkham (2004) found that the relationship between competence and depression outcome was no longer significant when controlling for therapeutic alliance, and Strunk, Brotman, DeRubeis, and Hollon (2010) found that the relationship between therapist competence and change in depressive symptoms was moderated by factors related to the client, as client anxiety, early onset of depression, and chronic course predicted lower levels of change. Kuyken and Tsivrikos (2009), however, found that therapists’ high competence was associated with improved outcomes to depression regardless of clients’ comorbid diagnoses. Factors related to the therapist, such as positive attitudes toward empirically supported treatments, resulted in better implementation of depression-focused CBT in community settings (Lewis and Simons, 2011), and previous cognitive therapy experience and careful case selection were linked to therapist competence in a sample of 20 postgraduate trainees working with depressed clients (James, Blackburn, Milne, and Reichfelt 2001). Each anxiety and depressive disorder poses unique challenges to training, and this is due to the nature of the disorders themselves. Trainees need to acquire knowledge and experience related to internalizing psychopathology (see Chapter 8). Within the training context some difficulties may arise from the multiple explanations for a single behavior that may occur in anxiety and depression. For example, inconsistent attendance at appointments may occur for different reasons: depressive clients may be fatigued and feel hopeless about the possibility of improvement; anxious clients may wish to avoid the exposure to anxious situations that is integral to therapy. Helping trainees consider multiple alternatives and explanations is likely crucial for an effective training. Similarly, the psychological treatment of mood disorders is more regularly combined with medication than the psychological treatment of anxiety disorders in youth (Treatment for Adolescents with Depression Study Team, 2004). Familiarity with psychotropic medications and regular communication with the prescribing physician are therefore essential for the successful treatment of depressed clients, but not always for the treatment of anxious clients.
Effective Training Methods
Introduction
Key Features of Training: Presenting Training Material Using Effective Strategies
Training Approaches for Treating Anxiety and Depressive Disorders