You are on page 1of 10

849985

research-article2019
AUT0010.1177/1362361319849985AutismAlbaum et al.

Original Article

Autism

Predictors and outcomes associated 2020, Vol. 24(1) 211­–220


© The Author(s) 2019
Article reuse guidelines:
with therapeutic alliance in cognitive sagepub.com/journals-permissions
DOI: 10.1177/1362361319849985
https://doi.org/10.1177/1362361319849985

behaviour therapy for children journals.sagepub.com/home/aut

with autism

Carly Albaum , Paula Tablon, Flora Roudbarani


and Jonathan A Weiss

Abstract
Therapeutic alliance is often an important aspect of psychotherapy, though it is rarely examined in clients with autism.
This study aims to determine the child pre-treatment variables and treatment outcomes associated with early and late
alliance in cognitive behaviour therapy targeting emotion regulation for children with autism. Data were collected from 48
children with autism who participated in a larger randomized-controlled trial. Pre-treatment child characteristics included
child, parent, and clinician report of child emotional and behavioural functioning. Primary outcome measures included
child and parent-reported emotion regulation. Therapeutic alliance (bond and task-collaboration) was measured using
observational coding of early and late therapy sessions. Pre-treatment levels of child-reported emotion inhibition were
associated with subsequent early and late bond. Pre-treatment levels of parent and child-reported emotion regulation
were related to early and late task-collaboration. Late task-collaboration was also associated with pre-treatment levels
of behavioural and emotional symptom severity. Task-collaboration in later sessions predicted improvements in parent-
reported emotion regulation from pre- to post-therapy. Future research is needed to further examine the role of task-
collaboration as a mechanism of treatment change in therapies for children with autism.

Keywords
autism, children, cognitive behavioural therapy, therapeutic alliance

Children with autism often exhibit mental health and therapist, collaboration on therapeutic tasks and a positive
behavioural challenges, including high rates of anxiety, bond (Bordin, 1979). This relationship is dynamic and
depression or aggressive behaviour. Cognitive behaviour transactional in nature, influenced by both therapist and
therapy (CBT), if adapted, has been shown to be effica- client attributes and varying in quality over the course of
cious in reducing mental health problems and improving treatment (Bordin, 1994). In treatment for children without
emotion regulation in verbally able children with autism, autism, alliance is thought to account for a significant por-
with small to moderate treatment effects (Weston, tion of therapeutic outcomes (Karver, Handelsman, Fields,
Hodgekins, & Langdon, 2016). Only a portion of individu- & Bickman, 2005). Recent meta-analyses suggest that alli-
als with autism who take part in therapeutic interventions ance is associated with small to moderate effects (McLeod,
demonstrate significant gains, with approximately 30% 2011; Murphy & Hutton, 2018) and is related to improve-
showing no improvement following CBT (Vasa et al., ments in both internalizing (Chiu, McLeod, Har, & Wood,
2014). To refine and maximize treatment effects, focus 2009) and externalizing symptoms (Kazdin, Marciano, &
needs to be directed towards examining the therapeutic Whitley, 2005) following CBT.
factors that function as mechanisms of change (Lerner,
White, & McPartland, 2012). York University, Canada
Therapeutic alliance is a recognized contributor to
Corresponding author:
treatment outcome. Therapeutic alliance is conceptualized Jonathan A Weiss, 230 Behavioural Science Building, 4700 Keele Street,
as the working relationship between therapist and client Toronto, Ontario, Canada M3J 1P3.
based on treatment goals central to both the client and Email: jonweiss@yorku.ca
212 Autism 24(1)

The quality of therapeutic alliance appears to be influ- of child reports (McLeod, Southam-Gerow, & Kendall,
enced in part by child pre-treatment factors. For example, 2017). Only one intervention study has used independent
children who are more motivated and prepared to change observer ratings of alliance with participants with autism.
(Christensen & Skogstad, 2009), and who have better As part of a pilot randomized-controlled trial (RCT) com-
social competence and securer social relationships (Levin, paring CBT to non-directive, supportive counselling for
Henderson, & Ehrenreich-May, 2012) tend to have a adolescents with autism, Murphy and colleagues (2017)
stronger alliance with their therapist based on ratings from used the Therapy Process Observational Coding Scheme–
multiple informants. Results from the adult literature indi- Alliance Scale (TPOCS-A; McLeod & Weisz, 2005) as an
cate a relation between emotion regulation, client-reported index of treatment fidelity. Results indicated good inter-
alliance and treatment outcome (Owens, Haddock, & rater agreement among coders, and independent observer
Berry, 2013), with at least one study reporting a link for ratings of alliance were comparable to those given in pre-
children with anxiety (Chu, Skriner, & Zandberg, 2014). vious therapy studies involving youth without autism
Results are more mixed around how pre-treatment inter- (Brown et al., 2015). It is yet to be determined whether
nalizing and externalizing symptom severity is associated pre-treatment child characteristics are associated with
with the formation of bond and task-collaboration (Shirk observer ratings of alliance or whether such ratings are
& Karver, 2011). predictive of treatment change.
Beyond child and treatment-specific factors, researchers
have examined differences in the alliance-outcome associa-
tion as a function of reporting source. Although the therapeu- Current study
tic alliance is undoubtedly a subjective experience for both This study stems from a larger RCT evaluating an emotion
client and therapist, objective techniques for assessing this regulation focused CBT intervention for children with
relationship, such as through independent observer reports, autism (Weiss et al., 2018). Using independent observer
may serve to be a more equitable methodological approach. ratings of early and late therapeutic alliance (operational-
In their meta-analysis, Shirk and Karver (2003) note that ized as task-collaboration and therapeutic bond), the fol-
children may not be equipped with the social and cognitive lowing research questions and hypotheses were addressed:
skills needed to assess their own therapeutic alliance. Ceiling
effects may also be observed in child reports of alliance 1. Do pre-treatment child characteristics, including
because ratings are only provided by a subgroup of children emotional and behavioural symptoms, emotion
who remain in treatment (Accurso & Garland, 2015). It has regulation and readiness for therapy, predict the
been argued that reports on process and outcome variables quality of therapeutic alliance? Based on previous
from the same source may potentially bias results by inflat- research, it was expected that emotional and behav-
ing effect sizes (Horvath & Symonds, 1991; McLeod, 2011). ioural symptoms and emotion regulation chal-
In addition, parent report of the therapist–child alliance may lenges would negatively predict therapeutic
be biased (either positively or negatively) by the parent’s alliance in early and in late sessions, whereas read-
own perceptions and attitudes towards the therapist and the iness for treatment would be a positive predictor.
context of the assessment (e.g. providing ratings while the 2. Is therapeutic alliance in early and in late sessions
therapist is present; McLeod & Weisz, 2005). Few studies a significant predictor of change in the CBT inter-
have looked at alliance in children with autism receiving vention’s primary outcome variable: emotion regu-
psychotherapy. Kerns, Collier, Lewin, and Storch (2018) lation? It was hypothesized that therapeutic alliance
examined the relation between child- and therapist-reported would account for a moderate portion of the vari-
alliance and treatment response in CBT designed to address ance in changes of emotion regulation, as reported
anxiety in children and adolescents. Treatment responsive by children and parents.
children were found to have greater post-treatment, retro-
spective therapist-rated (but not child-rated) levels of alli-
ance than non-responsive children, with no link to child age Methods
or the severity of autism or internalizing and externalizing
symptoms. Results from the grey literature support the link
Participants
between therapist reports of alliance in therapy and anxiety Participants included 48 children (91.7% male) between
symptom reduction (Klebanoff, 2015), and according to par- the ages of 8 and 12 years (M = 9.60, SD = 1.25), who took
ent interviews, specific therapist qualities (i.e. collaborating, part in a RCT of an emotion regulation focused CBT
being fun, giving praise, being patient) are important for a intervention (Weiss et al., 2018). All children (1) demon-
strong therapist-child alliance (Houlding, 2014). strated at least average intellectual functioning (IQ ⩾ 79)
Although therapeutic alliance is a subjective experi- based on the Wechsler Abbreviated Scale of Intelligence–
ence, independent observation has emerged as a useful Second Edition (WASI-II; Wechsler, 2011); (2) exhibited
way to gauge quality, addressing concerns around validity some degree of willingness to participate in therapy; (3)
Albaum et al. 213

had a documented autism diagnosis from a qualified 2017). The TPOCS-A has been used in other studies of
healthcare professional; and (4) met cut-offs on either the alliance in both individual and group CBT for children
parent-report versions of the Social Communication with acceptable reliability (Chiu et al., 2009; Liber et al.,
Questionnaire (SCQ cut-off > 14; Rutter & Bailey, 2003) 2010). For this study, ratings ranged from 1.75 to 3.75 for
or the Social Responsiveness Scale–Second Edition (SRS- early bond (M = 2.80, SD = 0.46), 1.17 to 5.00 for early
2 Total T score cut-off > 59, Constantino, 2012). For task-collaboration (M = 4.04, SD = 0.76), 2.00 to 3.92 for
children whose parent could not provide documentation late bond (M = 2.98, SD = 0.48) and 1.83 to 5.00 for late
and did not meet cut-off scores for either screening tool task-collaboration (M = 3.99, SD = 0.69). Interrater relia-
(n = 2), the Autism Diagnostic Observation Schedule– bility is described below.
Second Edition (ADOS-2; Lord et al., 2012) Module 3
was administered. Children were not eligible to partici- Primary treatment outcome. The primary treatment out-
pate in the study if they had a recent history of aggressive come of the intervention trial was emotion regulation, as
behaviour towards others or self-injurious behaviours reported by parent and child.
that could potentially be a serious safety concern, or if
they were currently receiving CBT or another therapy Children’s Emotion Management Scales (CEMS). 
targeting emotion regulation. Child self-reported emotion regulation was measured using
For the current sample, child Full-Scale IQ–2 (FSIQ-2) the CEMS (Zeman, Cassano, Suveg, & Shipman, 2010).
scores ranged from 79 to 140 (M = 105.00, SD = 14.64). The CEMS include three separate scales assessing self-
Children varied in autism symptom severity both on the regulation during feelings of Sadness (12 items), Anger (11
SRS-2 total T scores (M = 74.40, SD = 9.33) and SCQ total items) and Worry (10 items), each yielding three subscales:
scores (M = 21.62, SD = 4.45). The majority of parents Inhibition (e.g. ‘I hide my sadness’), Dysregulation (e.g. ‘I
identified their children as White/Caucasian (78.6%) and do things like slam doors when I am mad’) and Coping (e.g.
reported themselves as being married (91.5%), having ‘I talk to someone until I feel better when I’m worried’).
post-secondary education (90.7%), and having an annual A research assistant read each statement aloud and con-
family income of at least CAD$100,000 before taxes firmed the child understood each item. Children then rated
(65.1%; 18.6% preferred not to disclose). how frequently they engage in each behaviour on a 3-point
scale (1 = hardly ever; 3 = often). Items were averaged across
emotion scales to provide overall scores for each subscale.
Measures Average pre-treatment scores in this study ranged from 1.00
Therapeutic alliance.  Child and parent reports of therapeu- to 3.00 for Inhibition (M = 1.74, SD = 0.47), 1.00 to 2.78 for
tic alliance were not included in the initial protocol for the Dysregulation (M = 1.73, SD = 0.41) and 1.17 to 2.75 for
larger RCT in which this study is embedded. Therapists Coping (M = 1.96, SD = 0.42). The CEMS has demonstrated
did provide ratings of their perceived quality of the thera- convergent and divergent validity (Zeman et al., 2010) and
peutic alliance following each session. However, this was acceptable to good internal consistency for this sample
only measured using a single-item (‘How would you (α = 0.71–0.85).
describe the quality of the therapeutic relationship during
the session with the child?’ 1 = very poor; 7 = very good) Emotion Regulation Checklist (ERC).  The ERC (Shields &
and was collected for the purposes of assessing treatment Cicchetti, 1997) is a 24-item parent-report measure assess-
fidelity. For these reasons, this study opted to focus on the ing emotion regulation processes. Each item is rated on
use of retrospective independent observational ratings. a 4-point scale (1 = never; 4 = almost always). The ERC
Therapeutic alliance was measured using the TPOCS-A includes two subscales: Lability/Negativity (15 items),
(McLeod & Weisz, 2005). The TPOCS-A is a nine-item measuring mood swings, reactivity, emotional intensity, and
observational measure evaluating two facets of the alli- dysregulated emotions (e.g. ‘Is prone to disruptive outbursts
ance: the therapeutic bond between therapist and client of energy and exuberance’), with higher scores indicating
(bond; six items) and compliance and collaboration on greater dysregulation, and Emotion Regulation (eight items;
therapeutic tasks (task-collaboration; three items). Items one item was not included), measuring adaptive regulation
are rated by an independent observer on a 6-point Likert- processes (e.g. ‘Responds positively to neutral or friendly
type scale (0 = not at all; 5 = great deal), indicating the overtures by adults’), with higher scores indicating bet-
extent to which the client or therapist demonstrate given ter emotion regulation (Shields & Cicchetti, 1998). Pre-
behaviours in session. Initial psychometric properties of treatment scores in this study ranged from 1.67 to 3.53 for
the measure in children 8–14 years of age suggest accept- Lability/Negativity (M = 2.43, SD = 0.41) and 1.88 to 4.00
able interrater reliability (intraclass correlation coefficient for Emotion Regulation (M = 2.87, SD = 0.49). The ERC has
(ICC) ⩾ 0.40) for all nine items and excellent internal good to excellent internal consistency (Shields & Cicchetti,
consistency (α = 0.95). The measure also has convergent 1997, 1998) and acceptable to good internal consistency for
validity with therapist reports of alliance (McLeod et al., this study (α = 0.75–0.80).
214 Autism 24(1)

Predictors of therapeutic alliance. In addition to pre-treat- Review Board (#e2013-229). Thirty-two children were
ment levels of emotion regulation, as assessed using the excluded for not meeting study inclusion criteria, and 11
CEMS and ERC measures described above, the following declined to participate despite being eligible. Sixty-eight
pre-treatment child characteristics were included as pre- children were eligible to participate in the larger RCT.
dictors of therapeutic alliance. Once eligibility was determined, parents provided written
informed consent and children provided either written or
Readiness to participate.  Child readiness to participate verbal informed assent. For the purposes of this study, all
in therapy was assessed at initial screening using three children who received the intervention in its entirety were
questions: (1) ‘How much do you want to be part of the combined to form one treatment group regardless of
program?’ (2) ‘How much do you want to change?’ and whether they were initially randomized to treatment imme-
(3) ‘How hard you are willing to work?’ Children rated diate or waitlist. Measures were administered within the
each question on 8-point Likert-type scale, ranging from 2 weeks prior to treatment receipt (pre-treatment) and
0 = not at all to 8 = very, very much, and an overall readi- within 1 week of completing therapy (post-treatment).
ness score was calculated by averaging the three ratings. Of the 68 eligible families, 13 withdrew from the study
Pre-treatment mean readiness was 4.89 (SD = 2.00), rang- after confirming enrolment (nine children dropped out
ing from 0.33 to 8.00. before beginning the intervention and four dropped out
part way through the programme). Data were not available
Behavioural Assessment System for Children–Second Edition, for an additional six children because parents did not con-
Parent Rating Scale (BASC-2 PRS).  The BASC-2 PRS (Reyn- sent to having session videos used for research purposes
olds & Kamphaus, 2004) assesses behavioural and emotional (n = 4) or technical issues caused session videos to be
problems and adaptive functioning. For children between 8 unusable (n = 2). Finally, data for one participant was
and 11 years of age, parents completed the PRS-Child form excluded due to a change in therapist midway through
(160 items), while parents of children who were 12 years of treatment, leaving a final sample of n = 48.
age completed the PRS-Adolescent form (150 items). Three
composites were included in this study: Externalizing Prob- Intervention. The Secret Agent Society: Operation Regula-
lems (M = 58.06, SD = 10.47, Range = 41–86), Internaliz- tion (SAS:OR; Beaumont, 2013) is a manualized CBT pro-
ing Problems (M = 61.33, SD = 12.70, Range = 40–95) and gramme targeting emotion regulation adapted for children
Behavioural Symptoms Index (BSI; M = 69.25, SD = 10.05, with autism. The programme includes 10 individual ther-
Range = 53–95). The BASC-2 has strong internal consist- apy sessions that the therapist, child and primary caregiver
ency and concurrent validity with other child behaviour attend. Over the course of the study trial, sessions were
rating scales (Reynolds & Kamphaus, 2004) and has been facilitated by three post-doctoral fellows and 19 trained
used as an assessment tool in a number of studies that have graduate students (90.9% female; Mage = 26.95, SD = 3.05)
included children with autism (Grondhuis & Aman, 2012; enrolled in clinical or clinical-developmental psychology
Volker et al., 2010). programmes, under the supervision of a registered clinical
psychologist. Treatment integrity across sessions was
Anxiety Disorder Interview Schedule–Parent Version (ADIS- acceptable (85% ± 11%, Range = 50%–100%). Additional
P). The ADIS-P (Silverman & Albano, 2004) is a semi- details of the SAS:OR programme and therapist training
structured interview of both internalizing and externalizing procedures are provided elsewhere (Weiss et al., 2018).
disorders based on Diagnostic and Statistical Manual of
Mental Disorders (4th ed.; DSM-IV; American Psychiatric Coding. TPOCS-A coding followed procedures outlined
Association 1994). Parents provide information regarding by McLeod and Weisz (2005). Training included in-depth
symptomology, age of onset and degree of interference in review of the test development and scoring manual, cod-
daily life for each disorder. Based on the information pro- ing practice sessions and weekly check-ins between cod-
vided, the interviewer then gives an overall clinical severity ers to discuss any discrepancies or issues that arose during
rating ranging from 0 to 8, with higher ratings indicating practice coding. The coders (C.A., P.T., and F.R.) worked
greater severity. The overall severity rating for the current in close proximity, allowing for regular meetings and
sample ranged from 0 to 7 (M = 4.04, SD = 1.66). The ADIS- brief check-ins. During the first week of training, coders
P is recognized as the most commonly used outcome meas- met to code two therapy sessions together (for a pilot par-
ure in CBT trials for children with autism (Sung et al., 2011; ticipant who was not included as part of the final study).
Walters, Loades, & Russell, 2016). This provided an opportunity to discuss coding as the ses-
sion was being reviewed and make detailed notes on the
coding system. Coders met in person for at least 2 h for the
Procedures 5 weeks following (3 weeks of practice coding, followed
The larger RCT from which this study was derived began by 2 weeks of study coding). During these meetings, dis-
in September 2013. This research has received ethics crepancies in ratings were thoroughly discussed and video
review and approval by the York University’s Ethics content was reviewed to ensure all coders established a
Albaum et al. 215

similar repertoire of examples that corresponded with par- second block consisted of either early or late bond and
ticular ratings. Coders were trained over a 1-month period task-collaboration scores. Separate analyses were run for
and reached excellent reliability (ICC = 0.92, p < 0.001). each outcome variable.
Once reliability was established, sessions were randomly We recognize that conducting these analyses raises
assigned to coders. To avoid rater drift, coders continued questions about issues related to multiplicity, including
to meet in person throughout the data collection phase (bi- inflated Type I error rates. Scientific and clinical risk
weekly early on and then monthly once reliability was associated with Type I error within the context of this
evidently stable) and regularly corresponded between study include identifying and placing undue emphasis on
meetings if any questions arose. Coders were not involved pre-treatment factors that are not true predictors of the
in therapy provision for sessions they were coding and quality of alliance, and falsely predicting the extent to
were unaware of treatment outcome. which therapeutic alliance predicts treatment change.
Sampling of therapy sessions for study coding mim- While failing to correct for multiple comparisons may
icked methods employed by previous research examining increase the likelihood of identifying false positive find-
early and late phases of therapy for children (Chiu et al., ings, the small sample size, limited research in the area
2009; McLeod & Weisz, 2005). Sessions 2 and 3 (early) and an interest in balancing the examination of signifi-
and sessions 8 and 9 (late) were coded, and ratings were cance in terms of the probability of identifying a true
averaged to produce early and late bond and task-collab- effect serve as rationale for no adjustments being made
oration scores. If video recordings were not available (Feise, 2002). All variables included in the analyses
(e.g. technical issues with recording equipment), subse- were selected on the basis of clinical relevance and pre-
quent sessions for early alliance (i.e. session 4) and pre- viously derived empirical evidence. Power analyses
vious sessions for late alliance (i.e. session 7) were coded. using G*Power 3.1 (Faul, Erdfelder, Buchner, & Lang,
This was the case for nine early sessions (session 2, n = 5; 2009) indicated that moderate to large effects could be
session 3, n = 4), and eight late sessions (session 8, n = 5; detected using multiple linear regression analyses with a
session 9, n = 3). Kruskal–Wallis analyses confirmed that sample of 48 children, depending on the number of pre-
ratings on TPOCS-A items did not significantly differ dictors included.
between cases where sessions 4 and 7 were coded as
alternates.
Interrater reliability for the TPOCS-A was then calcu- Results
lated using ICCs for approximately 30% of available ses- Pre-treatment child characteristics and
sions (n = 60). Reliability coefficients were based on the
one-way random effects ICC (1, 1) model. The overall inter-
therapeutic alliance
rater reliability for TPOCS-A was excellent (ICC = 0.95, As shown in Table 1, several pre-treatment child character-
p < 0.001). Interrater reliability for individual items was all istics were associated with TPOCS-A ratings, both early and
within acceptable range (ICC ranging from 0.76 to 0.96). late in treatment. Child age and autism symptom severity
(SCQ and SRS) were not related to any early or late alliance
measure. Child IQ was associated with late task-collabora-
Analysis plan tion, but no other indicator of alliance. Early and late bond
All analyses were conducted using IBM SPSS Statistics were both positively associated with child report of emo-
version 24. Spearman-rho correlations were calculated to tional inhibition (CEMS-Inhibition). Early task-collabora-
test the hypothesis that pre-treatment characteristics tion was positively related to child-reported coping
would be associated with subsequent measures of early (CEMS-Coping) and negatively associated with child report
and late bond and task-collaboration at the bivariate of emotional dysregulation (CEMS-Dysregulation). Late
level. Multiple regressions were then calculated to deter- task-collaboration was positively associated with child
mine if pre-treatment child characteristics that were sig- report of inhibition (CEMS-Inhibition) and negatively
nificant at the bivariate level predicted therapeutic related to child report of emotional dysregulation (CEMS-
alliance. If predictor variables were largely correlated Dysregulation), parent report of child emotional lability
with each other (i.e. r > 0.50), only the variable with the (ERC Lability/Negativity), child externalizing symptoms
strongest association with bond and task-collaboration (BASC-2 Externalizing), child behavioural symptoms
was included in the model to maintain power to detect (BASC-2 BSI) and clinician rated overall severity of psy-
moderate to large effects. chopathology (ADIS-P Overall Severity).
A series of hierarchical regression analyses were con- Multiple regression analyses were not calculated for
ducted to test the hypothesis that early and late alliance early or late bond, as only a single bivariate correlate
would predict treatment outcomes. The first step con- emerged as significant. Results of multiple regressions
trolled for time in treatment, child IQ and baseline levels revealed that child pre-treatment characteristics did not
of an outcome measure (McLeod & Weisz, 2005). The account for a significant portion of the variance in early
216 Autism 24(1)

Table 1.  Spearman-rho correlations between pre-treatment child characteristics and TPOCS-A ratings (N = 48).

Characteristic Early TPOCS-A Late TPOCS-A

Bond Task-collaboration Bond Task-collaboration


Age −0.15 0.16 −0.04 0.04
FSIQ-2a 0.20 0.07 0.29† 0.34*
SRS-2 0.03 0.03 0.05 −0.25†
SCQ 0.22 0.14 0.13 0.19
Readiness to participatea 0.17 0.25† 0.02 −0.05
CEMSb
 Inhibition 0.30* 0.27† 0.36* 0.30*
 Dysregulation −0.24 −0.38* −0.27† −0.32*
 Coping 0.09 0.36* 0.24 0.28†
ERC
 Lability/negativity −0.16 −0.27† −0.07 −0.39**
  Emotion regulation 0.11 0.17 −0.02 0.14
BASC-2
  Externalizing problems −0.12 −0.22 −0.14 −0.37**
  Internalizing problems 0.04 −0.09 0.05 −0.26†
 BSI −0.06 −0.11 −0.02 −0.36*
ADIS-P overall severity −0.17 −0.14 −0.04 −0.30*

TPOCS-A = Therapist Process Observational Coding System–Alliance Scale; FSIQ-2 = Full-Scale IQ–2 Subscales; SRS-2 = Social Responsiveness
Scale–Second Edition, Total T Score; SCQ = Social Communication Questionnaire; CEMS = Children’s Emotion Management Scale; ERC =
Emotion Regulation Checklist; BASC-2 = Behavioural Assessment System for Children–Second Edition; BSI = Behavioural Symptoms Index; ADIS-P
= Anxiety Disorder Interview Schedule–Parent Version.
an = 47.
bn = 45.
†p < 0.10; *p < 0.05; **p < 0.01.

task-collaboration and no unique predictors emerged. Discussion


Child pre-treatment characteristics accounted for a moder-
ate portion of the variance in late task-collaboration, This study examined the role of therapeutic alliance in
R2 = 0.40, F(7, 34) = 3.20, p = 0.01; however, there were no CBT for children with autism by evaluating the contribu-
significant unique predictors. tion of pre-treatment child characteristics to the quality of
alliance and the contribution of alliance to change in emo-
tion regulation following treatment. This was among the
Therapeutic alliance and primary treatment first study to explore predictors of alliance and consider
outcome how it relates to treatment outcome in therapy for children
A series of hierarchical linear regressions were conducted with autism. It is also the first to use a behavioural obser-
to determine if alliance variables predicted treatment out- vation method that assesses alliance at multiple points in
comes. Early bond and task-collaboration were not predic- treatment.
tive of treatment change for any outcome variables
(Supplemental Table 1). In contrast, significant patterns Pre-treatment child characteristics and
emerged when measures of late alliance were included as
predictors, as shown in Table 2. Specifically, late ratings of
therapeutic alliance
alliance accounted for a significant portion of variance in Consistent with the initial hypothesis, emotion regulation
treatment change in parent reports of child emotional labil- was significantly related to the quality of therapeutic alli-
ity (ERC Lability/Negativity), ΔR2 = 0.07, p = 0.02, with ance at different points of treatment. In particular, child
late task-collaboration emerging as a unique predictor self-reported tendencies to inhibit emotional responses
(β = –0.36, p = 0.02). Late task-collaboration emerged as a were associated with a stronger therapeutic bond and bet-
unique predictor of improvements in child report of emo- ter task-collaboration both early and late in treatment. In
tional dysregulation (CEMS-Dysregulation), β = –0.45, the context of therapy with children with autism, emo-
p = 0.04, even though late alliance as a whole was not a tional inhibition may benefit the therapeutic process, in
significant predictor (ΔR2 = 0.12, p = 0.07). Late alliance contrast to the negative effects that suppressing one’s
ratings were not predictive of change in CEMS-Inhibition emotions may have in day-to-day life (Aldao, Nolen-
or Coping and ERC Emotion Regulation (all ps > 0.05). Hoeksema, & Schweizer, 2010). In comparison
Albaum et al. 217

Table 2.  Linear regression results for late therapeutic alliance ability and the presentation of emotional dysregulation
predicting treatment outcome. are pertinent to consider when working to establish thera-
Variable B SE B β peutic rapport with children in treatment, especially since
emotion regulation is a common challenge for children
CEMS-inhibitiona with autism (Mazefsky & White, 2014).
  Baseline score 0.78 0.17 0.66** Parent reports of child externalizing problems, and cli-
  Days in treatment <0.01 <0.01 0.06 nician judgements of overall psychopathology, were asso-
 FSIQ-2 <–0.01 0.01 −0.07 ciated with poorer task-collaboration in later sessions, but
  TPOCS-A bond 0.03 0.19 0.02 not to early therapeutic alliance or to late-session ratings of
  TPOCS-A task −0.15 0.13 −0.20
therapeutic bond. In the only other study of pre-treatment
CEMS-dysregulationa
characteristics and alliance for children with autism,
  Baseline score 0.15 0.12 0.19
demographic factors and pre-treatment clinical levels of
  Days in treatment <–0.01 <0.01 −0.05
internalizing and externalizing symptoms were not related
 FSIQ-2 0.01 <0.01 0.27†
  TPOCS-A bond 0.05 0.13 −0.08
to post-treatment retrospective ratings of alliance, as
  TPOCS-A task −0.19 0.09 −0.45* reported by child, parent or therapist (Kerns et al., 2018).
CEMS-copinga Beyond autism, associations of child factors and alliance
  Baseline score 0.42 0.12 0.48** are known to occur as a result of differences in source of
  Days in treatment <0.01 <0.01 0.17 reporting (e.g. child report vs therapist report vs independ-
 FSIQ-2 <–0.01 <0.01 <0.01 ent observer) and the timing of reporting (e.g. at early or
  TPOCS-A bond −0.07 0.13 −0.09 late sessions, or retrospectively following treatment com-
  TPOCS-A task 0.17 0.09 0.34† pletion; McLeod, 2011; McLeod et al., 2017), and thus
ERC lability/negativitya may contribute to why our findings differed.
  Baseline score 0.72 0.11 0.68** Contrary to expectations, child readiness to participate
  Days in treatment <0.01 <0.01 −0.01 in therapy was not significantly related to the quality of
 FSIQ-2 0.01 <0.01 0.16 therapeutic alliance, though there was a trending associa-
  TPOCS-A bond 0.10 0.12 0.11 tion with early task-collaboration. Although children var-
  TPOCS-A task −0.22 0.09 −0.36* ied in their degree of readiness to participate, treatment
ERC emotion regulationa was sought by the child’s primary caregiver, and in this
  Baseline score 0.57 0.08 0.75** context, children may fail to recognize personal emotional
  Days in treatment <0.01 <0.01 0.03 and behavioural challenges (Shirk & Russell, 1998, as
 FSIQ-2 <0.01 <0.01 0.02 cited in Shirk & Karver, 2003). From a process and devel-
  TPOCS-A bond −0.05 0.10 −0.07 opmental perspective, this lack of insight may serve as a
  TPOCS-A task 0.10 0.07 0.20
unique challenge when trying to establish alliance with
CEM = Children’s Emotion Management Scale; FSIQ-2 = Full-Scale younger clients (Shirk & Karver, 2003). An additional
IQ–2 Subscales; TPOCS-A = Therapist Process Observational Coding unexpected finding was that in this sample of children
System–Alliance Scale; ERC = Emotion Regulation Checklist. with at least average estimated intellectual functioning,
aOutcome variable.
†p < 0.10; *p < 0.05; **p < 0.01. IQ was related to late task-collaboration and had a trend-
ing association with bond. Given the heterogeneity in
intellectual functioning for children with autism, future
to common overt emotional dysregulation that require research should continue to examine the role of cognitive
significant management of behaviours from parents and functioning and variable profiles within the context of
individuals working with children with autism (Mazefsky, CBT, as this treatment orientation is so focused on active
2011), children who are better able to inhibit highly emo- task-collaboration.
tional displays may allow for therapists to more easily Although not a focus of this study, exploratory analy-
establish rapport. It is also likely that those children who ses indicated no significant association between autism
are more emotionally inhibited are less likely to demon- symptom severity and observer-rated therapeutic bond or
strate negative behaviours and affect that would impede task-collaboration. To our knowledge, only one study to
on the quality of the bond as operationalized on the date has compared therapeutic alliance in children with
TPOCS-A bond subscale. Several other pre-treatment and without autism. Klebanoff (2015) found that in CBT
indicators of emotion regulation were associated with targeting anxiety in children, therapist ratings of alliance
better task-collaboration at early and late sessions. This were significantly lower for children with autism aged
included child report of greater coping skills and less 10–11  years, compared with those without autism.
emotional dysregulation and parent report of greater However, there was no significant difference between rat-
child emotion regulation. These findings suggest that ings for children below 10 years of age. This age by group
both parent and child reports of emotional regulation finding certainly warrants further study of potentially
218 Autism 24(1)

autism-specific dynamics, and the TPOCS may be a use- included participants who completed treatment, and for
ful tool given its application in both clients with and with- whom post-treatment data were available. Premature ter-
out autism. mination is recognized as an important methodological
Child pre-treatment characteristics did not predict issue for intervention research because it limits generaliz-
either aspect of the therapeutic alliance early in treatment, ability of results, introduces sampling bias and, depending
or the therapeutic bond later in treatment, when entered on sample size available, reduces statistical power (Nock
into regressions. Furthermore, only a moderate portion of & Ferriter, 2005). In addition, the sample included was
variance of late task-collaboration was accounted for by predominately male, limiting how results generalize to
the pre-treatment characteristic regression model, with no females with autism. Although previous research has not
significant unique predictors. This lack of significant demonstrated a gender-effect in the association between
regression results may be a result of the low power to alliance-outcome (Kerns et al., 2018; McLeod, 2011),
account for small to moderate effects in models where the future studies should aim to include a larger proportion of
predictor variables, though not at the level of multicollin- females to determine if this finding holds within the autism
earity, continue to show correlations with each other. population. Coders could also not be completely blind to
session number. Although session order was randomized
to reduce coding bias, the session content is manualized
Therapeutic alliance and primary treatment
for each session and the client or therapist may also have
outcome mentioned the session number in video recordings, making
The initial hypothesis around therapeutic alliance and it difficult for coders to be blind to the session. Notably,
treatment outcome was partially supported, in that only a this study only assessed therapeutic alliance using inde-
particular aspect of late alliance was associated with pendent observer ratings. Given that alliance-outcome
child change in therapy. More specifically, late task-col- associations tend to vary as a result of informant source,
laboration was predictive of improvements in child emo- future research should consider assessing the convergence
tion dysregulation. Although this study was the first to and predictive validity of multi-informant ratings in ther-
examine alliance as it relates to emotion regulation as a apy for children with autism. Finally, this study was part of
treatment outcome, these findings align with those from a larger efficacy trial that in part looked to evaluate thera-
studies involving children without autism, where alli- pist fidelity to a manualized protocol, potentially affecting
ance-outcome effect sizes tend to be greater when con- the generalizability of findings to the real-world context.
sidering changes in externalized symptom presentation,
compared with internalized presentations (McLeod,
2011). Whereas emotion regulation involves internalized
Conclusion
processes (Mazefsky et al., 2013), the current results Therapeutic alliance is an important process factor to con-
reflect changes in emotion dysregulation; the child’s neg- sider when providing therapy to children with autism.
ative externalized behavioural response. The measures of Although this study could not determine whether the qual-
emotion regulation that were not significantly predicted ity of alliance differs from children without autism, it
by alliance (e.g. ERC Emotion Regulation subscale) appears that this relationship can still develop and is rel-
focused more on the internalized aspects of emotion reg- evant to the benefit some children with autism experience
ulation. Considerable literature also favours late meas- from participating in CBT. Child pre-treatment character-
ures of alliance versus early ones in being related to istics, particularly intellectual functioning, emotion dys-
treatment outcome in therapy for children (Karver, regulation and overall symptom severity, may influence
Handelsman, Fields, & Bickman, 2006; McLeod, 2011; aspects of alliance, most notably, the in-session task-col-
Shirk & Karver, 2011). Although ratings of later alliance laboration between therapist and child. Task-collaboration
may be biased by symptom improvement when the was found to be a stronger predictor of treatment outcome
reporter has been actively involved or invested in the and appears to be more heavily influenced by child char-
treatment process (McLeod & Weisz, 2005; Shirk & acteristics prior to treatment than was the therapeutic
Karver, 2011), this study used independent observational bond. Since task-collaboration in later sessions was iden-
coding, which may have helped to reduce the perception tified as an important predictor of treatment change,
of treatment progress as a confound. addressing challenges related to engagement throughout
the treatment process and applying therapeutic skills that
foster a collaborative relationship may be important
Limitations aspects of therapy provision when working with children
There are several limitations with this study that should be with autism. This active collaboration between therapist
considered. First, results should be interpreted with the and child during session activities fits into the broader
consideration that no alpha-level adjustments were made process-related factor of treatment adherence or engage-
to correct for multiple comparisons. The sample only ment, which is known to be crucial for making treatment
Albaum et al. 219

gains (Meichenbaum & Turk, 1987). Clinicians working Christensen, M., & Skogstad, R. S. (2009). What predicts qual-
with children with autism would benefit from skills train- ity of the therapeutic alliance in a cognitive behavioural
ing that specifically focuses on promoting and supporting treatment for children with anxiety disorders? Therapeutic
child engagement and collaboration in therapy. alliance measured from the patient, therapist and observer
perspective (Master’s thesis). The University of Bergen,
Bergen, Norway.
Acknowledgements
Chu, B. C., Skriner, L. C., & Zandberg, L. J. (2014). Trajectory
The authors wish to thank the many families, graduate students and predictors of alliance in cognitive behavioral therapy
and research assistants who participated in this research. for youth anxiety. Journal of Clinical Child & Adolescent
Psychology, 43, 721–734.
Funding Constantino, J. N. (2012). Social Responsiveness Scale™ (SRS™-
The author(s) disclosed receipt of the following financial support 2) (2nd ed.). Los Angeles, CA: Western Psychological
for the research, authorship, and/or publication of this article: Services.
This study was supported by the Chair in Autism Spectrum Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009).
Disorders Treatment and Care Research, the Canadian Institutes Statistical power analyses using G*Power 3.1: Tests for
of Health Research in partnership with Autism Speaks Canada, correlation and regression analyses. Behaviour Research
the Canadian Autism Spectrum Disorders Alliance, Health Methods, 41, 1149–1160.
Canada, Kids Brain Health Network (formerly NeuroDevNet) Feise, R. J. (2002). Do multiple outcome measures require
and the Sinneave Family Foundation. p-value adjustment? BMC Medical Research Methodology,
2, 8.
Grondhuis, S. N., & Aman, M. G. (2012). Assessment of anxiety
Supplemental material
in children and adolescents with autism spectrum disorders.
Supplemental material for this article is available online. Research in Autism Spectrum Disorders, 6, 1345–1365.
Horvath, A. O., & Symonds, B. D. (1991). Relation between
ORCID iDs working alliance and outcome in psychotherapy: A meta-
Carly Albaum https://orcid.org/0000-0002-0011-8813 analysis. Journal of Counseling Psychology, 38, 139–149.
Houlding, K. (2014). Exploring the therapeutic alliance in cog-
Jonathan A Weiss https://orcid.org/0000-0002-5849-7334 nitive-behavior therapy with children with autism spectrum
disorder: An interpretative phenomenological approach
References (Master’s thesis). Retrieved from https://dr.library.brocku
Accurso, E. C., & Garland, A. F. (2015). Child, caregiver, and ther- .ca/handle/10464/5384
apist perspectives on therapeutic alliance in usual care child Karver, M. S., Handelsman, J. B., Fields, S., & Bickman, L.
psychotherapy. Psychological Assessment, 27, 347–352. (2005). A theoretical model of common process factors in
Aldao, A., Nolen-Hoeksema, S., & Schweizer, S. (2010). Emotion- youth and family therapy. Mental Health Services Research,
regulation strategies across psychopathology: A meta-ana- 7, 35–51.
lytic review. Clinical Psychology Review, 30, 217–237. Karver, M. S., Handelsman, J. B., Fields, S., & Bickman, L.
American Psychiatric Association. (1994). Diagnostic and statis- (2006). Meta-analysis of therapeutic relationship variables
tic manual of mental disorders (4th ed.). Washington, DC: in youth and family therapy: The evidence for different
American Psychiatric Publishing. relationship variables in the child and adolescent treatment
Beaumont, R. (2013). Secret Agent Society – Operation outcome literature. Clinical Psychology Review, 26, 50–65.
Regulation (SAS-OR) manual. Brisbane, Queensland, Kazdin, A. E., Marciano, P. L., & Whitley, M. K. (2005). The
Australia: Social Skills Training. therapeutic alliance in cognitive-behavioral treatment of
Bordin, E. S. (1979). The generalizability of the psychoanalytic children referred for oppositional, aggressive, and antisocial
concept of the working alliance. Psychotherapy: Theory, behavior. Journal of Consulting and Clinical Psychology,
Research and Practice, 16, 252–260. 73, 726–730.
Bordin, E. S. (1994). Theory and research on the therapeutic Kerns, C. M., Collier, A., Lewin, A. B., & Storch, E. A. (2018).
working alliance: New directions. In A. O. Horvath & L. S. Therapeutic alliance in youth with autism spectrum disor-
Greenberg (Eds.), The working alliance: Theory, research, der receiving cognitive-behavioral treatment for anxiety.
and practice (pp. 13–37). New York, NY: John Wiley & Sons. Autism, 22, 636–640.
Brown, R., Iqbal, Z., Reynolds, L., Press, D. A., Shaker-Naeeni, Klebanoff, S. (2015). The therapeutic alliance in cognitive-
H., Scrivener, L., . . . Murphy, S. (2015). Inter-rater reli- behavioral therapy for children with autism and anxi-
ability of treatment fidelity and therapeutic alliance meas- ety (Unpublished Master’s thesis). Retrieved from https://
ures for psychological therapies for anxiety in young people escholarship.org/uc/item/9v57p5jn
with autism spectrum disorders. International Journal of Lerner, M. D., White, S. W., & McPartland, J. C. (2012).
Developmental Disabilities, 61, 190–199. Mechanisms of change in psychosocial interventions
Chiu, A. W., McLeod, B. D., Har, K., & Wood, J. J. (2009). for autism spectrum disorders. Dialogues in Clinical
Child-therapist alliance and clinical outcomes in cognitive Neuroscience, 14, 307.
behavioral therapy for child anxiety disorders. Journal of Levin, L., Henderson, H. A., & Ehrenreich-May, J. (2012).
Child Psychology and Psychiatry, 50, 751–758. Interpersonal predictors of early therapeutic alliance in a
220 Autism 24(1)

transdiagnostic cognitive-behavioral treatment for adoles- Rutter, M., & Bailey, A. (2003). Social Communication
cents with anxiety and depression. Psychotherapy, 49, 218. Questionnaire (SCQ). Los Angeles, CA: Western
Liber, J. M., McLeod, B. D., Van Widenfelt, B. M., Goedhart, A. Psychological Services.
W., van der Leeden, A. J., Utens, E. M., & Treffers, P. D. Shields, A., & Cicchetti, D. (1997). Emotion regulation among
(2010). Examining the relation between the therapeutic alli- school-age children: The development and validation of a
ance, treatment adherence, and outcome of cognitive behav- new criterion Q-sort scale. Developmental Psychology, 33,
ioral therapy for children with anxiety disorders. Behavior 906–916.
Therapy, 41, 172–186. Shields, A., & Cicchetti, D. (1998). Reactive aggression among
Lord, C., Rutter, M., Dilavore, P. C., Risi, S., Gotham, K., & maltreated children: The contributions of attention and emo-
Bishop, S. L. (2012). Autism Diagnostic Observation tion dysregulation. Journal of Clinical Child Psychology,
Schedule® (ADOS®-2) (2nd ed.). Los Angeles, CA: Western 27, 381–395.
Psychological Services. Shirk, S. E., & Karver, M. (2011). Alliance in child and adolescent
Mazefsky, C. A. (2011). Managing problem emotions and psychotherapy. In J. C. Norcross (Ed.), Psychotherapy rela-
behaviors in children with ASD: An assessment-driven tionships that work: Evidenced-based responsiveness, 2nd
three-step approach. Perspectives Language Learning Edition (pp. 70–91). Oxford, UK: Oxford University Press.
Education, 19, 38–47. Shirk, S. R., & Karver, M. (2003). Prediction of treatment out-
Mazefsky, C. A., Herrington, J., Siegel, M., Scarpa, A., Maddox, come from relationship variables in child and adolescent
B. B., Scahill, L., & White, S. W. (2013). The role of emo- therapy: A meta-analytic review. Journal of Consulting and
tion regulation in autism spectrum disorder. Journal of the Clinical Psychology, 71(3), 452–464.
American Academy of Child & Adolescent Psychiatry, 52, Shirk, S. R., & Russell, R. L. (1998). Process issues in child
679–688. psychotherapy. In A. Bellack & M. Hersen (Eds.),
Mazefsky, C. A., & White, S. W. (2014). Emotion regulation: Comprehensive clinical psychology (Vol. 5, pp. 57–82). (T.
Concepts & practice in autism spectrum disorder. Child and Ollendick Children and adolescents Clinical formulation
Adolescent Psychiatric Clinics of North America, 23, 15–24. and treatment). Oxford, UK: Pergamon.
McLeod, B. D. (2011). Relation of the alliance with outcomes in Silverman, W. K., & Albano, A. M. (2004). Anxiety Disorders
youth psychotherapy: A meta-analysis. Clinical Psychology Interview Schedule for DSM-IV – Parent interview sched-
Review, 31, 603–616. ule. Oxford, UK: Oxford University Press.
McLeod, B. D., Southam-Gerow, M. A., & Kendall, P. C. (2017). Sung, M., Ooi, Y. P., Goh, T. J., Pathy, P., Fung, D. S., Ang, R.
Observer, youth, and therapist perspectives on the alli- P., . . .Lam, C. M. (2011). Effects of cognitive-behavioral
ance in cognitive behavioral treatment for youth anxiety. therapy on anxiety in children with autism spectrum dis-
Psychological Assessment, 29, 1550–1555. orders: A randomized controlled trial. Child Psychiatry &
McLeod, B. D., & Weisz, J. R. (2005). The Therapy Process Human Development, 42, 634–649.
Observational Coding System – Alliance Scale: Measuring Vasa, R. A., Carroll, L. M., Nozzolillo, A. A., Mahajan, R.,
characteristics and prediction of outcome in usual clinical Mazurek, M. O., Bennett, A. E., . . . Bernal, M. P. (2014).
practice. Journal of Consulting and Clinical Psychology, A systematic review of treatments for anxiety in youth
73, 323–333. with autism spectrum disorders. Journal of Autism and
Meichenbaum, D., & Turk, D. C. (1987). Facilitating treatment Developmental Disorders, 44, 3215–3229.
adherence: A practitioner’s guidebook. Berlin, Germany: Volker, M. A., Lopata, C., Smerbeck, A. M., Knoll, V. A.,
Plenum Press. Thomeer, M. L., Toomey, J. A., & Rodgers, J. D. (2010).
Murphy, R., & Hutton, P. (2018). Practitioner review: Therapist BASC-2 PRS profiles for students with high-function-
variability, patient-reported therapeutic alliance, and clinical ing autism spectrum disorders. Journal of Autism and
outcomes in adolescents undergoing mental health treatment Developmental Disorders, 40, 188–199.
– A systematic review and meta-analysis. Journal of Child Walters, S., Loades, M., & Russell, A. (2016). A systematic
Psychology and Psychiatry, 59, 5–19. review of effective modifications to cognitive behavioural
Murphy, S. M., Chowdhury, U., White, S. W., Reynolds, L., therapy for young people with autism spectrum disorders.
Donald, L., Gahan, H., & Press, D. A. (2017). Cognitive Review Journal of Autism and Developmental Disorders, 3,
behaviour therapy versus a counselling intervention for anx- 137–153.
iety in young people with high-functioning autism spectrum Wechsler, D. (2011). Wechsler Abbreviated Scale of Intelligence
disorders: A pilot randomised controlled trial. Journal of (WASI-II) (2nd ed.). San Antonio, TX: NCS Pearson.
Autism and Developmental Disorders, 47, 3446–3457. Weiss, J. A., Thomson, K., Burnham Riosa, P., Albaum, C., Chan,
Nock, M. K., & Ferriter, C. (2005). Parent management of V., Maughan, A., . . . Black, K. (2018). A randomized wait-
attendance and adherence in child and adolescent therapy: A list-controlled trial of cognitive behavior therapy to improve
conceptual and empirical review. Clinical Child and Family emotion regulation in children with autism. Journal of Child
Psychology Review, 8, 149–166. Psychology and Psychiatry, 59, 1180–1191.
Owens, K. A., Haddock, G., & Berry, K. (2013). The role of the Weston, L., Hodgekins, J., & Langdon, P. E. (2016). Effectiveness
therapeutic alliance in the regulation of emotion in psy- of cognitive behavioural therapy with people who have
chosis: An attachment perspective. Clinical Psychology & autistic spectrum disorders: A systematic review and meta-
Psychotherapy, 20, 523–530. analysis. Clinical Psychology Review, 49, 41–54.
Reynolds, C. R., & Kamphaus, R. W. (2004). Behavioral Zeman, J. L., Cassano, M., Suveg, C., & Shipman, K. (2010).
Assessment System for Children (BASC-2) (2nd ed.). San Initial Validation of the Children’s Worry Management
Antonio, TX: NCS Pearson. Scale. Journal of Child and Family Studies, 19, 381–392.

You might also like