You are on page 1of 17

Available online at www.sciencedirect.

com

ScienceDirect
Behavior Therapy 54 (2023) 444–460

www.elsevier.com/locate/bt

Clinical Change Mechanisms in the Treatment of College Students


With ADHD: Trajectories and Associations With Outcomes
Joshua M. Langberg
Rutgers University
Melissa R. Dvorsky
Children’s National Hospital–George Washington University School of Medicine

Paul Silvia
Jeff Labban
Arthur D. Anastopoulos
University of North Carolina Greensboro

nificant gains in the use of behavioral strategies and trajec-


The purpose of this study was to evaluate trajectories of tories were associated with large effect size improvements
response for the three theorized mechanisms of clinical in measures of symptoms and functioning. Participants also
change (knowledge, behavioral strategies, and adaptive made improvements in ADHD knowledge. However, only
thinking) associated with the Accessing Campus Connec- the knowledge trajectory with rapid improvement dis-
tions and Empowering Student Success (ACCESS) interven- played significantly better outcomes. Only one trajectory
tion for college students with attention-deficit/ group showed improvement in adaptive thinking with most
hyperactivity disorder (ADHD) and their association with ACCESS participants remaining stable across time. How-
treatment outcomes. Participants included 250 college stu- ever, adaptive thinking trajectories were strongly related
dents comprehensively diagnosed with ADHD randomly to both symptom and functional outcomes. ACCESS is
assigned to ACCESS or to a delayed-treatment control associated with large gains in two of the three theorized
who completed ratings at baseline, end of active treatment, clinical mechanisms of change, behavioral strategies and
and end of the maintenance phase of treatment (after two ADHD knowledge. Rapid improvement in behavioral
semesters). Growth mixture models (GMMs) were used strategies was associated with robust improvement in
to evaluate trajectories. Participants in ACCESS made sig- symptoms and functioning. Although improvements in
the third mechanism, adaptive thinking, were small, they
were strongly associated with outcomes demonstrating
Conflict of Interest Statement: For co-authors Dvorsky, Green, the importance of a cognitive-behavioral approach in treat-
Silvia and Labban, there are no conflicts. Drs. Langberg and ing college students with ADHD.
Anastopoulos published the ACCESS treatment manual as part of
the intervention dissemination process. The manual was published
by Springer, entitled CBT for College Students with ADHD: A
Clinical Guide to ACCESS. As such, we receive royalties associated Keywords: ADHD; college; mechanisms; intervention; treatment
with book purchases. The research reported here was supported by outcome
the Institute of Education Sciences, U.S. Department of Education,
through grant R305A150207 awarded to the University of North
THE TRANSITION from high school to college poses
Carolina Greensboro. The opinions expressed are those of the
authors and do not represent views of the Institute or the U.S. many unique developmental challenges. Emerging
Department of Education. adults attending college are faced with signifi-
Address correspondence to Joshua M. Langberg, Ph.D., Rutgers cantly increased academic, interpersonal, and
University, 152 Frelinghuysen Road, Piscataway, NJ 08854. financial management responsibilities (Arnett,
e-mail: jl3079@gsapp.rutgers.edu.
2007, 2013; Larose et al., 2019). At the same time,
0005-7894/Ó 2023 Association for Behavioral and Cognitive Therapies. the monitoring and structure provided by adults
target for psychological Published by Elsevier Ltd.
mechanisms of treatment response to access 445
during childhood is largely removed, and college effects. Mechanistic information will form the
students are expected to autonomously self- foundation for the next phase of intervention
manage academic and extracurricular activities development.
(Lowe & Dotterer, 2018). The transition is partic- In 2014, the National Institutes of Mental Health
ularly challenging for emerging adults with (NIMH) redefined clinical trials, placing a strong
attention-deficit/hyperactivity disorder (ADHD) emphasis on experimental therapeutics, or mecha-
who exhibit deficits in planning and organization nistic research. NIMH clarified that a successful
behaviors, struggle with academic motivation, treatment outcome study should “evaluate not only
and experience difficulties with impulsivity and the clinical effect of the intervention, but also gener-
self-regulation of behavior (Canu et al., 2021; ate information about the mechanisms underlying a
Fleming & McMahon, 2012). In comparison to disorder or an intervention response” (Insel &
their peers, college students with ADHD have Gogtay, 2014). This shift occurred in part because
lower grades and are less likely to graduate, expe- receiving something (i.e., some service or interven-
rience high rates of internalizing problems such as tion) is often better than receiving nothing, and
anxiety and depression, and are more likely to for the field to advance, it is important to under-
engage in high-risk behaviors such as binge drink- stand whether theorized active ingredients are hav-
ing (Anastopoulos et al., 2018; Baker et al., 2012; ing the intended effect. Psychosocial treatments are
DuPaul et al., 2021). frequently multifaceted. Treatment effects may be
In the past 5 years, the field has witnessed a driven by a small portion of the intervention com-
rapid increase in the development and evaluation ponents or may simply be the result of increased
of psychosocial interventions for college students attention or a therapeutic relationship (Karver
with ADHD. The college setting presents many et al., 2018). This is precisely where we find our-
challenges for ADHD intervention development selves with interventions for college students with
given that it is not feasible to scale-up most child- ADHD. It is clear that providing something is better
hood ADHD interventions for the college context. than nothing (e.g., waitlist control), but there is lim-
Specifically, most childhood ADHD interventions ited information on why this is the case and which
are behavioral in nature and enlist parents and clinical change mechanisms are driving effects. It
teachers to provide structure and skills implemen- is important to understand whether unique mecha-
tation monitoring (Fabiano et al., 2021; Van der nisms (e.g., cognitive v. behavioral) are linked with
Oord & Tripp, 2020). However, parents have lim- specific outcomes (e.g., academic functioning v.
ited knowledge of, or involvement with, their chil- depression) so that the field can begin to develop
dren’s day-to-day college activities and classes are modular and personalized approaches to care.
often too large for professors to provide substan- The college ADHD intervention with the most
tial support (LaCount et al., 2019; Vasko et al., robust research evidence is Accessing Campus
2020). In addition, comorbid symptoms of anxiety Connections and Empowering Student Success
and depression significantly increase during late (ACCESS). ACCESS is a cognitive-behavioral
adolescence, and prevalence rates for internalizing treatment with a published protocol that has been
disorders approach 50% in college students with evaluated through an open trial and a large multi-
ADHD (Anastopoulos et al., 2018). This suggests site randomized trial with participants followed
that traditional childhood behavioral therapeutic over 1 year (Anastopoulos et al., 2021). ACCESS
approaches alone may not be sufficient. Finally, consists of eight 90-minute group sessions com-
receiving services on a college campus requires bined with brief weekly individualized mentoring
that the individual, rather than a caregiver, have sessions. A randomized controlled trial (N = 250)
knowledge about ADHD and treatment options showed that relative to a waitlist control, partici-
and be willing to seek and self-advocate for ser- pants in ACCESS made significant and reliable
vices (Pfeifer et al., 2021). Given this unique con- improvements in executive functioning (EF) and
text, ADHD interventions developed to date for ADHD symptoms and multiple aspects of func-
college settings have varied widely in the therapeu- tioning (e.g., academic skills and overall well-
tic approach utilized, ranging from behavioral being; Anastopoulos et al., 2021; Eddy et al.,
skills-based approaches to cognitive treatments, 2021). Importantly, the sample was relatively
to a joint cognitive-behavioral treatment (Gu diverse and had high rates of comorbid conditions,
et al., 2018; LaCount et al., 2018; Solanto & increasing the likelihood that the findings will
Anouk, 2021; Van der Oord et al., 2020). Many generalize.
of these interventions have demonstrated promis- The structure of the ACCESS intervention is
ing effects. However, almost nothing is known ideal for mechanistic research as the three core
about the therapeutic mechanisms driving these therapeutic ingredients are addressed with
446 langberg et al.
participants at each session. Specifically, each executive functions and impairment outcomes
ACCESS session has ADHD knowledge, behav- include overall well-being and academic skills
ioral/skills, and adaptive thinking skills (i.e., cog- use. Outcomes were assessed at baseline, end
nitive therapy) components. Briefly, for ADHD of active treatment (i.e., end of the first seme-
knowledge, participants learn about the core ster), and at the end of the maintenance phase
symptoms of ADHD and how they are evaluated, of treatment (i.e., at the end of the second seme-
the impact of ADHD on functioning, and ster). We hypothesized that ADHD knowledge
evidence-based treatment options and how to response would be associated with all outcomes,
access them on campus. The behavioral aspects whereas behavioral/skills mechanisms would pre-
of the intervention include teaching skills for plan- dict symptoms and skills outcomes and adaptive
ning ahead and organizing materials and study and thinking would only impact well-being.
time-management strategies. The cognitive ther-
apy strategies address identification and replace- Method
ment of maladaptive thinking patterns with
adaptive thinking, along with understanding and participants
coping with emotions. Findings from the RCT Participants were recruited at two large, public
show that participants in ACCESS made signifi- universities in urban areas of the southeastern Uni-
cant group-level improvements in these clinical ted States with large numbers of first-generation
change mechanisms relative to control. Reliable college students and diverse student bodies. Insti-
change analyses revealed that ACCESS partici- tutional Review Boards (IRB) at both institutions
pants had a more robust response on the measures reviewed and approved the study. All participants
of ADHD knowledge (43.6%) and behavioral were over the age of 18 and provided consent. See
strategies (31.2%), with only 11.6% of partici- “Study Procedures” section below for more details
pants showing a reliable clinical response on the on student recruitment. We report how we deter-
cognitive clinical mechanisms (Anastopoulos mined our sample size, all data exclusions, all
et al., 2021). However, all of these analyses were manipulations, and all measures in the study. A
at the group level and do not provide information target sample size of N = 250 was determined
about trajectories of response (e.g., rapid respon- using power analysis with the software package
der v. slow and steady) or whether the clinical nQueryÒ version 6 based upon preliminary open
change mechanisms are associated with outcomes. trial estimates. A total of 361 students completed
informed consent procedures and were screened
present study for eligibility. Eighty-one participants were
The purpose of the present study is to evaluate deemed ineligible for reasons related to not meet-
trajectories of improvement for the knowledge, ing diagnostic criteria for ADHD or having a con-
behavioral, and adaptive thinking cognitive com- current active psychiatric condition outside of the
ponents of ACCESS and whether these trajecto- scope of treatment. Thirty eligible participants
ries are differentially associated with outcomes. randomly assigned to the immediate ACCESS
A person-centered approach is utilized to provide intervention could not participate due to work
unique information about the pace of uptake for and classroom scheduling conflicts that precluded
the three core clinical change mechanisms as their involvement during the group portion of
well as the different levels of response. Specifi- the active treatment phase. Thus, the final sample
cally, growth mixture modeling is utilized to included 250 participants ranging in age from 18
provide information about longitudinal patterns to 30 years (M = 19.68; SD = 2.15). See
of individual response and intra-individual differ- Anastopoulos et al. (2021) for a CONSORT dia-
ences in response (Muthén et al., 2002). Trajec- gram showing participant flow through each of
tories of response with the clinical change the study timepoints. The majority of the sample
mechanisms are then evaluated relative to out- identified as female (N = 165; 66%) and repre-
comes, to determine whether various patterns sented a range of postsecondary education levels
of improvement are differentially associated with (i.e., 47.6% first-year students, 16.4% sopho-
gains on distal measures of symptoms and func- mores, 26.4% juniors, 9.6% seniors). Approxi-
tioning. Both symptom and functional impair- mately 6.8% of the participants identified as
ment outcomes are included given the potential Hispanic/Latino; 66.3% identified as Caucasian,
for therapeutic mechanisms to be linked with 14.2% as African American, 5.3% as Asian,
some outcome domains and not others. For 0.4% as Native American, 10.6% as multi-racial,
symptoms, the present study evaluates the and 3.3% as other (see Table 1 for additional
impact on ADHD inattentive symptoms and demographic information).
mechanisms of treatment response to access 447
Table 1
Pretreatment Demographic and Selected Clinical Characteristics by Group
Variable ACCESS (N = 119) DTC (N = 131) Total (N = 250)
M (SD) M (SD) M (SD)
Age 19.74 (2.24) 19.63 (2.07) 19.68 (2.15)
FSIQ 110.53 (10.72) 110.56 (12.34) 110.54 (11.57)
CAARS Total Score 34.43 (9.25) 34.73 (8.86) 34.59 (9.03)
(%) (%) (%)
Female 64.7% 67.2% 66%
Race
Caucasian 66.1% 66.4% 66.3%
Black/African American 11.9% 16.4% 14.2%
Asian 5.1% 5.5% 5.3%
More than one race 11.9% 9.4% 10.6%
Other/not reported 5.1% 2.4% 3.7%
Ethnicity/Hispanic 7.0% 6.6% 6.8%
First Year College Students 49.6% 45.8% 47.6%
Comorbidity Status 62.2% 58.0% 60%
Predominantly Inattentive Presentation 41.2% 42.0% 41.6%
Combined ADHD Presentation 58.8% 58.0% 58.4%
ADHD Medications 52.9% 41.9% 47.2%
Other Medications 26.1% 29.0% 27.6%
Note. DTC = Delayed Treatment Condition; no statistically significant group differences detected using chi-square for categorical variables
and t-tests for dimensional variables; CAARS Total Score = overall ADHD symptom severity; Comorbidity Status = presence of other
DSM-5 mental health disorders co-occurring with ADHD; CAARS Total Score is reported in raw score form. ADHD Medication Sta-
tus = reported use of medication to treat ADHD; Other Medication Status = reported use of a psychoactive medication to treat other mental
health conditions

A multi-method, multi-informant assessment presence of developmentally inappropriate symp-


was used to determine ADHD and comorbidity toms prior to age 12, and symptoms and impair-
status. An expert panel comprised of three licensed ment not better explained by another ongoing
clinical psychologists reviewed evaluation data psychiatric condition. In the final sample
and confirmed ADHD eligibility status through (N = 250), 58.4% met criteria for an ADHD Com-
required unanimous agreement. Participants went bined presentation and 41.6% for ADHD Predom-
through a comprehensive evaluation procedure to inantly Inattentive presentation. Furthermore,
assess for a diagnosis of ADHD as defined in the 60% of participants met DSM-5 criteria for at
Diagnostic and Statistical Manual of Mental least one co-occurring psychiatric diagnosis (i.e.,
Disorders–Fifth Edition (DSM-5; APA, 2013). 29.6% met criteria for a depressive disorder and
Participants were administered a semistructured 31.6% met criteria for an anxiety disorder). The
interview collecting information about ADHD final sample consisted of 119 immediate ACCESS
symptoms and impairment associated with symp- participants and 131 delayed treatment control
toms. Further, parent-report of childhood symp- (DTC) participants. DTC participants received
toms of ADHD (i.e., symptoms present prior to ACCESS after two semesters in the control group.
age 12) was collected by telephone interview. As shown in Table 1, the two groups were statisti-
Finally, evaluation procedures included a struc- cally equivalent at pre-treatment across numerous
tured interview assessing for the presence of other demographic and clinical variables.
psychiatric conditions; further, information about
onset and duration of psychiatric conditions was description of intervention
collected to inform differential diagnosis between ACCESS incorporates some elements of existing
ADHD and other conditions. Background infor- adult CBT programs (Safren et al., 2005;
mation (e.g., history of ADHD diagnosis, past aca- Solanto, 2011) adapted to the developmental
demic/social functioning) was also collected. needs of emerging adults with ADHD in college.
Participants were diagnosed with ADHD if the ACCESS is delivered across two consecutive seme-
panel determined they met DSM-5 criteria for sters, the first of which is an 8-week active phase,
ADHD as evidenced by 5 or more symptoms of followed by a low-intensity semester-long mainte-
inattention and/or hyperactivity/impulsivity, nance phase. Treatment is delivered in both a
impairment associated with symptoms, the group and individual mentoring format. During
448 langberg et al.
active treatment, participants received eight the ADHD Rating Scale-5. Students who endorsed
weekly 90-min CBT group sessions with no more 4 or more symptoms of either inattention or hyper-
than eight participants per group. The three activity/impulsivity on the phone screen were
hypothesized clinical change mechanisms—ADHD scheduled for the comprehensive evaluation.
knowledge, behavioral strategies, and adaptive Participants meeting eligibility criteria were
thinking skills—were addressed in each of these randomly assigned to receive ACCESS immedi-
active phase group sessions (see Figure 1). Concur- ately or after a 1-year delay (i.e., DTC group).
rent with the CBT group timeline, participants Random assignment was stratified by medication
received weekly 30-min individual mentoring ses- status to ensure equivalent numbers of participants
sions. The objectives of individual mentoring are taking ADHD medication in each group. Recruit-
to reinforce what the student learns in the CBT ment was ongoing, and ACCESS was delivered
group, to assist the student in setting personal to five successive cohorts of participants across
goals and monitoring progress, and to help the stu- consecutive semesters from the fall of 2015
dent make connections with campus resources. through the spring of 2018. Fall cohorts ran from
During the maintenance phase, participants early September through mid-November; spring
received a booster CBT group session and four to cohorts from early February into mid-April. While
six mentoring sessions. The treatment manual waiting to participate in ACCESS on a 1-year
has been published and is publicly available delayed basis, DTC participants were permitted
(Anastopoulos et al., 2020). In the current study, to receive treatment as usual.
83.2% of the immediate treatment group attended Graduate student research assistants and one
at least 6 group sessions, and 85.7% attended a licensed master’s-level professional counselor
majority of mentoring sessions. served as ACCESS group leaders and mentors.
All group leaders received extensive training to
Study Procedures prepare them to implement the treatment protocol
Students were recruited from multiple sources, with fidelity. Throughout the study, weekly super-
including various campus support units (e.g., dis- vision was provided by licensed doctoral-level clin-
ability services, student health services), first-year ical psychologists experienced in the treatment
summer orientation sessions, and campus fliers. protocol; in addition, a detailed treatment manual
E-mail advertisements announcing the study were was provided to group leaders and mentors. Treat-
sent to students currently registered with disability ment sessions were recorded, and 20% were ran-
services at each respective campus. Interested stu- domly selected and reviewed for fidelity. Overall
dents were phone screened by study staff using adherence to the content of treatment sessions

FIGURE 1 ACCESS Active Phase Weekly Content.


mechanisms of treatment response to access 449
was excellent, with fidelity ratings of 96.4 and improvements in emotional well-being and behav-
95.6% obtained for the group and mentoring ses- ioral functioning. The ACS-CV had satisfactory
sions, respectively. internal consistency (coefficient a = .77).

measures outcome measures


Participants completed measures at baseline (T1), The ADHD Impact Module-Adult (AIM-A;
end of the first semester (i.e., end of active treat- Health Act CHQ Inc, 2007)
ment; T2), and at the end of the second semester The AIM-A is a self-report measure designed to
(i.e., end of maintenance phase; T3). assess the effects of ADHD symptoms and associ-
ated impairments on a number of life domains.
clinical change mechanisms Scales include Living with ADHD, General Well-
Test of ADHD Knowledge (TOAK) Being, Performance and Daily Functioning, Rela-
The TOAK is a 40-item questionnaire that mea- tionships and Communication, Bothersomeness
sures general knowledge of ADHD. For each item, and Concern, and Daily Interference. Scores range
participants respond to statements about ADHD from 0 to 100 with higher scores representing
(e.g., “Hereditary factors play a major role in higher functioning. The AIM-A has demonstrated
determining if someone will develop ADHD”) good internal consistency (a’s > .80) and concur-
with “agree,” “disagree,” or “not sure.” Correctly rent and discriminant validity (Landgraf, 2007).
endorsed “agree” and “disagree” items are The Performance and Daily Functioning (a = .84)
summed to yield a total score, with higher scores and General Well-Being (a = .88) scales were uti-
indicating greater knowledge of ADHD. Findings lized in this study. The Performance and Daily
based on the current sample indicate that the Functioning scale (11 items) measures self-
TOAK possesses excellent internal consistency (co- perceptions of performance in managing daily
efficient a = .86) and demonstrates evidence of responsibilities and engaging in general problem-
convergent validity. solving and decision making. Participants rate
Strategies for Success (SFS) their adeptness at “handling everyday hassles,”
The SFS contains 18 self-report items that assess and “ability to adapt to disruptions or unexpected
use of behavioral strategies for managing not only changes in routine.” For the General Well-Being
academic work (e.g., using a planner) but also var- scale (10 items), respondents are rate frequency
ious personal responsibilities (e.g., keeping track of positive mood states, such as “accepting of
of keys/cell phone, organizing dorm room/apart- yourself” and “able to cope.”
ment, connecting with campus support services) Behavior Rating Inventory of Executive Function-
specifically targeted by the ACCESS intervention. Adult (BRIEF-A; Roth et al., 2005)
Respondents indicate how adeptly they use these The BRIEF-A is an 86-item self-report measure
strategies on a 5-point scale, with 1 indicating designed to assess an individual’s behavioral appli-
not well and 5 indicating very well. Items are cation of EF abilities and has shown good internal
summed to yield a total score, with higher scores consistency (coefficient a = .96). Responses gener-
indicating more frequent behavioral strategy use. ate three composite scale scores: the Behavioral
Findings from the current sample suggest that the Regulation Index (BRI), which evaluates an indi-
SFS possesses adequate internal consistency (coef- vidual’s ability to appropriately inhibit and control
ficient a = .84). behaviors and emotions and shift between tasks
ADHD Cognitions Scale–College Version (ACS- and environments; the Metacognition Index
CV) (MCI), which measures their ability to self-
The ACS-CV is a 12-item self-report questionnaire manage and monitor one’s own progress and per-
that assesses frequency of ADHD-related mal- formance; and the overall Global Executive Com-
adaptive thinking patterns (e.g., “My work is bet- posite (GEC), which served as the primary
ter if I wait until the last minute”). Each item is outcome in this study. Higher scores on this com-
rated on a 5-point scale, and ratings for all 12 posite scale indicates more difficulties with (EF).
items are summed to create a total ACS-CV score, Conners Adult ADHD Rating Scale, Long Version
with higher scores reflecting more frequent engage- (CAARS-S:L; Conners et al., 1999)
ment in maladaptive thinking patterns (Knouse The CAARS-S:L is a widely used, psychometrically
et al., 2019). Treatment-related decreases in sound (coefficient a from .73 to .84) measure of
ACS-CV scores indicate that targeted maladaptive ADHD in adults. The DSM–IV Inattentive (IN)
thinking patterns have been identified and replaced scores were used to assess treatment-related
with adaptive thinking patterns necessary for changes in ADHD symptoms in the current study.
450 langberg et al.
The Learning and Study Strategies Inventory– & Muthén, 2000), we used a combination of
Second Edition (LASSI-2; Weinstein et al., 2002) empirical criteria (i.e., [sample size adjusted] Baye-
The LASSI-2 is a self-report measure designed to sian Information Criterion [ssBIC], Akaike Infor-
assess the academic skills and strategies of college mation Criteria [AIC], Lo-Mendell-Rubin [LMR]
students, in addition to attitudes and beliefs asso- adjusted likelihood ratio test for K-1 classes, boot-
ciated with academic success. The LASSI-2 was strapped parametric likelihood ratio test [BLRT],
developed and normed using a large, nationally statistical significance of parameter estimates for
representative college student population. It intercepts and slopes,) and substantive criteria
includes 80 items rated on a 5-point Likert-style including classification probabilities greater than
scale to indicate the frequency of each behavior. .70 (i.e., how distinct each class is from the other
The present study included the Motivation classes). We also examined class sizes, considering
(a = .79), Time Management (a = .75), and Test classes with no less than 5% of the total sample
Strategies (a = .73) subscales. Higher scores on (Jung & Wickrama, 2008). Prior simulation stud-
Test Strategies and Time Management indicate ies support this sample size is sufficient for identi-
more frequent use of these skills. Higher scores fying K = 1 to 4 classes (Lubke & Muthén, 2007;
on the Motivation scale indicate willingness to Ram & Grimm, 2009). Once the best-fitting
complete academic goals (Weinstein et al., 2002). model was determined, models were examined to
determine if trajectories had significant slopes
analytic approach (i.e., indicating either improvement or worsening;
Growth mixture models (GMMs) were computed nonsignificant slopes indicated stable functioning).
in Mplus, Version 8.8 (Muthén & Muthén, To investigate the stability of each solution, we
1998–2022)) to examine the differential trajecto- reestimated the model with different starting val-
ries of thinking, strategies for success, and ADHD ues for the growth parameters. In each case, the
knowledge during the intervention and mainte- solution proved robust for different starting val-
nance periods. The GMMs also evaluated how ues, suggesting optimization was not achieved
treatment condition (immediate vs. delayed) was through identification of a local maximum (Hipp
associated with differential change over time. & Bauer, 2006).
Instead of assuming that there is one underlying Second, models were run with the auxiliary
population with a single change pattern, examin- function in Mplus using Vermunt’s three step pro-
ing multiple latent subpopulations that differ in cedure (Vermunt, 2010) with treatment condition
model parameters (intercepts and slopes) allows and baseline ADHD medication status as predic-
for variability around these parameters within tors of class membership. Finally, we simultane-
each class (Muthén & Muthén, 2000). GMMs ously included outcomes assessed at T3 (well-
do not necessarily assume growth exists; rather, being, daily functioning, EFs, inattention, time
latent classes may exhibit positive slopes, negative management, test taking strategies, and motiva-
slopes, or no change over time. A visual inspection tion) to examine whether class membership was
of individual trajectories indicated a high variabil- differentially associated with outcomes at the end
ity between individuals, as well as a high number of the maintenance phase. This approach involved
of nonlinear trajectories. Specifically, for models regressing treatment outcome variables, one at a
of strategies for success and ADHD knowledge, time, onto an indicator that represents an individ-
trajectories exhibited periods of rapid acceleration ual’s most likely GMM class membership (i.e., tra-
(i.e., skills acquisition) during the active phase fol- jectory that most closely approximated their data).
lowed by a plateau during the maintenance phase. This minimizes potential bias in predictive models
To account for the rapid improvement that by using information about classification probabil-
occurred for many across baseline to postinterven- ities, obtained from the standard output of the
tion, we used a freed loading growth model, where unconditional GMM to represent the measure-
the first time point was fixed to 0 and last time ment error associated with forcing individuals into
point was fixed to 1, with all intermediate time a particular GMM class. To provide an estimate of
points freely estimated. effect size for any significant predictors and out-
Consistent with recent studies using GMM to comes of class membership, Cohen’s d was calcu-
examine treatment response heterogeneity (e.g., lated based on model estimated means and
Breaux et al., 2019) we performed these analyses standard errors for each class. As with the main
in two steps each for thinking, strategies for suc- outcomes paper (Anastopoulos et al., 2021), an
cess, and ADHD knowledge. First, we evaluated intent-to-treat approach was utilized, including
an unconditional GMM with classes K (in which any ACCESS participant who attended at least
K = 1, 2, 3, 4). Following best practice (Muthén one session. All participants were asked to com-
mechanisms of treatment response to access 451
plete ratings, even if they didn’t consistently attend (0.0%) and were significantly less likely to be in
treatment, and missing data were fairly low the moderately increasing (10.7%) and low/stable
(M = 15% across all three timpoints) and (2.6%) classes relative to those in the delayed
addressed using full-information maximum likeli- treatment condition (89.3% and 97.4%, respec-
hood accommodated missing data (i.e., included tively). The proportion of individuals in the
all available data for each participant). Intercorre- ACCESS condition was significantly greater in
lations and descriptive statistics for study variables the low rapidly increasing trajectory relative to
are presented in Table 2. the moderately increasing, v2(1) = 59.42,
2
The study was registered at ClinicalTrials.gov p < .001, and low/stable, v (1) = 301.75,
prior to publication of the initial efficacy manu- p < .001, trajectories. Medication status at base-
scripts (NCT04186312). The dataset is publically line was also significantly associated with trajecto-
available and can be accessed at dataverse.unc. ries of ADHD knowledge, v2(2) = 14.54, p = .011,
edu. such that those in the low rapidly increasing trajec-
tory were much less likely to be taking medication
Results for ADHD at baseline (5.3%) relative to the mod-
erate increasing (42.2%; v2(1) = 8.45, p = .004)
trajectories of treatment response and low/stable (51.2%; v2(1) = 13.40, p < .001)
ADHD Knowledge classes. There were no differences between the
A three-class solution was the best-fitting model low/stable and moderately increasing trajectories
for ADHD knowledge (see Table 3). Although for either treatment condition (v2(1) = 0.33,
the adjusted LMR and bootstrapped LRT was p = .569) or medication (v2(1) = 0.57, p = .452).
nonsignificant and both the 3-class and 4-class Being in the low rapidly increasing trajectory of
solutions, the BIC increased in the 4-class solution, ADHD knowledge was significantly associated
supporting the 3-class model. Further, a visual with fewer inattention problems (ds = 0.42-.53)
inspection of the 4-class solution demonstrated and better time management skills (ds = 0.38-
two classes with parallel patterns (similar inter- 0.54) at T3 compared to the moderate increasing
cepts and slopes) that were not qualitatively differ- class and low/stable class (see Table 4). The low
ent from the stable/low improving class in the 3- rapidly increasing trajectory of ADHD knowledge
class solution. Additionally, the smallest class size was also significantly associated with better daily
for the 3-class model represented 15.9% of the functioning (d = 0.44) and greater motivation
sample, however in the 4-class model there were (d = 0.41) after treatment compared to those in
one class representing less than 2.5% of the sam- the low/stable class. There were no differences
ple. We retained the 3-class model solution as between individuals in the low/stable and moder-
the preferred unconditional model, which ade- ate increasing trajectories at T3.
quately discriminated between classes with class
probabilities ranging from 0.80—0.84. All three Behavioral Strategies
trajectories started with low levels of ADHD A three-class model was determined to be the best
knowledge (Figure 1a). The first trajectory had fit for strategies for success (see Table 3). Although
low levels of ADHD knowledge (M = 18.02, the adjusted LMR and bootstrapped LRT was
SE = 6.38), which increased significantly during nonsignificant for both the 3-class and 4-class
the intervention (low rapidly increasing class; solutions, the AIC and BIC increased in the 4-
15.9%, lslope = 13.25, p = .003). A second class class solution, supporting the 3-class model. Fur-
(54.4%, moderate increasing class) started with ther, a visual inspection of the 4-class solution
low ADHD knowledge (M = 22.32, SE = 0.95) demonstrated two classes with parallel patterns
that increased moderately (lslope = 5.48, (similar intercepts and slopes) that were not qual-
p = .006). A third class (29.7%, low stable class) itatively different from the stable/low improving
had low initial levels of ADHD knowledge class in the 3-class solution. The 4-class model also
(M = 19.68, SE = 0.89) that remained stable contained one class representing less than 5% of
throughout the intervention and follow-up the sample (2.5%, n = 6). We retained the 3-class
(lslope = 0.28, p = .906). model solution and this model adequately discrim-
Treatment condition significantly predicted tra- inated between classes with class probabilities
jectories of ADHD knowledge, v2(2) = 480.84, ranging from 0.78—0.83. The first trajectory (Fig-
p < .001. Specifically, individuals in the immediate ure 1b) started with a relatively low frequency of
ACCESS intervention were significantly more using behavioral strategies (M = 41.46,
likely to be in the low rapidly increasing (100%) SE = 4.06), which rapidly increased throughout
relative to those in the delayed treatment condition the active period and continued to increase during
452
Table 2
Intercorrelations Between Study Variables
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
1. Treatment Group –
2. ADHD Medication Status .04
3. T1 Cognitions .02 .10
4. T2 Cognitions .18*** .10 .57***
5. T3 Cognitions .21** .13 .57*** .73***
6. T1 Strategies .09 .11 .47*** .21** .24***

langberg et al.
7. T2 Strategies .46*** .07 .21** .40*** .34*** .42***
8. T3 Strategies .41*** .05 .22** .35*** .38*** .46*** .75***
9. T1 ADHD Knowledge .01 .15 .12 .02 .01 .03 .08 .02
10. T2 ADHD Knowledge .48*** .02 .23*** .01 .02 .05 .24*** .19** .53**
11. T3 ADHD Knowledge .57*** .001 .20** .04 .09 .07 .28*** .21** .48*** .81***
12. T3 AIMS Well-being .08 .04 .24*** .29*** .34*** .23** .33*** .45*** .002 .01 .02
13. T3 AIMS Daily Functioning .27*** .06 .23** .33*** .31*** .35*** .55*** .74*** .03 .16* .13 .65**
14. T3 BRIEF EF .19*** .15* .45*** .58*** .61*** .41*** .48** .61*** .04 .001 .01 .56** .65***
15. T3 CAARS Inattention .26*** .16* .38*** .51*** .58*** .39*** .48*** .54*** .10 .05 .07 .42*** .51*** .81***
16. T3 LAS Time Management .24** .09 .15* .28*** .29*** .35*** .42*** .63*** .02 .11 .06 .37*** .56*** .50*** .45***
17. T3 LAS Motivation .24** .06 .16* .28*** .30*** .35*** .46*** .62*** .01 .11 .07 .37*** .57*** .49*** .44*** .64***
18. T3 LAS Test Strategies .21** .08 .21** .39*** .40*** .29*** .33** .42*** .003 .13 .08 .33** .42** .60*** .62*** .51*** .44***
Ms .48 36.14 34.37 33.80 45.69 54.97 55.06 20.85 25.95 26.36 53.85 53.52 145.37 16.51 19.39 26.48 24.84
SDs .50 8.08 8.02 8.65 11.05 13.40 14.25 6.22 6.11 6.41 15.91 20.79 25.29 5.46 6.12 6.33 5.59
Note. T1 = baseline, T2 = immediate post intervention, T3 = 6 months follow-up/maintenance. AIMS = ADHD Impact Module-Adult. BRIEF = Behavior Rating Inventory of Executive Function–
Adult Version. CAARS = Conners Adult ADHD Rating Scale, Self-Report. LAS = Learning and Study Strategies Inventory.
* p < .05, ** p < .01, *** p < .001.
mechanisms of treatment response to access 453
Table 3
Model Fit Statistics for Growth Mixture Models
Model AIC BIC ssBIC LMR p BLRT P
ADHD Knowledge
1 Class 4082.64 4107.26 4085.07 – – – –
2 Class 4083.26 4118.44 4086.74 5.07 .37 5.38 .38
3 Class 4083.04 4128.76 4087.55 5.87 .75 6.23 .31
4 Classa 4082.92 4139.20 4088.48 5.77 .05 6.12 .50
Strategies for Success
1 Class 5125.24 5149.89 5127.70 – – – –
2 Class 5114.43 5149.65 5117.94 5.43 .11 5.76 .33
3 Class 5110.27 5156.04 5114.83 9.59 .33 10.17 .08
4 Classa 5116.20 5172.55 5121.83 .06 .83 .06 .99
Maladaptive Cognitions
1 Class 4494.63 4519.28 4497.09 – – – –
2 Class 4494.80 4530.02 4498.32 5.49 .48 5.82 .26
3 Class 4489.23 4535.01 4493.70 10.91 .04 11.57 .07
4 Classa 4488.15 4544.49 4493.77 6.68 .25 7.09 .22
Note. Bolded row represents the best fitting model. AIC = Akaike Information Criterion. BIC = Bayesian Information Criterion.
ssBIC = sample size adjusted Bayesian Information Criterion. LMR = Lo-Mendell-Rubin adjusted likelihood ratio test. BLRT = boot-
strapped parametric likelihood ratio test. For the LMR and BLRT, tests are comparing the fit of one model to the previous (k-1 class)
model.
a
Four class solution had at least one class with fewer than n = 10 or (less than 4% of the sample).

the maintenance phase (18.1%, lslope = 28.51, inattention (ds = 0.99-1.03), as well as greater
p < .001; low rapidly increasing). A second trajec- time-management skills (ds = 0.87-1.32), motiva-
tory started with a moderate level of behavioral tion (ds = 0.79-1.21), and testing strategies
strategy use (M = 50.59 SE = 1.64) that increased (ds = 0.45-0.62) following treatment (Table 4).
particularly during the active phase of intervention There were no significant differences between indi-
(51.0%, lslope = 7.62, p < .001; moderate increas- viduals in the low rapidly increasing and moderate
ing). A third trajectory started with low use of increasing trajectories, except for daily function-
behavioral strategies (M = 40.09, SE = 1.74) that ing, which was significantly higher in the low
remained fairly stable (31.9%, lslope = 0.61, rapidly increasing group, v2(1) = 4.33, p = .038,
p = .794). d = 0.40.
Treatment condition significantly predicted tra-
Adaptive Thinking
jectories of behavioral strategies, v2(2) = 56.97,
A three-class model was determined to be the best
p < .001. Relative to the delayed treatment condi-
fit for the ACS-CV (see Table 3). The AIC and BIC
tion, individuals who received the ACCESS inter-
evidenced diminishing gains in estimating beyond
vention immediately were significantly more
a 3-class model. A nonsignificant adjusted likeli-
likely to be either in the group that started low
hood ratio statistic for the 4-class model and sig-
and made rapid improvements (86.4%; v2(1)
nificant adjusted Lo-Mendell-Rubin likelihood
= 53.72, p < .001) or in the moderate increasing
ratio test (LMR) test statistic for the 3-class model
group (59.2%; v2(1) = 19.90, p < .001), and less
provide further support for the 3-class model.
likely to be in the low/stable class (7.4%
Additionally, the smallest class size for the 3-
= ACCESS; 92.6% = delayed treatment). Individu-
class model represented 19.0% of the sample;
als in the ACCESS intervention condition were also
however, in the 4-class model there was one class
more likely to be in the group that started low and
representing less than 5% of the sample. We
rapidly improved relative to the moderate increas-
retained the 3-class model solution as the preferred
ing class, v2(1) = 4.75, p = .029. There were no sig-
unconditional model. This 3-class model ade-
nificant differences in medication status between
quately discriminated between classes with class
the trajectories, v2(2) = 0.48, p = .785. Being in
probabilities ranging from 0.82–.91. The trajecto-
either the group that started with low scores and
ries (Figure 1c) consisted of a class that started
increased or the group that started with moderate
with high impairment (M = 44.97, SE = 1.07) and
strategies use and increased was significantly asso-
remained high (“high stable” class; 19.0%), repre-
ciated with greater well-being (ds = 0.75-0.79),
senting more frequent engagement in maladaptive
better daily functioning (ds = 1.11-1.52), fewer
thinking patterns throughout the intervention
EF problems (ds = 1.10-1.12), less severe
454
Table 4
Follow-up Treatment Outcomes by Trajectory Class Membership for Each Treatment Response Domain
Follow-up Treatment Class Specification Means Wald v2 Tests of Mean Equality
Outcomes
ADHD Knowledge Class 1: Low- Class 2: Mod- Class 3: Low-Stable Class 1 v. 2 d Class 1 v. 3 d Class 2 v. 3 d
Increasing Increasing
M (SE) M (SE) M (SE)
AIMS Well-being 57.41 (4.56) 53.21 (2.07) 53.08 (2.44) .56 .17 .72 .18 .01 .01
AIMS Daily Functioning 61.09 (4.92) 53.90 (2.87) 49.07 (3.01) 1.25 .22 4.47* .44 1.04 .16
BRIEF EF 135.59 (5.59) 147.54 (3.43) 146.47 (3.96) 2.61 .31 2.63 .32 .03 .03
CAARS Inattention 13.54 (1.12) 16.97 (.74) 17.28 (.84) 5.16* .42 7.42** .53 .06 .04
LAS Time Management 22.55 (1.08) 19.00 (.86) 18.50 (.92) 5.13* .38 8.55** .54 .12 .05
LAS Motivation 28.68 (1.31) 26.42 (.91) 25.56 (.87) 1.56 .22 4.16* .41 .37 .09
LAS Test Strategies 26.07 (1.31) 25.50 (.76) 23.18 (.87) .11 .07 3.49+ .38 3.10+ .28
Strategies for Success Class 1: Low- Class 2: Mod- Class 3: Low-Stable Class 1 v. 2 D Class 1 v. 3 d Class 2 v. 3 d

langberg et al.
Increasing Increasing
M (SE) M (SE) M (SE)
AIMS Well-being 59.90 (3.27) 58.94 (2.02) 41.63 (2.75) .05 .04 18.44*** .79 20.31*** .75
AIMS Daily Functioning 71.40 (4.00) 60.47 (2.43) 29.85 (3.20) 4.33* .40 64.65*** 1.52 50.11*** 1.11
BRIEF EF 131.77 (6.09) 135.70 (2.97) 172.61 (3.88) .27 .11 31.40*** 1.12 50.10*** 1.10
CAARS Inattention 14.03 (1.32) 14.42 (.69) 21.65 (.75) .06 .05 24.90*** 1.03 43.16*** .99
LAS Time Management 23.81 (1.24) 20.96 (.81) 13.54 (.86) 2.93+ .32 45.71*** 1.32 33.06*** .87
LAS Motivation 30.84 (1.00) 28.11 (.86) 20.60 (1.07) 3.36+ .30 49.47*** 1.21 24.28*** .79
LAS Test Strategies 26.92 (1.19) 25.83 (.74) 21.69 (1.01) .48 .13 11.35** .62 8.35** .49
Maladaptive Cognitions Class 1: High Class 2: Mod- Class 3: Low- Class 1 v. 2 D Class 1 v. 3 d Class 2 v. 3 d
Stable Decreasing Decreasing
M (SE) M (SE) M (SE)
AIMS Well-being 44.32 (2.72) 54.84 (1.75) 59.32 (2.54) 9.14** .52 16.95*** .78 1.83 .22
AIMS Daily Functioning 44.17 (4.25) 52.12 (2.17) 64.17 (3.50) 2.41 .30 13.98*** .72 7.58** .46
BRIEF EF 167.07 (4.50) 149.74 (2.36) 118.87 (3.66) 10.14** .60 69.89*** 1.64 43.22*** 1.10
CAARS Inattention 21.49 (.75) 17.05 (.53) 11.30 (.89) 20.38*** .74 78.57*** 1.65 26.42*** .89
LAS Time Management 15.98 (1.05) 18.74 (.61) 23.66 (1.23) 4.49* .38 23.09*** .90 10.90** .62
LAS Motivation 24.30 (1.35) 26.02 (.67) 29.30 (1.10) 1.13 .21 8.45** .57 5.42* .40
LAS Test Strategies 21.60 (1.14) 24.32 (.57) 28.65 (.92) 3.99* .39 23.69*** .95 13.32*** .63
Note. +p < .10. *p < .05. ** p < .01. *** p < .001; LAS = LASSI-2nd edition.
mechanisms of treatment response to access 455
period (lslope = 0.41, p = 0.77). Two additional important for the field to begin to identify core
classes demonstrating less frequent maladaptive clinical change mechanisms so that these interven-
thinking were also observed: a “moderate decreas- tions can be refined and best-practice recommen-
ing” class (56.7%) that started with moderate mal- dations established. The ACCESS intervention
adaptive thoughts (M = 36.62, SE = 0.69) that provides psychoeducation about ADHD diagnosis,
significantly decreased (lslope = -2.55, p = .002); co-occurring features, impairments, and treatment
and a “low decreasing” class (24.3%) that started (i.e., ADHD knowledge), behavioral skills strate-
with relatively lower maladaptive thoughts gies (e.g., organizational skills), and adaptive
(M = 28.25, SE = 0.98) that significantly decreased thinking strategies (e.g., identifying, challenging,
after the active phase with continued improve- and replacing maladaptive thinking each session).
ments through the maintenance phase (lslope = - The present study evaluated trajectories of
3.87, p = .001). response for these clinical change mechanisms
Treatment condition was not significantly asso- and whether they were associated with improve-
ciated with trajectories of maladaptive thinking ment in symptoms and functional impairment.
patterns, v2(2) = 4.33, p = 0.115. However, indi- Participants in ACCESS made robust improve-
viduals in the delayed treatment condition were ments in ADHD knowledge and behavioral strate-
more likely to be in high stable maladaptive think- gies. Improvement in behavioral strategies was
ing trajectory (69.5%) relative to those in the associated with moderate to large effect size
immediate ACCESS intervention (30.5%), v2(1) improvement on all outcomes, whereas ADHD
= 3.71, p = 0.054. The proportion of individuals knowledge was primarily associated with moder-
in the ACCESS condition was not significantly dif- ate improvements in symptoms of inattention
ferent across the moderate decreasing trajectory and time management. Adaptive thinking skills
(50.4% delayed, 49.6% ACCESS) or the low displayed only small improvements over the course
decreasing trajectory (43.4% delayed, 56.7% of treatment and these improvements could not be
ACCESS). Treatment condition was not associated attributed to treatment condition. However, tra-
with any significant differences between the low jectories of thinking were significantly associated
decreasing trajectory and the moderate decreasing with both symptom and functional outcomes at
trajectory, v2(1) = 0.22, p = .642, or the high/ the follow-up assessments. Implications of these
stable trajectory (v2(1) = 2.45, p = .117). There findings for the treatment of college students with
were no significant differences in medication status ADHD and for intervention development and
between the trajectories, v2(2) = 1.44, p = .488. refinement are discussed.
Being in the moderate decreasing trajectory rela- As shown in Figure 2, approximately 70% of
tive to the high/stable trajectory was associated the sample made moderate to large improvements
with greater well-being (d = .52), fewer EF prob- in the knowledge and behavioral strategies clinical
lems (d = .60), less inattention (d = .74), greater change mechanisms. Participants in the ACCESS
time management (d = .38), and more effective intervention were far more likely to be in the tra-
testing strategies (d = .39; see Table 4). Those in jectory classes that made rapid gains on these mea-
the low decreasing trajectory had significantly bet- sures relative to the delayed treatment control.
ter outcomes than those in the high/stable trajec- Contrary to hypotheses, improvement in behav-
tory across all areas (ds from 0.57-1.65). ioral strategies was not only associated with aca-
Relative to those in the moderate decreasing class, demic outcomes but was also linked with
participants in the low decreasing trajectory also moderate to large effect size improvements in
had significantly higher functioning at follow-up well-being and overall functioning. It is notewor-
across outcomes (ds from 0.40-1.10), except for thy that significant improvement is what seems
well-being (d = 0.22). to matter, not the magnitude of that improvement.
Specifically, both the moderate and high improv-
Discussion ing behavioral strategies trajectories significantly
Increased academic expectations and demands for outperformed the low and stable group, but differ-
behavioral self-regulation combined with ences between the moderate and high classes were
decreased structure and monitoring make the col- small in terms of effect sizes. This was different for
lege environment challenging for emerging adults ADHD knowledge, where incremental improve-
with ADHD. Promising psychosocial interventions ments seemed to matter more, with the high
have been developed and vary widely in therapeu- improving class outperforming the moderate
tic approach, ranging from organizational skills to improving class for both symptoms of inattention
mindfulness to cognitive-behavioral therapy (e.g., and time management. It is important to note that
Fleming et al., 2015; Gu et al., 2018). It is a wide variety of behavioral strategies are taught
456 langberg et al.

FIGURE 2 Trajectories of response from baseline (T1), post active phase (T2) and end maintenance phase (T3).

in ACCESS and assessed on the Strategies for Suc- and costly. ACCESS directly addresses each of
cess measure. For example, one session targets these barriers to care. In fact, as part of ACCESS
accessing campus resources and self-advocacy, sessions, college service providers (e.g., disability
another session targets strategies for consistently services, writing support) come to group meetings
attending class, and another session targets inter- to provide brief, 20- to 30-minute introductions to
personal relationships. This is in addition to the the services they offer and how to access them. As
organizational skills and study strategies often demonstrated in the ACCESS RCT manuscript
included in interventions for college students with (Anastopoulos et al., 2021), at baseline, partici-
ADHD (e.g., Hartung et al., 2020; LaCount et al., pants in the treatment and control groups were
2018). statistically equivalent with the types of services
The college environment is in some ways unique they were receiving. However, at follow-up, 61%
in that disability and mental health services are of ACCESS participants were receiving disability
often readily available. However, many students services (i.e., accommodations) as compared to
are not aware of the services, feel stigma about 38% of the control (both groups less than 25%
pursuing services, are not comfortable self- at baseline). Interestingly, both ACCESS and
advocating for services, and/or find the documen- delayed participants increased ADHD medication
tation requirements (e.g., a report) cumbersome use from baseline to follow-up with no significant
mechanisms of treatment response to access 457
differences (ACCESS baseline = 53% and paring the class with the highest level of maladap-
post = 67%; Delayed baseline = 42% and tive thinking to the class with the lowest. Further,
post = 71%). Accordingly, it may be that provid- to our knowledge the ACCESS RCT was the first
ing documentation (i.e., the study initial evalua- to study the impact of intervention on overall
tion report) is sufficient for helping college well-being with other studies focusing solely on
students with ADHD obtain medication services, improvement in EF and ADHD symptoms and
but that better understanding ADHD as a disor- academic functioning. Emerging adults with
der, existing laws and regulations, and how to ADHD have often experienced patterns of per-
self-advocate (i.e., ACCESS knowledge and behav- ceived repeated failures by the time they reach col-
ioral components), is necessary for students to lege and struggle with self-esteem (Shaw-Zirt
overcome stigma and to pursue accommodations. et al., 2005). It is encouraging that both adaptive
As shown in Table 3, maladaptive thinking pat- thinking skills and behavioral strategies were asso-
terns were strongly associated with symptom and ciated with moderate to large effects on well-being
functional outcomes, and there were even substan- when comparing the high versus low trajectories.
tial incremental differences between each of the
classes (i.e., as opposed to just high v. low differ- clinical implications and future
ences). Figure 2 shows that approximately 80% directions
of participants displayed reductions in maladap- This study provides important insights into the
tive thinking. However, unlike the behavioral clinical change mechanisms associated with symp-
strategies and knowledge clinical mechanisms toms and functioning in college students with
where classes that improved were almost all par- ADHD. The large (ds over 1.0) effects for the
ticipants represented in the ACCESS group, each behavioral strategies mechanisms suggest that
maladaptive thinking class had roughly equal future interventions should focus on providing a
numbers of ACCESS and delayed treatment partic- wide variety of behavioral strategies, rather than
ipants. The only significant difference was that limiting to academic or organizational strategies.
69% of individuals in the group with the highest The ACCESS model is unique because after a brief
level of maladaptive thinking were in the delayed review of group content at the beginning of each
treatment compared to 31% in ACCESS. The mal- mentoring session, the participant picks which
adaptive thinking findings are novel and highlight strategies resonate with them and what they want
the benefits of this type of class trajectory to work on. Participants develop both short- and
approach. Unlike a group or mean-based approach long-term goals to work towards for the strategies
where we might conclude that adaptive thinking they pick. In this way, the ACCESS model allows
strategies don’t matter, our analyses show that treatment to be personalized, which may be
they are strongly associated with outcomes. How- important given the diversity of clinical presenta-
ever, the ACCESS treatment did not lead to a tions and needs associated with ADHD in college
robust change in maladaptive thinking. In some students. Additional work is needed to evaluate
ways this makes sense given that over 50% of the behavioral strategies data at the item level, to
the sample had a diagnosed internalizing condi- determine which specific skills and strategies par-
tion. The ACCESS intervention is relatively brief, ticipants are choosing to focus on and whether
with maladaptive thinking only being addressed effects can be parsed at the individual skill level.
for 30 minutes at a time for 8 group sessions. This Maladaptive thinking patterns were relatively
is in comparison to cognitive or cognitive- stable over the course of treatment. However,
behavioral therapy for depression which typically being in the high, moderate, or low thinking
includes 10–12, 50-minute sessions focused on groups had significant implications for both func-
identifying, challenging, and replacing maladap- tional and symptom outcomes. These data suggest
tive thinking patterns with adaptive thinking pat- that the ACCESS intervention may need to be
terns that lead to improvements in emotional refined further, perhaps to utilize a modular
well-being and functioning (Kazantzis et al., approach that provides additional content for col-
2018; Luo et al., 2020). It is important to note that lege students who present with low self-esteem
maladaptive thinking was most strongly associated and/or symptoms of depression. One option would
with the symptom outcomes (i.e., EF and inatten- be for the mentors to dictate a focus on maladap-
tion), which may be partially explained by similar- tive thinking when participants score above a cer-
ities across the constructs (see Table 3). However, tain level at baseline. Another option would be to
associations with well-being, overall functioning, have a separate three to five session ACCESS mod-
time-management, and test strategies were also ule focused specifically on identifying and chal-
large and clinically meaningful effects when com- lenging maladaptive thinking that participants
458 langberg et al.
could enroll in during the maintenance phase of self-report. This is typical in that in many classes
treatment. Finally, the current ACCESS session (e.g., large lecture) teachers may not know stu-
content and structure could be maintained, with dents individually or observe behavior in a manner
mentors making additional efforts to connect par- sufficient to provide ratings. Further, parents are
ticipants with internalizing comorbidities with no longer in a position to provide ratings and
campus-provided CBT. Regardless, it is important not all students have friends who could accurately
for future treatment outcome research with college rate their behavior (e.g., freshman) and/or they
students with ADHD to either take a CBT may be uncomfortable asking friends or room-
approach (versus skills/behavioral only) or to mates to rate behavior. As a result, the findings
ensure that participants in strictly behavioral and reported in this paper are subject to bias, in that
skills-based treatments are connected with a thera- they are single informant, the informants were
pist with expertise in internalizing conditions. aware whether they were in treatment or control,
The present study highlights the importance and and studies have shown some groups of students
utility of carefully identifying and frequently mea- with ADHD have difficulty rating their own
suring theorized mechanisms of change as recom- behavior accurately (Bourchtein et al., 2017).
mended by NIMH (Insel & Gogtay, 2014). In The only non-self-report assessment collected in
this study, each mechanism (knowledge, behav- the RCT was grade point average (GPA). How-
ioral, cognitive) was addressed during every ses- ever, as reported in (Eddy et al., 2021), no signif-
sion. The trajectory approach revealed some icant effects were found for GPA and slopes
interesting trends that will be important to study between the treatment and control did not differ.
further. For example, for behavioral strategies, In both conditions, GPAs were stable and in the
one group showed rapid uptake of skills (18% of mid-C range. Accordingly, GPA was not included
all study participants; 86% ACCESS participants), as a more objective outcome as it did not change
starting lower than the moderate improving group over time.
but ending up significantly higher than the moder- The ACCESS sample is fairly diverse, but lack of
ate improving group. In contrast, only 7% of the detailed assessment of factors related to race/ethnic-
group that did not make improvements in behav- ity and gender is a limitation. Given the importance
ioral strategies were ACCESS participants. Given of emerging adulthood for identity exploration and
the large impact of behavioral strategies on out- formation, future studies should move beyond ask-
comes, it will be important to explore the charac- ing about sex and race, to ask about gender identity
teristics of participants who made such large and and racial identity and centrality. In addition, con-
rapid gains. Moderator analyses are warranted to sidering the significant negative impact that struc-
evaluate whether the ACCESS intervention bene- tural and systemic racism has on college campuses
fits a diverse range of participants across sex, (Harwood et al., 2018; Squire et al., 2018), it is crit-
age, race/ethnicity, and comorbidity status. It ical to begin to measure the impact of these factors.
may be that the intervention needs to be tailored Treatments such as ACCESS may need to be cultur-
to more fully meet the needs of students in certain ally adapted to acknowledge the importance of
groups (e.g., freshman college students). The pro- these factors and the daily impact that they have
cess of treatment development for college students on access to care, stigma, and mental health inequi-
with ADHD is still in the early stages. As such, ties. It is worth noting that consistent with the col-
most of the studies published to date are pilot stud- lege campuses where the study took place, 60% of
ies with fewer than 80 total participants, which the sample identified as female. Accordingly, the
can make moderation analyses challenging from findings may not generalize to a sample with a more
a power perspective. RCTs as large as the ACCESS typical 3:1 male to female ADHD ratio. Further,
study and larger will be needed to develop an ade- since not all individuals ADHD attend college, it
quate understanding of what works for whom. would be important to evaluate whether the
ACCESS intervention is effective for emerging
limitations adults with ADHD transitioning from high school
This study aimed to measure outcomes in a com- into the workplace.
prehensive manner, covering symptoms, function-
ing, and academic skills/strategies. However, it is conclusion
important to note that the scales used in this study This was the first study to evaluate mechanisms of
(e.g., BRIEF-A and LASSI-2) have many additional clinical change in the psychosocial treatment of col-
subscales that could provide different or clinically lege students with ADHD. This study evaluated tra-
relevant information. Further, as with most studies jectories of clinical change mechanisms—ADHD
of college students, the outcome assessments were knowledge, behavioral strategies, and adaptive
mechanisms of treatment response to access 459
thinking—and their impact on symptoms and func- in young adolescents with ADHD? A fresh look at
tional outcomes. Participants in ACCESS made prevalence and stability using latent profile and transition
analyses. Journal of Abnormal Child Psychology, 45(6),
large gains in behavioral strategies and ADHD 1063–1075. https://doi.org/10.1007/s10802-016-0248-3.
knowledge. In contrast, maladaptive thinking was Breaux, R. P., Langberg, J. M., Bourchtein, E., Eadeh, H. M.,
largely stable across the intervention period, with Molitor, S. J., & Smith, Z. R. (2019). Brief homework
the only treatment difference being that individuals intervention for adolescents with ADHD: Trajectories and
in the delayed treatment condition were more likely predictors of response. School Psychology, 34(2), 201.
Canu, W. H., Stevens, A. E., Ranson, L., Lefler, E. K.,
to be in high stable maladaptive thinking trajectory LaCount, P., Serrano, J. W., Willcutt, E., & Hartung, C.
(69.5%) relative to those in the immediate ACCESS M. (2021). College readiness: Differences between first-
intervention (30.5%). Behavioral strategies and year undergraduates with and without ADHD. Journal of
adaptive thinking trajectories displayed large and Learning Disabilities, 54(6), 403–411. https://doi.org/
significant associations with symptom and func- 10.1177/0022219420972693.
Conners, C. K., Erhardt, D., Epstein, J. N., Parker, J. D. A.,
tional outcomes with clinically meaningful effect Sitarenios, G., & Sparrow, E. (1999). Self-ratings of
sizes differences. Knowledge trajectories displayed ADHD symptoms in adults I: Factor structure and norma-
small to moderate associations with improvement tive data. Journal of Attention Disorders, 3(3), 141–151.
on ADHD symptoms on inattention and use of DuPaul, G. J., Gormley, M. J., Anastopoulos, A. D., Weyandt,
time-management strategies. The findings from this L. L., Labban, J., Sass, A. J., Busch, C., Franklin, M., &
Postler, K. B. (2021). Academic trajectories of college
study lend support to the conceptual foundation for students with and without ADHD: Predictors of four-year
the ACCESS intervention; that ADHD knowledge, outcomes. Journal of Clinical Child & Adolescent Psy-
behavioral skills and strategies, and adaptive think- chology, 50(6), 828–843. https://doi.org/10.1080/
ing are important components in the treatment of 15374416.2020.1867990.
college students with ADHD. However, the results Eddy, L. D., Anastopoulos, A. D., Dvorsky, M. R., Silvia, P.,
Labban, J., & Langberg, J. M. (2021). A RCT of a CBT
of this study suggest that brief cognitive interven- intervention for college students with ADHD: Functional
tion is unlikely to be sufficient given the high levels outcomes. Journal of Clinical Child and Adolescent
of internalizing comorbidities found in college Psychology, 50(6), 844–857. https://doi.org/10.1080/
ADHD samples. This study also highlights the 15374416.2020.1867989.
importance of teaching a broad range of behavioral Fabiano, G. A., Schatz, N. K., Aloe, A. M., Pelham, W. E., Jr,
Smyth, A. C., Zhao, X., Merrill, B. M., Macphee, F.,
success strategies to include self-advocacy skills and Ramos, M., Hong, N., Altszuler, A., Ward, L., Rodgers, D.
how to access available services. B., Liu, Z., Karatoprak Ersen, R., & Coxe, S. (2021).
Comprehensive meta-analysis of Attention-Deficit/Hyper-
References activity Disorder psychosocial treatments investigated
within between group studies. Review of Educational
American Psychiatric Association. (2013). Diagnostic and Research, 91(5), 718–760.
statistical manual of mental disorders (5th ed.). https://doi. Fleming, A. P., & McMahon, R. J. (2012). Developmental
org/10.1176/appi.books.9780890425596 context and treatment principles for ADHD among college
Anastopoulos, A. D., DuPaul, G. J., Weyandt, L. L., Morris- students. Clinical Child and Family Psychology Review, 15
sey-Kane, E., Sommer, J. L., Rhoads, L. H., Murphy, K., (4), 303–329.
Gormley, M., & Gudmundsdottir, B. G. (2018). Rates and Fleming, A. P., McMahon, R. J., Moran, L. R., Peterson, A. P.,
patterns of comorbidity among first-year college students & Dreessen, A. (2015). Pilot randomized controlled trial of
with ADHD. Journal of Clinical Child & Adolescent dialectical behavior therapy group skills training for
Psychology, 47(2), 236–247. https://doi.org/10.1080/ ADHD among college students. Journal of Attention
15374416.2015.1105137. Disorders, 19(3), 260–271.
Anastopoulos, A. D., Langberg, J. M., Besecker, L. H., & Gu, Y., Xu, G., & Zhu, Y. (2018). A randomized controlled
Eddy, L. D. (2020). CBT for College Students with ADHD: trial of mindfulness-based cognitive therapy for college
A Clinical Guide to ACCESS. Springer. students with ADHD. Journal of Attention Disorders, 22
Anastopoulos, A. D., Langberg, J. M., Eddy, L. D., Silvia, P., (4), 388–399.
& Labban, J. (2021). A Randomized controlled trial Hartung, C. M., Canu, W. H., Serrano, J. W., Vasko, J. M.,
examining CBT for college students with ADHD. Journal Stevens, A. E., Abu-Ramadan, T. M., ... Flory, K. (2020). A
of Consulting and Clinical Psychology, 89, 21–23. https:// new organizational and study skills intervention for college
doi.org/10.1037/ccp0000553. students with ADHD. Cognitive and Behavioral Practice.
Arnett, J. J. (2007). Emerging adulthood: What is it, and what Harwood, S. A., Mendenhall, R., Lee, S. S., Riopelle, C., &
is it good for? Child Development Perspectives, 1(2), Huntt, M. B. (2018). Everyday racism in integrated spaces:
68–73. https://doi.org/10.1111/j.1750-8606.2007.00016. Mapping the experiences of students of color at a diver-
x. sifying predominantly white institution. Annals of the
Arnett, J. J. (2013). Adolescence and emerging adulthood: A American Association of Geographers, 108(5), 1245–1259.
cultural approach. Pearson. Health Act CHQ Inc. (2007). The ADHD impact module –
Baker, L., Prevatt, F., & Proctor, B. (2012). Drug and alcohol adult (AIM-A).
use in college students with and without ADHD. Journal of Hipp, J. R., & Bauer, D. J. (2006). Local solutions in the
Attention Disorders, 16(3), 255–263. estimation of growth mixture models. Psychological Methods,
Bourchtein, E., Langberg, J. M., Owens, J. S., Evans, S. W., & 11(1), 36–53. https://doi.org/10.1037/1082-989X.11.1.36.
Perera, R. A. (2017). Is the positive illusory bias common
460 langberg et al.
Insel, T. R., & Gogtay, N. (2014). National Institute of randomized preventive interventions. Biostatistics, 3(4),
Mental Health Clinical Trials: New Opportunities. New 459–475. https://doi.org/10.1093/biostatistics/3.4.459.
Expectations. JAMA Psychiatry, 71(7), 745–746. Pfeifer, M. A., Reiter, E. M., Cordero, J. J., & Stanton, J. D.
Jung, T., & Wickrama, K. A. S. (2008). An introduction to (2021). Inside and out: Factors that support and hinder the
latent class growth analysis and growth mixture modeling. self-advocacy of undergraduates with ADHD and/or speci-
Social and Personality Psychology Compass, 2(1), 302–317. fic learning disabilities in STEM. CBE—Life Sciences
https://doi.org/10.1111/j.1751-9004.2007.00054.x. Education, 20(2), ar17.
Karver, M. S., De Nadai, A. S., Monahan, M., & Shirk, S. R. Ram, N., & Grimm, K. J. (2009). Growth mixture modeling:
(2018). Meta-analysis of the prospective relation between A method for identifying differences in longitudinal change
alliance and outcome in child and adolescent psychother- among unobserved groups. International Journal of Behav-
apy. Psychotherapy, 55(4), 341. ioral Development, 33, 565–576. https://doi.org/10.1177/
Kazantzis, N., Luong, H. K., Usatoff, A. S., Impala, T., Yew, 0165025409343765.
R. Y., & Hofmann, S. G. (2018). The processes of Roth, R. M., Isquith, P. K., & Gioia, G. A. (2005). BRIEF—A:
cognitive behavioral therapy: A review of meta-analyses. Behavior Rating Inventory of Executive Function— Adult
Cognitive Therapy and Research, 42(4), 349–357. Version. Psychological Assessment Resources, Lutz, FL.
Knouse, L. E., Mitchell, J. T., Kimbrel, N. A., & Anastopou- Safren, S. A., Otto, M. W., Sprich, S., Winett, C. L., Wilens, T.
los, A. D. (2019). Development and evaluation of the E., & Biederman, J. (2005). Cognitive-behavioral therapy
ADHD cognitions scale for adults. Journal of Attention for ADHD in medication-treated adults with continued
Disorders, 23(10), 1090–1100. symptoms. Behaviour Research and Therapy, 43(7),
LaCount, P. A., Hartung, C. M., Shelton, C. R., & Stevens, A. 831–842.
E. (2018). Efficacy of an organizational skills intervention Shaw-Zirt, B., Popali-Lehane, L., Chaplin, W., & Bergman, A.
for college students with ADHD symptomatology and (2005). Adjustment, social skills, and self-esteem in college
academic difficulties. Journal of Attention Disorders, 22 students with symptoms of ADHD. Journal of Attention
(4), 356–367. Disorders, 8(3), 109–120.
LaCount, P. A., Hartung, C. M., Canu, W. H., & Knouse, L. Solanto, M. V., & Anouk, S. (2021). Feasibility, acceptability,
E. (2019). Interventions for transitioning adolescents with and effectiveness of a new cognitive-behavioral interven-
ADHD to emerging adulthood: Developmental context and tion for college students with ADHD. Journal of Attention
empirically-supported treatment principles. Evidence- Disorders, 25(14), 2068–2082.
Based Practice in Child and Adolescent Mental Health, 4 Solanto, M. V. (2011). Cognitive-behavioral therapy for adult
(2), 170–186. ADHD: Targeting executive dysfunction. Guilford Press.
Landgraf, J. M. (2007). Monitoring quality of life in adults Squire, D., Williams, B. C., & Tuitt, F. (2018). Plantation
with ADHD: Reliability and validity of a new measure. politics and neoliberal racism in higher education: A
Journal of Attention Disorders, 11(3), 351–362. framework for reconstructing anti-racist institutions.
Larose, S., Duchesne, S., Litalien, D., Denault, A. S., & Boivin, Teachers College Record, 120(14), 1–20.
M. (2019). Adjustment trajectories during the college Van der Oord, S., & Tripp, G. (2020). How to improve
transition: Types, personal and family antecedents, and behavioral parent and teacher training for children with
academic outcomes. Research in Higher Education, 60(5), ADHD: Integrating empirical research on learning and
684–710. motivation into treatment. Clinical Child and Family
Lowe, K., & Dotterer, A. M. (2018). Parental Involvement Psychology Review, 23(4), 577–604.
During the College Transition: A Review and Suggestion Van der Oord, S., Boyer, B. E., Van Dyck, L., Mackay, K. J.,
for its Conceptual Definition. Adolescent Research Review, De Meyer, H., & Baeyens, D. (2020). A randomized
3, 29–42. https://doi.org/10.1007/s40894-017-0058-z. controlled study of a cognitive behavioral planning inter-
Lubke, G., & Muthén, B. O. (2007). Performance of factor vention for college students with ADHD: An effectiveness
mixture models as a function of model size, covariate study in student counseling services in Flanders. Journal of
effects, and class- specific parameters. Structural Equation Attention Disorders, 24(6), 849–862.
Modeling, 14(1), 26–47. https://doi.org/10.1207/ Vasko, J. M., Oddo, L. E., Meinzer, M. C., Garner, A., &
s15328007sem1401_2. Chronis-Tuscano, A. (2020). Psychosocial interventions for
Luo, C., Sanger, N., Singhal, N., Pattrick, K., Shams, I., college students with ADHD: Current status and future
Shahid, H., ... Samaan, Z. (2020). A comparison of directions. The ADHD Report, 28(4), 5–12.
electronically-delivered and face to face cognitive beha- Vermunt, J. K. (2010). Latent class modeling with covariates:
vioural therapies in depressive disorders: A systematic Two improved three-step approaches. Political Analysis,
review and meta-analysis. EClinicalMedicine, 24, 100442. 18(4), 450–469. https://doi.org/10.1093/pan/mpq025.
Muthén, L. K., & Muthén, B. (1998). Mplus User’s Guide. Weinstein, C. E., Palmer, D. R., & Schultz, A. C. (2002).
Muthén & Muthén. LASSI. User’s Manual for those administering Learning
Muthén, B., & Muthén, L. K. (2000). Integrating person- and Study Strategies Inventory.
centered and variable-centered analyses: Growth mixture
modeling with latent trajectory classes. Alcoholism: Clin- RECEIVED: August 21, 2022
ical and Experimental Research, 24(6), 882–891. ACCEPTED: November 29, 2022
Muthén, B., Brown, C. H., Masyn, K., Jo, B., Khoo, S. T., AVAILABLE ONLINE: 7 DECEMBER 2022
Yang, C. C., Wang, C. P., Kellam, S. G., Carlin, J. B., &
Liao, J. (2002). General growth mixture modeling for

You might also like