You are on page 1of 13

This article was downloaded by: [Flinders University of South Australia]

On: 06 January 2015, At: 12:20


Publisher: Routledge
Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House,
37-41 Mortimer Street, London W1T 3JH, UK

Psychotherapy Research
Publication details, including instructions for authors and subscription information:
http://www.tandfonline.com/loi/tpsr20

Analysis of the therapist's verbal behavior during


cognitive restructuring debates: A case study
a a a
María Xesús Froján-Parga , Ana Calero-Elvira & Montserrat Montaño-Fidalgo
a
Biological and Health Psychology Department , Universidad Autónoma de Madrid , Madrid,
Spain
Published online: 11 Feb 2009.

To cite this article: María Xesús Froján-Parga , Ana Calero-Elvira & Montserrat Montaño-Fidalgo (2009) Analysis of the
therapist's verbal behavior during cognitive restructuring debates: A case study, Psychotherapy Research, 19:1, 30-41, DOI:
10.1080/10503300802326046

To link to this article: http://dx.doi.org/10.1080/10503300802326046

PLEASE SCROLL DOWN FOR ARTICLE

Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained
in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the
Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and
should be independently verified with primary sources of information. Taylor and Francis shall not be liable for
any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of
the Content.
This article may be used for research, teaching, and private study purposes. Any substantial or systematic
reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any
form to anyone is expressly forbidden. Terms & Conditions of access and use can be found at http://
www.tandfonline.com/page/terms-and-conditions
Psychotherapy Research, January 2009; 19(1): 3041

Analysis of the therapist’s verbal behavior during cognitive


restructuring debates: A case study

MARÍA XESÚS FROJÁN-PARGA, ANA CALERO-ELVIRA, & MONTSERRAT


MONTAÑO-FIDALGO

Biological and Health Psychology Department, Universidad Autónoma de Madrid, Madrid, Spain
(Received 18 January 2008; revised 26 June 2008; accepted 30 June 2008)
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

Abstract
This paper reports a case study in which the authors analyze the application of the debate technique in cognitive
restructuring so as to obtain a deeper understanding of the relevant behavioral processes. The authors examined the
recordings of a clinical case of low mood disorder and selected five debates that dealt with the same problem. After their
transcription, the authors analyzed the clienttherapist verbal interaction. Results show changes in the verbalizations of both
parties as the treatment progresses. The authors propose a new explanation of these changes, constituting a step forward in
the theoretical explanation of the debate technique within the cognitivebehavioral approach.

Keywords: cognitivebehavior therapy; process research; observational methodology; cognitive restructuring technique

Cognitive techniques have been classified in numer- disturbances by changing cognitive schemas and
ous ways in the cognitivebehavioral approach. One errors (arbitrary inference, selective abstraction,
of the most widely used classifications is that of overgeneralization, magnification and minimization,
Mahoney and Arnkoff (1978), who distinguished personalization, and absolutist and dichotomous
between three types of techniques: cognitive restruc- thinking). To achieve this goal, a wide range of both
turing, training in coping skills, and problem solving. behavioral and cognitive techniques can be used,
In this article, we focus on the first type, known depending on Beck’s proposed classification. To
collectively as cognitive restructuring techniques. examine and test the reality of automatic thoughts,
These techniques are intended to identify and a commonly used procedure is to submit to Socratic
modify the client’s maladaptive cognitions, high- questioning the empirical evidence that could sustain
lighting the negative impact they have on behavior such thoughts. A variety of strategies have been
and emotions. They constitute a key element in proposed for this Socratic dialogue or thought-
cognitive therapy (Beck, Rush, Shaw, & Emery, debating method, among them reattribution, search
1979) and rational emotive therapy (Ellis, 1962; for alternative interpretations and solutions, ques-
Ellis & Grieger, 1977). Other authors have proposed tioning the evidence, and use of the three-column
variations of cognitive restructuring that do not technique. The client’s inappropriate assumptions
make substantially different contributions, such as are modified throughout, using the same procedures
systematic rational restructuring (Goldfried & Gold- as for modifying automatic thoughts.
fried, 1986/1993). These variations all form part of a The central notions in Ellis’s rational emotive
broad group of techniques that have one fundamen- therapy are that (a) thoughts affect human emotion
tal point in common: the use of debate. Debating as well as behavior and (b) irrational beliefs are mainly
sometimes has been referred to as cognitive restructur- responsible for a wide range of disorders. There are
ing, a term that actually encompasses this whole basically four types of irrational beliefs: dire necessity,
group of cognitive techniques. feeling awful, cannot stand something, and self-
Beck defined cognitive therapy as an active, condemnation. The therapeutic process is defined as
directive, and structured procedure of limited dura- an experience of cognitiveemotional retraining, to
tion that is used to deal with different psychiatric which end rational emotive therapy commonly uses a

Correspondence concerning this article should be addressed to Marı́a Xesús Froján-Parga, Biological and Health Psychology Department,
Universidad Autónoma de Madrid, Madrid 28049, Spain. E-mail: mxesus.frojan@uam.es

ISSN 1050-3307 print/ISSN 1468-4381 online # 2009 Society for Psychotherapy Research
DOI: 10.1080/10503300802326046
Cognitive restructuring debates 31

wide range of techniques classified as cognitive, Trijsburg & Perry, 2004). Other studies have ana-
emotive, or behavioral. Here the debating of irrational lyzed the content of clienttherapist verbalizations
beliefs is the basic technique to be used (although (Stiles & Shapiro, 1995) or analyzed cognitive
there may be others). It involves the logical-empirical techniques, emphasizing therapeutic work within
method of questioning beliefs, critically examining each session as well as the therapeutic relation
them, debating propositions in a scientific fashion, (Kanter, Schildcrout, & Kohlenberg, 2005). Some
evaluating and disputing irrational beliefs, and distin- have even developed instruments such as the Cog-
guishing between logical and illogical thinking as well nitive Therapy Scale (Young & Beck, 1980) and the
as between semantic definition and redefinition. Collaborative Study Psychotherapy Rating Scale
Beck’s and Ellis’s important theoretical and clinical (Hollon et al., 1988) to measure the competence of
contributions are undeniable. However, by contrast therapists and their ability to adapt to the compo-
with other behavior modification techniques based nents specified in the application of cognitive ther-
on a long experimental tradition, in this case little apy or other forms of psychotherapy. The scarcity of
experimental research has been conducted on the process studies is particularly noticeable in this
underlying learning processes. Whereas we can debate, leaving numerous questions unanswered:
explain systematic desensitization (Wolpe, 1958) in Do all therapists actually do the same thing? Where
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

terms of counterconditioning and reciprocal inhibi- does the success of this technique lie? What is it that
tion, for example, the same cannot be said for the really works when the technique is applied? Is there
debate technique. Furthermore, existing explana- anything qualitatively or quantitatively different
tions of the debate technique often have been based regarding the processes effective in different techni-
on constructs with little operational meaning (logical ques?
error, dysfunctional schema) and on circular expla- The present study does not aim to answer all of
nations (Pérez-Álvarez, 1996; Salzinger, 1992). As these questions. Given the preliminary status of this
Haaga and Davison (1993) pointed out, the very line of research, our aim is rather to further our
notion of an irrational belief seems tautological: understanding of the processes that underlie the
Rational emotive therapy defines a belief as irrational debate technique and thereby promote changes in
if it results in disturbances while the latter are said to the client’s verbalizations. We start from a theoretical
be present because of the irrational belief. An behavioral approach, according to which changes in
additional problem for this type of intervention is irrational beliefs or cognitive schemas are understood
the absence of systematic guidelines for implementa- as changes in the person’s verbalizations, from less
tion. Different texts on cognitive restructuring (CR) adaptive to more adaptive ones. We could go further
give general advice on the debate technique, but one and postulate, following Poppen (1989) and Martin
can assume that therapists will use different proce- and Pear (2007), that restructuring is a procedure for
dures to change their clients’ beliefs because there are modifying erroneous, self-imposed rules. Poppen
no systematic guidelines tailored to each case. (1989) argued that debating is a verbal procedure
Like other cognitive techniques, debating has that features shaping and reinforcement processes
been used and continues to be widely used by through which the therapist manages to change the
clinicians. Numerous publications document the verbal rules that he or she has identified in the patient.
empirical effectiveness of cognitive techniques for a Punishment processes also occur, because patients
wide range of psychological problems (Chambless have to explain why they maintain erroneous beliefs
et al., 1996, 1998; Chambless & Ollendick, 2001; and the ensuing challenges from the therapist’s side
DeRubeis & Crits-Christoph, 1998; Jiménez-Murcia may function as punishing events. Meanwhile, the
et al., 2007). However, process research in cognitive therapist teaches the patient to make discriminations
techniques can be characterized by a paucity of and individual statements about the events that
studies and by theoretical disarray. Some research happen instead of simplistic, all-or-none formula-
comes from theoretical approaches that are not tions. That is, patients are provided with new rules in
behavioral or use methodologies different from the order to achieve sharper analyses of existing con-
one we are proposing. For example, some studies tingencies instead of the overgeneralizations that
have analyzed the components in treatment packages constituted their previous verbal rules. Without
(Hofmann, Schulz, Meuret, Moscovitch, & Suvak, entering the controversies that surround the concept
2006; Smits, Powers, Cho, & Telch, 2004; Zettle & of rule-governed behavior (e.g., Schlinger, 1990) and
Hayes, 1987) or compared the processes involved in without considering this term as an explanation,
therapies of different orientations by using instru- rather than a description, of behavior, we assume
ments built for this effect, such as the Psychotherapy that this perspective could be well suited to analyzing
Process Q-Set or the Comprehensive Psychotherapy the debate technique. Restructuring is closely tied to
Intervention Rating Scale (Ablon & Jones, 1999; a person’s language and, accordingly, to the classic
32 M. X. Froján-Parga, A. Calero-Elvira, and M. Montaño-Fidalgo

and operant conditioning processes involved in clinical sessions with the same client. The fragments
learning and development (e.g., Skinner, 1957; lasted a total of 37 min 21 s (m 7 min 28 s). The
Staats, 1967). Could the same conditioning pro- longest fragment lasted 13 min 31 s, and the short-
cesses lie at the core of psychological change through est, 1 min 9 s.
Socratic questioning, or are other processes involved? The therapist who took part in the study was a
To answer this question, we draw on previous behavioral psychologist with 20 years of clinical
proposals that address the clinical changes underlying experience. She worked at Instituto Terapeútico de
the therapeutic process, such as the pioneering work Madrid, a private psychological clinic. The client
of Murray (1956) and Truax (1966), the unpublished was a 29-year-old woman attending counseling for
works of Willard Day’s team at Reno University in the low mood. Among other techniques, cognitive
1960s (Reno Methodology), as well as the approach restructuring was applied in several areas where the
of Hamilton (1988), Rosenfarb (1992), and Follette, client indicated problems, although this study solely
Naugle, and Callaghan (1996), who conceive of selected the verbalizations that were related to her
therapeutic change as the shaping of new behaviors low self-esteem in the workplace. Although the
through contingencies that obtain in the therapeutic speech of both client and therapist could be heard
relation. We also take note of the contributions from in the recordings, only the therapist was visible. The
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

the contextual approach in clinical behavior analysis, client always had her back to the camera to protect
which has developed therapeutic approaches such as confidentiality as much as possible. Table I specifies
functional analytic psychotherapy (Kohlenberg & the sessions from which the fragments were taken
Tsai, 1991), acceptance and commitment therapy and their length.
(Hayes, Strosahl, & Wilson, 1999), and dialectical
behavior therapy (Linehan, 1993), all of which Variables
emphasize that language during the clinical session
has the status of clinically relevant behavior, both as Two variables were analyzed in this study: the verbal
an instance of the clinical problem and as an interaction between therapist and client, and the
opportunity for therapy (Pérez-Álvarez, 1996). client’s verbalizations/cognitions that were estab-
Previous work by our research group has involved lished as targets for debate. Concerning the verbal
the study of processes that underlie the debate interaction between therapist and client, the verbal
technique. We have explored general models for behavior of the therapist was categorized in seven
explaining this technique, based on the systematic functions (Table II), based on basic behavioral
observation of several clinical sessions with different operations (Catania, 1992) adjusted to the clinical
clients and therapists (Froján, Calero, & Montaño, setting. This system of categories was developed
2007), using the Observer XT software instrument. earlier by our research group and has been used in
Starting from this work, we intend to go one step previous studies (Froján, Calero, & Montaño, 2007;
further with the detailed study of all the debates Froján, Montaño, & Calero, 2007). Three indepen-
bearing on a single topic that arose during the dent observers took part in the development of the
treatment of a clinical case. To this end, the sequences coding system, observing several sessions and dis-
of interaction between the therapist and client are cussing disagreements over the basic categories. The
analyzed one by one, with special emphasis on the definitions of the proposed functions were gradually
therapist’s verbal behavior throughout the course of modified, and a set of agreements was worked out to
the treatment and on the client’s verbalizations/ help the observers decide how to categorize verbaliza-
cognitions that the therapist sets as targets for change, tions (Froján, Calero, Montaño, & Garzón, 2006).
The interjudge reliability of this coding system was
studying the possible modifications that occur in the
evaluated by calculating Cohen’s kappa index with the
application of the technique along sessions. In this
Observer XT 7.0 program (Grieco, Loijens, Zimmer-
case study, we believed that literal transcriptions of the
man, & Spink, 2007), using a 1-s tolerance window
debates were more suitable than using the software,
(kO1O2 .72, p B.001; kO1O3 .74, p B.001;
with respect to both the analysis of the therapistclient
interaction and the study of specific verbalizations/ Table I. Sample
cognitions1 that arose in therapy.
Fragment Session Duration (min:s)

Method 1 5 01:17
2 5 12:45
Sample 3 6 08:39
4 7 13:31
We observed and coded five fragments of conversa- 5 9 01:09
tion taken from our recordings of four different
Cognitive restructuring debates 33

kO2O3 .68, p B.001). According to Bakeman,


Quera, McArthur, and Robinson (1997), these kappa
values indicate a high level of observer precision for an
eight-category system where the variability among

Verbalization by the therapist that highlights the benefits derived from a given behavior shown by the client or the costs of maintaining
Verbalization by the therapist that elicits an observable emotional response or a verbalization referring to its appearance in an indirect
category probabilities is high.
The system of categories was adjusted slightly for
its use in the debate technique. Specifically, the
informative and motivational functions (by which we
mean the verbalizations of the psychologist aimed at
Verbalization that occasions a client’s behavior (verbal or nonverbal), usually followed by reinforcement or punishment

informing or motivating the client) were considered


as preparation for the debate. Aside from this, the
Verbalizations that indicate disagreement with, disapproval of, or rejection of the behavior shown by the client ‘‘others’’ category was not used.
Verbalizations that show agreement with, acceptance of, or admiration for the behavior shown by the client

Guidelines offered by the therapist to promote a given behavior in the client outside the clinical context Apart from the R (response) function, the func-
tions of the client’s verbal behavior were not
Verbalization by the therapist that transmits his or her theoretical or clinical knowledge to the client analyzed in this study because we considered the
therapist at any moment as the member of the dyad
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

in charge of the interaction. Thus, in the three-term


sequence stimulusresponse consequence (S-R-C),
S and C always refer to the therapist’s verbalizations,
whereas R refers to the client’s verbalizations pre-
Definition

ceded and followed by the therapist’s behaviors. In


Any verbalization that could not be included in any of the above categories

summary, our study focused on changes in the


therapist’s client-directed verbalizations as the
debate evolved, leaving a detailed analysis of the
contents of the client’s verbalizations for future
studies.
Concerning the client’s verbalizations/cognitions
that were established as targets for debate, we
focused at any moment on the client’s verbalizations
that the psychologist challenged (analyzing primarily
the contents of the therapist’s verbalizations) and on
the type of strategy followed by the therapist to
achieve restructuring (e.g., What type of questions
did she ask? Did she provide information?).

Procedure
a dysfunctional behavior

The first step was to contact the clinic and obtain


way by the client

approval. Both client and therapist gave their formal


consent for the sessions to be recorded and used for
Table II. Therapist’s Verbal Behavior Category System

research purposes. This procedure fully complied


with the requirements of the Research Ethics Com-
mittee of Universidad Autónoma de Madrid. The
sessions were then recorded on closed circuit, with
the camera partly hidden so as to interfere with
therapy as little as possible. Subsequently, one of the
authors, a psychologist specializing in behavior
therapy, observed the 16 sessions and identified 14
fragments of the recorded sessions, which, based on
a study guide written by our research group, were
considered to involve the debate technique (Froján,
Calero, & Montaño, 2006). They were all taken
Reinforcement
Discriminative

Instructional
Motivational
Punishment

from sessions that took place after the functional


Informative
Evocative

‘‘Others’’
Function

analyses had been explained to the client. To avoid


possible errors, the correct identification of the
debate technique was then confirmed with the case
34 M. X. Froján-Parga, A. Calero-Elvira, and M. Montaño-Fidalgo

therapist, who observed all of the selected fragments. 4 (Example 1), when the psychologist asked the
The 14 fragments were studied, analyzing the topics client whether she thought that someone who was
under discussion and identifying basically three of above the rest was ‘‘exceptional’’ (discriminative
them: the client’s obligation to take care of a relative, function). After the client’s response, the therapist
her ex-partner’s indifference toward her, and her low did not emit any reinforcing or punishing function
self-esteem in the workplace. From these three but simply asked another question (‘‘Are you above
topics, the last one was selected for analysis because the rest?’’; discriminative function). The second type
it was the object of the most debate throughout of sequence differed from the previous one in that
therapy. The five debate fragments that involved this the therapist added a verbalization that reinforced
topic were selected, and literal transcriptions were what the client just said. For example, in Debate 5
made.2 (see Table III, Example 4), the psychologist encour-
In the second stage of this study, two of the authors, aged the client to repeat a statement to herself and
both highly trained in using the proposed system for explained that this was appropriate, to which the
categorizing the therapist’s verbal behavior, coded the client answered ‘‘Yes’’ and the psychologist emitted a
five debate fragments and discussed the differences reinforcing verbalization, ‘‘Good.’’ In the third type
found until agreement was reached. The results were of sequence, instead of reinforcing what the client
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

then analyzed in detail, paying special attention to the said, the therapist emitted a verbalization with a
changes occurring in the fragments of debate as the punishing function. Thus, in Example 6 (see Table
restructuring and treatment of the topic progressed. III, Debate 2), in response to one of the client’s
Specifically, the transcriptions were analyzed on three maladaptive responses, the psychologist emitted a
levels. First, the analysis concentrated on the three- verbalization with a punishing function, namely,
term sequences, S-R-C. Second, the client’s verbali- ‘‘You don’t know much about life.’’ A fourth type
zations/cognitions acted on by the therapist were of sequence involved any of the previous sequence
analyzed along with the strategies used by the types, preceded by a preparatory verbalization of the
therapist to challenge them. Third, the analysis psychologist with an informative or motivational
focused on the moments in which the therapist function or with an instructional function. For
changed the target of debate (i.e., the client’s target example, before asking her client something, the
verbalization) or the debating strategy. The frequency psychologist supplied relevant information. This is
of the different functions of the therapist’s verbal illustrated in the information that precedes the
behavior was calculated for each debate. discriminative function in a segment of Debate 4
(see Table III, Example 7): ‘‘One can’t use the word
‘exceptional’ for everybody because then the word
Results
would be meaningless,’’ after which the normal
We now present the three levels of analysis outlined sequence continues: discriminative function,
in the previous section, explaining and illustrating response of the client, and another discriminative
the four types of therapistclient interaction function. Table III includes these and other exam-
sequences that were found in the debate segments. ples of each type of sequence taken from different
We also include a brief summary of the target segments of the debates.
verbalizations that were dealt with through the five These four types of sequences followed one an-
debate segments and the strategies used to this other to produce the dialogue between therapist and
effect, and analyze the sequences present in the client during the application of the debate technique.
therapistclient interaction when the target verbali- Through all five segments, instances can be clearly
zation or debating strategy changed. Aside from this, distinguished in which all of the therapeutic objec-
we present a summary table with the frequency of tives focused on the client’s claims of being worthless
each of the functions of the therapist’s verbal in the workplace. The verbalizations set by the
behavior in each segment. therapist as targets for debate, along with the
The S-R-C sequences found in the clientthera- strategies used to this end, are presented schemati-
pist interaction during the debates basically fell into cally in Table IV.
four types. In the first type, the therapist emitted a As Table IV shows, the debating process started
verbalization that evoked a response from the client. with the therapist announcing the final target verba-
For instance, the therapist asked for information or lization, namely ‘‘I am a successful woman’’; the
made a statement, and the client replied with a strategy in this case was to give the client information
relevant comment, the latter not being followed by on her accomplishments. The psychologist repeated
any specific consequence apart from another ques- the same objective in Debate 5 (see Table IV), again
tion on the same topic. As shown in Table III, an with the same strategy. Meanwhile, in Segments 2, 3,
example of this type of sequence occurred in Debate and 4, the therapist gradually brought up more
Cognitive restructuring debates 35
Table III. Types of S-R-C Sequences Found in the Analysis of Debates

Type of S-R-C Sequence Examples

DISC-R-(not C) Example 1 (Debate 4)


T: Is someone who is above the rest ‘‘exceptional’’? (DISC)
Cl: Yes. (R)
T: So, are you above the rest or not? (DISC)
Example 2 (Debate 2)
T: And you don’t think you are worthy? (DISC)
Cl: Nothing special. (R)
T: Nothing special? (DISC)
DISC-R-REINF Example 3 (Debate 4)
T: So, what does ‘‘special’’ mean, something good or bad? (DISC)
Cl: It’s good. (R)
T: Okay. (REINF)
Example 4 (Debate 5)
T: Say it to yourself. It’s perfectly right to do so. (DISC)
Cl: Yes, yes, this is what I’m doing. (R)
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

T: Good. (REINF)
DISC-R-PUN Example 5 (Debate 4)
T: So, are you above the rest with respect to your work? (DISC)
Cl: I suppose so. (R)
T: No, don’t ‘‘suppose,’’ no. (PUN) Yes or no? (DISC)
Example 6 (Debate 2)
T: Do you think that any son would do that? (DISC)
Cl: Hmm. (R)
T: Well, you don’t know much about life. (PUN)
PREP (informative, motivational) or INSTR Example 7 (Debate 4)
 DISC-R-REINF/PUN T: One can’t use the word ‘‘exceptional’’ for everybody because
then the word would be meaningless. (PREP INF) Now, tell me,
do people value you? (DISC)
Cl: Yes. (R)
T: Do you think you do your job well? (DISC)
Example 8 (Debate 3)
T: So, regardless of whether this comes from some intrinsic power,
which I don’t think is the case, or from lots of things that come
together (PREP INF), do you think they rank you higher or lower
than others? Do they give you easy or difficult tasks? Do they send
you on overseas assignments? Tell me. (DISC)
Cl: They rank me higher than others. (R)
T: Okay, good, that’s all I wanted to hear . . . (REINF)

Note. T therapist; Cl client; Sstimulus; R response (of the client); C consequence; DISCdiscriminative function; REINF
reinforcement; PUN punishment; PREPpreparation.; INFinformative function; INSTRinstructional function.

complex objectives (verbalizations) to debate: ‘‘In outside the sessions, such as asking her colleagues
general, my behavior is valuable’’ (Debate 2), ‘‘My and supervisor about how she performed at work. In
behavior at work is valuable’’ (Debate 2), ‘‘At work I one case (Debate 2), the psychologist resorted to the
rank at the top’’ (Debate 3), ‘‘My behavior at work is strategy of providing extensive information about the
valuable’’ (Debate 4), ‘‘I am above average in my learning of particular behaviors, which was useful to
work’’ (Debate 4), ‘‘I am exceptional in my work’’ carry on the debate. Finally, in Debate 4, we can
(Debate 4). As summarized in Table IV, the debating discern another type of strategy: presenting questions
strategies used by the psychologist in these inter- to evaluate the client’s grasp of words such as
mediate segments consisted mainly of questioning ‘‘exceptional’’ or ‘‘special’’ that she was using
the client about the empirical validity of her target throughout the debate. In this case, the therapist
verbalizations. That is, the therapist asked the client asked questions such as ‘‘Do you know what the word
about possible proofs of her worth in the workplace, ‘exceptional’ means?’’ In case of doubt, the therapist
of her being better than her colleagues, and so on. In gave explanations to the client so as to make her
some of these cases (see the debating strategies used realize that the word could apply to her behavior.
in Segments 3 and 4), the psychologist used informa- Table V presents a more extensive analysis of the
tion that the client gathered from her assignments different parts of a debate (Debate 3), including all
36
M. X. Froján-Parga, A. Calero-Elvira, and M. Montaño-Fidalgo
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

Table IV. Verbalizations/Cognitions Set as Therapeutic Objectives

Debate Verbalization/cognition set as therapeutic objective Debating strategy

1 ‘‘I am a successful woman’’ (final goal of the restructuring process) Information about what is meant by ‘‘a successful woman’’
2 ‘‘In general, my behavior is valuable’’ ‘‘My behavior at work is valuable’’ Questions intended to evaluate empirical evidence for the verbalization ‘‘My behavior is
valuable’’
Questions intended to evaluate empirical evidence for the verbalization ‘‘My behavior
at work is valuable’’
Information about how certain behaviors are learned
Homework proposal: asking colleagues about how she is doing in the workplace
3 ‘‘At work I rank at the top’’ Questions intended to evaluate empirical evidence for the verbalization ‘‘At work
I rank at the top’’
Questions intended to evaluate empirical evidence for the verbalization ‘‘At work
I rank at the top’’ based on the opinion of her coworkers

4 ‘‘My behavior at work is valuable’’ Questions intended to evaluate empirical evidence for the verbalization ‘‘My behavior
at work is valuable’’
‘‘I am above average in my work’’ Questions intended to evaluate empirical evidence for the verbalization ‘‘I am above average
in my work’’
‘‘I am exceptional in my work’’ Questions intended to evaluate empirical evidence for the verbalization ‘‘I am
exceptional in my work’’
Questions intended to evaluate empirical evidence for the verbalization
‘‘I am exceptional in my work’’ based on the opinion of her supervisor
Questions intended to evaluate semantic clarity of the words ‘‘exceptional’’ and
‘‘special’’
5 ‘‘I am a successful woman’’ (final goal of the restructuring process) Information about what is meant by ‘‘a successful woman’’
Cognitive restructuring debates 37
Table V. Example of Debate Segment (Segment 3): Parts of the Debate, S-R-C Sequences, and Examples of TherapistClient
Interchange

Parts of the debate S-R-C sequences Therapistclient interchange

Evaluation of homework DISC-R T: Have you read it? (DISC)


Cl: Yes, I have. (R)
T: Great, well done! (REINF) Well? Does it say
nasty things? (DISC)
Cl: No. (R)
T: Ah. (DISC)
Cl: No, not nasty, it says nice things. (R)
Questions intended to evaluate empirical DISC-R T: Each person is different, but with respect to
evidence for the verbalization ‘‘At work I criteria of efficiency and performance, or appraisal,
rank at the top’’ people do not end up all equal. Some rank higher
than others. That’s the way it is. (PREP INF) So,
face it, are you one of those who are good or one of
those who are bad at what they do?(DISC)
PREP (INF)DISC-R CI: I don’t know (R)
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

DISC-R-PUN T: I’m going to ask you the question again.


(DISC)
Cl: It depends on who you’re talking about, well, I
mean . . . (R)
Questions intended to evaluate empirical DISC-R T: (reads a letter from the client’s coworker)
evidence for the ‘‘At work I rank at the Do you think all jobs are highly valued?
top’’ based on opinion of colleagues at work (DISC)
PREP (INF)DISC-R-REINF CI: Yes. (R)
T: All equally well? (DISC)
Cl: Each in its own way, but yes. (R)
T: (reads another fragment) Don’t you think
that . . . ? (DISC)
Questions to check that target verbalization DISC-R T: Fantastic! Great! It’s great that you’ve done it
‘‘At work I rank at the top’’ intact and the result couldn’t be better. (REINF) So, are
you good or bad at what you do?(DISC)
DISC-R-REINF CI: I’m good. (R)
PREP(INF)DISC-R T: Are you well considered or not? (DISC)
Cl: Yes. (R)
T: Are you good at what you do? (DISC)
Cl: Yes. (R)
T: Do they see you like a person who opens herself
to others or not? (DISC)
Cl: Yes. (R)
T: Okay. That’s quite an achievement. (REINF)

Note. T therapist; Clclient; Sstimulus; Rresponse (of the client); Cconsequence; DISCdiscriminative function; REINF
reinforcement; PUNpunishment; PREPpreparation; INFinformative function.

the relevant types of S-R-C sequences and some From our analysis of moments of change in the
examples of dialogues. Table V also shows examples targeted verbalizations or debate strategies, we iden-
of the strategy of evaluating the empirical evidence for tify three different ways in which the therapist directs
or against a verbalization. Here the therapist supplies the changes: (a) The objective is not met, the therapist
information about the appraisal of workers in a punishes (or does not reinforce) the client’s verbal
company (‘‘Each person is different, but with respect behavior, and a change is made; (b) the therapist’s
to criteria of efficiency and performance, or appraisal, partial or final objective is met, reinforcement may be
people do not end up all equal. Some rank higher delivered, and a change is made to confirm what has
than others. That’s the way it is’’). The therapist then been achieved or to move on with the therapy; (c) the
asks the client whether she thinks she is among the client changes her topic of conversation and the
people who are considered good at their job (‘‘So, therapist engages in the debate for a while, digressing
face it, are you one of those who are good or one of from the strategy she was following. The most
those who are bad at what they do?’’; discriminative frequent type of change was the first, which occurred
function). When feeling that the client does not reply 13 times (see Example 1 in Table VI), followed by the
adequately, the therapist repeats the question. second, which occurred six times (see Example 2 in
38 M. X. Froján-Parga, A. Calero-Elvira, and M. Montaño-Fidalgo

Table VI). The least frequent was the third type, cognitive/verbal aspects. Indeed, our proposal
which occurred only once in the five segments of focuses on this second part. Clearly, the fundamen-
debate (see Example 3 in Table VI). tal role played by behavioral activities in cognitive
Table VII shows the frequency of occurrence of behavioral therapy should not be overlooked. It is
the different functions of the therapist’s verbal equally important, however, to bear in mind what
behavior in the debate technique of this case study. has traditionally been referred to as ‘‘the cognitive
It also presents the absolute frequencies and percen- part’’ of this therapy, namely the activity of debating,
tages of the different functions in relation to the which may be better explained in behavioral terms.
therapist’s total number of interventions in each The latter point is essential because the therapist’s
segment of debate. achieving a better understanding of what he or she is
applying, of why changes occur, and of what
produces changes in the client’s verbalizations as
Discussion
the debate progresses could undoubtedly improve
Before discussing our results, we relate them to an clinical effectiveness. Thus, from our analysis of the
issue that has been debated extensively in the series of verbalizations that the therapist was estab-
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

associated literature: whether behavioral compo- lishing along the debates, and from our study of
nents are actually responsible for the success of when the debating strategies or therapeutic objec-
what is known as cognitive therapy (or for the tives changed, as well as focusing on the S-R-C
success of the cognitive part of cognitivebehavioral sequences we identified, we may conclude in this
therapy). This is what authors such as Dimidjian case that the change of verbalizations throughout the
et al. (2006) and Pérez-Álvarez (2007) argue. They treatment, or cognitive restructuring, corresponds to
find that comparing both interventions separately a shaping procedure in which the client changes
reveals the superiority of the purely behavioral from less to more adaptive verbalizations. This
approaches. Like these authors, we believe that explanation is consistent with Poppen’s (1989)
more work is needed to shed light on this question. proposal. Shaping can be defined as the develop-
Highlighting the importance of behavioral compo- ment of new behavior through the reinforcement and
nents, however, does not imply forgetting the extinction of successive approximations to a final,

Table VI. Different Forms of Change Along Debate

Form of change Examples

Therapeutic goal is not met, therapist punishes Example 1 (Debate 4)


(or does not reinforce) behavior, and changes strategy T: Now, tell me, do people value you? (DISC)
Cl: Yes. (R)
T: Do you think you do your job well? (DISC)
Cl: Yes. (R)
T: No, that unconvincing ‘‘Yes’’ isn’t any good. (PUN)
[Change]
T: Let’s start again. (DISC)
Therapist’s objective is met, reinforcement may be delivered, Example 2 (Debate 4)
and change is made (to confirm what has been achieved or T: I’ll ask you again, is your performance at work above that
to move on with therapy) of your colleagues? Or above average, if you prefer it that
way? (DISC)
Cl: In some ways, yes. (R)
T: Good. (REINF)
[Change to move on]
T: I am going to repeat the question because I want you
to give me a convincing ‘‘Yes’’ look. (DISC)
Client changes her topic of conversation and therapist engages Example 3 (Debate 4)
in the debate for a while, digressing from strategy she was T: Let’s go back over this again. (DISC)
following Cl: Yes, but that is, I don’t know . . . that’s there because it’s
a way of saying there’s a special characteristic. (R)
[Change]
T: ‘‘Special.’’ I like that too. (REINF) Right. Do you think
that everybody is special? (DISC)
Cl: Yes, but ‘‘special’’ is neither good nor bad. (R)

Note. T therapist; Clclient; R response of the client; DISCdiscriminative function; REINFreinforcement; PUNpunishment.
Cognitive restructuring debates 39
Table VII. Absolute and Relative Frequency of Functions of the Therapist’s Verbal Behavior in Each Debate

Debate 1 Debate 2 Debate 3 Debate 4 Debate 5

Function AF % AF % AF % AF % AF %

DISC 1 25% 45 67.16% 35 68.63% 53 55.21% 2 25.0%


REINF 1 25% 2 2.98% 11 21.57% 23 23.96% 2 25.0%
PUN 0 0% 3 4.48% 1 1.96% 9 9.37% 0 0%
PREP: INF 2 50% 16 23.88% 4 7.84% 11 11.46% 3 37.5%
PREP: MOTIV 0 0% 0 0% 0 0% 0 0% 0 0%
INSTR 0 0% 1 1.49% 0 0% 0 0% 1 12.5%
EVOC 0 0% 0 0% 0 0% 0 0% 0 0%

Note. AFabsolute frequency; DISCdiscriminative function; REINFreinforcement; PUNpunishment; PREPpreparation; INF


informative function; MOTIVmotivational function; INSTRinstructional function; EVOCevocative function.

target behavior and the extinction of those same questions shorter and more to the point. As ex-
approximations as the final behavior is configured. plained in the previous section and as illustrated in
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

Three aspects can be distinguished in this procedure: Table VI, on some occasions the therapist failed to
achieve the programmed objective and accordingly
1. Specifying the target behavior clearly
did not reinforce the client’s behavior. Instead, she
2. Choosing an initial behavior
punished the behavior and changed her strategy,
3. Choosing the steps to be followed and moving
sometimes going back to a previous step that had not
forward at an appropriate pace.
been sufficiently consolidated; alternatively, she kept
These three aspects can be found in the debates working on the same step but with a different
analyzed here. It is worth mentioning that a change strategy. In contrast, when the proposed objective
was reached, the therapist moved on to the next step
in verbalization throughout the debate technique
if the objective seemed relatively secure, or she kept
means the achievement of the desired therapeutic
working on the same step until the verbalization was
goal because, as we pointed out earlier, the aim of
sufficiently consolidated. (Either strategy exemplifies
cognitive restructuring techniques is precisely to
Step 3 of the hypothesized shaping process.)
identify and modify the client’s maladaptive cogni-
If we focus on a more molecular level of analysis,
tions, highlighting their harmful impact on behavior
the S-R-C sequences in the therapistclient interac-
and emotions.
tion, it also seems that we can talk of shaping: The
As explained in the Results section and indicated
client’s behaviors that came closer to treatment
in Table IV, in this case study the therapist indicated
objectives were reinforced, while those that moved
from the outset, in Debate 1, the verbalization that
away from the verbalizations set as targets by the
was the final objective of restructuring (Step 1 of the therapist were either nonreinforced or punished.
hypothesized shaping process): ‘‘I am a successful Thus, throughout the case (see Table VII), a higher
woman,’’ an objective eventually reached in the last frequency of punishment occurred in two debates
debate. Between these two moments, the verbaliza- (2 and 4) in which the client emitted verbalizations
tions that the therapist set as targets for debate opposed to the therapeutic goals, whereas reinforce-
moved steadily toward the final objective. For ment was much more frequent when the client
example, as Table IV shows, Debate 2 started with emitted verbalizations that agreed with these goals
‘‘My behavior at work is valuable’’ (Step 2 of the (something that happened with greater frequency in
hypothesized shaping process), and Debate 3 the last debates, when the client’s verbalizations were
focused on ‘‘At work I rank at the top,’’ until getting closer to the final behavioral objective). The infor-
to ‘‘I am above average in my work’’ and ‘‘I am mative function appeared in varying proportions
exceptional in my work’’ in Debate 4. In some of the across the different segments, and, as already
debates, before moving on to a more advanced indicated, we believe that it performed a preparatory
verbalization, the therapist checked that the achieve- role for shaping. The information always alternated
ments of the previous sessions remained intact. For with moments when, instead of plainly stating the
example, in Debate 4 the therapist started with target verbalizations, the therapist aimed at making
questions aimed at evaluating the empirical evidence the client verbalize them. On many occasions, the
behind the verbalization ‘‘My behavior at work is therapist provided information when she considered
valuable,’’ something already done in Debate 2 that the client was not sufficiently informed to go on
(see Debating Strategy in Table IV). In these cases, with the debate; accordingly, in order to progress,
the debate tended to be much quicker and the the therapist went back to explain aspects of the
40 M. X. Froján-Parga, A. Calero-Elvira, and M. Montaño-Fidalgo

client’s behavior or the behavior of others. When the allowing us to make a statistical study of the
information load was high, the therapist always sequences that occur. An analysis of the content of
checked that the client was following her explana- the client’s verbalizations is also required, which, in
tions by asking questions to this effect. In the clinical turn, implies the defining of subcategories for the
case reported here, the motivational function, which functions of the psychologist’s verbal behavior,
we also consider a preparation for shaping, occurred promoting a more detailed study of their dyadic
at a zero frequency. This was probably due to the interaction.
small number of debates analyzed, because the
motivational function did occur in our previous
research based on a larger sample (Froján, Calero, Notes
1
& Montaño, 2007). As to the instructional function, The terms verbalization and cognition are understood to be
it always occurred at the end of the debates, along equivalent throughout this article because, from a behavioral
approach, the only way to gain access to a person’s cognitions is
with information about the usefulness of the pro- through self-report, in other words, through his or her verba-
posed task, apparently in order to consolidate the lizations.
changes produced during the therapy; alternatively, 2
Because of space limitations, only small parts of the transcrip-
the therapist proposed tasks that allowed moving tions have been included as examples in the text and tables.
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

into the next debate, as in Debate 2 (see Table IV). However, we will gladly provide the full transcriptions to any
reader who requests them.
In agreement with previous results by our research
group (Froján, Calero, & Montaño, 2007), the
evocative function did not appear in any debate, Acknowledgements
which may indicate that it is not a characteristic
function of debates in cognitive restructuring. Financial support was received from the Spanish
Although our theoretical explanation of what Government (Science and Innovation Ministry,
I+D+I Research Grant, SEJ200766537PSIC).
happens during restructuring differs from that pre-
Also, Ana Calero-Elvira and Montserrat Montaño-
sented by Beck and Ellis, the debate technique was
Fidalgo were supported by a grant (FPI research
implemented here in ways quite similar to the
fellowship) from the Education Department of the
examples that both authors include in their manuals,
Community of Madrid and the European Social
with one important difference. In our case study,
Fund (E.S.F.) to conduct this research, as part of
the final, target verbalization was presented from the
their doctoral thesis. We would also like to thank
outset, and the client was regularly informed of the
François Tonneau for his valuable help and com-
therapeutic goal to be achieved at any moment. This
ments on this paper and its translation into English.
is clearly unlike what both Beck et al. (1979) and
Ellis and Grieger (1977) proposed: The challenges
to the client’s suppositions should be presented in References
the form of questions and suggestions of possible Ablon, J. S., & Jones, E. E. (1999). Psychotherapy process in the
alternatives instead of making declarative statements National Institute of Mental Health Treatment of Depression
or affirmations. Might the present option be more Collaborative Research Program. Journal of Consulting and
convenient in therapeutic terms? In theory, it might Clinical Psychology, 67, 6475.
Bakeman, R., Quera, V., McArthur, D., & Robinson, B. F. (1997).
if we hypothesize that restructuring is a shaping
Detecting sequential patterns and determining their reliability
process. The empirical effectiveness of this option with fallible observers. Psychological Methods, 2, 357370.
could be evaluated though a comparative study of Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979).
the two ways of performing cognitive restructuring: Cognitive therapy of depression: A treatment manual. New York:
establishing different indicators of effectiveness and Guilford Press.
Catania, A. C. (1992). Learning. Hillsdale, NJ: Prentice Hall.
using a larger sample of debate segments. This type Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E.,
of comparative study seems both interesting and Calhoun, K. S., Crits-Christoph, P., et al. (1998). Update on
feasible because, in previous data analyzes con- empirically validated therapies, II. The Clinical Psychologist,
ducted by our research group, which involved 51(1), 316.
different cases and therapists with varying levels of Chambless, D. L., & Ollendick, T. H. (2001). Empirically
supported psychological interventions: Controversies and evi-
clinical experience, the final target verbalizations dence. Annual Review of Psychology, 52, 685716.
were not always presented clearly at the outset Chambless, D. L., Sanderson, W. C., Shoham, V., Johnston, S. B.,
(see, e.g., Froján, Calero, & Montaño, 2007). Pope, K. S., Crits-Christoph, P., et al. (1996). An update on
Other improvements planned in our future empirically validated therapies. The Clinical Psychologist, 49(2),
research involve a more extensive use of the Ob- 518.
DeRubeis, R. J., & Crits-Christoph, P. (1998). Empirically
server XT instrument for the detailed analysis of the supported individual and group psychological treatments for
sequences of interaction between therapist and client adult mental disorders. Journal of Consulting and Clinical
that would, in turn, facilitate sequential analyses, Psychology, 66, 3752.
Cognitive restructuring debates 41
Dimidjian, S., Dobson, K. S., Kohlenberg, R. J., Gallop, R., Kanter, J. W., Schildcrout, J. S., & Kohlenberg, R. J. (2005). In
Markley, D. K., Atkins, D. C., et al. (2006). Randomized trial vivo processes in cognitive therapy for depression: Frequency
of behavioral activation, cognitive therapy, and antidepressant and benefits. Psychotherapy Research, 15, 366373.
medication in the acute treatment of adults. Journal of Consult- Kohlenberg, R. J., & Tsai, M. (1991). Functional analytic
ing and Clinical Psychology, 74, 658670. psychotherapy. Creating intense and curative therapeutic relation-
Ellis, A. (1962). Reason and emotion in psychotherapy. New York: ships. New York: Plenum Press.
Lyle Stuart. Linehan, M. M. (1993). Cognitive behavioral treatment of borderline
Ellis, A., & Grieger, R. (1977). Handbook of rational emotive personality disorder. New York: Guilford Press.
therapy. New York: Springer. Mahoney, M. J. & Arnkoff, D. B. (1978). Cognitive and self-
Follette, W. C., Naugle, A. E., & Callaghan, G. M. (1996). A control therapies. In: S. L. Garfield & A. E. Bergin (Eds),
radical behavioural understanding of the therapeutic relation- Handbook of psychotherapy and behavior change: An empirical
ship in effecting change. Behavior Therapy, 27, 623641. analysis (2nd ed., pp. 689722). New York: Wiley.
Froján, M. X. Calero, A. & Montaño, M. (2006). Guı́a para la Martin, G., & Pear, J. (2007). Behavior modification: What it is and
identificación del diálogo socrático en la reestructuración cognitiva how to do it. Hillsdale, NJ: Prentice Hall.
[Guide to identify Socratic questioning in cognitive restructur- Murray, E. J. (1956). A content-analysis method for studying
ing]. Unpublished manuscript, Universidad Autónoma de psychotherapy. Psychological Monographs, 70(13Whole No. 420),
Madrid. 132.
Froján, M. X., Calero, A., & Montaño, M. (2007). Procesos de Pérez-Álvarez, M. (1996). Tratamientos psicológicos [Psychological
aprendizaje en las técnicas de reestructuración semántica treatments]. Madrid, Spain: Universitas.
Downloaded by [Flinders University of South Australia] at 12:20 06 January 2015

[Learning processes in the cognitive restructuring techniques]. Pérez-Álvarez, M. (2007). La activación conductual (AC): Un
Análisis y Modificación de Conducta, 32, 287305. nuevo acercamiento al tratamiento de la depresión [Behavioral
Froján, M. X. Calero, A. Montaño, M. & Garzón, A. (2006). activation (BA): A new approach for the treatment of depres-
Sistema de codificación de la conducta verbal del terapeuta sion]. Infocop, 31, 4143.
[Therapists’ verbal behavior coding system]. Unpublished Poppen, R. L. (1989). Some clinical implications of rule-governed
manuscript, Universidad Autónoma de Madrid. behavior. In S. C. Hayes (Ed.), Rule-governed behavior: Cogni-
Froján, M. X., Montaño, M., & Calero, A. (2007). Why do people tion, contingencies and instructional control (pp. 325357). New
York: Plenum Press.
change in therapy? A preliminary study. Psychology in Spain, 11,
Rosenfarb, I. S. (1992). A behaviour analytic interpretation of the
5360.
therapeutic relationship. Psychological Record, 42, 341354.
Goldfried, M. R., & Goldfried, A. P. (1993). Métodos de cambio
Salzinger, K. (1992). Cognitive therapy: A misunderstanding of B.
cognitivo [Methods for cognitive change]. In F. H. Kanfer & A.
F. Skinner. Journal of Behaviour Therapy and Experimental
P. Goldstein (Eds), Cómo ayudar al cambio en psicoterapia [How
Psychiatry, 23, 38.
to get psychotherapeutic change] (pp. 123165). Bilbao, Spain:
Schlinger, H. D. (1990). A reply to behaviour analysts writing
Desclée de Brouwer. (Original work published 1986).
about rules and rule-governed behaviour. The Analysis of Verbal
Grieco, F., Loijens, L., Zimmerman, P., & Spink, A. (2007).
Behavior, 8, 7782.
Reliability analysis. In F. Grieco, L. Loijens, P. Zimmerman &
Skinner, B. F. (1957). Verbal behavior. New York: Appleton-
A. Spink (Eds), The Observer XT reference manual. Version
Century-Crofts.
(pp. 461490). Wageningen, the Netherlands: Noldus Infor-
Smits, J. A., Powers, M. B., Cho, Y., & Telch, M. J. (2004).
mation Technology b.v. Mechanism of change in cognitive-behavioral treatment of
Haaga, D. A., & Davison, G. C. (1993). An appraisal of rational- panic disorder: Evidence for the fear of fear mediational
emotive therapy. Journal of Consulting and Clinical Psychology, hypothesis. Journal of Consulting and Clinical Psychology, 72,
61, 215220. 646652.
Hamilton, S. A. (1988). Behavioral formulations of verbal Staats, A. W. (1967). Learning, language and cognition. New York:
behaviour in psychotherapy. Clinical Psychology Review, 8, Holt, Rinehart & Winston.
181193. Stiles, W. B., & Shapiro, D. A. (1995). Verbal exchange structure
Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (1999). Acceptance of brief psychodynamicinterpersonal and cognitivebehavioral
and commitment therapy: An experiential approach to behavior psychotherapy. Journal of Consulting and Clinical Psychology, 63,
change. New York: Guilford Press. 1527.
Hofmann, S. G., Schulz, S. M., Meuret, A. E., Moscovitch, D. A., Trijsburg, R. W., & Perry, J. C. (2004). An empirical study of the
& Suvak, M. (2006). Sudden gains during therapy of social differences in interventions between psychodynamic therapy
phobia. Journal of Consulting and Clinical Psychology, 74, and cognitive-behavioural therapy for recurrent major depres-
687697. sion. Canadian Journal of Psychoanalysis, 12, 325345.
Hollon, S. N. Evans, M. D. Auerbach, A. DeRubeis, R. J. Elkin, I. Truax, C. B. (1966). Reinforcement and nonreinforcement in
Lowery, A. et al. (1988). Development of a system for rating rogerian psychotherapy. Journal of Abnormal Psychology, 71,
therapies for depression: Differentiating cognitive therapy, interper- 19.
sonal psychotherapy, and clinical management pharmacotherapy. Wolpe, J. (1958). Psychotherapy by reciprocal inhibition. Stanford,
Unpublished manuscript. CA: Stanford University Press.
Jiménez-Murcia, S., .Álvarez-Moya, E. M., Granero, R., Aymami, Young, J. & Beck, A. (1980). Cognitive Therapy Scale: Rating
M. N., Gómez-Peña, M., Jaurrieta, N., et al. (2007). Cognitive- manual. Unpublished manuscript, Center for Cognitive Ther-
behavioral group treatment for pathological gambling: Analysis apy, Philadelphia, PA.
of effectiveness and predictors of therapy outcome. Psychother- Zettle, R. D., & Hayes, S. C. (1987). Component and process
apy Research, 17, 544552. analysis of cognitive therapy. Psychological Report, 61, 939953.

You might also like