You are on page 1of 279

Processing Perspectives on Task Performance

Task-Based Language Teaching:


Issues, Research and Practice (TBLT)
Task-Based Language Teaching (TBLT) is an educational framework for the
theory and practice of teaching second or foreign languages. The TBLT book
series is devoted to the dissemination of TBLT issues and practices, and to
fostering improved understanding and communication across the various clines
of TBLT work.
For an overview of all books published in this series, please see
http://benjamins.com/catalog/tblt

Editors
Martin Bygate John M. Norris Kris Van den Branden
University of Lancaster University of Hawaii at Manoa KU Leuven

Volume 5
Processing Perspectives on Task Performance
Edited by Peter Skehan
Processing Perspectives
on Task Performance

Edited by

Peter Skehan
St. Mary’s University, Twickenham

John Benjamins Publishing Company


Amsterdam / Philadelphia
TM
The paper used in this publication meets the minimum requirements of
8

the American National Standard for Information Sciences – Permanence


of Paper for Printed Library Materials, ansi z39.48-1984.

Library of Congress Cataloging-in-Publication Data

Processing perspectives on task performance / Edited by Peter Skehan.


p. cm. (Task-Based Language Teaching, issn 1877-346X ; v. 5)
Includes bibliographical references and index.
1. Language and languages--Study and teaching. 2. Task analysis in education. 3. Competence
and performance (Linguistics) 4. Second language acquisition. 5. Second language
acquisition--Methodology. 6. Task analysis in education. 7. Cognitive learning. 8. Psy-
cholinguistics. I. Skehan, Peter.
P53.82.P84   2014
418.0071--dc23 2013050660
isbn 978 90 272 0725 8 (Hb ; alk. paper)
isbn 978 90 272 0726 5 (Pb ; alk. paper)
isbn 978 90 272 7041 2 (Eb)

© 2014 – John Benjamins B.V.


No part of this book may be reproduced in any form, by print, photoprint, microfilm, or any other
means, without written permission from the publisher.
John Benjamins Publishing Co. · P.O. Box 36224 · 1020 me Amsterdam · The Netherlands
John Benjamins North America · P.O. Box 27519 · Philadelphia pa 19118-0519 · usa
For Daniel
Table of contents

Series editors’ preface to Volume 5 ix


Preface xi

chapter 1
The context for researching a processing perspective on task performance 1
Peter Skehan

chapter 2
On-line time pressure manipulations: L2 speaking performance under
five types of planning and repetition conditions 27
Zhan Wang

chapter 3
Task readiness: Theoretical framework and empirical evidence
from topic familiarity, strategic planning, and proficiency levels 63
Bui Hiu Yuet Gavin

chapter 4
Self-reported planning behaviour and second language performance
in narrative retelling 95
Francine Pang & Peter Skehan

chapter 5
Get it right in the end: The effects of post-task transcribing
on learners’ oral performance 129
Li Qian

chapter 6
Structure, lexis, and time perspective: Influences on task performance 155
Zhan Wang & Peter Skehan

chapter 7
Structure and processing condition in video-based narrative retelling 187
Peter Skehan & Sabrina Shum
viii Investigating a Processing Perspective on Task Performance

chapter 8
Limited attentional capacity, second language performance,
and task-based pedagogy 211
Peter Skehan
Author Biodata 261
Index 263
Series editors’ preface to Volume 5

It is our pleasure to introduce the fifth volume in this series, a collection edited by Peter
Skehan and entitled Investigating a Processing Perspective on Task Performance. This
book is in many ways a culmination of work initiated by Skehan some two decades ago,
as it builds upon the theoretical perspectives of his Tradeoff Hypothesis and extends
from the considerable associated research into task types, characteristics, and imple-
mentation conditions. Of primary interest in this volume is the relationship between
task design variables and their effect on how language learners produce speech for
communicative purposes. Tasks here are generally brief spoken narratives of the sort
that have grown in popularity as primary pedagogic tools of task-based instruction that
seeks to provide a focus-on-form and – meaning simultaneously. Beyond their apparent
face value as opportunities for practicing L2 speech and developing fluency, such tasks
offer the intriguing possibility of drawing learners’ attention to form-­meaning con-
nections, initiating learner analysis and restructuring of their interlanguage, improv-
ing their control of the language, and ultimately pushing the development of language
knowledge and proficiency. The main goal here is for learners to be able to produce
complex, accurate, and fluent L2 speech, with tasks being employed to integrate the
various learning processes; and the key question then is “how?”
Beginning in the early 1990s, and presented first in an influential article “A frame-
work for the implementation of task-based instruction” followed by the highly cited
book A Cognitive Approach to Language Learning, Peter Skehan proposed that learner
performance on these kinds of tasks was determined in part by the fundamentally
limited cognitive resources that a person has available during speech. Telling a story,
describing a picture, explaining a process – these tasks consume the attention that
learners have at their disposal, and which, as a consequence, needs to be divided
between fluency, accuracy and complexity of their performance. In this respect, cer-
tain tasks have been claimed to make greater or lesser demands on cognition; in a
similar vein the conditions under which learners are asked to perform tasks may influ-
ence what they focus on in their production. For example, providing learners with the
opportunity to plan prior to telling a story may free up attentional resources, result-
ing in spoken narratives that are lexically more diverse, syntactically more complex,
grammatically more accurate, and so on. Building from these observations into peda-
gogic implications, Skehan advocated for cycles of tasks that were selected, designed,
and sequenced to intentionally shift learners’ attention between a focus on fluent and
efficient communication versus the opportunity to restructure and ‘push’ language
production at the cusp of interlanguage development.
Skehan’s groundbreaking ideas, along with the competing theoretical position of
Peter Robinson’s Cognition Hypothesis (see volume 2 in the TBLT:IRP series), inspired
x Investigating a Processing Perspective on Task Performance

a generation of task-based research into the effects of task features (types, conditions,
characteristics) on the cognitive complexity of task demands and the resulting influ-
ences on L2 performance. It is no exaggeration to suggest that this line of work has
led to the majority of published empirical research related to TBLT during the 1990s
and 2000s. In the current volume, Skehan and his students at the Chinese University,
Hong Kong, make two major contributions to this accumulating domain of research.
First, the empirical studies compiled here reflect a relatively comprehensive agenda of
research into key dimensions of the Tradeoff Hypothesis: Taken together, they illumi-
nate, strengthen, and extend patterns of findings previously attested in the literature.
In particular, they address the role of pre- and during-task planning, the effect of post-
task demands on during-task performance, and the relationship between greater or
lesser task structure and performance. Second, in his introductory and concluding
chapters, Skehan offers an extended and updated explanation of the theory underly-
ing his processing perspective on tasks, emphasizing the grounding of his ideas in
a Leveltian psycholinguistic model of speech production. He also provides a pains-
taking review and synthesis of findings from the studies in this volume in conjunc-
tion with previous research, thereby updating, clarifying, and expanding the Tradeoff
­Hypothesis in critical ways.
The chapters collected in this volume, based on creative and insightful research
designs emanating from a core theoretical coherence, offer concrete findings that have
the potential to inform task design and implementation for language learning pur-
poses in important ways. To be certain, the volume is about specific kinds of tasks
(relatively brief speaking tasks) that are controlled and manipulated according to a
handful of theoretically motivated principles, and the claims forwarded here cannot
be automatically generalized to all ‘tasks’ that might shape what happens in task-based
instruction. In that regard, and in order to encourage future research that builds upon
the solid foundations laid in this volume, we would like to repeat here a suggestion that
we forwarded in our preface to volume 2 of this series:
It is, therefore, perhaps not overly ambitious to suggest that a next phase in this
particular research agenda would turn to the embedded investigation of cognitive task
complexity as one aspect of TBLT educational design and implementation. Certainly,
it will be only through such ecologically valid research that the ultimate contribution
of these important ideas – in interaction with the variety of other factors at play in
long-term and otherwise complex language teaching and learning – will be realized.
We look forward to featuring such work in a future volume of this series.

Along these lines, we hope very much to see work in the near term that takes important
theoretically motivated and empirically attested ideas, like those presented in the cur-
rent volume, and explores their implementation in task-based educational p ­ ractice –
such is the potential and intent of TBLT as a truly researched pedagogy.

John M. Norris, Martin Bygate, Kris Van den Branden


Preface

Producing a book is always nice, but this book is the source of particular pleasure.
In January 2004 I took up a post as Professor of Applied Linguistics in the English
Department at the Chinese University of Hong Kong, and spent six years there. Many
things characterised this period, but outstanding amongst these were the opportuni-
ties for doing empirical research. These came in two major guises – opportunities
to apply for research grants (both internally to the university, and more importantly,
externally to the Research Grants Council of Hong Kong), and the delight of supervis-
ing doctoral students. In the former category, I was lucky enough to obtain one inter-
nal grant, and two external grants, both targeting task-based performance, enabling
me to undertake a programme of research, rather than one individual study. In the
latter case, I was extremely fortunate to supervise a succession of talented doctoral
students who were a superb combination of being individually highly motivated, as
doctoral students must be, and also willing to work within a framework. The delight
was that they each pursued a personal research agenda, but that agenda fitted within
the wider programme which motivated my research.
The result of all this is the present volume, which is an edited collection, but with
the difference, that while it has a sustained focus on task-based performance, this is
studied within certain parameters:

–– a view that attention is limited and that we must explore what the consequences
of this are
–– a concern to explore how task characteristics influence performance
–– an interest in the conditions under which tasks are done, with a certain amount
of focus on planning

The result is a collection which makes a cumulative contribution, rather than being
characterised by disparate chapters brought together through quality, but lacking a
shared focus. So, it is a source of pride to me that collectively we have been able to
produce such a volume, with the aim of contributing to the understanding of second
language spoken performance as well as the literature on second language tasks. In so
doing, we also hope to bring out the ‘researchability’ of the area, as well as its practi-
cal relevance. A processing approach to second language performance has provided
fertile to us. We hope to convince other people of its utility.
There are many people to thank in relation to this volume. The Editors of the
series deserve considerable thanks, first for being encouraging about the idea of
the volume, and then for the considerable work each has put in with the chapters
of the volume, work which has strengthened the chapters considerably. I would
xii Investigating a Processing Perspective on Task Performance

also like to thank other Ph.D. students from the Chinese University, Hong Kong,
who worked as research assistants on various of the specific research projects: Dai
Binbin, Cai Jing, and Ren Hongtao. I am also grateful in that regard to the ­English
Department at CUHK which funded this research assistance, especially Tracey
Liang, and also M.A. students who played a part, by examining and rating candi-
date tasks that we were considering.
I would also like to offer thanks to two individuals who have strongly influenced
the processing research reported here. First there is Willem Levelt, whose model of
first language speaking is the starting point for many of the studies which follow. The
structure and theoretical foundations that this model provides have been immensely
influential and had a strong guiding role. Second, there is Peter Robinson, whose
Cognition Hypothesis stands in clear opposition to my own Tradeoff Approach. I am
grateful to him for the clear opposing standpoint to my own and because we share the
frame of reference by which the different positions can be judged. The disagreement
has been amicable and stimulating, and I feel my work has benefited enormously as a
result.
Finally, to return to the institutional context in Hong Kong, I would like to thank
the Arts Faculty at the Chinese University for an internal grant that funded research
that underpins Chapter 4, and the Research Grants Council for two Earmarked Grants
which were the main basis for Chapters 4, 6, and 7, as well, essentially, for much of the
material in Chapter 10. The RGC also deserves considerable thanks for the doctoral
studentships which supported all the remaining chapters.
chapter 1

The context for researching a processing


perspective on task performance

Peter Skehan
St. Mary’s University, Twickenham

Introduction

In this chapter there is a need to set the scene, and explore why the contributing
authors were interested in tasks, task conditions, and task measurement, and why we
thought these were important enough to occupy us all for several years. To do that we
have to go back a little, since growth in interest in tasks has been a major development
in itself within applied linguistics. Communicative language teaching in the 1970s and
1980s represented a major shift in the goals and methods of language instruction rela-
tive to the structure-domination of the years before. An approach which gave much
greater importance to meaning and to language use as an important basis for develop-
ment brought about a shift in the entire profession, from the nature of coursebooks
and language teaching methodology, through assessment procedures, to the goals and
procedures of teacher education. All of these put the learner centre-stage, and saw
interaction as vital. One interpretation of a communicative approach has been to orga-
nise teaching around the use of language learning tasks, tasks which have meaning-
primacy, a focus on outcomes, and some connection with real-world language use.
In this respect, it has been fundamentally important that task-based approaches have
attracted considerable research and theoretical interest. Regarding the former I have
argued elsewhere (Skehan 2011) that the approach is distinguished most clearly by
the way claims are considered to be accountable to data so that tasks are judged not
simply by their appeal to the teacher, but also by their impact on performance, and,
ultimately, development. While there have been notable practical developments (Van
Den Branden 2006; Willis 1996) it is the research accountability that has been the
most distinctive contribution for many working in the task field, enabling a possible
move towards a researched pedagogy.
Tasks also have interesting theoretical linkages. Early approaches to researching
tasks were strongly influenced by the Interaction Hypothesis (Long 1996), and, mak-
ing the assumption that certain sorts of interactional processes are most propitious for
second language development, the initial priority was largely one of exploring how far
2 Peter Skehan

tasks might be designed and used to maximise opportunities for interactional features,
such as recasting and negotiation of meaning, which were deemed to be particularly
helpful in driving acquisition. It was assumed that the goal was to understand how
an interlanguage system develops most effectively, and good task design, empirically
grounded, was seen as the basis for this since it would generate more conversational
feedback – the oil that supported change and progress. Dangers were soon identified
with task-based approaches, and in this regard, the concept of ‘focus on form’ was devel-
oped (Long & Robinson 1998). This proposes that when communication proceeds,
there is a possibility that communicational needs will predominate, and that form will
lose focus (and with this chances of development and control being enhanced will be
compromised). In fact, however, research interpreted processes such as recasting and
negotiation of meaning as promoting a focus on form while communication itself was
still the primary goal of the encounter. In other words, communicational naturalness is
not compromised, but at the same time, conditions are being created which mean that
form is not forgotten and indeed is being nurtured through the targeted, personalised
feedback that becomes available (Doughty & Williams 1998).
Since the late 1980s a somewhat contrasting approach to researching tasks has
emerged. This strand is less concerned with interaction processes (although these still
figure (Robinson & Gilabert 2007)) and is more concerned with task performance
and the processing influences upon it. This performance has been frequently con-
ceived in terms of complexity, accuracy, and fluency. I have argued that it is possible
to conceive of an acquisitional dynamic implicit in these performance areas (Skehan
2009a), such that:

a. Complexity (or new, or emerging language) is associated with change, develop-


ment, and risk-taking, but also possible error.
b. This possible error demonstrates a need for greater control, eventually leading to
greater Accuracy, as the new language is used with greater facility. But although
error may be avoided, performance may be halting and slow and probably reliant
on a rule-based system which has not yet been automatised.
c. The next stage is to acquire even greater control, to proceduralise, and to produce
correct language Fluently, without excessive interruptions to flow, and without
the need to apply rules with awareness.

The boldfaced terms are the three areas (complexity, accuracy, fluency) which are
more frequently measured in studies exploring task characteristics and task conditions
and have, recently, been the major focus for a book (Housen, Kuiken & Vedder 2012).
Making the assumption that these three dimensions (which have been shown to be
distinct from one another; (Skehan & Foster 1997; Tavakoli & Skehan 2005) are a good
reflection of performance, the goal is to explore what makes it more likely that each
The context for researching a processing perspective on task performance 3

will increase, whether as a function of the task or of the way the task is done. However,
if it is the case that where attentional resources are limited, the natural priority, in a
communicative context, is to emphasise meaning, rather than form (Van Patten 1990,
1996), the danger would be that form can lose focus, and that advanced language, or
control over less advanced language, might be sacrificed to the primary goal of achiev-
ing fluency and meaning expression.
While this changed analysis of performance itself is important, what is of even
more significance is how influences upon that performance are researched, because
there has been a clear switch in general framework. This has involved a move towards
a more cognitive approach, one in which the functioning of attention and working
memory have become more central. While previous studies had considered factors
which were cognitive in nature (associated with the processes of successful negotia-
tion for meaning), these were not often interpreted within wider cognitive theory.
Researchers did not explore how a focus-on-form which arose during communication
(and which would be prominent in working memory) would then make the transi-
tion to long-term memory, or how many such exposures would be necessary to assist
this transition (but see Doughty (2003) for discussion of this issue). In this light, two
frameworks for studying tasks can be usefully contrasted. My own is to see limitations
in attention as fundamental to second language speech performance, an assumption
which leads to the need to explore what attentional and working memory demands
are made by a task, and the consequences this may have for different performance
dimensions. More demanding tasks are assumed to be likely to lead to prioritization
of fluency over accuracy and complexity – what has become known as the ‘tradeoff ’
hypothesis. Consistent with this view is the suggestion that tasks based on familiar or
concrete information favour a concern for accuracy, as do tasks which contain a post-
task phase. Similarly interactive tasks, or tasks requiring transformation or manipu-
lation of material, or tasks which have had pre-task planning might lead to greater
linguistic complexity. The fundamental principle here then is that demanding tasks
can create problems for a learner/ second language speaker because of processing limi-
tations, and that one can explore methods of mitigating these difficulties, and even try-
ing to nurture improved performance in all dimensions, through effective use of task
choice and task conditions which overcome attentional limitations.
In contrast to this is the position advocated by Peter Robinson, in the form of the
Cognition Hypothesis (Robinson 2001, 2011). He proposes that attention is not con-
strained in the same way as the Tradeoff position argues, and that it can expand to deal
with the demands placed upon it, under certain conditions. Further he proposes that
task complexity (a construct he discusses at some length) is what drives performance,
and that greater task complexity simultaneously raises accuracy and complexity. The
Tradeoff position, in contrast, argues that the range of attentional demands involved
can cause tasks to become more difficult and that a very common manifestation of
4 Peter Skehan

this will be complexity and accuracy being in competition with one another for these
limited resources, with the result that capacity given to one of them will be at the
expense of the other. Apart from arguing that task complexity can increase accuracy
and complexity simultaneously, Robinson also proposes that fluency will be lowered
when there is greater task complexity, an influence on which Tradeoff is generally neu-
tral, since task complexity is seen as influencing what is said rather than how it is said.
Interestingly, therefore, the field has a constructive dispute regarding the impact on
difference performance dimensions of making tasks more complex (Robinson 2011)
or difficult (Skehan 1998). Much research has been generated by researchers attempt-
ing to demonstrate that one position or the other is better at accounting for results –
something the present volume will also attempt to do!
It is clear that the Cognition Hypothesis is more ambitious than the Tradeoff posi-
tion. It is more wide-ranging and comprehensive in nature. It also has been the basis
for applications to pedagogy of a fairly extensive nature, especially as regards curricu-
lum or syllabus design (Robinson 2011). It even has the virtue of making what, for me,
are counter-intuitive predictions, predictions of the sort that are likely, if sustained, to
make unanticipated contributions to the field. In contrast, Robinson (2007), in com-
menting on the Tradeoff position, has suggested that it is vacuous in comparison to the
Cognition Hypothesis, arguing that it does not lead to predictions, so much as to post-
hoc rationalisations of results. Cognition, in principle, should not have this weakness,
since predictions should flow from it rather readily.
So it is useful at this point to clarify what the status of the Tradeoff Hypothesis is (in
an attempt to show that it is not vacuous), and the nature of the foundation it provides
for the chapters in this volume. The starting point here is that I do not think we are,
currently, able to put forward strong and wide-ranging models of task performance. It
seems to me that three points of reference are vital. First, we do need to use what we can
from neighbouring disciplines. In that respect, I have argued elsewhere (Skehan 2009a)
that a model of first language speaking, such as Levelt’s (1989, 1999; Kormos 2006) has
to be the starting point for a credible analysis of the psycholinguistic processes involved
in second language speaking. This model (Levelt 1989) is impressive, but it targets a
first language speaker equipped with a first language mental lexicon. It is obviously
not immediately transferable to the second language case, but it does contain struc-
tures and processes which are bound to relate to whatever is done in second language
speaking. So it becomes, for me, an inevitable starting point, even if it has been shown
to have certain limitations for this different context (De Bot 1992). Second, against the
background that this model provides for organising our thinking about second lan-
guage speaking, we then need to explore how attentional and working memory limita-
tions are important in accounting for the differences between first and second language
speaking: this is where the Tradeoff perspective comes in, because it assumes that the
existence of a far less impressive mental lexicon will have strong influences on how
The context for researching a processing perspective on task performance 5

second language speaking will proceed. Analysing second language speaking through
the Levelt model and its component stages allows us to make sense of where and why
problems might occur. The model can bring out the pressures which cause what ideally
should be a parallel process (Conceptualiser, Formulator and Articulator functioning
simultaneously and in, modular, automatic fashion) to become serial and effortful. In
this way, we have a sounder basis for making predictions about performance (as some
of the later chapters will show). Without such underpinning psycholinguistic theory,
it is difficult to see how we can make much progress. That is, in order to hypothesise
the effects of task complexity or difficulty on performance, it is essential to understand
the kinds of psycholinguistic processes that underlie the production of linear stream
of speech. Third, as a foundational target, we need to establish a wide range of gener-
alisations about patterns of performance and to gain understanding about important
variables, in other words to establish a database of findings, before we can go on to build
effective models for the second language case. Such models are desirable, obviously,
but it serves no-one’s interests if what is put forward is premature. The various research
studies in this volume are an attempt to gain understanding about major influences on
second language performance as a precursor to model building. Even so, on occasions
predictions are possible, even if they are quite limited in nature.
So, given the absence of a convincing model of second language speaking, one has
to have some framework for research to counter any tendency for individual studies to
be conducted in a piecemeal fashion, and to run the risk that they do not contribute to
any coherent picture. It is for that purpose that I have put forward a general framework
for the investigation of tasks, a framework which has the potential to organise findings
as they emerge. The outline of the framework is shown in Table 1:

Table 1.  A framework for investigating second language task performance


Task
–– task types and characteristics
–– task difficulty
Task Conditions and Implementation Phases
–– pre-task: preparedness, such as planning, repetition, familiarity
–– during task: task processing
{{ time pressure

{{ support (e.g. visual)

{{ information pressure

{{ negotiability and mediation

–– post-task
{{ post-task activities

{{ post-task exploitation

The framework is not intended to provide any theoretical insights. Instead, it is


based on fairly direct features of tasks and their implementation which at least means
6 Peter Skehan

that application to real situations where tasks are used is facilitated. First of all, we have
tasks themselves, and here a distinction is made between task types and characteris-
tics and task difficulty. The second of these, task difficulty, where difficulty is seen as
inherent in the task, rather than learner-dependent, has, in my view, seen surprisingly
little progress. We are little closer now to having a scale of difficulty which could be
used, for example, to locate any task within a more extensive syllabus. There may be
features which can be argued to have simpler or more difficult values, such as number
of elements, or concrete versus abstract (and some of these figure in Robinson’s analy-
sis of task complexity). So given two tasks, difficulty ranking might well be possible.
But there is the problem that any task is likely to subsume a bundle of features, and
not all of these features are likely to be jointly simpler or jointly more complex, such
as a small number of concrete elements versus a larger number of abstract elements.
Further, tasks, given their nature, are likely to be strongly influenced by context, and so
what is difficult in one (pedagogic) context or for one particular learner may not be so
difficult in another, through, for example, cultural knowledge or age differences. Then
we have the difficulty that many (good) tasks are capable of multiple interpretations, so
that one person could interpret a given task to make it more difficult than another (this
connects with the wider issue of the predictability of tasks). Foster and Skehan (1996)
illustrated this with different participants making radically different interpretations of
the depth at which they should address judgements about custodial sentences for some
crimes they were given to adjudicate on. Overall then, although some progress has
been made on establishing relative task difficulty, a lot of issues remain to be unraveled
before we can reach a position to make any sort of reliable and valid judgement about
a particular task and the identification of factors that impinge upon this.
In contrast, the study of task characteristics has seen greater progress. This
focusses, in a more micro way, on the relationship between specific task characteristics
and particular performance features. Within the constraints of variation through con-
text differences and different task interpretations by different participants mentioned
above, which push for less predictability, the search here is for connections to perfor-
mance from analysable task features, such as type of information (concrete-abstract;
familiar-unfamiliar material) or organisation of this information (e.g. structured-
unstructured). There is a range of findings in this area already (Ellis 2003; Skehan
2001; Foster & Skehan 2012), and we hope to contribute more through this volume.
The Tradeoff approach, fundamentally, tries to uncover such generalisations regard-
ing the link between task characteristics (concreteness, familiarity) and performance
dimensions (complexity, accuracy, fluency), and use them to gain a better under-
standing of how the Levelt model can illuminate the case of second language learners.
A  range of generalisations can then provide a more robust basis for understanding
second language performance, as is discussed in the final chapter of this volume where
the impact of influences such as information familiarity, and task structure on differ-
ent aspects of performance is discussed.
The context for researching a processing perspective on task performance 7

Task characteristics, as it happens, are analysed differently by Peter Robinson. The


Cognition Hypothesis makes a big thing of the distinction between resource-directing
and resource-dispersing factors. In essence, resource directing is very close to the sort
of selective influence discussed here – influences (independent variables) which have
predictable and close relationships with particular aspects of performance. These may
be specific within form, for example, promoting more feedback, or engaging specific
language features such as relativisation or article usage. Alternatively, they may be
more general in impact, as, for example, when (putative) task complexity simultane-
ously raises accuracy and complexity. Resource-dispersing factors, such as planning,
have a more general impact on attentional resources and functioning, and thereby
performance, and do not lead to predictions such as that of joint accuracy-complexity
increases (and so resemble more the approach taken by a Tradeoff approach).
This treatment of types of variable is a fundamental difference between Cognition
and Tradeoff. A Limited Attentional Capacity approach does not have any place for
a distinction between resource-directing and resource-dispersing variables. Rather it
pursues the goal of finding links between a whole range of variables and performance,
and sees no common quality which unites, for example, resource-directing variables. It
explores variables on a case-by-case basis, and tries to use findings from such research
as a basis for wider theoretical claims, such as adaptations of Levelt’s model to second
language spoken performance (Kormos 2006; Skehan 2009a). Research designs within
the Tradeoff approach, therefore, do not probe the functioning of any such construct
as ‘resource directedness’. The two approaches do have in common the usefulness of
task as a unit for research. However, from that departure point, as we will see, they
diverge, and the various chapters to follow in this volume illustrate the richness of
being unconstrained by any need to look at categories of variable, or to use these to
motivate research designs. Even so, both positions take task as a unit for research very
seriously, and seek to establish whether we can understand how specific task charac-
teristics influence performance in a useful way.
Within the framework in Table 1, we turn next to task conditions and implemen-
tation phases. The phases are essentially before, during, and after. Naturally, we start
with the pre-task phase. The label given here is ‘preparedness’, which is intended to
bring out the generality of this phase. Task researchers have mostly interpreted this
phase as pre-task planning (an interpretation important for some chapters in this vol-
ume). But there is more to preparedness than this. Pedagogically, Willis (1996) for
example outlines the range of activities that can be used to get learners ready to do
a task more effectively, through carefully constructed pre-tasks, or development of
splash diagrams, or input from native speakers. Linking more directly to the research
literature, there are other aspects of preparedness than planning. Having already done
something similar (or identical) to the task before would be a factor. A special form of
this would be repeating a task, since then one could look on the repetition as the ‘more
prepared for’ version of the task. Familiarity with the information in the task would
8 Peter Skehan

be another type of preparedness, as more generally, would be the greater relatedness


of the task to one’s real life encounters, experiences, or interests. In this case, the task
itself, in a particular form, might never have been done before by particular students,
but the ideas which feed into the task would be accessible and organized from other
prior experiences. So, to sum this up, the pre-task phase contains planning, but a lot
more besides, as we shall see later, and as Bui (this volume) discusses extensively in
his chapter.
The impact of what students do after a task has also been researched, and proved
interesting. Two aspects of this are shown in Table 1.1. First, we have post-task activi-
ties, whose role is to change the way the earlier task was done. Here it is the anticipa-
tion of the post-task, and the way this signals that doing the task is not the end of
things, that is important. As we will see, this is a growing area of research (Lynch
2001, 2007) and one which links with concepts of focus-on-form nicely. But second,
we have what is termed post-task exploitation. The focus here is on the subsequent use
for pedagogical purposes of language that has been made salient by a task. Language
whose importance emerges in this way can be timely for development and consolida-
tion by teachers. This has not been an area associated with much research (though
see Samuda 2001), but the possibility beckons. So far we have only had discussions of
pedagogic possibilities (Skehan 2011, 2013), but there is considerable scope for more
systematic empirical study.
From the above framework, it remains to consider the during-task or task pro-
cessing stage, referred to in the table as ‘task processing’ This area concerns options in
processing, and how a task will actually run, bringing in issues of time pressure (and
opportunities for on-line planning, or not), information pressure if a lot of input is
built into the task, and support while the task is being done, as well as the scope there
is for the person doing the task to shape what is happening, to influence its goals and
content and to slow things down or divert it if that is helpful. All these factors can
have a considerable impact on performance, as we have seen through Ellis’ discussion
of on-line planning, and Robinson’s views on time perspective – his Here-and-now
versus There-and-then conditions essentially pit input prominence against visual sup-
port, after all. So, whatever the basic task is, processing conditions can have an inde-
pendent impact on performance.
All the factors shown in Table 1 may have an influence, but there are a lot of dimen-
sions here, and research has only established a partial understanding of their various
impacts. The purpose of the framework is to try to summarise and organise what has
been done, and what remains to be done, and to do so in a way which does not pre-
judge theoretical issues. Taking the example of planning, we need to know more about
what happens when planning takes place before we can decide how it fits in theoreti-
cally. It is located as a ‘resource-dispersing’ variable in the Cognition Hypothesis, that
is, relevant because of its impact on resources, but without any predictable influence on
The context for researching a processing perspective on task performance 9

performance. But it is possible that, depending on the nature of the planning activities,
it could equally well be a ‘resource-directing’ variable (in Robinson’s terms) and linked
to particular aspects of performance (such as accuracy). Without relevant research, we
cannot know. Similarly, staying with the assumption in the Cognition Hypothesis that
time perspective is seen as a task complexifying variable, a framework such as that in
Table One allows us to explore visual support and input dominance (which both oper-
ate in the Here-and-now condition) separately, and not assume that a construct such
as task complexity needs to be invoked. The framework also allows interactions to be
explored. It is a simple matter to hypothesise that different variables have a conjoint
effect (i.e. condition-seeking research; McLaughlin 1980), such that together they pro-
duce an effect that is more than the sum of the parts, such as for example planning being
explored in relation to more complex tasks; or structured tasks being studied in relation
to There-and-then processing (see Wang & Skehan, this volume).
So, a framework such as the one shown has to be judged by its utility, by its capac-
ity to organise and generate interesting research results. The ultimate aim, though, has
to be model building, and a more theoretical account of performance (and possibly
development). In my view, the Cognition Hypothesis has rather jumped to this stage
before it has established an adequate empirical grounding. So I would prefer, as a theo-
retical position, something like a modified version of the Levelt model of first language
speaking, adapted for the second language case, and which takes account of the differ-
ences in these two cases, such as a less elaborate second language mental lexicon. This,
at least, gives us some theoretical credentials. But accountability to a range of findings
is fundamental. One has to remember the old saying “logic is the art of going wrong,
with confidence” to moderate our natural tendency to over-theorise. In any case, as we
shall see, the studies reported in this volume fit into the above framework quite nicely,
with several studies of planning, one of the post-task phase, and a number looking at
task characteristics, principally task structure. As we will see in the final chapter, the
framework enables us to consider just how ambitious models in this area can be. But
for that, we need to look at the individual studies in the volume.

The structure of the book

There are eight empirically based chapters in the book, all based on data collected dur-
ing the time I worked in the English Department at Chinese University. They are based
either on Hong Kong Research Grants Council funded studies (three), all of which
were motivated by the framework from the last section and by my interest in the com-
parison of Tradeoff or Cognition accounts, or on individual Ph.D. dissertations that I
supervised (three) and these came from students interested in similar issues, but based
on research problems that intrigued each of them.
10 Peter Skehan

Three of the chapters are concerned with planning, and we will start with these.
Chapter 2 is by Zhan Wang (Jan), and is based on her Ph.D. at Chinese University. Jan
started out interested in general planning, and so examined the literature for inter-
esting possible research questions. She became intrigued by Ellis’ notion of on-line
planning (Ellis 2005). Planning, in general, is benign in its influence, and is associ-
ated with raised task performance, in a fairly general way. But the generalisation that
emerges in the literature is that complexity and fluency are consistently increased,
with large effect sizes, whereas accuracy is not so dependably affected, and when
it is, the effect sizes are smaller. This set of findings has been around for some time
now, and Ellis’ aim was to shed light on why accuracy seems to be more difficult to
influence through planning. He proposes that one can distinguish between pre-task
(or strategic) planning, and on-line planning. Pre-task planning is done, obviously,
before the task itself, with time allocations for this varying, but typically lasting ten
minutes. This, Ellis proposes, is good for complexity and fluency. On-line planning,
he proposes, is the sort of planning which takes place ‘on the fly’ while speaking is
taking place and speakers reorganize their speech while continuing to talk. The Levelt
model fits well with these two types of planning. The model contains modular stages,
so that initial Conceptualisation is followed by different sub-stages within the mac-
rostage of Formulation, and then Articulation, the actual speech production stage
completes the process. For any individual speaker all stages operate in parallel, since
different things are happening at the same time in each. Current Formulation, for
example, is the result of previous Conceptualisation, while current Conceptualisation
is yet to impact on the Formulator, but soon will. (See Wang, Chapter 2, this volume,
for a more extensive discussion)
Ellis proposes that when processing conditions are demanding, the second lan-
guage speaker has difficulty in sustaining this parallel processing, and as a result,
accuracy suffers. In contrast, when processing conditions are less demanding, it is
possible for the speaker, even the second language speaker, to give attention simul-
taneously to Conceptualisation (i.e. preparing plans to be ready for the next stage),
while at the same time devoting enough attention to current Formulation, thereby
achieving greater levels of accuracy. Jan followed this reasoning, but was unhappy
with Ellis’ actual operationalisation of this distinction between planning types.
She felt there was scope to introduce modifications to distinguish between the two
planning types more clearly. So her basic aim was to introduce a methodologi-
cal improvement. But she also wanted to explore more about Levelt’s third gen-
eral stage, Articulation, and she linked this with the use of a Repetition condition.
She reported a set of results which bring out the usefulness of pre-task planning,
and also that of on-line planning, and most interesting of all, of their synergistic
effects in combination. Repetition, too, proved to be a rewarding variable to have
worked with.
The context for researching a processing perspective on task performance 11

Bui Hiu Yuet Gavin (Chapter 3), also looked at planning, but in a different though
similarly creative way. As we have just seen, the typical research design in the plan-
ning literature is to give second language speakers ten minutes to plan before they
do a speaking task. But planning, more broadly, is an aspect of preparedness (see the
earlier section), and this is much wider in scope. Ten minutes are given, after all, to
plan something you had no idea about moments before. However, preparedness can
take many other forms, such as having told the same story before (and see Jan’s use of a
repetition condition in her chapter). Or it could mean being more deeply f­ amiliar with
what is talked about and even talking about something which is important already
in one’s life. Bui takes just such an approach in his study. In a clever research design,
he compares the effects of conventional planning (the approach that is typical in the
literature) with the effect of speaking about something familiar. Not only does he pro-
vide interesting results on this issue, he also puts forward a model to cover the various
senses of planning hinted at earlier in this paragraph and the previous section (i.e.
including on-line planning). He prefers the term ‘readiness’ to capture this wider view
of planning. In this way, he contributes to enabling more sophisticated use of the con-
struct of planning in future research.
The third chapter on planning (Chapter 4 in this volume) is based on a study
conducted by Francine Pang and myself as part of a Hong Kong RGC grant. Once
again the starting point is that the planning literature is extensive, that there are now
‘attested’ findings, but that there is more work to be done, particularly at the explana-
tory level. Specifically, there is the issue that although we have a range of findings,
we have tended to ‘black box’ planning, and embed it within quantitative research
designs. Increasingly studies do interview participants after planning (Tavakoli &
Skehan 2005), but this tends to be only to ask if they thought the planning time was
worthwhile, and whether they thought they benefitted. What is missing is thorough
research on what participants say they do when they plan, although there is one major
exception to this – the work of Lourdes Ortega (1995, 1999, 2005). However, as Ortega
herself states, it is remarkable that so little qualitative research has been done to ‘peer
inside’ planning processes. The study reported here is an attempt to redress this state
of affairs, a little at least. We gave participants a narrative to tell, and then Francine
engaged them in retrospective interviews (RIs), probing what they had done during
the planning time that was available. She then developed a coding scheme to catego-
rise the various processes they reported engaging in, a coding scheme which started
from the transcribed interviews, but which, as it happens, can be related to elements
of Levelt’s model of speaking. Next we did something we have not found anywhere in
the literature. We looked at the association between the planning behaviours which
were reported and the actual performances which were produced, generally with the
intention of exploring whether some planning behaviours are more effective than oth-
ers. The chapter reports on how we made sense of the successful behaviours. But it also
12 Peter Skehan

gives an account of something which surprised us. It was just as important to discover
which reported planning behaviours were harmful to performance, or at least to cer-
tain aspects of it. So it isn’t simply what you do during planning that counts. It’s just as
important to know what you shouldn’t do.
There is one more study which focusses on a task condition: Chapter 5 by Li Qian
is on what happens after a task, rather than before it. Li Qian (Christina) had become
interested in research that I had done with Pauline Foster (Skehan & Foster 1997;
Foster & Skehan 2013) which had explored the impact on task performance of antici-
pating what activity will follow the task. We had shown, tentatively at first (­Skehan &
Foster 1997) but more robustly later (Foster & Skehan 2013), that a post-task activity
can have focused effects on performance. Our initial hypothesis had been that post-
task effects are confined to raising accuracy, as was the case in Skehan and Foster
(1997). The second of our studies (Foster & Skehan 2013) had shown that anticipa-
tion of the need to transcribe some of one’s performance post-task did raise accuracy,
with narrative and decision-making tasks, but also raised complexity with the second
of these tasks. We had hypothesised that a post-task activity would raise pedagogic
targets and induce participants to try to avoid error. In the event, the post-task activity
seemed to impact upon form in general, and also led participants to use more complex
language on one of the two tasks. Christina was interested in this, and liked the way
we had shown that self-transcription had desirable effects. But she felt that post-task
transcription was something of a blunt instrument, as we had used it (though she was
too polite to put it like that), and that there was scope to explore if different opera-
tionalisations of post-task transcription might have different effects on performance.
She complexifies what is possible with a post-task manipulation, using individual vs.
group-based transcription, and transcription with or without rewriting of an ‘ideal’
version. The chapter reports on her study, and shows that the impact of post-task tran-
scription is indeed more complex than had been thought. It also enables another point
to be made, one that could be brought up elsewhere, too. All the studies reported in
this volume have L1 Mandarin or Cantonese speakers, and the data was collected in
Hong Kong, Macao, or in Guangzhou. There are obvious issues of generalisation here,
and one can ask whether the research is relevant for people outside this relatively nar-
row geographical context. Christina’s research is interesting, however, because she is
partially replicating what had been done elsewhere (with a range of different L1s in the
Foster and Skehan research). The fact that she produced results which compare quite
well with those from the earlier studies does give us confidence that generalisation is
indeed possible, and that the findings reported in this volume do not apply only to
particular L1s.
We turn next to studies which have explored task characteristics. First of these is
the chapter I wrote with Zhan Wang (Chapter 6, this volume), which is the product of
an RGC grant on which she was a researcher. In the introductory section, I ­mentioned
The context for researching a processing perspective on task performance 13

the competing merits of the Cognition and Tradeoff approaches to understanding


task performance. The Cognition approach predicts that task complexity will raise
accuracy and complexity simultaneously. The Tradeoff approach proposes attentional
limitations as a constraint on performance, but does not at all preclude accuracy and
complexity both being raised simultaneously. Indeed people connected with Tradeoff
have published research to this effect (Skehan & Foster 1999; Foster & Skehan 2013;
Tavakoli & Skehan 2005). The Tradeoff interpretation of this kind of finding is that
separate influences, if they apply in combination, work together to produce the jointly
raised effect. The study reported on here builds on the (somewhat accidental) results
from these other studies, and puts the relevant variables into the research design. It
looks at task structure (a clear influence that has emerged in the literature) and time
perspective (a central variable in the Cognition Hypothesis, and one which has gener-
ated remarkably little supportive evidence for it). The study predicts that the conjoint
influence of these variables will produce a simultaneous accuracy-complexity effect,
but for totally different reasons than the Cognition Hypothesis would propose, that
is, nothing to do with task complexity. The study incorporates another variable, lexi-
cal difficulty, as an additional potential influence on task performance, on the basis of
other post-hoc analyses of previous studies (Skehan 2009b).
Structure also figures in the next study, co-written with Sabrina Shum (Chapter 7),
and also the product of a Hong Kong RGC grant. One of the issues in the literature is
that structure tends to have been investigated with cartoon picture series. This volume
has more than one study where the focus of a narrative is video-based retelling. That is
the case with the Shum-Skehan chapter. Mr. Bean, an unsung hero of applied linguis-
tics research, is the basis for a series of videos which vary in their degree of structure.
The first part of the study looks at the effects on performance of levels of structure,
defined with reference to discourse analysis research, in the context of retellings while
the video is running (and therefore putting some considerable processing pressure
on the participants). The second dimension of the study is to look at processing con-
ditions. One comparison here is the Robinsonian time perspective (Here-and-now
versus There-and-then). But the study also includes variations on the Here-and-now
condition, with the attempt made to provide some degree of mitigation to see if this
can help the narrators by easing processing pressure, even with a video rolling in real
time. The study adds considerably to our understanding of the importance of the vari-
able of structure, and a little to our understanding of processing.
The final chapter, written by me, attempts to summarise and extend the findings
from the eight empirical chapters, and to use them, where appropriate, in relation to
pedagogy. The theoretical-empirical first half of the chapter has two broad goals. First,
it takes some of the findings which cut across the separate studies, and relocates them
within the literature. There is an extensive analysis of planning and this is related to
existing models of speaking and task performance. The analysis incorporates the wider
14 Peter Skehan

view of preparedness, of the role of familiarity, of on-line planning, and of repetition.


There is also an analysis of structure, and how this relates to performance (and even to
planning). The findings from all three of the RGC projects demonstrate that structure
is a key aspect in assisting second language speaking. There is also some discussion
of the influence on performance of processing pressures, and the way these pressures
can be mitigated. Second, previous attempts to organise how task and condition influ-
ences impact upon performance (complexifying, easing, pressuring, and focussing)
are reviewed and extended. They become the basis for examining the conditions under
which second language learners are more likely to sustain parallel processing (and so
function consistently with the Levelt model) as opposed to being ‘pushed down’ to a
serial mode of processing (Kormos 2006; Skehan 2009a).
The remainder of the final chapter is concerned with pedagogy. None of the
research studies was directly concerned with pedagogy, but they do have implications
for it. The chapter explores these implications, and extends them in two ways. First, it
updates a set of pedagogic principles I first put forward in 1998, and tries to link these
principles with task research findings. Second, the chapter presents the argument that
the post-task phase is the key phase if one is to make links between actual performance
and longer-term development and change.

Measurement issues

We have now set the scene for the chapters which follow, and we have introduced each
chapter separately. But there is one additional issue which cuts across all the stud-
ies, and that is how performance was measured. All studies reported in this book use
quantitative data (even the qualitative study of Pang & Skehan). As much as all studies
were conducted within the research framework outlined earlier in this chapter, they
were all based on (roughly) the same approach to measurement, and so it is useful here
to outline this approach. This saves repetition within the individual chapters. It also
offers suggestions for methodological progress in the field, since a fairly comprehen-
sive set of measures is being proposed.
It is worth saying at the outset that there are many things which could be mea-
sured in task performance. However, since such measurements are time-consuming,
what is chosen is invariably chosen at the expense of something else. Interactional
moves (Long 1996), symmetry (Van Lier & Matsuo 2000), discourse markers, con-
versational feedback (Lyster & Ranta 1997) are all possibilities and have been used by
others. But in the present case, and continuing to follow a rather cognitive approach,
the focus will be on complexity, accuracy, fluency, and lexis (Skehan 2009a; Housen &
Kuiken 2009). These dimensions have been used in a huge number of studies now.
They were introduced earlier, with the point that studies have shown independence
The context for researching a processing perspective on task performance 15

between these areas – higher proficiency does not simply mean that people score gen-
erally higher in each dimension. In fact, they can often function very distinctly from
one another, and so it is interesting in itself to explore when they correlate with one
another and when they do not.
Given that these areas are the focus of measurement, one still needs to discuss the
issue of specific versus general measures. Some researchers (e.g. Crookes 1989; Ortega
2005; Robinson et al. 2009) prefer to use specific measures, of, for example, article usage,
or verb concord, or pronoun use. Such a preference may have strong supportive argu-
ments, with the idea that specific measures have greater construct validity, and that
provided one chooses appropriately, individual measures can be used to detect the influ-
ence of experimental conditions. For example, specific measures can reflect the nature
of the task chosen. The use of pronouns, for example, might be justified in this way
with a narrative retelling where clarity of reference is particularly important. The cen-
tral problem with this approach, in my view, is not at all theoretical, but only practical.
When one is working with second language spoken performance, one has to work with
relatively brief performances, often less than five minutes in length. These, not infre-
quently, generate below two hundred words. The difficulty, therefore, is that there may
not be enough tokens to work with. If one wants, for example, to work with pronouns,
it is quite possible that in two hundred words or so, there may not be enough examples
of pronouns (or appropriate pronoun contexts) to give the sensitivity that is required to
detect differences between experimental groups. This, obviously, is a great limitation. It
is for this reason that we have, in this volume, preferred to work with generalised indi-
ces. These do not focus on particular areas, but use measures which draw on as much
of the sample as possible in order to have a sufficiently rich sampling of data. One loses
in precision of hypothesis-making, but one gains in detecting influence. (Logically, one
might use a two-step strategy here – the first phase would try to detect influences which
are strongest, through general measures, and the second phase, in follow-up research,
could use this information with specific measures which would then be more likely to
be sufficiently sensitive).
Next, we need to explore how exactly we used these general measures of complex-
ity, accuracy, fluency and lexis. Before that, though, some general discussion of analytic
procedures is necessary. The CHILDES system (MacWhinney 2000) exists to facilitate
data transcription (through the CHAT set of conventions), with subsequent analysis
of data possible through the associated CLAN suite of programs. The approach was
developed for first language acquisition data but is increasingly used for second lan-
guage spoken performance also (Marsden et al. 2003). It can be very useful, and so
the data I have been associated with for some time has been transcribed in the CHAT
format. But the programs in CLAN, excellent though they are, do not really provide
clear indices relevant to the measurement profiles we want to work with. Accordingly,
in all the research which follows, data is coded in a modified CHAT format, in that
16 Peter Skehan

additional timing information is provided, capturing the beginning and end points of
each AS-unit, and then an extra line is added to the coding for each AS unit (Foster
et al. 2000), and this line contains codes relevant for the calculation of a range of com-
plexity, accuracy, fluency and lexis measures. These will be described more fully below.
The issue, then, is how to analyse the additional fourth line. This is done, for all the
chapters in this volume, through the use of TaskProfile, a computer program written in
Delphi, which outputs a wide range of measures. The disadvantage of this is that tran-
scription and coding have to follow a set of conventions exactly. The advantage is that
once the time-consuming transcription and coding are done, the program generates
results virtually instantly. In addition, there is the advantage that if additional ideas
about performance emerge, new measures can be developed and incorporated into the
program fairly easily, and then new results obtained. Accordingly, the next section will
outline the measures that are available. Obviously the focus will be on the measures
which have actually been used in the studies that follow, but brief mention may also
be made about other measures which are output by TaskProfile, since, methodologi-
cally, they could have value for other researchers. The following sections will explore
measures of complexity, accuracy, fluency, and lexis.
The ‘standard’ measure of complexity which has been used in many task-based
studies is that of degree of subordination. No-one believes that subordination, in itself,
is complexity, but it is taken as a good, general-purpose surrogate measure. CHAT
codings are in terms of AS units, a measure Foster et al. (2000) argue is more appro-
priate for spoken language than the T-unit, and then TaskProfile computes the ratio of
total clauses, that is, main clauses plus other clauses, finite and non-finite, to AS units.
The minimum value here would be 1, with no subordination at all, so that the num-
ber of total (matrix) clauses and the number of AS clauses are identical. Typically, for
second language speakers, one gets values above 1.2, generally but not always below 2,
with group means often in the range 1.4 to 1.6. This index has been used widely and
has been shown to be sensitive to experimental differences in a consistent way. How-
ever, it is far from the only method of assessing complexity. Measures of range of struc-
tural use have also been used (Foster & Skehan 1996), but their use is not widespread.
More recently, Norris and Ortega (2009) have proposed that the subordination mea-
sure is not so effective at higher levels of proficiency. Indeed, studies which have native
speaker baseline data provide some supportive evidence for this, since native and non-
native speaker groups often do not differ very much on subordination scores (Skehan
2009b). Norris and Ortega (2009) propose instead that measures based on the number
of words in clauses capture a different dimension of complexity, and that this is more
sensitive to differences at higher proficiency levels. Accordingly, TaskProfile computes
the scores for number of words in AS units, in matrix clauses, in finite subordinate
clauses, and in non-finite subordinate clauses. Several of the chapters draw on this
possibility as appropriate and in so doing allow an investigation, in passing, of the
construct validity of the two types of complexity measures.
The context for researching a processing perspective on task performance 17

The next performance area to consider is that of accuracy. Here the ‘standard’
index is to compute the proportion of all clauses that are error-free, so that clearly we
are dealing here with values between the minimum of 0 and a maximum of 1. This
index too has been very serviceable, and has been used in very many studies. On the
basis of this work, one could claim that the index is a good way of detecting a differ-
ence if there is one. But although it may be the most widely used method of measur-
ing accuracy in task-based performance, it is not the only option. Mehnert (1998)
proposed that the measure is influenced by the clause structure of the language being
used, and that for L2 German, a more appropriate measure is errors per 100 words.
She proposes that this is a better general measure, since more or less ‘clausality’ in a
language does not affect it, and so it has greater crosslinguistic comparative utility.
Skehan and Foster (2005) introduced a yet different method of measuring accuracy.
They were worried that an error-free clauses measure was vulnerable to distortion
in cases where a speaker used a large number of very short clauses in their speech,
with these clauses being more likely to be correct. The resulting score, they proposed,
might be inflated, and not constitute a ‘true’ index of accuracy. So they proposed
building in to a measure of accuracy a safeguard through using clause length. Their
proposal is that one ranks all the clauses that have been produced for number of
words. Hence, one would bring together all two word clauses, all three word clauses,
and so on, up to whatever length of clause is produced. Then they propose calculating
the proportion of clauses that are correct for each length. Finally, one takes this infor-
mation, establishes a criterion, and then establishes the cutoff point that a particular
participant has reached. So, if someone produced the following data: 2-word, 100%
correct; 3-word, 100% correct, 4-word, 90% correct, 5-word, 80% correct, 6-word,
70% correct, 7-word, 60% correct, 8-word, 50% correct, 9-word, 30% correct, and if
one had set the criterion of 70% correctness, then this speaker would be awarded a
score of 6, since 6 words is the highest length that is being produced at the requisite
accuracy.
Of course, not all speakers are considerate enough as to produce scores which
lend themselves to scoring so neatly. Skehan and Foster (2005) therefore propose deci-
sion rules to handle more difficult cases. If a speaker, for example, fails a criterion at
a particular level, but then produces the next two clause lengths at criterion or better,
they are excused the ‘blip’ of the one level where they failed. But this only applies if
there is one blip. If they fail at more than one level consecutively, the score is given as
the length of clause at the last level that reached criterion. This additional rule handles
difficult cases very well, and so this becomes a reliable measure to use. It is important
to say that this illustrates the advantages of using a computer program to score coded
spoken language performance. As far as TaskProfile is concerned, there is negligible
additional effort in scoring accuracy in this way. The decision as to the score to be
assigned is done manually, that is, by the researcher, but this is based on the data which
is laid out by the program in tabular form, and so is the work of an instant.
18 Peter Skehan

As a result, we now have three accuracy measures: error-free clauses, errors


per 100 words, and what has been termed ‘length accuracy’. There is, however, one
more potential problem that is relevant for one or two of the chapters in this volume.
Foster and Wigglesworth (2010) propose another threat to the validity of accuracy
­measurements – that they treat all errors alike, however serious or trivial they might
be. They propose a scheme to capture error gravity, suggesting that three levels of
error should be distinguished, broadly through the extent to which they impair com-
munication. At the lowest level, if an error does not impair communication or slow
down comprehension except minimally, then one should categorise this as a superfi-
cial error. More seriously, if the hearer can understand, but has to make some effort to
do so, perhaps with a little delay, this should be regarded as an intermediate level of
error. Finally, errors that compromise comprehension, leaving the listener uncertain
what the speaker was trying to communicate, are categorised as serious errors. Foster
and Wigglesworth (2010) provide guidelines and examples to assist in rater coding of
error gravity, to try to overcome problems of estimating what hearer difficulty would
be. They report high inter-rather agreement, something which needs to be established,
in any case, for each study which uses this approach.
In this way, for all of the methods of accuracy measurement outlined above, there
are two or three versions. We will take errors per 100 words as an example. Three ver-
sions exist if one scores separately for the three levels of error, for instance errors per
100 words for all errors; errors per 100 words only counting intermediate and serious
errors; errors per 100 words only counting serious errors. This approach could be justi-
fied on theoretical grounds – no one can really regard all errors as equally significant.
But there is also a pragmatic issue. Participants in research studies vary in general pro-
ficiency. It is easy to make small errors, so for lower intermediate students, to count all
errors could mean rather low accuracy scores, and more seriously, lack of discrimina-
tion. This attenuation in range might then have implications for statistical work, sug-
gesting that a more lenient scoring procedure would be more effective. The example
was in terms of errors per 100 words, but the two other methods can be adapted simi-
larly. Preliminary work with error gravity suggests that intermediate and serious errors
are best combined, generating two error scores for each method, for example errors per
100 words, all errors; errors per 100 words, only intermediate and serious errors. As
the reader will have guessed, TaskProfile happily outputs all these results in a twinkling,
provided, of course, that error gravity has been coded in the first place.
We turn next to the measurement of fluency. This area is far from straightfor-
ward, not least because of the complexity of fluency (or dysfluency) itself. Many differ-
ent things contribute to fluency, which I have brought together in the diagram below
(­Figure 1).
In the figure, a distinction is made between disturbances to the flow of speech,
and then the speed of the speech which is produced. A major factor in flow is pausing.
The context for researching a processing perspective on task performance 19

Clause boundary

Silent
Mid-Clause
Pausing
Filled, e.g. ‘um’, ‘ah’

Non-silent
Flow Pseudo, e.g. ‘like’, ‘actually’

Reformulation

Repair Replacement
Repetition
False Starts
Pruned speech rate
Speed
Unpruned speech rate

Figure 1.  Components of fluency and dysfluency

There are a number of distinctions within this category. First there is the distinction
between silent and non-silent pauses. Regarding silent pauses, one first has to deal with
the problem of how long (or short) a pause needs to be to qualify as a pause or not. In
the present research, 0.4 seconds is used as the cutoff point. Other values have been
proposed to distinguish between simply taking breath and actually pausing, some as
low as 0.28 seconds. We use 0.4 in the present case as a sort of compromise measure,
brief enough to capture very small interruptions to the speech stream, but long enough
to make manual coding feasible. Within silent pauses (termed ‘breakdown fluency’,
­Skehan 2009b) one can examine separately pauses which occur at clause boundaries
and those which occur mid-clause. Segalowitz (2010), in a major review of fluency, sug-
gests that it is particularly useful to look at measures which distinguish most effectively
between native and non-native speakers. In that respect, since native-speaker speech
contains quite a bit of clause boundary pausing, but much less mid-clause pausing, a
measure of such mid-clause pausing might be particularly effective (Skehan 2009b).
In addition, one could compute derivative measures, such as the ratio of boundary to
mid-clause pauses as another way to detect level of disruption to speech. One could
also explore the average length of pause, either at clause boundaries or mid-clause.
However, one can also regard certain verbal behaviours as constituting filled
pauses, and these come in two main flavours. First we have ‘classic’ filled pauses, such
as ‘um’, ‘ah’, etc, where some interjection is placed into the speech stream to ‘buy time’
20 Peter Skehan

as it were. There is no meaning, and possibly little difference between this and an
unfilled pause (save that it may be more effective at keeping the floor). But one does
need to consider such interjections as pauses. In addition, one can argue that certain
forms of actual speech are more properly regarded as pauses, in that they contribute
no meaning to the ongoing discourse, and serve mainly to ease the pressure of time,
and perhaps keep the floor also. Forms such as ‘you know’, ‘like’ can be analysed in
this form, as perhaps a word such as ‘actually’, although in coding data it is important
to distinguish between these words used meaningfully and their use as pseudo-filled
pauses. ‘Actually’, for example, is not always empty in meaning. Since all these pausing
measures, unfilled as well as filled, are affected by how much is said, and especially how
many words are used, they are standardised per 100 words.
Next to indices of a breakdown in the flow of speech, there are also occasions
where the speaker attempts to make changes to what is being said, rather than simply
having problems saying it. These attempts, which have been termed ‘repair fluency’ (or
more properly ‘repair dysfluency’), can be realized in many different ways, as reported
in the second language speaking literature. Reformulations are occasions where the
speaker changes what has been said by modifying the syntax or morphology, either
by changing something or by inserting or deleting something. In contrast, Replace-
ment, which also consists of change, is focused on lexical elements, so that syntax and
morphology remain unchanged, but something is done about the actual words which
are used. Repetition is self-evident: words or sequences of words are simply repeated,
without any intervening material. False Starts are occasions where something is aban-
doned, and some new form of expression is used. Of course, as with number of pauses,
there is the issue with all these measures that they occur more when speakers say
more. Accordingly, they are standardised per 100 words of discourse.
In contrast to measures of flow, one can also look at the speed with which lan-
guage is produced. Logically, one can separate flow and speed, and imagine some-
one who paused a lot, but who, when they were speaking, spoke fast, and the reverse,
someone who speaks slowly but without interruption to the flow. Hence, it is useful
to have measures of each, distinct from one another (DeJong et al. 2012). Typically
measures of speech rate, expressed as words or syllables per minute, are either pruned
or unpruned. In the latter case, the raw number of words is used, including repetitions,
reformulations and so on. In the former case, the additional material is removed, and
the measure is of meaningful, contributing words or syllables per minute.
In addition to the measures we have now covered, there are two more to be con-
sidered. They are both, effectively, composite measures of aspects of dysfluency. Pho-
nation time simply captures the proportion of the time speech is taking place, and
subtracts from total time the time spend pausing, so it reflects not simply number
of pauses but also length of pausing. Length of Run is a measure of the average span
in speech without any sort of interruption, whether a pause or a repair, and has been
The context for researching a processing perspective on task performance 21

­ roposed as a measure of automatisation in speech (Towell, Hawkins & Bazergut


p
1996). These two measures are therefore blends of several other measures but have the
potential to index level of general fluency more validly.
TaskProfile outputs all the above measures (assuming of course that things like
pseudo-filled pauses and pausing and repair have been coded). Now all this is useful,
but only up to a point. We still await a convincing theory of second language flu-
ency, so the existence of all these measures is a mixed blessing. There is much work
to be done in the area of fluency alone to understand what its major dimensions are,
and how the different measures might relate to different underlying psycholinguistic
processes. The chapters in this volume do not set themselves that task (although Bui
comes close). Accordingly, the different authors took a pragmatic stance, and made
slightly different decisions. Perhaps one can regard examining results for a measure of
end-of-clause pausing, mid-clause pausing, and a repair measure as a useful basic set
here, to avoid proliferating measures. The different chapters will reveal how the differ-
ent authors wrestled with this problem of choice.
Finally, we come to the area of lexis in second language task-based performance,
an area that I argue (Skehan 2009a, 2009b) has not received adequate attention in the
task literature. There are three measures to consider here, the type-token ratio (as an
index of lexical diversity), lexical density, and lexical sophistication. The type-token
ratio is far-and-away the most used measure in the second language field. It is the
ratio of different words to total words. In other words, the more particular words are
repeated in a (spoken) text, the lower this value becomes, and of course, conversely,
the more a speaker keeps bringing in new words, the higher the value will be. The
major issue here is that there is a very strong inverse relationship between length of
text and magnitude of type-token ratio (Richards & Malvern 2007), with this being
of the level of -0.70 with second language speakers (Foster 2001). So, to cite a type-
token ratio in itself is meaningless without information about the length of text.
In practice what this means for researchers is that some method has to be found
which corrects for text length with type-token measures. Fortunately, a range of pro-
cedures exist. The choice made in the present research follows from the decision
to adopt CHAT conventions, and the consequent availability of CLAN programs.
These include VocD (Malvern & Richards 2002) which takes a CHAT-formatted file,
and then calculates a statistic, D, which captures lexical diversity independent of text
length. Given the relatively short texts typical with task-research (and so a great vul-
nerability to text length effects on type-token ratios), this is a very effective solution
to a difficult problem.
Another aspect of lexis in second language speech is lexical density. This, following
work by Halliday (1975), first distinguishes between structure and content words, and
then calculates a ratio of content (or lexical) words to total words (i.e. structure plus
content words). This gives an indication of the extent to which lexical words ‘­penetrate’
22 Peter Skehan

a spoken text, and could be taken as an indicator of the propositional density of text.
(But see Skehan 2009b, for additional discussion of such measures.)
The final aspect of lexis to be considered is lexical sophistication. In ideal form,
this reflects the extent to which the speaker draws upon difficult words in what they
say. In practice, defining difficulty is not so easy, and the typical approach which is
taken is to use frequency (or rather low frequency) as a surrogate for difficulty. So,
the task becomes one of finding a measure to capture the extent to which less fre-
quent words are used by a speaker doing a task. Laufer and Nation’s (1999) Lexical
Frequency Profile is one means of doing this, but when the present research program
started, before my move to Hong Kong, there was no means of using this based on
any spoken language corpus. Accordingly, I adapted a computer program written by
Paul Meara, Plex (Meara & Bell 2001). This program divides a text up into ten word
chunks, and then calculates how many words in each ten-word chunk are of a lower
frequency. It then uses a Poisson Distribution (developed to model low frequency
events) to estimate a parameter, Lambda, which captures the extent to which the text
draws upon lower frequency words. This approach has been shown to be effective
with quite short texts (Bell 2003), and so it is useful for texts such as we use in the
task-based field. I adapted Meara’s original program in three ways. First, I was able
to use a different frequency corpus as the basis for the decision making with any
particular word. I based my version of his program on the spoken component of the
British National Corpus. Second, I built a BNC-based reference dictionary for the
program which was lemmatised, and so the program outputs both lemmatised and
non-lemmatised values of Lambda for any particular text (although typically it is
the lemmatised value which is used). Finally, the program allows the user to specify
the cutoff frequency to separate low and high frequency words. In all uses of the
program in chapters in this volume, this was set as 150 occurrences per ­million run-
ning words. Further details on this statistic, as well as a discussion of other aspects
of lexical measurement in second language spoken language are provided in Skehan
(2009b).
As a result, we have three measuring procedures, lexical diversity, lexical density,
and lexical sophistication (with these terms taken from Read 2000). The first question
to consider is what each of them measures, and second, how they interrelate. One can
propose the following:

–– Lexical diversity captures the extent to which a speaker draws upon a wide range of
words in what they say, compared to a speaker who recycles a smaller set of words.
The measure is neutral as to whether high or low frequency words are used. What
is important is how words relate to other words within that text. For this reason
lexical diversity is referred to as a ‘text-internal’ measure (Daller et al. 2003).
The context for researching a processing perspective on task performance 23

–– Lexical density reflects the penetration within a text of content words, as opposed
to reliance on structure words. It is thought to reflect the density of propositions
in the text, and is also considered to be likely to be different in spoken and written
language.
–– Lexical sophistication is an index of the speakers’ capacity or preference for using
less frequent words, which presupposes knowledge of such words (implying a
larger second language lexicon) as well as a capacity to mobilise them on-line
(lexical accessibility).

In a sense, these characterisations are tantalising. They hint at differences, but there seems
to be a considerable degree of overlap as well. Wouldn’t high lexical diversity tend to go
with lexical sophistication, for example? However, Skehan (2009b) demonstrated quite
a bit of independence between measures in each of these areas. The truth is that at the
moment we are equipped with measures but are not sure exactly what they are getting at.
Typically, in second language studies (Skehan 2009b), measures of lexical sophistication
are more likely to show differences between groups or conditions than do the other mea-
sures. But there is a case for including all of them: lexical diversity, because it has been the
measure of choice more often than any other; lexical density, because of Halliday’s (1975)
theoretical justification of this construct; and lexical sophistication, not only because
it may be the best bet for detecting differences, but also because size of mental lexicon
may be an issue with second language learners, and so such a measure may reveal how
different tasks and different task conditions enable second language speakers to draw on
that lexicon more or less effectively. In any case, we will see in some of the chapters in
this volume that characterising second language task performance without incorporat-
ing measures of lexical involvement is a hazardous undertaking.
In all, we can conclude that many measures are available. It is to be hoped, as the
reader goes through the chapters in this volume, that this range of measurement pos-
sibilities is itself put to the test, and we may gain some insights as to which measures
are most effective in such contexts.

References

Bell, H. (2003). Using frequency lists to assess L2 texts. Unpublished Ph.D. thesis, University of Swansea.
Crookes, G. (1989). Planning and interlanguage variation. Studies in Second Language Acquisition,
11, 367–383.
Daller, H., Van Hout, R., & Treffers-Daller, J. (2003). Lexical richness in the spontaneous speech of
bilinguals. Applied Linguistics, 24, 197–222.
DeBot, K. (1992). A bilingual production model: Levelt's “Speaking” model adapted. Applied Lin-
guistics, 13, 1–24.
24 Peter Skehan

De Jong, N., Steinel, M.P., Florijn, A., Schoonen, R., & Hulstijn, J. (2012). The effect of task ­complexity
on functional adequacy, fluency and lexical diversity in speaking performances of native and
non-native speakers. In A. Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2 perfor-
mance and proficiency: Complexity, accuracy, and fluency in SLA (pp. 121–142). Amsterdam:
John Benjamins.
Doughty, C. (2003). Instructed SLA: Constraints, compensation, enhancement. In C. Doughty &
M.H. Long (Eds.), The handbook of second language acquisition (pp. 256–310). Oxford: Blackwell.
Doughty, C. & Williams, J. (1998). Pedagogical choices in focus on form. In C. Doughty & J. Williams
J. (Eds.), Focus on form in classroom second language acquisition (pp 197–262). Cambridge: CUP.
Ellis, R. (2003). Task-based language learning and teaching. Oxford: OUP.
Ellis, R. (2005). Planning and task-based performance: Theory and research. In R. Ellis (Ed.), Plan-
ning and task performance in a second language (pp. 3–34). Amsterdam: John Benjamins.
Foster, P. (2001). Lexical measures in task-based performance. Paper presented at the AAAL Confer-
ence, Vancouver, Canada.
Foster, P. & Skehan, P. (1996). The influence of planning on performance in task-based learning.
Studies in Second Language Acquisition, 18, 3, 299–324.
Foster, P., & Skehan, P. (2012). Complexity, accuracy, fluency and lexis in task-based performance: a
synthesis of the Ealing research. In A. Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2
performance and proficiency: Complexity, accuracy and fluency in SLA (pp. 199–220). Amster-
dam: John Benjamins.
Foster, P., & Skehan, P. (2013). Anticipating a post-task activity: The effects on accuracy, complexity
and fluency of L2 language performance. Canadian Modern Language Review 69, 3, 249–273.
Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Measuring spoken language: A unit for all reasons.
Applied Linguistics, 21, 354−75.
Foster, P., & Wigglesworth, G. (2010). Towards a new measure of accuracy in task-based second
language performance. English Department, St.Mary’s University, Twickenham.
Halliday, M.A.K. (1975). Spoken and written language. Gelong: Deakin University Press.
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition.
Applied Linguistics, 30, 461–473.
Housen, A., Kuiken, F., & Vedder, I. (2012). Dimensions of L2 performance and proficiency: Complex-
ity, accuracy, and fluency in SLA. Amsterdam: John Benjamins.
Kormos, J. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence
­Erlbaum Associates.
Laufer, B., & Nation, P. (1999). A vocabulary-size test of controlled productive ability. Language
­Testing, 16, 33–51.
Levelt, W.J. (1989). Speaking: From intention to articulation. Cambridge: CUP.
Levelt, W.J. (1999). Language production: a blueprint of the speaker. In C. Brown & P. Hagoort (Eds.),
Neurocognition of Language (pp. 83–122). Oxford: OUP.
Long, M.H. (1996). The role of the linguistic environment in second language acquisition. In W.
Ritchie & T. Bhatia (Eds.), Handbook of Research on Second Language Acquisition, (pp. 413–468).
New York, NY: Academic Press.
Lynch, T. (2001). Seeing what they meant: transcribing as a route to noticing. English Language
Teaching Journal, 55, 124–132.
Lynch, T. (2007). Learning from the transcript of an oral communication task. English Language
Teaching Journal, 61, 311–319.
Lyster, R., & Ranta, L. (1997). Corrective feedback and learner uptake: Negotiation of form in com-
municative classrooms. Studies in Second Language Acquisition, 19, 37–66.
The context for researching a processing perspective on task performance 25

Long, M., & Robinson, P. (1998). Focus on form: Theory, research, and practice. In C. Doughty &
J. Williams (Eds.), Focus on form in classroom SLA (pp. 15–41). Cambridge: CUP.
MacWhinney, B. (2000). The CHILDES Project: Tools for analysing talk, Volume 1: Transcription for-
mat and programs (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Malvern, D., & Richards, B. (2002). Investigating accommodation in language proficiency interviews
using a new measure of lexical diversity. Language Testing, 19, 85–104.
Marsden, E., Myles, F., Rule, S., & Mitchell, R. (2003). Using CHILDES tools for researching second
language acquisition. In S. Sarangi & T. van Leeuwen (Eds.), Applied Linguistics and Communi-
ties of Practice (Vol. 18, pp. 98–113). London: BAAL/Continuum.
McLaughlin, B. (1980).Theory and research in second language learning: An emerging paradigm.
Language Learning, 30, 331–350.
Meara, P., & Bell, H. (2001). P_Lex: A simple and effective way of describing the lexical characteris-
tics of short L2 texts. Prospect, 16(3), 5–19.
Mehnert, U. (1998). The effects of different lengths of time for planning on second language perfor-
mance. Studies in Second Language Acquisition, 20, 83–108.
Norris, J., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA:
The case of complexity. Applied Linguistics, 30, 555–578.
Ortega, L. (1995). The effect of planning on L2 Spanish narratives. Research Note 15, Honolulu, HI:
University of Hawai’i Second Language Teaching and Curriculum Center.
Ortega, L. (1999). Planning and focus-on-form in L2 oral performance. Studies in Second Language
Acquisition, 21, 109–148.
Ortega, L. (2005). What do learners plan? Learner-driven attention to form during pre-task planning.
In R. Ellis (Ed.), Planning and task performance in a second language (pp. 77–109). Amsterdam:
John Benjamins.
Read, J. (2000). Assessing vocabulary. Cambridge: CUP.
Richards, B. & Malvern, D. (2007). Validity and threats to the validity of vocabulary measurement.
In H. Daller, J. Milton, J. Treffers-Daller (Eds.), Modelling and assessing vocabulary knowledge
(pp. 79–92). Cambridge: CUP.
Robinson, P. (2001). Task complexity, task difficulty, and task production: Exploring interactions in
a componential framework. Applied Linguistics, 22, 27–57.
Robinson, P. (2007). Rethinking-for-speaking and L2 task demands: The Cognition Hypothesis, task
classification, and sequencing. Paper presented at the 2nd International Conference on Task-
based Language Teaching, University of Hawaii, September 2007.
Robinson, P., & Gilabert, R. (2007). Task complexity, the Cognition Hypothesis, and second language
learning and performance. International Review of Applied Linguistics, 45, 161–176.
Robinson, P., Cadierno, T., & Shirai, Y. (2009). Time and motion: Measuring the effects of the
conceptual demands of tasks on second language speech production. Applied Linguistics, 30,
533–544.
Robinson, P. (2011). Second language task complexity, the Cognition Hypothesis, language learn-
ing, and performance. In P. Robinson (Ed.), Second language task complexity: Researching
the Cognition Hypothesis of language learning and performance (pp. 3–38). Amsterdam: John
Benjamins.
Samuda, V. (2001). Guiding relationships between form and meaning during task performance: the
role of the teacher. In Bygate, M., Skehan, P., & Swain, M. (Eds.), Researching pedagogic tasks:
second language learning, teaching, and testing. London: Longman.
Segalowitz, N. (2010). Cognitive bases of second language fluency. London: Routledge.
Skehan, P. (1998). A cognitive approach to language learning. Oxford: OUP.
26 Peter Skehan

Skehan, P. (2001). Tasks and language performance. In M. Bygate, P. Skehan, & Swain M. (Eds.),
Researching pedagogic tasks: Second language learning, teaching, and testing (pp. 167–185).
­London: Longman.
Skehan, P. (2009a). Modelling second language performance: Integrating complexity, accuracy, flu-
ency and lexis. Applied Linguistics, 30, 510–532.
Skehan, P. (2009b). Models of speaking and the assessment of second language proficiency. In
A. Benati (Ed.), Issues in second language proficiency (pp. 202–215). London: Continuum.
Skehan, P. (2011). Researching tasks: Performance, assessment, pedagogy. Shanghai: Shanghai Foreign
Language Education Press.
Skehan, P. (2013). Nurturing noticing. In J.M. Bergsleithner, S.N. Frota, & J.K. Yoshioka (Eds.),
Noticing and second language acquisition: Studies in honor of Richard Schmidt. (pp. 169–180).
­Honolulu, HI: National Foreign Language Resource Center.
Skehan, P., & Foster, P. (1997). Task type and task processing conditions as influences on foreign
language performance. Language Teaching Research, 1, 185–211.
Skehan, P., & Foster, P. (1999). The influence of task structure and processing conditions on narrative
retellings. Language Learning, 49, 93–120.
Skehan P., & Foster, P. (2005). Strategic and on-line planning: The influence of surprise information
and task time on second language performance. In R. Ellis (Ed.), Planning and task performance
in a second language (pp. 193–216). Amsterdam: John Benjamins.
Tavakoli, P., & Skehan, P. (2005). Planning, task structure, and performance testing. In R. Ellis
(Ed.), Planning and task performance in a second language (pp. 239–273). Amsterdam: John
Benjamins.
Towell, R., Hawkins, R., & Bazergui, N. (1996). The development of fluency in advanced learners of
French. Applied Linguistics, 17, 84–115.
Van Lier, L. & Matsuo, N. (2000). Varieties of conversational experience: Looking for learning oppor-
tunities. Applied Language Learning, 11, 265–288.
Van Patten, B. (1990). Attending to content and form in the input: an experiment in consciousness.
Studies in Second Language Acquisition, 12, 287–301.
Van Patten, B. (1996). Input processing and grammar instruction in second language acquisition.
­Norwood, NJ: Ablex.
Van den Branden, K. (2006). Task-based language education: From theory to practice. Cambridge:
CUP.
Willis J. (1996). A framework for task-based learning. London: Longman.
chapter 2

On-line time pressure manipulations


L2 speaking performance under five types of planning
and repetition conditions

Zhan Wang
University of Pittsburgh

This chapter is concerned with an investigation of the underlying mechanisms of


second language speaking. It reports on an experiment containing five different
types of planning and repetition conditions, each relevant to certain processes
and stages of speech production. The five conditions were two forms of strategic
planning, two forms of on-line planning, and task repetition. Data were collected
from 77 undergraduates (L1: Chinese and L2: English) doing a video narrative task in
English. Speech samples were transcribed and coded. The study found: (1) strategic
planning improved speech complexity and fluency, suggesting that support for
the conceptualization stage in speech production helps language complexity and
fluency; (2) on-line planning solely focusing on the formulation stage did not
enhance speech complexity and accuracy, whereas on-line planning supported by an
earlier opportunity to watch the video did, indicating a ‘meaning priority’ principle
in speaking; (3) repetition enhanced speech complexity, fluency, and accuracy,
suggesting that repetition is a robust way to improve speaking quality. Based on the
results, an instructional model of L2 speech intervention is proposed. It argues that
speech monitoring is the key to accuracy. Interventions at the speech formulation
stage, which are often emphasized in pedagogy, work for accuracy only when speakers
are instructed to attend to monitoring.

Introduction

Processes of L1 speaking
Speaking in one’s native language is an easy, fluent, and automatic process. According
to Levelt’s model of first language (L1) speech production (Levelt 1989, 1993, 1999),
information processing in L1 speaking contains the stages of conceptualization,
­formulation, and articulation as well as a speech comprehension system by which
28 Zhan Wang

the outputs of each stage can be monitored: the pre-verbal message, the inner speech
plan, and the overt speech plan. L1 speaking to a large extent is an incremental, paral-
lel, and automatic process (Kormos 2006, p. 7–8).
To say that L1 speaking is incremental means that speech information needs to flow
from Conceptualizer, Formulator, to Articulator for speech to be produced. Through
these processors, information is delivered from a larger unit in the hierarchy first to
intermediate, and then to even smaller, subunits (Lashley 1951; Meyer  & ­Gordon
1985), which is the opposite process to word recognition and reading (i.e. ­decoding
the printed material to meaning and from smaller units such as phonemes, syllables,
and words, to larger units such as the meaning of sentences and discourse). For exam-
ple, when a large unit of speech intention has been formed, the brain searches for a
mapping between the pre-verbal message and specific target lexical nodes based on
the relevant semantic and syntactic information in the lexicon – the process of lexi-
cal selection (Levelt 2001). Then the activated lexical nodes (e.g. play-verb) get mor-
phologically encoded (e.g. played-past tense verb) and are passed to the phonological
encoder for the activation of phonological and phonetic encoding (e.g. /pleid/) (Levelt,
Roelofs & Meyer 1999; Schriefers, Meyer & Levelt 1990). Finally, through the motor
action from the Articulator, the small units of each phonetic word are articulated –
what we perceive as speech.
L1 speech production is also a parallel and highly automatic process, two impor-
tant aspects of fluent L1 speaking. In Levelt’s model, for example, as soon as the Con-
ceptualizer passes information to the Formulator, the Conceptualizer starts to work
on the next piece of information regardless of the fact that the last piece of informa-
tion is still being processed by the Formulator (Kempen & Hoenkamp 1987; cited
in Kormos 2006, p. 8). This efficient parallel processing is based on the claim that
conceptualization in speech production is likely to be the only controlled process that
requires conscious awareness. Both Formulator and Articulator to a great extent work
automatically without much conscious awareness1 (Levelt 1989, p. 20). Researchers
may not have consensus on exactly how morphological transformations are computed
when retrieving linguistic forms. For example, researchers who argue for statisti-
cal learning rules (Seidenberg 1997) posited that low frequency forms are less easily
retrieved from mental lexicon or mental grammar. That is why sometimes speakers
hesitate about the precise phrasing to be used. However, as to the high frequency L1

.  Although articulation in L1 speaking is largely regarded as automatic motor processing


without conscious awareness, it may still involve conscious awareness at the time course around
the articulation motor movement. Levelt addressed this issue by assuming a monitoring process
along the time course of speech production. He assumed that because of the self-monitoring of
speech production, speakers sometimes can detect speech errors prior to articulation and repair
them (Levelt 1983).
On-line time pressure manipulations 29

forms that ­speakers encounter, the morpho-phonological formulation as well as their


articulation are largely automatic. Considering the large proportion of high frequency
forms in our daily speech, the phases of formulation and articulation can be consid-
ered as being highly automatic, which makes L1 speech production fast and efficient.
In terms of the controlled and automatic processing of language, Ullman (2001a,
2001b, 2004, 2005, 2008) distinguishes between declarative memory and procedural
memory (both of them belonging to the long-term memory system). Declarative
memory concerns the learning, representation, and use of knowledge about facts and
events. This type of knowledge is partly explicitly learned and remembered – that is,
it requires conscious awareness. Procedural memory concerns the control of long-
established, motor and cognitive ‘skills’ or ‘habits’ (Ullman 2001b, p. 106). This part of
knowledge is implicitly learned and remembered – that is, without conscious aware-
ness. In L1 speaking, the conceptualization of non-compositional forms from lexical
memory relies on declarative memory; the formulation of compositional forms and
rules (e.g. regular forms such as ‘–ed’ in past tense) which make up the mental gram-
mar relies on procedural memory. The articulation of speech relies on procedural
memory too because pronunciation can be regarded as essentially a motor skill.
A similar distinction can be found in other cognitive psychological theories such
as the distinction between declarative and procedural knowledge in ACT-R (Anderson
1983; Anderson et al. 2004; Anderson & Lebiere 1998; Squire 1987) and the distinction
between controlled and automatic processing (Schneider & Chein 2003; Shiffrin &
Schneider 1977). All of these help explain how different types of language mechanism
in the human brain can work together coherently to produce L1 speech.
Since the above three stages of L1 speaking are all relevant for understanding L2
speech processing, we present an illustration of parallel processing in L1 speaking
(Table 1). The phases involving automatic processing that makes L1 speaking quick
and efficient are highlighted.

Table 1.  Illustration of parallel processing in L1 speaking


L1 speech processor Tan Tn+1 Tn+2 Tn+3 Memory access Processing
ICn+3
Conceptualizer ICbn ICn+1 ICn+2 Declarative Controlled
Formulator … ICn ICn+1 ICn+2 Procedural Automatic
Articulator … … ICn ICn+1 Procedural Automatic
a T: Time
b IC: Information Chunk

Table 1 clarifies how the three processors in speech production work in an


incremental, parallel, and automatic way as we discussed above. In the table, we
are o
­ bserving information processing in the brain starting from Time n (Tn). If we
30 Zhan Wang

s­ uppose our technology can distinguish brain activity from the three processors (i.e.
­Conceptualizer, Formulator, and Articulator), at Tn, Information Chunk n (ICn) is
processed through the Conceptualizer first. When ICn completes processing at the
Conceptualizer stage, it enters into the Formulator for morpho-phonological process-
ing at Tn+1. This demonstrates the feature of incremental processing. If we only observe
a time point at Tn+2, we find that none of the processors is at rest. Conceptualizer,
Formulator, and Articulator are working simultaneously in parallel. This remarkable
capacity for parallel processing ability is attributed to the largely automatic nature of
processing at the Formulator and the Articulator phases. These incremental, parallel,
and automatic features make L1 speaking continuous, fast, and efficient (Levelt 1989,
1993, 1999; Kormos 2006).

L2 speaking processing and time pressure


Unlike L1 speaking, which is largely regarded as based upon easy, fluent and automatic
processes, L2 speakers have at least the following four sources of problem in commu-
nication, as argued by Dörnyei and Scott (1997) and cited in Kormos (2006):

1. resource deficits,
2. processing time pressure,
3. perceived deficiencies in their own language output, and
4. perceived deficiencies in decoding the interlocutor’s message.

It seems that processing time pressure is one of the bottlenecks in L2 speaking given
that our working memory capacity is regarded as being limited (Baddeley 1986, 2003).
The bottleneck is likely to impede language learning and development. Table 2 illus-
trates why L2 speakers are experiencing real-time pressure during speaking. The
phases that have differences from L1 processing and make L2 speaking less quick and
efficient are highlighted.

Table 2.  Illustration of the bottleneck of time pressure in L2 speaking


L2 speech processor Tan Tn+1 Tn+2 Tn+3 Memory access Processing

Conceptualizer ICbn ICn+1 ICn+2 ICn+3 Declarative Controlled


Formulator … ICn ICn+1 ICn+2 Declarative Controlled
Articulator … … ICn ICn+1 Procedural Automatic
a T: Time
b IC: Information Chunk

In comparison to L1 speakers, L2 speakers generally have more time pressure


at both the conceptualization and formulation stages (though L1 speakers to some
On-line time pressure manipulations 31

degree have time pressure at conceptualization too). Beginning L2 learners have more
time pressure than their L1 peers in the compilation of articulatory motor programs
too. However, for intermediate and advanced L2 learners, since they have acquired
the basic acoustic templates of the target language phonetics, the articulation of the
encoded phonetic plans is likely to implicate automatic motor programming, which
requires little conscious awareness.2
Researchers often regard conceptualization as being the least different between
L1 and L2 speakers. However, for processing L2 forms either learned (but not proce-
duralized) or missing in the L2 mental lexicon, L2 speakers are generally slower than
their native peers. First of all, Kroll and Stewart (1994) have argued in their Revised
Hierarchical Model (RHM) that there is no direct link between concepts and the L2
initially, but a link begins to be established gradually when L2 proficiency increases.
They also argue that for low proficiency L2 learners, the link between concept and
its L2 representation is often assisted by their native language. This implies that in
contrast to the direct link between meaning and L1 representations, a longer time is
required to access and retrieve target L2 lemmas from the mental lexicon so that on
its own it is less efficient in processing the L2 than the L1. Therefore, L2 speakers are
likely to need more time to retrieve L2 words in real time speech, even for items that
have been learned.
Second, due to resource deficits in the L2 (Dörnyei & Scott 1997; Kormos 2006),
ideas which have been conceived so that they can be expressed in real-time speech
sometimes encounter gaps in the L2 mental lexicon. As a result, L2 speakers generally
are more tentative in the conceptualization of ideas. They have developed strategies
to make the best match between what to conceive that they are able to express and
what to compromise about due to the lack of sufficient L2 resources at hand – the
issues of ‘cognitive comparison’ and ‘selective attention’ (Doughty 2001). Therefore,
conceptualization for L2 speakers is a bi-directional3 process involving revision and
­re-conceptualization (i.e. finding alternative ways to express thoughts) in order to
match speech with the L2 resources available.
At the stage of formulation, L1 speakers rely on automatic processing in most
instances to encode morphological and phonological information, which makes
speech production easy and fast once ideas are conceptualized. However, with late L2

.  Similar to L1 speech processing, though motor programming of articulation to a large extent
is an automatic process, it still involves conscious awareness around the time course of the motor
action.
.  L1 speaking at the stratum of conceptualization may have a bi-directional connection
between concepts and lemmas too, as argued by Roelof ’s WEAVER network (Levelt et al. 1999;
Roelof 1997) – this is not due to the lack of linguistic resources but due to the change of speech
plan.
32 Zhan Wang

learners, grammatical rules whose computation depends upon procedural m ­ emory in


L1 are posited to be more dependent upon declarative memory in the L2 due to the
lack of brain plasticity after the close of the critical period (Ullman 2008). L2 learners
may have to memorize or construct utterances through explicit rules from declarative
memory. Therefore, the formulation of L2 syntactic, morphological, and phonological
forms during speech production is less of an automatic and more of a controlled pro-
cess that requires attentional resources. Because of this difference, L2 speakers need
more time to compose morpho-syntactic and phonological information from the
mental lexicon; however the real-time nature of any speech production does not read-
ily allow extra time for processing, so L2 speakers often feel short of time in speech
production.

L2 speaking intervention targeting the bottleneck of time pressure


In the previous section I clarified how time pressure affects L2 speech and impedes
learners from retrieving newly learned but not yet automatized linguistic structures.
Therefore, effective interventions that focus on the bottleneck of time pressure dur-
ing speech should be explored. This study is aimed at examining such interventions.
They should be able to provide learners with opportunities to overcome time pres-
sure by giving them practice in accessing relevant linguistic knowledge as effectively
as possible, using forms and functions, and proceduralizing them in long term
memory.
The past two decades have witnessed a transition of both research interest and
classroom practice from communicative language teaching to task-based language
teaching approaches (Bygate & Samuda 2005; Robinson 2011; Skehan, Bei, Li & Wang
2012). Using tasks in language learning and teaching involves solving communication
problems as well as real-world language use in which meaning is primary (see the
definition of ‘tasks’ in Ellis 2003; Samuda & Bygate 2008; Skehan 1998). For our study,
using a task-based approach as a medium to explore various interventions that focus
on time-pressure reduction has at least the following two advantages: (1) it provides
evidence from the discourse level, which resembles real-time speaking activities; (2) it
connects speech processing conditions with speech product, with language perfor-
mance seen in terms of certain standardized measures such as complexity, accuracy
and fluency (CAF) (Ellis 2009; Housen & Kuiken 2009; Norris & Ortega 2009; Skehan
2009a) – which will provide evidence for evaluating the potential interventions that
can be used in language learning classrooms.
Researchers have already found that giving time to plan when doing tasks may
provide opportunities for learners to ‘notice the gap’ (Schimidt 1990) between task
demands and linguistic resources, and then strategically to allocate attentional
resources to ‘focus on form’ (Long & Robinson 1998) so as to increase accuracy,
On-line time pressure manipulations 33

fluency, and complexity in speech production (Skehan 1998). Connecting with


­psycholinguistic models of speech production, particularly the Levelt (1989) model,
Ellis (2005) proposed a framework of task-based planning, which primarily distin-
guishes two types of  planning according to when the planning occurs: pre-task
planning and within-task planning. Pre-task planning is conducted before learners
perform a task. Within-task planning is conducted on-line while learners are per-
forming a task. P ­ re-task planning can be further divided into two forms: rehearsal
and strategic p ­ lanning – the difference being whether learners have opportunity
to actually perform the complete task as a preparation, that is, ‘rehearsal’; or are
only allowed time to consider the content and expressions to be encoded before
speaking on the task in their working memory, that is, ‘strategic planning’. Within-
task planning has two (may be extreme) forms too: one is pressured (i.e. having a
limited time for on-line planning) and the other is unpressured (i.e. having unlim-
ited time to perform a task). These distinctions in the Ellis framework provide the
inspiration for the current study which explores the links between different stages
of speech production and effective interventions regarding how time pressure is
handled.
Based on Ellis’ model, this study consists of a wide-ranging experiment c­ omparing
five time pressure reduction conditions (i.e. experimental conditions) with a control
condition. The control condition is a baseline designed to involve the least possible
planning opportunity either before or within the task. In contrast, the five experi-
mental conditions provide certain degrees of planning opportunities to reduce time
pressure at a specific phase of speech production: conceptualization, formulation, and
articulation, or a combination of the phases. The comparison between each of the
experimental condition with the control condition can help us examine the effect of
time pressure reductions for pedagogical purposes. The conditions and the proposed
locations of time pressure reduction with reference to the Levelt speech production
model are outlined in Table 3. The table also presents their hypothesised effects on L2
speaking performance as well as some of the evidence in the literature that lends sup-
port to these hypotheses.
Condition one is the control condition, and gives no planning and no p
­ re-watching
opportunities for speakers. In its operationalization, a speaker was sitting in front of
a computer. The researcher asked the speaker to narrate while watching a normally
played video and the speaker had no opportunity for pre-watching the video or know-
ing the story. The speaker had to narrate in response to what he/she was watching, sim-
ilar to a sports commentator broadcasting in a live sporting event. It is a ­challenging
condition because the speaker, without knowing the story content before speaking, was
telling the story merely guided by watching the on-going frames of the video. From the
linguistic perspective, borrowing the terms from Bygate and Samuda (2005), it is hard
34 Zhan Wang

Table 3.  Control and experimental conditions


Condition Operationalization Targeted Hypotheses^ Evidence from the
location# literature

1 Control watch+tell – – –
2 Watched watch, watch+tell Conceptualizer C, F Skehan & Foster 1999
3 On-line watch+tell Formulator A, F (–) –
Planning (slowed video)
4 Watched watch, watch+tell Conceptualizer+ C, A, F (–) Ahmadian &
On-line (slowed video) Formulator Tavakoli 2011;
Planning (on-line) Ellis 1987; Hulstijn &
Hulstijn 1984;
Yuan & Ellis 2003
5 Watched watch, planning, Conceptualizer + C, A, F Guará-Tavares 2008;
Strategic watch+tell Formulator Mehnert 1998; Ortega
Planning (strategic 1999; Skehan & Foster
problem-solving) 1997; Tajima 2003
6 Repetition watch+tell, Conceptualizer + C, A, F Bygate 1996, 1999, 2001;
watch+tell Formulator + De Jong & Perfetti 2011;
Articulator Gass et al. 1999; Lynch &
McLean 2000, 2001
# Location: The speech production stage(s) that the time pressure reduction intervention targets
  ^ Hypotheses:
   C: increasing complexity
   F: increasing fluency
    F (–): decreasing fluency
   A: increasing accuracy

for speakers to either take the ‘perspectives’ of either the speaker’s or the presumed
­listener’s attitude, or to ‘preview’, that is, consider the background and f­oreground of
what is happening and what is about to happen – these are two important l­inguistic
resources that lead to ‘framing’ a narration toward discourse coherence (Bygate &
Samuda 2005: p. 48). Having the least possible planning time (before and within the
task) this condition is hypothesised as being the hardest among all the ­conditions –
involving what Ellis (2005) described as ‘pressured online planning’.
The ‘Watched’ condition (Condition 2) allows speakers to watch the video before
narrating the story. ‘Watching’ is a type of ‘pre-task activity’ (Skehan & Foster 1999),
which provides exposure to the task material before the real task performance.
This manipulation is intended to reduce time pressure at speech conceptualization
by exposing to speakers the story content first. In this way, a greater proportion of
attention becomes available to attend to formulation (and to ‘focus on form’) while
the speaker is performing the task, and his/her speech performance can therefore be
enhanced. Few studies have explored the effect of pre-watching. Skehan and Foster
(1999), as an exception, compared the effects of having and not having a ­pre-­watching
On-line time pressure manipulations 35

­ pportunity. However, contrary to its theoretical assumptions, their study did not find
o
significant results on the CAF measures. A similar line of research that involves easing
speech conceptualization may be strategic planning. For example, Pang and ­Skehan
(this volume) in a qualitative study found that during strategic planning, learners
reported that they selectively prepared for speech content or language forms. The lit-
erature on strategic planning (see Ellis 2003, 2008, 2009 for reviews) generally shows
that having the chance to plan before speaking helps raise speech fluency and syntac-
tic complexity4 (Crookes 1989; Foster 1996; Foster & Skehan 1996, 1999; Skehan &
­Foster 2005; Tavakoli & Skehan 2005; Wendel 1997; Yuan & Ellis 2003). Therefore, this
study hypothesizes that watching has a similar effect to strategic planning and can help
learners produce more complex and more fluent speech.
The ‘Online Planning’ condition (Condition 3), is the same as the control condi-
tion regarding no pre-watching opportunity, but is different from the control con-
dition as it provides extra time for speakers to conduct on-line planning. The video
used for narration is of the same content for all the conditions, except that the video
for the two online planning conditions (i.e. ‘Online Planning’ and ‘Watched Online
Planning’) was edited to be played slowly so that extra time was created for conduct-
ing on-line planning (see ‘Methodology’). By comparing Condition 3 with the control
condition, it is hypothesised that the extra time for conducting online planning can
help learners attend to morpho-syntactic formulation so as to increase speech accu-
racy but speech fluency especially regarding speech rate (Yuan & Ellis 2003) is affected
by the detrimental effect of on-line planning. This condition leads to the question:
because the ‘Online Planning’ condition does not allow pre-watching, when provided
with extra time for on-line planning, can learners successfully take the opportunity to
focus on form? That is, can they successfully divide their attention between linguis-
tic formulation and story conceptualization simultaneously when both pressures are
high? A p­ ossible answer can be offered by comparing the result of this condition with
that of the ‘Watched Online Planning’ Condition (Condition 4).
The ‘Watched Online Planning’ condition (Condition 4) provides the opportunity
for pre-watching as well as the extra time for speakers to conduct on-line planning while
narrating. It is likely that having the chance to watch a video before speaking and then
benefitting from additional time when speaking (so that on-line planning is facilitated)
will reduce time pressure at both the conceptualization and the formulation phases so
that learners can speak with higher accuracy and complexity (Yuan & Ellis 2003). This

.  There have also been studies which have found positive effects of pre-task planning on
­accuracy, but these studies were either in a language testing context (Tavakoli & Skehan 2005;
­Wigglesworth 1997) or provided planning time as long as 10 minutes and allowed note-taking,
which are very different from the ‘watching’ condition in this study. (Guará-Tavares 2008; Ortega
1999; Skehan & Foster 1997; Tajima 2003).
36 Zhan Wang

prediction is based on the on-line planning literature. Most of the studies in the litera-
ture used narrative tasks in which the content of the narration was already known to the
speakers (Ahmadian & Tavakoli 2011; Ellis 1987; Yuan & Ellis 2003), which is similar
to ‘having watched’ the video in this task condition. These studies found that providing
on-line planning to the speakers who has already known the story content had positive
effects on speech accuracy and complexity. Therefore, it is hypothesized that ‘Watched
Online Planning’ can help increase complexity and accuracy in learners’ speech per-
formance. Meanwhile, due to the time used for careful formulation, it will also have a
detrimental effect on speech fluency, especially on speech rate.
The ‘Watched Strategic Planning’ condition (Condition 5) provides an opportu-
nity for pre-watching as well as extra time (3 minutes) for speakers to conduct strategic
planning before speaking. It is a reinforcement of the ‘Watched’ condition (Condition
2). Through the provision of the pre-watching opportunity, conceptualization pres-
sure is likely to be reduced. Then having extra time before narrating, learners can use
the strategic planning time either to prepare for expressing the content of the story or
to search for solutions to certain anticipated linguistic problems (see Pang & Skehan
this volume). This condition is different from the two on-line planning conditions, in
which the extra time was inserted into the video so that speakers are more likely to
use the time resource ‘on-line’ to deal with immediate linguistic problems. However,
if the speakers know that the retrieval of the unfamiliar lexis may take a longer time
than the real time speaking situation could tolerate, they are likely to stop searching
for it o
­ n-line and switch to their familiar ways of expression – that might be a con-
straint of the two online planning conditions. In contrast, strategic planning affords
speakers time to search for unfamiliar lexis and expression before speaking. There-
fore, in this condition, having both a pre-watching opportunity and strategic planning
time, ‘Watched Strategic Planning’ could have a similar effect to those task conditions
involving adequate pre-task planning time such as 10 minutes (Guará-Tavares 2008;
Mehnert 1998; Ortega 1999; Skehan & Foster 1997; Tajima 2003). Based on the results
of these studies, it is hypothesized that ‘Watched Strategic Planning’ will result in
enhanced speech performance in complexity, accuracy, and fluency.
The ‘Repetition’ condition (Condition 6) uses immediate task repetition (i.e. a
kind of rehearsal) as an intervention to investigate time pressure reduction in the
complete process of speech production (i.e. conceptualization, formulation, and
articulation). Speakers were not told that they would carry out the same task again
until they had finished speaking on the task for the first time (so they themselves did
not think of their first encounter with the task as a rehearsal). Researchers have stud-
ied task repetition in various forms, but most of the studies have examined task rep-
etition after several days’ or weeks’ interval. For example, Bygate (1996) found fluency
and accuracy effects in a repetition task after a 3 day interval. Bygate (2001) found
increased speech fluency and complexity in a repetition task after 10 weeks. Gass,
Mackey, Álvarez-Torres and Fernández-García (1999) found that the group which
On-line time pressure manipulations 37

repeated the same task after a 2–3 day interval on two occasions outperformed the
non-repetition group regarding a general proficiency rating, partial accuracy of the
Spanish structure ‘to be’, morphosyntax, lexical density (i.e. type token ratio) and lexi-
cal sophistication (i.e. the number of difficult words used). The study by Lynch and
McLean (2000), however, involves a speaking condition similar to immediate task
repetition. They found that repeatedly making a presentation of a poster to differ-
ent interlocutors six times resulted in improved accuracy and fluency. More recently,
De Jong and Perfetti (2011), using a 4-3-2 repetition task (i.e. repeating a topic for
4, 3, and 2 minutes) as the training method, found that the group which repeated
the same topic three times had significantly higher fluency in a post-test one week
later than the group that spoke on three different topics each time. Although these
studies involve various forms of task repetition, generally they lead to the claim that
task repetition is likely to be a robust condition to enhance L2 speakers’ speaking flu-
ency, complexity and accuracy. The reason, as Bygate and Samuda (2005) explained,
is that during the re-run of the task, speakers are likely to build on the knowledge and
performance of the first enactment so that both speaking processing and language
product can be impacted by task repetition (p. 45). Therefore it is hypothesized that
immediate task repetition has the advantage of time pressure reduction in conceptu-
alization, formulation, and articulation, and L2 speakers’ speech complexity, accu-
racy, and fluency will be increased.
To summarize, the five experimental planning conditions proposed in this study are
connected with stages in speaking production and speaking performance – their com-
parisons with the non-intervention control condition may reveal the specific impact of
each time pressure reduction on L2 speaking performance. They may also reveal the
underlying mechanisms of L2 speech production with reference to processing stages.

Research Questions

This study is guided by the following five research questions:

1. Does the ‘Watched’ condition (Condition 2), which targets time pressure ­reduction
at the Conceptualizer stage, result in significantly more complex and more fluent
speech in comparison to the control condition (Condition 1)?
2. Does the ‘On-line Planning’ condition (Condition 3), which targets time pressure
reduction at the formulator stage, result in significantly more accurate but less
­fluent speech in comparison to the control condition (Condition 1)?
3. Does the ‘Watched On-line Planning’ condition (Condition 4), which targets
time pressure reduction at both the Conceptualizer and the Formulator (through
­on-line planning) stages, result in significantly more complex and more accurate
but less fluent speech in comparison to the control condition (Condition 1)?
38 Zhan Wang

4. Does the ‘Watched Strategic Planning’ condition (Condition 5), which targets
time pressure reduction at both the Conceptualizer and the Formulator (through
strategic planning) stages, result in significantly more complex, more accurate,
and more fluent speech in comparison to the control condition (Condition 1)?
5. Does the ‘Repetition’ condition (Condition 6), which targets time pressure reduc-
tion at the complete process of speech production (i.e. conceptualization, formu-
lation, and articulation), result in significantly more complex, more accurate, and
more fluent speech in comparison to the control condition (Condition 1)?

Method

Participants
The 77 participants (50 females, 27 males) in this study were undergraduates in differ-
ent majors at a university in Hong Kong, aged from 18 to 22. They were native Chinese
speakers who learned English as a second language. None of them had overseas expe-
rience of more than 3 months. They were recruited on a voluntary basis and a time
compensation fee was provided after they completed the tasks. Data were collected
through one-to-one meetings with participants. Once a student arrived for the data
collection, a pre-test was administered (see below) and according to the pre-test score,
the participants were assigned to one of the task conditions. The researcher made the
grouping decisions with the intention of achieving the balance of pre-test (primarily),
gender, year of study, and major of study across groups. The participants’ English pro-
ficiency, as self-reported, ranged from TOEFL 540 to 630 and IELTS 6 to 7.5 (with the
speaking subset ranging from 5.5 to 7.5).

English proficiency pre-test


A pre-test was administered to the participants on the same day as the main study. The
pre-test used a version of the TOEFL Listening subtest (extracted from Hinkel 2004).
A listening test was used because TOEFL listening was reported to be a strong indica-
tor of the general English proficiency measured by TOEFL exams (Sawaki et al. 2009).
Listening also involves a relatively similar process to speaking, especially regarding the
degree of on-line resource generation for problem solving (Yuan & Ellis 2003, p. 9). Par-
ticipants were allocated to different speaking conditions to balance English proficiency.

Material
Drawing on Skehan and Foster (1999, 2005), we used two videos from the Mr. Bean
series to elicit speaking performance (the content of the two video stories is presented
in Appendix A). Using two videos can avoid some task irrelevant variables such as
learners being unfamiliar with the narrative task. The presentation sequence of the two
On-line time pressure manipulations 39

videos was counter-balanced, and the study reports the mean scores of the two video
performances as the results. The same videos were used in all conditions. The only dif-
ference across the conditions was that there were two playing rates: a slow speed for
conditions involving on-line planning, and a normal speed for all other conditions.
Details about task duration are discussed in Table 4. The Mr. Bean video series are
appropriate for narrative retelling because each episode is short, largely mimed, easy
to comprehend, and appealing (Skehan & Foster 1999). The videos were piloted for its
comprehensibility and cultural understanding.

Slowed video for on-line planning


The operationalization for the slowed video as the basis for on-line planning narratives
is inspired by ‘tempo-naming tasks’ and ‘response deadline’ tasks (Kello 2004; Kello &
Plaut 2000; Kello, Plaut & MacWhinney 2000; Kello & Plaut 2003 based on a compu-
tational model). These tasks investigated the relation between rate of processing and
control of processing, as well as the underlying mechanisms that are revealed in ­on-line
reading or speaking. With a visually and audially manipulated tempo, it is claimed that
people have the natural ability to synchronise behavior to an external rhythm (Kello &
Plaut 2003, p. 210). The results showed that readers’ and speakers’ responses can be
well-timed with rhythm, and the fastest tempo interval drove response ­latencies faster
and also induced a speed/accuracy trade-off (called ‘premature processing’). This ratio-
nale as to how external rhythm can shape the control of processing is in line with the
on-line planning definition – ‘moment by moment preparation during speech’ (Yuan &
Ellis 2003) and careful control of processing during speech production.
To obtain the slowed version of the video for the two conditions involving on-line
planning (i.e. ‘Online Planning’ and ‘Watched Online Planning’), the author piloted
three different rates of playing with a group of participants with a similar background

Table 4.  Description of speaking conditions (Independent variables)


Speaking conditions Pre-watching On-line Strategic Task time
(5 min) planning planning (min)
(3 min#) (3 min)

1 Control – – – 5
2 Watched √ – – 10
3 Online Planning# – √ – 8
4 Watched Online Planning# √ √ – 13
5 Watched Strategic Planning √ – √ 13
6 Repetition Repetition – – 10
# Condition 3 ‘Online Planning’ and Condition 4 ‘Watched Online Planning’ used a slow version of video
that made a 5 minutes normal video become 8 minutes long so that it allows 3 minutes implicitly as on-line
planning time.
40 Zhan Wang

and proficiency level to the main study participants. The three pilot versions were: 50%
of the normal speed (making a normal 5 minutes’ video 10 minutes long), 60 % of the
normal speed (8 minutes), and 75% of the normal speed (6.5 minutes). These slowed
versions were made by using the Adobe Premiere© video compilation software to
edit the videos to be played consistently slower throughout the video (with no pauses
manually inserted). Based on the pilot participants’ feedback, 60% of the normal speed
was selected as the experimental version of on-line planning video because it was not
so slow for the manipulation to be recognized. 50% of normal speed, in contrast, was
recognized as ‘artificial’ (even though it would allow more on-line planning time).
Therefore the 60% speed was selected, which made a normal 5 minutes’ video become
8 minutes’ long. In other words, an extra 3 minutes was available to facilitate on-line
planning time implicitly while the video was running.

Task conditions and instructions


All the speaking conditions were conducted in the Here-and-now mode – speakers nar-
rate a story while watching the video simultaneously. As shown in Table 4 below, ‘Control’
(No Pre-watching, No Planning) is the baseline performance condition in which partici-
pants start to narrate the story without pre-watching and without planning. The ‘Watched’
condition allows speakers to watch the movie silently once before narration. The ‘­On-line
Planning’ condition is supposed to provide participants on-line planning time by speaking
to the slowed version of video as explained earlier. The ‘Watched On-line Planning’ con-
dition allows participants to watch the normal speed video once silently before speaking
to the slowed on-line planning video. In ‘Watched Strategic Planning’, speakers watch the
video once silently, then have an additional 3 minutes’ time for doing strategic planning,
and after that speak to the normal speed video. In the ‘Repetition’ condition, learners watch
and narrate the story simultaneously once, and then watch and narrate the story simulta-
neously again. Table 4 lists the total task completion time for each condition.
To help participants become familiar with the speaking conditions, a page of task
instructions in both English and Chinese was provided (Appendix B). The participants’
comprehension of the instructions was checked through a few questions and sample
practice with the researcher. All the communication around the instructions was con-
ducted in Chinese. After a participant was clear about the data collection procedure, the
researcher started to play the video. At the beginning of the video, the same instructions
appeared again on the screen. Shortly after that, the computer told the speaker to get ready
to speak in 10 seconds, and then the task started and task performance was recorded.

Measures of speaking performance


Since the overarching aim of this study is to examine whether each proposed time
pressure reduction has a positive effect on L2 speaking performance, the measures
On-line time pressure manipulations 41

of speaking performance are important. Researchers generally regard speaking


­performance as multi-componential and consisting of at least the following dimen-
sions: syntactic complexity, accuracy, fluency, and lexis (Ellis 2003; Ellis & Barkhuizen
2005; Norris & Ortega 2009; Skehan 1998, 2009a). Indicators of these performance
aspects have been widely used in the TBLT literature (see Housen & Kuiken 2009 for a
discussion). Table 5 lists the performance measures used in this study.

Table 5.  Measures of speaking performance (Dependent variables)5 6 7 8


Components Measures Descriptions

Fluency (speed)5  1  Speech_Rate6  e number of words per minute for a


–  Th
speech sample.
Fluency  2  AS_End_Pause –  The average length of pauses at the end of
(breakdown) AS units.
 3  AS_Mid_Pause –  The average length of pauses in the
middle of AS units.
Fluency (repair)  4  Reformulation –  The number of strings in a speech sample
that are repeated with some modifications
to syntax, morphology, or word order, etc.
Complexity  5  Total_Words –  Total number of words in a speech
sample.
 6  ML_AS –  The average number of morphemes per
AS unit.
 7  Subordination –  Total number of subordination clauses
and verb infinitives divided by total AS
units (Foster, Tonkyn & Wigglesworth
2000).
Accuracy  8  EF_Clause –  Total number of error free clauses (which
has no error in syntax, morphology, or
word order, etc.) in a speech sample.
 9  EF_Clause_Rate –  Total number of error free clauses divided
by total number of clauses.
Lexical Diversity7 10 D –  Adjusted type token ratio8 (Malvern &
Richards 2002)

.  Following Skehan (2009a), we divided fluency into three components: speed, breakdown, and
repair.
.  Following Yuan and Ellis (2003) we used ‘pruned’ words – the words that were repeated, refor-
mulated and reduced were excluded from the calculation.
.  Here we follow the CLAN manual in calling D ‘lexical diversity’ (MacWhinney 2000).
.  The type token ratio is the total number of different words divided by total number of words.
42 Zhan Wang

Coding
The 90 speech samples collected (See Table 6 for the sample size of each ­condition)
were transcribed and coded following CHAT format (MacWhinney 2000) and Task-
profile conventions (Skehan, Chapter 1, this volume). The basic segmentation of
units for analysis was AS Units (Foster, Tonkyn & Wigglesworth 2000). Codes such
as measures of language complexity (e.g. subordination) and language accuracy (e.g.
error-free clauses) were computed by Taskprofile except for lexical diversity, which
was computed by the command ‘VOCD’ in CLAN software (MacWhinney 2000;
­Malvern & Richards 2002; Richards & Malvern 1998).

Analysis
In view of the large number of dependent variables (i.e. speech performance mea-
sures), five MANOVAs were conducted to analyze each experimental condition (i.e.
‘Watched’, ‘On-line Planning’, ‘Watched On-line Planning’, ‘Watched Strategic Plan-
ning’, and ‘Repetition’) in comparison with the control condition. Statistical signifi-
cance is assessed relative to the two-tailed a priori alpha level of 0.05 (p < .05) for all
the measures. In each MANOVA, the dependent variables were the 10 performance
measures as listed in Table 5, and the independent variables were two speaking condi-
tions – the various experimental speaking conditions in comparison with the control
condition.
Before performing the MANOVAs, multivariate normality was examined. The
normal distribution of every dependent variable was examined and all variables that
deviated from normality (p < .001) were transformed into normal distribution using
a logarithm transformation. Standardized skewness and kurtosis were set within the
range of (–2, 2). Cohen’s d (Cohen 1988, 1992, 1994) was used in this study as the form
of effect size measures. Cohen’s d is based on the concept of standardized mean differ-
ence of a contrast (e.g. the difference between mean scores of a control condition and
an experiment), which is easy to comprehend and consistent with Norris and Ortega’s
(2000) meta-analysis of L2 instruction.
In such a study containing 5 MANOVAs, where each MANOVA involves 2 speak-
ing conditions as the independent variables and 10 performance measures as the
dependent variables, a mini meta-analysis based on effect size comparisons is ideal for
comparing the effect of each experimental condition. Confidence intervals, as men-
tioned by Norris and Ortega (2000), gauge the statistical trustworthiness of observed
effects (Rosenthal 1991). Therefore, 95% confidence intervals (CI95) around each
mean effect size were computed. A confidence interval at 95% in a population can be
interpreted as claiming the effect as likely 95% of the time.
On-line time pressure manipulations 43

Results

Pre-test
Two participants who scored 49 and 50 (out of 50) were excluded from the data analy-
sis since their scores were too close to the ceiling. Another participant who dropped
out after completing the first speaking task was excluded too. Table 6 below presents
the means and standard deviations (SD) for the pre-test. An ANOVA showed that
there was no significant difference among the groups in terms of pre-test scores (at
p < .05). The ‘Control’/ ‘Repetition’ group represents a within-subjects design, in which
the same group of participants produced speech samples twice, once for the baseline
performance as ‘Control’ samples, and the other as ‘Repetition’ samples.

Table 6.  Descriptive statistics for pre-test listening scores

Group N Mean SD Min Max

Control/Repetition* 13 35.8 5.3 28 45


Watched 16 37.1 5.7 26 45
Online Planning 16 37.1 5.6 26 46
Watched Online Planning 16 37.4 6.1 26 47
Watched Strategic Planning 16 36.8 6.3 24 48
All 77 36.9 5.7 24 48
*All the conditions are a between-subjects design except for the ‘Control’/
‘Repetition’ conditions.

Speaking conditions
The results of descriptive and inferential statistics are given in Table 7. Since tests of
statistical significance can be greatly affected by sample size, a very weak effect can be
‘statistically significant’ while a strong effect can fail to attain ‘significance’ (Cortina &
Nouri 2000; Hunter & Schmidt 1990; Meehl 1990) if sample sizes are large or small
respectively. However, effect size, which is the standardized index of the magnitude of
an effect, makes it possible to compare the effects of different variables within a given
study or to compare the effects of the same variable across different studies (Cortina &
Nouri 2000: p. 8). It is also unbiased with regard to the scale of the measurement the
researcher used as well as the standard errors of the dependent variables. Therefore,
the effect size of each contrast being significant or not is given in Table 8. The results
in Table 8 serve as a meta-analysis which synthesizes the effects of all the 5 types of
planning conditions relative to the control condition.
44 Zhan Wang

Table 7.  Descriptive and inferential statistics for speaking conditions


Control Watched Online Watched Watched Repetition
group planning online strategic
planning planning
Measures N = 13 N = 16 N = 16 N = 16 N = 16 N = 13

1. Speech_Rate 61.50 76.81** 58.64 61.75 77.22* 75.36***


(15.17) (13.39) (18.41) (17.24) (18.78) (15.06)
2. AS_End_Pause# 3.04 2.05* 4.01 4.54 2.24 1.99***
(1.18) (1.20) (1.88) (2.87) (1.54) (0.90)
3. AS_Mid_Pause# 0.93 0.82 1.25 1.01 0.74 0.81
(0.52) (0.58) (0.62) (0.60) (0.49) (0.38)
4. Reformulation# 5.89 8.32 8.10 10.66* 8.04 7.04
(3.71) (5.73) (5.17) (6.76) (4.99) (3.52)
5. Total_Words 307.50 384.01** 469.10*** 494.00*** 386.10* 376.77***
(75.84) (66.92) (147.23) (137.95) (93.90) (75.30)
6. ML_AS 9.03 10.45* 9.42 10.73* 10.55* 9.75**
(1.87) (1.78) (1.84) (2.52) (1.92) (2.10)
7. Subordination 1.41 1.57* 1.48 1.62** 1.64** 1.58***
(0.16) (0.22) (0.18) (0.24) (0.25) (0.24)
8. EF_Clause 22.81 34.81* 39.38** 49.79*** 35.78* 31.39***
(9.41) (14.46) (18.05) (26.52) (17.11) (13.14)
9. EF_Clause_Rate 0.40 0.53 0.48 0.56* 0.52 0.45**
(0.16) (0.22) (0.17) (0.22) (0.19) (0.19)
10. Lexical_DiversityD 42.93 42.85 48.31 44.68 42.90 44.82
(10.84) (10.74) (9.56) (7.21) (8.48) (8.42)
#Scores have been transformed in order to obtain a normal distribution.
Note: The table presents all the mean scores of the dependent variables (i.e. performance measures).
Standard deviation is given in parentheses. The results of the five MANOVAs comparing each of the
experimental condition with the control condition (using Pillai’s trace) are: ‘Watched’ vs ‘Control’:
F(28) = 3.12, p < .05; ‘Online Planning’ vs ‘Control’: F(28) = 4.53E6, p < .001; ‘Watched Online Planning’ vs
‘Control: F(28) = 6.09E6, p < .001; ‘Watched Strategic Planning’ vs ‘Control’: F(28) = 3, p < .05; ‘Repetition’
vs ‘Control’: F(25) = 37.14, p < .01. Because all the MANOVAs are significant, ANOVAs were followed to
locate the significant contrast (*p < .05; **p < .01, ***p < .001).

From Table 8 we can see that first, ‘Watched’ and ‘Watched Strategic Planning’ have
similar effects on speaking performance. Both of them significantly increased speech
fluency (measured by Speech_Rate) and complexity (measured by Total_Words, ML_
AS, and Subordination), but did not affect speech accuracy measured by the rate of
error-free clauses (EF_Clause_Rate) or lexical diversity. It is worth noting here that the
‘Watched’ condition was designed to reduce time pressure at the stage of conceptual-
ization while ‘Watched Strategic Planning’ was targeted at both ­conceptualization and
On-line time pressure manipulations 45

Table 8.  A synthesis of all the experimental results


Measure Watched Online Watched Watched Task
planning online strategic pepetition
planning planning

Speech_Rate 0.96a 0.25 ns 0.03 ns 0.76 3.35


[CI95] [ 0.17, 1.76 ]b [ -0.51, 1.0 ] [ -0.72, 0.79 ] [ -0.02, 1.55 ] [ 2.11, 4.59 ]
AS_End_Pause 0.85 0.64 ns 0.61 ns 0.58 ns 2.92
[CI95] [ 0.06, 1.64 ] [ -0.13, 1.42 ] [ -0.17, 1.38 ] [ -0.19, 1.35 ] [ 1.77, 4.08 ]
AS_Mid_Pause 0.24 ns 0.66 ns 0.16 ns 0.43 ns 0.63 ns
[CI95] [ -0.51, 1.00 ] [ -0.11, 1.44 ] [ -0.60, 0.92 ] [ -0.33, 1.19 ] [ -0.19, 1.45 ]
Reformulation 0.38 ns 0.52 ns 0.99 0.53 ns 0.50 ns
[CI95] [ -0.38, 1.14 ] [ -0.25, 1.29 ] [ 0.19, 1.79 ] [ -0.23, 1.30 ] [ -0.31, 1.32 ]
Total_Words 0.96a 1.43 1.53 0.76 3.34
[CI95] [ 0.17, 1.76 ] [ 0.58, 2.28 ] [ 0.67, 2.39 ] [-0.02, 1.55 ] [ 2.10, 4.58 ]
ML_AS 0.74 0.20 ns 0.69 0.70 0.89
[CI95] [ -0.04, 1.52 ] [ -0.56, 0.96 ] [ -0.09, 1.46 ] [ -0.08, 1.48 ] [ 0.05, 1.73 ]
Subordination 0.94 0.44 ns 1.16 1.14 1.89
[CI95] [ 0.15, 1.74 ] [ -0.33, 1.2 ] [ 0.34, 1.98 ] [ 0.32, 1.95 ] [ 0.93, 2.86 ]
EF_Clauses 0.93 1.25 1.41 0.99 3.47
[CI95] [ 0.13, 1.73 ] [ 0.42, 2.07 ] [ 0.56, 2.25 ] [ 0.19, 1.79 ] [ 2.20, 4.74 ]
EF_Clause_Rate 0.69 ns 0.49 ns 0.89 0.74 ns 1.26
[CI95] [ -0.08, 1.47 ] [ -0.28, 1.26 ] [ 0.10, 1.68 ] [ -0.04, 1.52 ] [ 0.39, 2.14 ]
Lex.DiversityD 0.01 ns 0.56 ns 0.26 ns 0.05 ns 0.73 ns
[CI95] [ -0.74, 0.77 ] [ -0.21, 1.33 ] [ -0.50, 1.02 ] [ -0.71, 0.80 ] [ -0.10, 1.56 ]
Note: This analysis synthesizes the effect sizes of each experimental condition relative to the control condition.
Significant contrasts at p < .05; ns = non-significant.
a Effect size d
b Lower and upper 95% Confidence Interval.

formulation. In comparison to the ‘Watched’ condition, participants in ‘Watched Stra-


tegic Planning” had 3 minutes’ strategic planning time before speaking to solve antici-
pated linguistic formulation problems. However it seems that having 3 more minutes
to prepare after watching the movie made no difference from the more limited condi-
tion of directly narrating the story after watching the movie.
Second, ‘On-line Planning’, which was designed to reduce time pressure at the lin-
guistic formulation stage and hypothesized to increase speech accuracy, did not have
any significant effects on general measures of speech fluency, complexity, and accu-
racy. It did generate significant effects with speech length (measured by Total_Words)
46 Zhan Wang

and the number of error free clauses (measured by EF_Clause) that were produced.
However, these two effects were likely to be the result of the extended speaking time,
so that speech quantity was increased.
Third, unlike the ‘On-line Planning’ condition, ‘Watched On-line Planning’
significantly enhanced speech complexity (measured by Total_Words, ML_AS,
and Subordination) and accuracy (measured by EF_Clause and EF_Clause_Rate).
In addition, ‘Watched On-line Planning’ was the only condition that significantly
increased the number of reformulations – an indicator of less fluency and more
self-repairs, which actually provides evidence for learners’ greater engagement in
the ­on-line planning and monitoring activities compared to the control condition.
It seems that although both ‘On-line Planning’ and ‘Watched Online Planning’ are
supposed to influence on-line linguistic formulation, only the ‘Watched On-line
Planning’ condition enhanced performance through speaking in a more complex
and more accurate way. We will discuss in detail later why these two conditions pro-
duced such contrasting results.
Fourth, the ‘Repetition condition, which was supposed to release time pressure at
all three speaking stages, generated significant improvement in speech fluency, com-
plexity, and accuracy. The results therefore lend support to the previous hypotheses.
Moreover, the magnitude of effects for the ‘Repetition’ condition is the largest among
all the conditions which were used.9
Last but not the least, none of the experimental conditions had a significant effect
on lexical diversity (measured by D), which is consistent with the general findings in
L2 planning studies (e.g. Ortega 1999; Yuan & Ellis 2003). Ortega used the type-token
ratio as a measure and did not find a significant planning effect with lexical variety.
Similarly, Yuan and Ellis (2003) did not find an effect of strategic planning or on-line
planning on lexical variety relative to No Planning either. It seems that learners’ lexical
performance is task dependent. As Skehan (2009b) and Skehan and Foster (2008) have
found, different tasks (Personal, Narrative and Decision-making tasks) resulted in sig-
nificantly different lexical sophistication10 scores (Read, 2000) measured by Lambda.11
Tavakoli and Foster (2008) also demonstrated that a task with storyline background
produced higher lexical diversity D than a task without background in unstructured
tasks (but not in structured tasks) for EFL learners. They argued that it may be the

.  ‘Repetition’ is the only condition that used within-subject design. Such repeated measures may
slightly increase the effect sizes (Cortina & Nouri 2000).
.  This lexical measure computes how many difficult words are used in a text defined by lower
frequencies on the basis of a certain frequency list from corpus analysis.
.  This uses a Poisson distribution to identify events which have low frequency levels, following
Meara and Bell (2001) and Bell (2003) (see Skehan 2009a, and Chapter 1, this volume, for more
details).
On-line time pressure manipulations 47

number of events in tasks that determine the extent of lexical variety that L2 speakers
use – more events, more diversity of vocabulary (p. 462).
Table 9 further summarizes the above results. Four patterns can be identified from
the table (and in relation to Table 3):
1. All the experimental conditions that contained ‘pre-watching’ had a positive effect
on speech complexity.
2. All the ‘pre-watching’ conditions that did not involve ‘on-line planning’ improved
speech fluency as well – indicating that reducing time pressure at conceptualiza-
tion had positive effects on speech complexity and fluency.
3. The experimental conditions that had time pressure reduction at both conceptu-
alization and on-line formulation (i.e. ‘Watched On-line Planning’) had a positive
effect on speech accuracy.
4. The only condition that had positive effects on all the three components of speak-
ing performance (i.e. fluency, complexity and accuracy) is the ‘Repetition’ condi-
tion, which targets time pressure reduction at conceptualization, formulation, and
articulation.

Table 9.  Comparing each experimental condition with the control condition
Experimental conditions Complexity Accuracy Fluency Lexis

Watched highera nsb higher ns


Watched Strategic Planning higher ns higher ns
Online Planning ns ns ns ns
Watched Online Planning higher higher lower/ns ns
Repetition higher higher higher ns
a ‘higher’/‘lower’ refers to a certain intervention that has significantly higher/lower complexity/
accuracy/fluency than the control condition;
b  ‘ns’ refers to no significant difference that was found.

Discussion

This study started with a discussion of the stages of L2 speech production. It then
explored methods of achieving time pressure reduction for L2 speakers, drawing upon
Ellis’ task-based planning framework. A study was designed to explore the compara-
tive effectiveness of several different research conditions. The results obtained from
the study demonstrated that different interventions had different effects on speech
performance. In this section, we mainly discuss the following three issues:

1. Why did time pressure reduction at the conceptualization stage result in higher
language complexity and fluency (as in the ‘Watched’ and ‘Watched Strategic’
conditions)?
48 Zhan Wang

2. Why did time pressure reduction solely at the on-line formulation stage fail to
improve the quality of speech (as in the ‘On-line Planning’ condition) whereas
intervention targeting both the formulation and conceptualization stages resulted
in higher speech complexity and accuracy (as in the ‘Watched On-line Planning
condition)?
3. Why did the conditions involving monitoring (as in ‘Watched On-line Planning’
that involves on-line monitoring and ‘Repetition’ that involves speech perception
monitoring) result in higher speech accuracy?

Skehan et al. (2012) have argued that ‘working with ideas’, ‘rehearsing’, and ‘monitor-
ing’ are the three processes that influence how L2 speech is produced and what the
nature of the speech performance will be. This analysis may provide answers to the
above questions. Based on the results of this study, and trying to connect pedagogical
interventions with the speech production processes, I adopt their generalization and
revise the three processes into ‘content conceptualization’, ‘linguistic formulation’, and
‘speech monitoring’ (See Table 10).

Table 10.  An instructional model of L2 speech interventions


Influence

Intervention focus Complexity Accuracy Fluency


(syntactic) (speech rate)

Content conceptualization + +
Linguistic formulation (+) –
Speech monitoring +
+ refers to a positive effect; – refers to a negative effect
(+) refers to a conditional positive effect (e.g. the intervention targeting linguistic
formulation may have a positive effect if the conceptualization pressure has been dealt with).

Table 10 presents an instructional model of L2 speech interventions. First of all,


following L2 speech production theories from among others Bygate (2001), Bygate
and Samuda (2005), Ellis (2005), Kormos (2006), Skehan (2009a), Skehan et al. (2012),
the model argues that the three processes (i.e. content conceptualization, linguistic
formation, and speech monitoring) should be the focus of speech interventions. The
Levelt (1989) model proposed all the processing stages/phases of speaking. However,
not all the processes in the Levelt model should be the pedagogical focus. As argued by
Bygate and Samuda (2005), speech articulation ‘is not thought to be a major drain on
attention capacity’; it is unlikely to be the focus of explicit planning (p. 43); nor should
it be the focus of language interventions for adult learners who are already proficient
at L2 pronunciation. Instead, monitoring, which has often been neglected in many
L2 speaking curricula and methods, should be highlighted in language instruction.
On-line time pressure manipulations 49

This is because monitoring is involved in almost every process of speech production,


especially with conceptualization, formulation, and the links between the two (since
articulation is largely an automatic process) (Bygate 2001, p. 25; Bygate & Samuda
2005, pp. 44–45). The quality of monitoring therefore directly concerns the quality
of speaking performance especially regarding speech accuracy – as indicated by this
study. Second, based on the results of this study, the model lists the effects of differ-
ent interventions on speech performance, which connects psycholinguistic process-
ing with potential language learning products. The results of this study indicate that
interventions at speech conceptualization enhance language complexity and fluency;
interventions at the formulation stage influence language fluency and may improve
language accuracy too (if the conceptualization pressure has been dealt with); and
more attention for monitoring speech production enhances language accuracy. More
detailed discussions of the evidence and pedagogical suggestions are provided in the
following sections.

Intervention targeting content conceptualization


Interventions at content conceptualization (Bygate & Samuda 2005) or working with
ideas (Skehan et al. 2012) can extend and organize the content of what is being said.
In this respect, the pre-watching condition actually allowed speakers to organize the
ideas to be expressed. Given that syntactic structure is strongly influenced by the out-
put of the conceptualization stage, that is, the pre-verbal message (Levelt 1989, 1999),
the conditions allowing pre-watching increased the scale or range of ideas and clause
embedding so that when speech performance was assessed through complexity indi-
ces such as total words, mean length of AS Unit, and the number of subordinations per
AS Unit, significantly higher complexity was found for the pre-watching conditions.
Although the present study is based on L2 data, the raised complexity applies to both
L1 and L2 speech production because the speaking stage at conceptualization is largely
controlled processing for both L1 and L2. The pre-watching effect on language com-
plexity found in this study is consistent with pre-task planning research in L1 speaking
(Foster 2001; Skehan 2009a, 2009b; Skehan & Foster 2007, 2008) as well as in L2 speak-
ing (Kawauchi 2005; Ortega 1999; Tavakoli & Skehan 2005).
Intervention at conceptualization can also enhance speech fluency. This is
because the parallel processing assumption of L2 speaking (Bygate & Samuda 2005;
Kormos 2006; this study) suggests that language fluency is related to both the stages
of conceptualization and formulation, so that acceleration and smoothing in either
stage would help improve fluency and vice versa, a result pointed out by Bygate and
Samuda (2005) as ‘speedier’ (and more ‘accurate’) speech performance (p. 45). It is
assumed that having pre-watching before speaking probably accelerates the process-
ing of ­conceptualization during speaking. The results from this study, by and large,
lend support to these assumptions. Conceptualization is eased in the ‘Watched’ and
50 Zhan Wang

‘Watched Strategic Planning’ conditions and shows increased fluency. However,


‘Watched On-line Planning’ though containing a ‘pre-watching’ facilitation of content
­conceptualization, resulted in significantly more reformulations (which means more
breakdowns and less fluency) than the control condition. It seems that in the ‘Watched
On-line Planning’ condition, the on-line planning component mitigated the effect of
the pre-watching advantage on speech fluency. The effect of pre-watching on fluency
found in this study is consistent with pre-task planning research in both L1 (Foster
2001; Foster & S­ kehan 1996; Ortega 1999; Skehan & Foster 2007, 2008) and L2 speak-
ing (Mehnert 1998; Ortega 1999; Sangarun 2005; Skehan & Foster 1997, 2005; Tajima
2003; Tavokoli & Skehan 2005; Gilabert 2007; Wendel 1997; Wigglesworth 1997).

Intervention targeting linguistic formulation


Interventions at linguistic formulation have been hypothesized to increase speech accu-
racy (Table 3). However, the pure ‘On-line Planning’ condition in this study was not
found to improve the quality of speech performance significantly. In contrast, ­on-line
planning with pre-watching (the ‘Watched On-line Planning’ condition) improved
speech accuracy (and speech complexity as well). This could be termed a ‘conceptu-
alized on-line planning’ effect. That conceptualized on-line planning helps language
complexity and accuracy can be explained by the incremental feature of L1 and L2
speech production. Indeed, sequentially, knowing ‘what to say’ is a pre-requisite for
knowing ‘how to say’ (Ellis 2003, p. 109). Knowing ‘what to say’ might help speakers
use the spare capacity for monitoring linguistic formulation (Bygate & Samuda 2005).
This implies that on-line planning if there is no prior conceptualization might not
have much effect on syntactic formulation. It is also likely that a speaker will not direct
their attention to formulation (even when they have been given on-line planning time)
unless the conceptualization pressure is dealt with – a similar natural tendency to the
‘meaning-priority’ principle in listening (VanPatten 1990), a point which is also raised
by Skehan (1998) and Bygate and Samuda (2005) regarding speech production.
A similar operationalization of conceptualized on-line planning can be found in
studies by Ellis (1987) and Yuan and Ellis (2003). They operationalized on-line plan-
ning as providing learners unlimited time to produce writing or speaking based on
picture prompts, which means that speakers could have enough time (i.e. unpressured
on-line planning time, Ellis 2005) for both content conceptualization and linguis-
tic formulations under the on-line planning condition. Yuan and Ellis (2003) have
reported similar results to the current study in that syntactic complexity and speech
accuracy were improved.

Intervention targeting speech monitoring


The only two conditions in the study that enhanced speech accuracy are: ‘Watched
On-line Planning’ and ‘Repetition’. Ellis (2003) has argued that the mixed results of
On-line time pressure manipulations 51

the planning effects on speech accuracy in the literature ‘reflect whether learners were
able to, or chose to engage in monitoring while they performed the task’ (p. 131).
Based on the results of speech accuracy in Bui (this volume), Li (this volume), and
this study, I also argue that monitoring is the key to accuracy. Skehan et al. (2012)
have proposed that allocating attentional resources to monitor ‘what is being said
just before it is said’ induces selective attention towards accuracy. ‘Watched On-line
Planning’ freed up attentional resources for conceptualization and also released time
for on-line planning so as to commit more attention to the monitoring of linguistic
structures that are being produced. In Bui’s study, pre-task planning did not help L2
learners improve accuracy whereas ‘familiarity with the speaking topic’ (operational-
ized as the task topic being related to learners’ major of study) did. The advantage of
‘familiarity’ probably allowed less pressure on conceptualization and easier retrieval of
topic-related lexis so as to have more attentional resources to monitor the speech – as
a result, accuracy was increased. Similarly, Li found that having post-task activities
(operationalized as transcribing their own speech products) induced L2 speakers to
produce more accurate language. As Skehan et al. (2012) proposed, learners who knew
they would transcribe their own errors seemed to (selectively) direct their attention to
accuracy during speech.
Following this analysis, it is claimed that the accuracy benefit demonstrated in this
study is not solely because of the interventions at both conceptualization and formu-
lation stages (as in ‘Watched On-line Planning’), but more precisely it is because the
reduction in time pressure at the two stages provides greater opportunities to direct
attentional resources to the monitoring of speech production so that speech accuracy
was raised. The evidence of increased self-repair (measured by reformulations) in the
‘Watched On-line Planning’ condition is essentially evidence for more engaged speech
monitoring.
Two other studies which also provide supportive evidence for this claim are
worth mentioning. Hulstijn and Hulstijn (1984) hypothesized that two conditions in
their study would favour accuracy: (a) instructions to focus-on-form (in contrast to
focus-on-meaning), and (b) slowed-down processing (in contrast to normal process-
ing speed). The results showed that only the focus-on-form condition helped produce
higher grammatical accuracy, while slowed-down processing did not. Interestingly, the
focus-on-form condition led to more time being taken in processing the speech, indi-
cating that focus-on-form might involve a higher level of speech monitoring whereas
slowing-down speech to enable on-line planning might not necessarily. Mochizuki
and Ortega (2008) found similar results in terms of an instructional intervention tar-
geting the monitoring of grammatical structures. They investigated three speaking
conditions in a narrative task with an auditory stimulus: no planning, unguided plan-
ning, and guided planning (operationalized as providing printed instructions on how
to make relative clauses). The results showed that while guided planners had a lower
speech rate than unguided planners and no planners, they had higher accuracy than
52 Zhan Wang

unguided planners in the relative clauses that they produced. All the studies discussed
here are consistent with the generalisation that allowing unlimited time for processing
or ‘Watched On-line Planning’ does not necessarily enhance accuracy, but directing
learners attention to speech monitoring often does. This claim can then explain why
mixed results have been found in the literature regarding whether different types of
planning benefit speech accuracy (Ellis 2009).
Finally an effect for speech monitoring was also found in the ‘Repetition’ con-
dition too. As proposed by Bygate and Samuda (2005), it is likely that speaking for
the first time has already involved the speech comprehension system so that speech
monitoring can operate at three places: the pre-verbal message, the inner speech plan
and overt speech plan (Levelt 1993). In other words, when L2 speakers are actually
speaking for the first time, they become the first (more than anyone else) to parse their
speech. As a result, the degree of monitoring in speech production in the ‘Repetition’
condition is higher than the other conditions that do not involve overt articulation.
Repeating the same task would induce more attention for monitoring, from which the
whole speech performance would benefit. This accuracy benefit found from immedi-
ate task repetition in this study is consistent with the findings in Bygate (1996), and
Gass et al. (1999).
To sum up, based on the results of this study, an instructional model of L2 speech
intervention was proposed (in Table 10). It suggests that different instructions will
enhance different aspects of language. First, L2 complexity could be enhanced by
interventions focusing on conceptualization. Second, speech fluency can be improved
by the manipulation of either conceptualization or formulation: easing conceptualiza-
tion or enabling rehearsal at the formulation stage could increase fluency but expand-
ing on-line formulation could decrease fluency to some extent. Third, interventions
focusing on speech monitoring is the key to improving language accuracy.

Conclusion

Researchers are interested in models of second language speaking because such mod-
els can uncover the subtle underlying mechanisms of speech production. Second
language pedagogy needs instructional models because they help teachers teach in
a systematic and effective way. The overarching goal of this study is to connect L2
speech production theories and instruction in order to develop an evidence-based
instructional model for L2 teaching. I have tried to accomplish this goal by establish-
ing a relation between the points of interventions with different processes of speech
production, on the one hand, and with performances, on the other. The five different
types of planning and repetition conditions designed, which are: ‘Watched’, ‘On-line
Planning’, ‘Watched On-line Planning’, Watched Strategic Planning’, and ‘Repetition’
On-line time pressure manipulations 53

represent time pressure reduction at certain production stages when compared with
the control condition.
The results showed that ‘Watched’ and ‘Watched Strategic Planning’ both helped
produce more complex and more fluent language; ‘On-line Planning’ did not help
complexity and accuracy, whereas ‘Watched On-line Planning’ did help produce more
complex and more accurate language but with a trade-off of having more reformu-
lations in speech; repetition is a robust condition that promoted speech complexity,
accuracy, and fluency with large effect sizes.
These results lead to the question as to why ‘On-line Planning’, which is s­ upposed
to direct attention to on-line formulation, did not help language accuracy but ‘Watched
On-line Planning’ did; and further, why there are often mixed results with accuracy in
task-based planning research. What has been proposed here is that L2 speakers are not
likely to attend to form unless conceptualization pressure has been solved – a ‘mean-
ing priority’ principle in L2 speaking. Because of this, ‘Watched On-line Planning’ has
been described as conceptualized on-line planning. It is argued that conceptualized
on-line planning has a greater chance, in terms of time and attentional resources, to
focus on speech monitoring. The evidence from this study as well as a range of other
empirical studies is consistent with this claim, such as in Bui (this volume), H ­ ulstijn
and Hulstijn (1984), Li (this volume), Mochizuki and Ortega (2008), and Yuan and Ellis
(2003). These studies, together with the findings from the ‘Watched On-line P ­ lanning’
and ‘Repetition’ conditions of this study, all report an accuracy effect for second lan-
guage speaking. It is concluded that speech monitoring is the key to L2 speech accuracy.

Author note

The author would like to express gratitude to Peter Skehan, Martin Bygate, John ­Norris,
Kris Van den Branden, and Rod Ellis for their helpful comments on earlier versions
of this article.

References

Ahmadian, M.J., & Tavakoli, M. (2011). The effects of simultaneous use of careful online planning
and task repetition on accuracy, fluency, and complexity of EFL learners’ oral production. Lan-
guage Teaching Research, 15, 35–59.
Anderson, J.R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.
Anderson, J.R., & Lebiere, C. (1998). The atomic components of thought. Mahwah, NJ: Lawrence
Erlbaum Associates.
Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S., Lebiere, C., & Qin, Y. (2004). An integrated
theory of the mind. Psychological Review, 111(4), 1036–1060.
54 Zhan Wang

Baddeley, A.D. (1986). Working Memory. Oxford: OUP.


Baddeley, A.D. (2003). Working memory and language: An overview. Journal of Communication
Disorders, 36, 189–208.
Bell, H. (2003). Using frequency lists to assess L2 texts. Unpublished Ph.D. thesis, University of
Swansea.
Bygate, M. (1996). Effects of task repetition: Appraising the developing language of learners. In
D. Willis & J. Willis (Eds.), Challenge and change in language teaching (pp. 134–146). London:
Heinemann.
Bygate, M. (1999). Task as context for the framing, reframing and unframing of language. System,
27(1), 33–48.
Bygate, M. (2001). Effects of task repetition on the structure and control of oral language. In
M.  Bygate et al., (Eds.), Researching pedagogic tasks: Second language learning, teaching, and
testing (pp. 23–48). Harlow: Longman.
Bygate, M., & Samuda, V. (2005). Integrative planning through the use of task-repetition. In R. Ellis
(Ed.), Planning and task performance in a second language (pp. 37–76). Amsterdam: John
Benjamins.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Law-
rence Erlbaum Associates.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.
Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49, 997–1003.
Cortina, J.M., & Nouri, H. (2000). Effect size for ANOVA Designs. State University Papers Series on
Quantitative Applications in the Social Sciences, 07–129. Thousand Oaks, CA: Sage.
Crookes, G. (1989). Planning and interlanguage variation. Studies in Second Language Acquisition,
11, 367–83.
De Jong, N. & Perfetti, C.A. (2011). Fluency training in the ESL classroom: An experimental study of
fluency development and proceduralization. Language Learning, 61, 533–568.
Dörnyei, Z., & Scott, M.L. (1997). Communication strategies in a second language: Definitions and
taxonomies. Language Learning, 47, 173–210.
Doughty, C. (2001). Cognitive underpinnings of focus on form. In P. Robinson (Ed.), Cognition and
second language instruction (pp. 206–257). Cambridge: CUP.
Ellis, R. (2009). The differential effects of three types of task planning on the fluency, complexity and
accuracy in L2 oral production. Applied Linguistics, 30(4), 474−507.
Ellis, R. (1987). Interlanguage variability in narrative discourse: Style shifting in the use of the past
tense. Studies in Second Language Acquisition, 9, 1–20.
Ellis, R. (2003). Task-based language learning and teaching. Oxford: OUP.
Ellis, R. (2005). Integrative planning through the use of task-repetition. In R. Ellis (Ed.), Planning
and task performance in a second language (pp. 3–36). Amsterdam: John Benjamins.
Ellis, R. (2008). The study of second language acquisition. Oxford: OUP.
Ellis, R. (2009). The differential effects of three types of task planning on the fluency, complexity and
accuracy in l2 oral production. Applied Linguistics, 30, 474–509.
Ellis, R. & Barkhuizen, G. (2005). Analysing learner language. Oxford: OUP.
Foster, P. (1996). Doing the task better: How planning time influences students’ performance. In
J. Willis & D. Willis (Eds.), Challenge and change in language teaching (pp. 126–135). Oxford:
Heinemann.
Foster, P. (2001). Rules and routines: A consideration of their role in the task-based language
production of native and non-native speakers. In M. Bygate, P. Skehan, & M. Swain (Eds.),
Researching pedagogic tasks: Second language learning, teaching, and testing (pp. 23–48).
­Harlow: Longman.
On-line time pressure manipulations 55

Foster, P., Tonkyn, A., & Wigglesworth, J. (2000). Measuring spoken language: A unit for all reasons.
Applied Linguistics, 21(3), 354−75.
Foster, P., & Skehan, P. (1996). The influence of planning on performance in task-based learning.
Studies in Second Language Acquisition, 18, 299–324.
Foster, P., & Skehan, P. (1999). The influence of source of planning and focus of planning on task-
based performance. Language Teaching research, 3, 185–214.
Gass, S., Mackey, A., Álvarez-Torres, M.J., & Fernández-García, M. (1999). The effects of task repeti-
tion on linguistic output. Language Learning, 49, 549–581.
Gilabert, R. (2007). Effects of manipulating task complexity on self-repairs during L2 oral produc-
tion. IRAL, 45, 215–240.
Guará-Tavares, M.G. (2008). Pre-task planning, working memory capacity and L2 speech performance.
Unpublished Ph.D. thesis. Universidade Federal de Santa Catarina, Brazil.
Hinkel, E. (2004). TOEFL test strategies with practice tests (3rd ed.) Hauppauge, NY: Barron’s.
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition.
Applied Linguistics, 30(4), 461–473.
Hulstijn, J.H., & Hulstijn, W. (1984). Grammatical errors as a function of processing constraints and
explicit knowledge. Language Learning, 34, 23–43.
Hunter, J.E., & Schmidt, F.L. (1990). Methods of meta-analysis: Correcting error and bias in research
findings. Newbury Park, CA: Sage.
Kawauchi, C. (2005). The effects of strategic planning on the oral narratives of leaners with low and
high intermediate L2 proficiency. In R. Ellis (Ed.), Planning and task performance in a second
language (pp. 37–76). Amsterdam: John Benjamins.
Kello, C.T, & Plaut, D. (2003). Strategic control over rate of processing in word reading: A computa-
tional investigation. Journal of Memory and Language, 48, 207–232.
Kello, C.T. (2004). Control over the time course of cognition in the tempo-naming task. Journal of
Experimental Psychology: Human Perception and Performance, 30(5), 942–955.
Kello, C.T., & Plaut, D.C. (2000). Strategic control in word reading: Evidence from speeded respond-
ing in the tempo-naming task. Journal of Experimental Psychology: Learning, Memory, & Cogni-
tion, 26, 719–750.
Kello, C., Plaut, D., & MacWhinney, B. (2000). The task-dependence of staged versus cascaded pro-
cessing: An empirical and computational study of Stroop interference in speech production.
Journal of Experimental Psychology: General, 129(3), 340–360.
Kempen, G., & Hoenkamp, E. (1987). An incremental procedural grammar for sentence formula-
tion. Cognitive Science, 11, 201–258.
Kormos, J. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence
­Erlbaum Associates.
Kroll, J.F., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence
for asymmetric connections between bilingual memory representations. Journal of Memory and
Language, 33, 149–174.
Lashley, K.S. (1951). The problem of serial order in behavior. In L.A. Jeffress (Ed.), Cerebral mecha-
nisms in behavior (pp. 112–146). New York, NY: Wiley.
Levelt, W.J.M, Roelofs, A., & Meyer, A.S. (1999). A theory of lexical access in speech production.
Behavioral and Brain Sciences, 22, 1–75.
Levelt, W.J.M. (1983). Monitoring and self-repair in speech. Cognition, 33, 41–103.
Levelt, W.J.M. (1989). Speaking: From intention to articulation. Cambridge, MA: The MIT Press.
Levelt, W.J.M. (1993). Language use in normal speakers and its disorders. In G. Blanken, J. D
­ ittmann,
H. Grimm, J.C. Marshall, & C–W. Wallesch, (Eds.), Linguistic disorders and pathologies
(pp. 1–15). Berlin: De Gruyter.
56 Zhan Wang

Levelt, W.J.M. (1999). Producing spoken language: A blueprint of the speaker. In C. Brown &
P. Hagoort (Eds.), Neurocognition of language (pp. 83–122). Oxford: OUP.
Levelt, W.J.M. (2001). Spoken word production: A theory of lexical access. Proceedings of the National
Academy of Sciences USA, 98(23), 13464–13471.
Long M., & Robinson, P. (1998). Focus on form: Theory, research, and practice. In C. Doughty &
J. Williams (Eds.), Focus on form in classroom SLA (pp. 15–41). Cambridge: CUP.
Lynch, T., & Maclean, J. (2000). Exploring the benefits of task repetition and recycling for classroom
language learning. Language Teaching Research, 4, 221–50.
Lynch, T., & Maclean, J. (2001). Effects of immediate task repetition on learners’ performance. In
M. Bygate, P. Skehan, & M. Swain (Eds.), Researching pedagogic tasks, second language learning,
teaching and testing (pp. 99–118). Harlow: Longman.
MacWhinney, B. (2000). The CHILDES Project: Tools for Analyzing Talk (3rd ed.). Mahwah, NJ: Law-
rence Erlbaum Associates.
Malvern, D., & Richards, B. (2002). Investigating accommodation in language proficiency interviews
using a new measure of lexical diversity. Language Testing, 19, 85–104.
Meara, P., & Bell, H. (2001). P_Lex: A simple and effective way of describing the lexical characteris-
tics of short L2 texts. Prospect, 16(3), 5–19.
Meehl, P.E. (1990). Why summaries of research on psychological theories are often uninterpretable.
Psychological Reports, 66, 195–244.
Mehnert, U. (1998). The effects of different lengths of time for planning on second language perfor-
mance. Studies in Second Language Acquisition, 20, 83–108.
Meyer, D.E., & Gordon, P.C. (1985). Speech production: Motor programming of phonetic features.
Journal of Memory and Language, 24, 3–26.
Mochizuki, N., & Ortega, L. (2008). Balancing communication and grammar in beginning level for-
eign language classrooms: A study of guided planning and relativization, Language Teaching
Research, 12, 11–37.
Norris, J.M., & Ortega, L. (2009). Towards an organic approach to investigating CAF in SLA: The case
of complexity. Applied Linguistics, 30(4), 555–578.
Norris, J.M., & Ortega, L. (2000). Effectiveness of L2 Instruction: A research synthesis and quantita-
tive meta-analysis. Language Learning, 50(3), 417–528.
Ortega, L. (1999). Planning and focus on form in L2 oral performance. Studies in Second Language
Acquisition, 21, 109–148.
Read, J. (2000). Assessing vocabulary. Cambridge: CUP.
Richards, B.J., & Malvern, D.D. (1998). A new research tool: Mathematical modelling in the measure-
ment of vocabulary diversity (Award reference no. R000221995). Final Report to the E ­ conomic
and Social Research Council, Swindon, UK.
Robinson, P. (1995). Task complexity and second language narrative discourse. Language Learning,
45, 99–140.
Robinson, P. (2011). Task-based language learning: A review of issues. Language Learning,
61(Suppl. 1), 1–36.
Roelofs, A. (1997). The WEAVER model of word-form encoding in speech production. Cognition,
64, 249–284.
Rosenthal, R. (1991). Meta-analytic procedures for social research. Newbury Park, CA: Sage.
Samuda, V., & Bygate, M. (2008). Tasks in second language learning. Basingstoke: Palgrave.
Sangarun, J. (2005). The effects of focusing on meaning and form in strategic planning. In R. Ellis (Ed.),
Planning and task performance in a second language (pp. 111–141). Amsterdam: John Benjamins.
On-line time pressure manipulations 57

Sawaki, Y., Stricker, L.J., & Oranje, A.H. (2009). Factor structure of the TOEFL internet-based test.
Language Testing, 26(1), 5–30.
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11,
129–158.
Schneider, W., & Chein, J.M. (2003). Controlled & automatic processing: Behavior, theory, and bio-
logical mechanisms. Cognitive Science, 27, 525–559.
Schriefers, H., Meyer, A.S., & Levelt, W.J.M. (1990). Exploring the time course of lexical access in
language production: Picture-word interference studies. Journal of Memory and Language, 29,
86–102.
Seidenberg, M.S. (1997). Language acquisition and use: Learning and applying probabilistic con-
straints. Science, 275, 1599–1603.
Shiffrin, R.M., & Schneider, W. (1977). Controlled and automatic human information processing,
II: Perceptual learning, automatic attending and a general theory. Psychological Review, 84(2),
127–190.
Skehan, P. (1998). A cognitive approach to language learning. Oxford: OUP.
Skehan, P. (2009a). Modelling second language performance: Integrating complexity, accuracy,
­fluency and lexis. Applied Linguistics, 30(4), 510–532.
Skehan, P. (2009b). Lexical performance by native and non-native speakers on language-learning
tasks. In H. Daller, D. Malvern, P. Meara, J. Milton, B. Richards, & J. Treffers-Daller (Eds.),
Vocabulary studies in first and second language acquisition: The interface between theory and
application (pp. 107–124). London: Palgrave Macmillan.
Skehan, P., & Foster, P. (1997). The influence of planning and post-task activities on accuracy and
complexity in task-based learning. Language Teaching Research, 1(3), 16–33.
Skehan, P., & Foster, P. (1999). The influence of task structure and processing conditions on narrative
retellings. Language Learning, 49, 93–120.
Skehan, P., & Foster, P. (2005). Strategic and online planning: The influence of surprise information
and task time on second language performance. In R. Ellis (Ed.), Planning and task performance
in a second language (pp. 193–218). Amsterdam: John Benjamins.
Skehan, P., & Foster, P. (2008). Complexity, accuracy, fluency and lexis in task-based performance:
A meta-analysis of the Ealing research. In S. Van Daele, A. Housen, F. Kuiken, M. Pierrard, &
I. Vedder, (Eds.), Complexity, accuracy and fluency in second language use, learning and teaching
(pp. 263–284). Brussels: Royal Flemish Academy of Belgium for Sciences and Arts.
Skehan, P., Bei, X., Li, Q., & Wang, Z. (2012). The task is not enough: Processing approaches to task-
based performance. Language Teaching Research, 16(3), 170–187.
Squire, L.R. (1987). Memory and brain. Oxford: OUP.
Tajima, M. (2003). The effects of planning on oral performance of Japanese as a foreign language.
Unpublished Ph.D. thesis, Purdue University.
Tavakoli, P., & Foster, P. (2008). Task design and second language performance: The effect of narra-
tive type on learner output. Language Learning, 58, 439–473.
Tavakoli, P., & Skehan, P. (2005). Strategic planning, task structure, and performance testing. In
R. Ellis (Ed.), Planning and task performance in a second language (pp. 239–276). Amsterdam:
John Benjamins.
Ullman, M.T. (2001a). The declarative/procedural model of lexicon and grammar. Journal of Psycho-
linguistic Research, 30(1), 37–69.
Ullman, M.T. (2001b). The neural basis of lexicon and grammar in first and second language: The
declarative/procedural model. Bilingualism: Language and Cognition, 4(1), 105–122.
58 Zhan Wang

Ullman, M.T. (2004). Contributions of memory circuits to language: The declarative/procedural


model. Cognition, 92(1–2), 231–270.
Ullman, M.T. (2008). The role of memory systems in disorders of language. In B. Stemmer & H.A.
Whitaker (Eds.), Handbook of the neuroscience of language (pp. 189–198). Oxford: Elsevier.
Ullman, M.T., Pancheva, R., Love, T., Yee, E., Swinney, D., & Hickok, G. (2005). Neural correlates of
lexicon and grammar: Evidence from the production, reading, and judgment of inflection in
aphasia. Brain and Language, 93(2), 185–238.
VanPatten, B. (1990). Attending to content and form in the input: An experiment in consciousness.
Studies in Second Language Acquisition, 12, 287–301.
Wendel, J. (1997). Planning and second language narrative production. Unpublished Ph.D. thesis,
Temple University, Japan.
Wigglesworth, G. (1997). An investigation of planning time and proficiency level on oral test dis-
course. Language Testing, 14, 85–106.
Yuan, F., & Ellis, R. (2003). The Effects of pre-task planning and online planning on fluency, complex-
ity, and accuracy in L2 monologicoral production. Applied Linguistics, 24, 1–2.

Appendix A  The material content (story scenes)

Story 1 Mr. Bean Had a ‘Sleepless Night’


1. Cleaning teeth with an electronic toothbrush
2. Washing mouth with a toy water gun
3. Using the toothbrush to clean ears
4. Saying good night to the mirror
5. Asking Teddy to go to bed
6. Reading a book for Teddy and laughing foolishly
7. Putting a pair of glasses onto the Teddy
8. Waving “Good night” to Teddy
9. Putting Teddy onto the bed
10. Shooting the light by a gun to switch it off
11. The clock is making a loud noise
12. Another noise from outside of the window
13. Making himself up as a pig to drive away the cats outside
14. Going back to bed but unfortunately is asphyxiated by the pillow
15. Switching on a TV by a spear
16. Chess playing program is on TV
17. Being waken up suddenly by TV advertisement
18. Starting to count the sheep
19. Being confused by the number
20. Getting an answer from a calculator
On-line time pressure manipulations 59

Story 2 Mr. Bean went ‘Shopping’


1. Showing off his credit card in a Department store
2. Being disgusted by perfume
3. Crawling on the floor
4. Persuade a woman from moving on
5. Going to the tooth brush shelves
6. Unpacking and trying a toothbrush
7. Taking an intact toothbrush
8. Trying on a bathroom towel
9. Going to the hardware section
10. Paring a potato
11. Selecting the pans
12. Taking out a fish from pocket to try a pan
13. Being annoyed by the soundless telephones
14. Picking up the saleswoman’s phone set
15. Checking out and showing off his card again
16. His card was swapped by an old man by mistake
17. Trying to steal back his card
18. Following the old man to a toilet
19. Helping the man find the toilet paper
20. Shocked the old man.

Appendix B  Task instructions

Condition [1] The ‘Control’ Condition


You will see a section of a video from the Mr. Bean series. The section will last for 5 minutes.
While you are watching the video for the first time, I would like you to tell the story of what is
happening.
Imagine you are telling the story to someone who has never seen this video, and cannot see the
screen at the same time as you. You should try to tell the story in the same time that the video
runs. As the events in the story take place, tell the story to this person; when the video stops you
should be finishing your story, and you should stop too.
Please be as detailed as you can when you are telling the story. Try to use ‘Mr. Bean’ or ‘He’
as the subject of the story, and try to say what is happening at any point, probably using the
­present tense. For example:
Mr. Bean is watching TV.
He feels a bit tired.
60 Zhan Wang

Condition [2] The ‘Watched’ condition


You will see a section of a video from the Mr. Bean series. The section will be played for you
twice. While you are watching for the second time; I would like you to tell the story of what is
happening. You can use the first watch as a preparation for your narrative.
Imagine you are telling the story to someone who has never seen this video, and cannot see the
screen at the same time as you. You should try to tell the story in the same time that the video
runs. As the events in the story take place, tell the story to this person; when the video stops you
should be finishing your story, and you should stop too.
Please be as detailed as you can when you are telling the story. Try to use ‘Mr. Bean’ or ‘He’
as the subject of the story, and try to say what is happening at any point, probably using the
­present tense. For example:
Mr. Bean is watching TV.
He feels a bit tired.

Condition [3] The ‘Online Planning’


You will see a section of a video from the Mr. Bean series. The section will last for 8 minutes.
While you are watching the video for the first time, I would like you to tell the story of what is
happening.
Imagine you are telling the story to someone who has never seen this video, and cannot see the
screen at the same time as you. You should try to tell the story in the same time that the video
runs. As the events in the story take place, tell the story to this person; when the video stops you
should be finishing your story, and you should stop too.
Please be as detailed as you can when you are telling the story. Try to use ‘Mr. Bean’ or ‘He’
as the subject of the story, and try to say what is happening at any point, probably using the
­present tense. For example:
Mr. Bean is watching TV.
He feels a bit tired.

Condition [4] ‘Watched Online Planning’


You will see a section of a video from the Mr. Bean series. While you are watching for the
­second time; I would like you to tell the story of what is happening. You can use the first watch
as a preparation for your narrative.
Imagine you are telling the story to someone who has never seen this video, and cannot see the
screen at the same time as you. You should try to tell the story in the same time that the video
runs. As the events in the story take place, tell the story to this person; when the video stops you
should be finishing your story, and you should stop too.
Please be as detailed as you can when you are telling the story. Try to use ‘Mr. Bean’ or ‘He’
as the subject of the story, and try to say what is happening at any point, probably using the
­present tense. For example:
Mr. Bean is watching TV.
He feels a bit tired.
On-line time pressure manipulations 61

Condition [5] ‘Watched Strategic Planning’


You will see a section of a video from the Mr. Bean series. The section will be played for you
twice. There is a 3-minute interval between your first watch and the second watch. While you
are watching for the second time, I would like you to tell the story of what is happening. You
can use the first watch as a preparation and you can use 3 minute interval to plan your narrative.
Imagine you are telling the story to someone who has never seen this video, and cannot see the
screen at the same time as you. You should try to tell the story in the same time that the video
runs. As the events in the story take place, tell the story to this person; when the video stops you
should be finishing your story, and you should stop too.
Please be as detailed as you can when you are telling the story. Try to use ‘Mr. Bean’ or ‘He’
as the subject of the story, and try to say what is happening at any point, probably using the
­present tense. For example:
Mr. Bean is watching TV.
He feels a bit tired.

Condition [6] ‘Repetition’


The task instructions for this condition are the same as the ‘Control’ condition. However, the
participants did not know that they would be told to carry out the same task again until they
have finished speaking one time. In other words, the researcher tried to obtain independent
measures of the ‘Control’ condition and the ‘Repetition’ condition. There was a one minute
interval between the two performance as the researcher used the time to tell the speaker to con-
tinue with a next task (e.g., ‘Repetition’) and to play the same instructions again (then followed
by the video for narration).
chapter 3

Task readiness
Theoretical framework and empirical evidence
from topic familiarity, strategic planning,
and proficiency levels*

Bui Hiu Yuet Gavin


Hang Seng Management College, Hong Kong

The construct of planning, operationalized as strategic planning, rehearsal and on-line


planning (Ellis 2009), has been much studied in the task-based language teaching
literature. These forms of planning could be thought of as task-external readiness
in which extra preparatory time is provided for learners to focus their attention
on certain performance areas. This chapter proposes a theoretical framework of
task-readiness as an extension to planning so that task research in planning could
broaden its horizons from a task-external perspective to also include a task-internal
perspective, that is, familiarity with aspects of a task.
To examine the relationship between task-external and task internal readiness,
this study explores the effects of topic familiarity (task-internal readiness), strategic
planning (task-external readiness), and proficiency levels (an individual difference)
in a 2 × 2 × 2 split-plot factorial design. The results show that both topic familiarity
and s­ trategic planning promoted more fluent language, but strategic planning
was a ­stronger form of task-readiness as indicated by its effect sizes. In contrast,
topic familiarity induced more accurate performance from the participants, while
planning was associated with significantly higher complexity. Proficiency seemed to
be positively related to formal accuracy rather than to fluency as higher proficiency
participants always scored higher in accuracy and sometimes in complexity, but not
so much in fluency. These findings suggest that though task-internal readiness and
task-external readiness share common factors in rendering assistance to learners, they
differ in their influence on various performance areas as well as the magnitude of the
effects. All this lends support to the differentiation between task-external and task-
internal readiness, and to the notion of task-readiness as a contextualizing framework
for relevant task research. Based on the theoretical discussion and empirical results,
pedagogical implications are also outlined in this chapter.

*  I would like to thank the Editor of this volume, Peter Skehan, who was also my Ph.D. supervisor,
for his guidance through this research. Thanks also go to Martin Bygate for his valuable comments
on previous drafts of this chapter.
64 Bui Hiu Yuet Gavin

Introduction

One distinctive feature of second language (L2) speaking is that many learners put
a lot of effort into speaking but still fail to reach native-like proficiency. A tension
between the meaning to express and the appropriate forms to use becomes a major
challenge to L2 learners. While communicative language ability in general involves
the ability to express ideational, interpersonal and discoursal meanings through the
use of formal linguistic resources, L2 development in particular further requires help-
ing learners to achieve the capacity to use resources already available to them (Bygate
2001). There exists a gap between L2 learners’ potential competence and their actual
performance. Such a phenomenon may be attributed to L2 learners’ underdeveloped
proficiency, but on top of this, they also fall prey to their processing capacity limita-
tions (Baddeley 1997; Skehan 1998). Therefore, there is a need to explore pedagogical
tasks and task conditions which go beyond cultivating underlying structural abilities
and which also increase learners’ readiness to handle various communicative needs
(Samuda 2001).
Much current research done to this end has focussed on planning (Ellis 2005,
2009), operationalized in a variety of forms such as pre-task planning and within-task
planning, as a means of maximizing learners’ readiness for tasks (see Wang, C ­ hapter 2,
this volume). Different types of planning have been shown to promote learner per-
formance in different areas, that is, fluency, complexity, and accuracy. What seems
unfortunate is that, after all these studies, we still lack a comprehensive account of the
interrelationship between various types of planning from a more wide-ranging per-
spective. The term “planning” per se, if it is to be used as an umbrella term for concepts
such as rehearsal, strategic planning, and online planning, (Ellis 2005), appears to fall
short of capturing the generic features which are shared, and is a bit too limited in its
scope as a means for preparing students to handle tasks more effectively. Based on an
empirical study, this chapter proposes “task readiness” as an alternative theoretical
framework to “planning” in order that task research can be better contextualized and
the different types of planning can be more clearly inter-connected to each other in
research as well as practice.

A theoretical framework of task readiness

Ellis (2005) distinguished between two types of planning: (1) pre-task planning which
can be further divided into rehearsal and strategic planning, and (2) within-task
­planning that subsumes both pressured and unpressured situations. Rehearsal, simply
put, is to allow learners to practise a task before its actual performance, as e­ xemplified
Task readiness 65

by Bei (2013). Rehearsal usually involves explicit signalling to the learner that the pre-
vious performance may serve as preparation for the next. This makes an interesting
contrast with task repetition (Bygate 2001) in which students receive no briefing about
future performance, thus their drawing on the prior knowledge of the same task for
the following tasks becomes implicit planning (see Table 1 below for the compari-
son). In general both rehearsal and task repetition show very strong positive effects
on fluency, complexity, and/or accuracy (also see Wang 2009; Chapter 2, this volume).
Strategic planning is the most widely studied form of planning in the literature. It is
generally operationalized as offering planning time (Crookes 1989; Foster & Skehan
1996; Skehan & Foster 2005) prior to a task. Strategic planning is in most cases found
to push learners towards more fluent speech which involves more complex clausal
structure, whereas its effects on accuracy are not consistent in the literature (Ellis 2009;
Skehan Bei, Li & Wang 2012). One possible reason for the mixed results with accu-
racy is that studies have differed as to whether the task conditions allowed time for or
encouraged careful on-line planning (i.e. formulation and monitoring of speech plans
during performance) (Yuan & Ellis 2003). Within-task planning, or on-line planning,
is assumed to occur when sufficient time is available for planning during speaking. An
example of unpressured within-task planning is to have learners describe an edited
video which is played at a lower speed (Wang, Chapter 2, this volume). In contrast,
pressured within-task planning does not allow any leeway in gaining extra time for
planning while speaking. Speakers have to engage in real time planning for the ongo-
ing communicative task.
Ellis (2009) slightly revised this system of categorization and talks about three
types of planning: rehearsal, pre-task planning and within-task planning. Even so,
these two categorizations (2005 & 2009) are essentially the same, dwelling on task-
external manipulations of the degree of preparedness for a task. Rehearsal and pre-task
(strategic) planning without doubt prepare learners prior to a task, but within-task
planning can also be viewed as being something that can be increased or decreased so
as to vary the readiness for performance in a series of consecutive segments of strate-
gic planning, carried out ad hoc during a task.
If we adopt a broader perspective on this issue, the notion of planning as prepara-
tion or readiness in order to increase one’s capacity to do a task should extend its hori-
zons beyond these task-external means outlined in Ellis (2005, 2009). Prior knowledge
about, and hence familiarity with, the content of a task or the schemata of a task –
the knowledge or preparedness a speaker brings to any task whether or not pre- or
within-task planning time is provided – should also be incorporated into this broader
sense of planning. This study will provide evidence that familiarity with a certain topic
facilitates learner performance in a variety of ways similar to other types of planning,
albeit different in some other areas as well. Therefore topic familiarity is, one could
66 Bui Hiu Yuet Gavin

argue, a kind of task-internal readiness, or implicit planning, as contrasted with task


external readiness, or explicit planning. The following table displays this extension of
the construct of planning.

Table 1.  A framework of task-readiness


Macro-dimension Micro-dimension Sample studies

–  Topic familiarity (prior This chapter


subject knowledge)
–  Schematic familiarity Skehan & Foster
(structural or (1999)
–  Task-internal
procedural knowledge)
readiness
–  Task familiarity (task Bygate (2001)
(implicit
types)
planning)
–  Task repetition (content Bygate (2001)
repetition without
Task-readiness awareness of future
performance.)
–  Rehearsal (repetition Bei (2013)
with awareness of future
–  Task-external
performance)
readiness
–  Strategic planning Foster & Skehan
(explicit
(pre-task preparation) (1996)
planning)
–  Within-task planning Yuan & Ellis
(online preparation) (2003)

As shown in Table 1, task readiness consists of two macro-dimensions. Obvi-


ously what the second macro-dimension involves are the three common planning
types, those discussed in Ellis (2005 & 2009). The novel part here is the first macro-­
dimension, task-internal readiness, which subsumes four different aspects.
The first kind of task-internal readiness is topic familiarity, which derives from
prior knowledge about a certain domain area, such as medical knowledge on a natural
virus by a medicine major, or the technical specialty about a computer virus by a com-
puter major, as exemplified in the present study. The second kind concerns schematic
familiarity. An example can be found in Skehan and Foster (1999) in which a ‘going
to a restaurant’ in the Mr. Bean video stood out as a fairly predictable story because
nearly everyone has a schema of “come in – order the dishes – eat the meal – pay the
bill – leave the restaurant”. Compared with the more predictable storyline in a res-
taurant, what happened when “Mr. Bean played golf ” was hard to foresee due to the
lack of a relevant schema. Further examples of such schematic familiarity are Skehan
and Shun (this volume) and Wang and Skehan (this volume). The third type of task-
internal readiness is task familiarity which deals with whether there will be a practice
effect transferred from one task to another of the same type (but with a different topic).
Bygate (2001) is a sample task-type familiarity study.
Task readiness 67

The last case of task-internal readiness, task repetition, makes an intriguing com-
parison with the first type of task-external readiness, namely rehearsal, with the major
difference lying in whether one knows if s/he is going to do the task again. Task repeti-
tion involves no briefing about future performance, so the previous task constitutes an
implicit planning opportunity which brings potential topic familiarity and task famil-
iarity to the next round of performance. In contrast, rehearsal as a task-external readi-
ness offers a probability known to the learner that one can prepare by practising the
task prior to the actual performance. Rehearsal thus becomes explicit planning which
also characterizes the other two kinds of task-external readiness: strategic planning
and within-task planning.
The major difference between task-internal and task-external readiness is the
degree of naturalness, or rather the degree of ad hoc manipulation, of the task prepa-
ration. Task-internal readiness, especially topic familiarity and schematic familiarity,
could be thought of as a more inherent and natural type of readiness, albeit perhaps
not so much a conscious process. At the same time, task-external readiness has a more
artificial element in that learners have imposed upon them extra manipulations to a
task. A question then arises from this comparison: which has a stronger influence for
the improvement of task performance? The literature on task research has little to offer
in this regard, so we will turn next to other areas for relevant insights.
Evidence for the influence of topic familiarity exists mainly in studies of speech
comprehension. The effects of prior knowledge, or schemas, in Piagetian terms, provide
good explanations for speech comprehension from a top-down perspective. In reading
comprehension research, being familiar with a certain content area has been gener-
ally found to be facilitative (Barry & Lazarte 1995; Bügel & Buunk 1996; Chang 2006;
Chen & Donin 1997; Johnson 1982; Lee 1986; Shimoda 1993). More recently, Lee (2007)
and Leeser (2007) also discovered that familiar texts greatly contributed to the compre-
hension of reading materials with also better content recall among L2 English learners
and L2 Spanish learners respectively. In listening comprehension, the mechanism of
topic familiarity bears some resemblance to that in reading, but the time constraints of
listening in real time impose additional difficulty on listeners. The time allowed in lis-
tening for the construction process (Kintsch 1988, 1998) before an appropriate schema
can be activated is much shorter, so while L2 readers have the opportunity of going back
to the textual data when first-inferencing fails, L2 listeners might encounter trouble at
this stage, before any helpful schema is able to take effect. In general, schemata might
be more important in L2 listening than L2 reading in that unlike readers who might,
given less time pressure, be able to rely more on bottom-up linguistic cues for meaning
construction, listeners probably have no such resource and a schema is crucial for pre-
diction and inference in a top-down manner. Not surprisingly, familiarity with content
knowledge in general aids learners in understanding audio input (Chiang & Dunkel
1992; Long 1990; Markham & Latham’s 1987; ­Schmidt-Rinehart 1994).
68 Bui Hiu Yuet Gavin

Not much research on topic familiarity has been conducted to investigate speech
production, and the existing literature mostly concerns L1 speaking. Prior knowledge
about a certain subject was found to raise temporal fluency (Good & ­Butterworh 1980),
reduce repeats and restarts but increase fillers (Bortfeld et al. 2001), but there are also
studies like Merlo and Mansur (2004) reporting unaffected fluency with a more famil-
iar topic. They instead found more propositions in the more familiar task, indicating
that the speech on a more familiar topic contains a higher density of information.
In addition, topic familiarity does not seem to help improve structural complexity
or coherence in narrative discourse (Banks 2004). These studies appear to show that
topic familiarity is more concerned with meaning expression (fluency and informa-
tion load) but less with structural ability (complexity and coherence) in first language
speaking.
Research on the influence of topic familiarity in L2 oral production is scarcer.
Familiarity with a topic seemed to enhance performance regarding fluency (words per
error-free T-unit and words per minute) but not with accuracy (error rate per T-unit)
in a monologic task (Chang 1999, with only 6 participants though). Familiarity with
the structure of a story, that is, a clearer schema in going to a restaurant versus a less
predictable storyline in playing golf, led to greater fluency (Skehan & Foster 1999).
Having a schema of a familiar area (a University map) also promoted fluency, but the
unfamiliar task (with an unfamiliar street map) generated higher lexical complexity
(Robinson 2001). More familiar tasks in Bei (2011) induced more formal language
features in discourse with a higher density of nouns and noun-associated word classes
such as articles and adjectives.
A few research gaps can be identified in the literature. It appears firstly from a
macro perspective that past research has generated quite extensive coverage on the
effects of task-external readiness, and even the interplay between its three types of
planning, namely rehearsal, strategic planning, and online planning. In contrast,
task-internal readiness has been much less touched upon, let alone the relationship
between task-external and task-internal readiness. The present study would argue that
task-internal readiness stands out as an inherent characteristic of task and could ren-
der more natural assistance to learner performance than task-external readiness does.
Secondly, at a micro level, topic familiarity has been shown quite unequivocally to help
L2 participants with greater fluency, but its influence on other performance areas like
complexity and accuracy is much less researched. A deeper consideration of this might
alert us to the possibility of its impact on test fairness as well, which warrants closer
scrutiny. At the same time and with no less significance, the extension of planning
to task-readiness may provide implications of findings for the Processing Approach
­(Skehan 1998) versus Cognition Hypothesis (Robinson 2001) debate, which could
help to shed light on tasks and task behaviour from a wider perspective.
Task readiness 69

In pursuit of these goals, the current study employs a combination of three factors,
namely topic familiarity (task-internal), strategic planning (task-external), and profi-
ciency (learner characteristic) in a 2 × 2 × 2 split-plot design. The following section
details the implementation of the study.

Methods

Participants
The participants in this study were eighty university students aged between eighteen
and twenty-four in Hong Kong. They were selected from 102 volunteers based on their
proficiency levels (see 3.3 “Proficiency criteria” below) and their academic major (see
below). They were all native Cantonese speakers but with reasonable L2 English profi-
ciency. They had received twelve to sixteen years’ education of English as their second
language at the time of the study. Among them, forty students were medicine majors
and another forty were computer science students (see “3.4 Study Design” below for
the rationale).

Speaking tasks
Participants were given the following general scenario:
You are a specialist in the field giving a presentation to a group of university students
who are neither medicine nor computer majors but are interested in the topics.
Each participant was invited to talk about the following two descriptive topics.
Topic 1: Please describe in detail the general process of the infection of virus in a
human body, the possible consequences, and the general procedure for dealing with a
virus-infected person.
Topic 2: Please describe in detail the general process of the infection of virus in
a computer, the possible consequences, and the general procedure for dealing with a
virus-infected computer.

Proficiency criteria
The 80 participants were equally divided into a high and an intermediate group
according to their proficiency levels. The grouping criteria include a combination of
their previous Use of English (UE) examination results in their Hong Kong Advanced-
Level (HKALE) public exams and a pre-test (a C-test adapted from Dornyei & Katona
1992) administered immediately before the tasks. According to entrance require-
ments of the participants’ university, their UE results were approximately pitched
70 Bui Hiu Yuet Gavin

at Band 6–8 of the IELTS system. Therefore they were termed intermediate to low
advanced L2 learners.

Study design: Independent variables


There are two between-participant independent variables (strategic planning and pro-
ficiency) and one within-participant independent variable (topic familiarity) in this
study, with each being a two-level variable, as shown in Table 2 below. Specifically,
the 80 candidates were evenly divided into a ten-minute pre-task planning group and
a non-planning (control) group. Within each group, there were two subgroups, each
containing 20 high and 20 intermediate proficiency learners. These 20 candidates con-
sisted of 10 computer majors and 10 medicine majors to counter-balance any topic
effect. That is, when there is a topic familiarity effect, we can be more confident that it
is not simply because one topic is easier than the other, since each cell performs exactly
the same topics. The order of familiar and unfamiliar tasks was also counterbalanced.
That is, half of the participants would present on the familiar topic first then the unfa-
miliar one, with the other half in the reverse order. Given the fact that the disciplines
were not regarded as an independent variable in this study, the sample size in each
cell therefore reached 20. Because every participant performed two tasks, the 80 can-
didates produced 160 data points in total. Based on Gardner (2001, p. 127–153), the
present study constitutes a 2 × 2 × 2 split-plot factorial design.

Table 2.  Number of participants in each group


Planning Proficiency Topic familiarity (within-participant)
(between-participant) (between-participant)
Familiar Unfamiliar

Planners High 20 20
Intermediate 20 20
Non-planners High 20 20
Intermediate 20 20

When the medicine majors talk about a natural virus, the topic is regarded as
“familiar” to them, while the computer virus becomes the “unfamiliar”. The opposite is
then true for the computer majors. After doing the two tasks, participants were asked
to rate their familiarity with the topics. A medicine major who indicated an equal or
higher degree of familiarity with the computer virus topic than their own natural virus
topic would be excluded from the study. The same familiarity screening procedure
applied to the computer majors as well.
Task readiness 71

Performance measures: Dependent variables


The effects of topic familiarity, planning, and proficiency on speech performance
were examined by measuring three conventional areas, namely fluency, complexity,
and accuracy to allow cross-study comparisons. Individual measures are described in
detail in Table 3 (and see additional description in Chapter 1, this volume).

Table 3.  Dependent variables

Areas Variable Description Studies

Breakdown Speech rate A pruned speech rate operationalized as Tavakoli &


fluency total words per minute after deletion of Skehan (2005)
filled pauses, reformulations, replacements,
false starts, and repetitions.
Mean length Number of words uttered before any Skehan &
of run breakdown or repair. Foster (2005)
Mid-clause Number of pauses in the middle of a Foster &
pause no. clause per one hundred words. A pause Skehan (1996)
operationalized as any break of 0.4 second
or longer.
Clause-end Number of pauses the end of a clause per Skehan &
pause no. one hundred words. Foster (2005)
Mid-clause The total length of pauses in the middle Bui (In review)
silence total of a clause per one hundred words.
Clause-end The total length of pauses at the end of a Bui (In review)
silence total clause per one hundred words.
Mid-clause The average length of pauses in the middle Bui (In review)
pause length of a clause.
Clause-end The average length of pauses at the end of Bui (In review)
pause length a clause.
Repair Reformulations: Phrases or clauses repeated with some Foster &
(dys)- modification to syntax, morphology, or Skehan (1999)
fluency word order.
False starts: Utterances abandoned before completion Foster &
with or without a reformulation followed. Skehan (1999)

Repetitions Words, phrases or clauses repeated with Foster &


no modification to syntax, morphology, or Skehan (1999)
word order.
Replacements Lexical items immediately substituted for Foster &
another. Skehan (1999)
(Continued)
72 Bui Hiu Yuet Gavin

Table 3.  Dependent variables (Continued)

Areas Variable Description Studies

Accuracy Error-free Ratio Ratio of error-free clauses to all clauses. Foster &
Skehan (1996)
Errors per 100 Number of errors per 100 pruned words. Mehnert (1998)
Words
70% Accuracy Length of clause at which 70% of all clauses Skehan &
Clause length1 are correct. E.g., if 70% of all 5-word Foster (2005)
clauses and only 60% of all 6-word clauses
are error-free, a score of 5 is awarded.
Complexity Clauses per AS Ratio of subordinate clauses per AS unit. Foster, Tonkyn, &
unit Wigglesworth (2000)
Words Per AS Average number of words in all AS units. Ortega, L., Iwashita,
Unit N., Norris, J., &
Rabie, S. (in prep)
Words Per Clause Average number of words in all clauses

Data analysis1
Speaking performance from each task was recorded and transcribed largely following
the CHILDES format before having it analyzed with the above measures. The results
will be presented in the next section as both descriptive (including means and stan-
dard deviations) and inferential statistics (including significance levels and effect sizes
in Cohen’s d). Following Thalheimer and Cook (2002), Cohen’s d was calculated to
indicate the size of an experimental effect. Other statistical results were obtained from
repeated measures analyses of variance (ANOVA) in SPSS 19, which is deemed appro-
priate in dealing with a split-plot design like the current study. Results are organised
in terms of the sets of dependent measures, fluency, accuracy and then complexity.

Results

Fluency
The first result concerns the length of each performance, as measured by the num-
ber of words, under various conditions. Participants produced longer accounts on
the more familiar topics (360.36 raw words and 300.84 pruned words as compared to

.  Following Skehan and Foster (2005), for example, if 50% of all 5-word sentences but lower than
50% of all 6-word sentence are correct, then with 50% as the threshold, the accuracy score is 5 in
that L2 speech. This study calculated 50%, 60%, and 70% as the thresholds, but only the 70% value is
reported in this study because it was found that 70% appeared to be a better threshold in differenti-
ating accuracy performance among learners of higher proficiency, such as those in the present study.
Task readiness 73

284.05 raw words and 229.61 pruned words with the unfamiliar topics, Cohen’s d = .53
for raw words, and Cohen’s d = .61 for pruned words, p = .000 for both). The opportu-
nity to have planning time seems to be a less powerful means in pushing learners to say
more, as a significant effect is reached only with total pruned words (297.8 and 233.60
in the familiar and unfamiliar tasks, p = .007, Cohen’s d = .44), which is an indication
that participants reduced repair features such as hesitation, repetition, interjections
and fillers (e.g. err, hmm) after strategic planning. A comparison of effect sizes further
supports the argument that familiarity with a certain topic has a greater impact on the
number of words used than does planning. Proficiency, interestingly, does not have
any effect on the number of words.
Factor analyses in the task literature (e.g. Mehnert 1998; Skehan & Foster 1999;
Tavakoli & Skehan 2005) have generally confirmed two types of fluency: breakdown
fluency and repair fluency. Breakdown fluency concerns temporal aspects of speech
and is usually measured through speech rate and pausing. In contrast, repair fluency
is associated with modifying language. It is operationalized as false starts, reformula-
tion, replacement, and repetition. Table 4 and Table 5 report on these two categories of
fluency variable respectively. The tables report on the effects of the three independent
variables, namely topic familiarity, strategic planning, and proficiency, on different
dependent variables such as the speech rate and phonation time in Table 4. In addition
to the means and standard deviations, the significance levels (p values) and the effect
sizes (Cohen’s d) are also given.
Table 4 shows that topic familiarity displays an overall effect on most (6 out
of  8) breakdown fluency measures. Being familiar with a certain subject matter
enables the participants to speak at a faster speech rate, with a longer stretch of
words before encountering any pauses, repairs or fillers (mean length of run).
Familiarity with a topic also helps to reduce the number as well as the average
length of pauses, and the total amount of silence in the middle of a clause. In addi-
tion, topic familiarity is able to shorten the total silence time between two clauses
(clause-end silence). However, the number and the length of pauses at the end of
clauses seem unaffected by topic familiarity. A notable point revealed in Table 4 is
the consistently small effect sizes in all measures contrasted with the wider range of
significance values. None of the effect sizes (Cohen’s d) reaches the medium level,2
which is an indication that while topic familiarity leads to higher fluency, the extent
of the influence is limited. It is intriguing that the largest effect sizes concern mid-
clause difficulties – familiarity seems particularly supportive in this respect.

.  According to Cohen (1992), the effect size of Cohen’s d at .20 is small, .50 is medium, and .80
is large.
74 Bui Hiu Yuet Gavin

Table 4. The effects of topic familiarity, strategic planning and proficiency on breakdown fluency

Topic familiarity Planning Proficiency

Fam. Unfam. Plan’d Unp’d High Interm.

Speech rate 96.30 (23.02) 90.47 (26.33) 102.52 (22.45) 84.24 (23.51) 96.79 (25.26) 89.97 (23.90)
p = .000 d = .26 p = .000 d = .58 p = .177 ns d = .28
Mean length of run 5.26 (1.57) 4.99 (1.76) 5.48 (1.85) 4.77 (1.38) 5.28 (1.51) 4.98 (1.80)
p = .016 d = .17 p = .046 d = .32 p = .397 ns d = .02
Mid-clause pause No. 9.73 (6.20) 12.13 (7.33) 8.61 (5.27) 13.24 (7.31) 10.17 (5.96) 11.69 (7.47)
p = .000 d = .38 p = .001 d = .54 p = .265 ns d = .22
Clause-end pauses No. 6.53 (2.09) 6.82 (2.52) 6.32 (2.22) 7.05 (2.34) 6.15 (1.97) 7.22 (2.48)
p = .562 ns d = .13 p = .087 ns d = .32 p = .023 d = .48
Mid-clause silence total 8.51 (7.86) 12.35 (13.41) 6.46 (4.83) 14.39 (13.09) 9.35 (9.25) 11.51 (11.77)
p = .000 d = .38 p = .000 d = .61 p = .299 ns d = .20
Clause-end silence total 5.73 (2.91) 6.41 (4.04) 5.10 (2.80) 7.08 (3.83) 5.63 (3.12) 6.54 (3.79)
p = .026 d = .19 p = .001 d = .59 p = .118 ns d = .26
Mid-clause pause length .79 (.31) .87 (.35) .70 (.33) .96 (.40) .80 (.29) .86 (.36)
p = .019 d = .28 p = .000 d = .71 p = .288 ns d = .18
Clause-end pause length 1.71 (.61) 1.78 (.81) 1.53 (.42) 1.96 (.86) 1.77 (.68) 1.72 (.74)
p = .437 ns d = .10 p = .001 d = .64 p = .584 ns d = .07
Notes: 1. Standard deviation in (). 2. All pause numbers and silence measures are standardized by calculating their occurrence per 100 words.
3. d = Cohen’s d which is a measure of effect size.
Task readiness 75

The effects of planning are quite similar to those of topic familiarity, except that
planning achieves a significant impact on more measures (7 out 8) with a larger mag-
nitude of the effects (i.e. bigger effect sizes). The opportunity to plan prior to speaking
raises the speech rate and the mean length of run. Planning reduces the number of
pauses in the middle of a clause, though not the number of pauses at the end of clauses.
There is also a reduction in the amount of silence and the average length of pauses in
the middle of a clause, the amount of silence, as well as the average pause length at the
end-of-clause positions.
Rather counter-intuitively, proficiency appears irrelevant to all but one measure,
the number of clause-end pauses. The intermediate proficiency participants produced
more pauses at the end of a clause than their high proficiency counterparts. This occur-
rence is intriguing in that the number of pauses at clause boundaries is one of few
measures that neither topic familiarity nor planning exerts any influence on, whereas
proficiency happens to fill this vacancy, with a medium Cohen’s d value (d = .48) indi-
cating a considerable effect. But other than that, the effect of proficiency seems to have
been overridden by topic familiarity and strategic planning.
In addition to the above main effects, there are also familiarity-by-planning
interaction effects in four breakdown fluency measures (see Table 5 below), that is,
speech rate (p = .001), number of mid-clause pauses (p = .005), mid-clause silence total
(p = .004) and clause-end silence total (p = .026). These five interaction effects con-
sistently point to a general trend that participants were able to reach a similar fluency
level after strategic planning, regardless of the familiarity level of the topics. That is, the
significant difference in breakdown fluency between familiar and unfamiliar topics is
reduced to almost non-existence when pre-task planning time is allowed. The results
suggest that, although planning helps to improve fluency performance in both familiar
and unfamiliar tasks, the unfamiliar tasks have benefited much more.

Table 5.  Means of the five measures with interaction effects


Topic familiarity

Familiar Unfamiliar Significance

Speech Rate Planned 103.47 (20.88) 101.58 (24.01) p = .001


Unplanned 89.12 (23.06) 79.35 (23.96)
Mid-clause Planned 8.08 (5.16) 9.15 (5.38) p = .005
pause number
Unplanned 11.37 (6.76) 15.11 (7.86)
Mid-clause Planned 6.04 (4.86) 6.89 (4.81) p = .004
silence total Unplanned 10.97 (9.44) 17.81 (16.73)
Clause-end Planned 5.06 (2.40) 5.13 (3.19) p = .026
silence total
Unplanned 6.48 (3.24) 7.72 (4.42)
Notes: 1. Standard deviation in ( ). 2. Dependent variables in italics. 3. N = 40 in each cell.
76 Bui Hiu Yuet Gavin

Regarding the different repair fluency measures, Table 6 shows that topic
familiarity helps to significantly reduce the number of repetitions, but only with
a small effect size (d = .31). Though not reaching significance, the means of the
other three variables are in the predicted direction. In comparison, ten-minutes
pre-task planning has a significant effect more generally, with fewer false starts,
reformulations, and repetitions, but it also induced more replacements. Similar
to the findings with breakdown fluency, the effect sizes produced by planning for
repair fluency range from medium to large, much bigger than those for familiarity.
As with the results for breakdown fluency, proficiency seems to exert little effect
on repair fluency.

Table 6.  The effects of topic familiarity, strategic planning, and proficiency on repair fluency
Topic familiarity Planning Proficiency

Fam. Unfam. Plan’d Unp’d High Interm.

False starts 1.38 (1.28) 1.63 (1.35) .85 (.80) 2.15 (1.40) 1.50 (1.29) 1.50 (1.35)
p = .125 ns d = .19 p = .000 d = 1.02 p = .999 ns d = 0
Reformulations 1.39 (1.00) 1.62 (1.25) 1.16 (.84) 1.84 (1.26) 1.60 (1.28) 1.40 (.95)
p = .088 ns d = .20 p = .001 d = .53 p = .321 ns d = .18
Replacements .95 (.79) 1.15 (.97) 1.26 (.90) .84 (.81) 1.08 (.85) 1.02 (.92)
p = .077 ns d = .23 p = .008 d = .43 p = .705 ns d = .07
Repetitions 3.94 (2.69) 4.72 (3.36) 3.16 (2.03) 5.40 (3.44) 4.29 (3.32) 4.27 (2.74)
p = .001 d = .31 p = .000 d = .60 p = .979 ns d = .01
Notes: 1. Standard deviation in (). 2. All number of the repairs are standardized by calculating their
occurrence per 100 words. 3. d = Cohen’s d which is a measure of effect size.

Accuracy
As shown in Table 7, topic familiarity appears to push participants to achieve a higher
ratio of error-free clauses, and thus fewer errors per 100 words, but only with small
effect sizes. Being familiar with a topic, however, does not help learners to produce
longer clauses where at least 70% of these clauses are correct (70% accuracy clause
length, p > .05). Strategic planning has even less of an impact here, showing no effect
on any of the measures. Proficiency, however, does show some significances. The
more advanced participants performed with longer 70% accuracy clauses, in addition
to having a significantly higher error-free ratio as well, and also a smaller number
of total errors per 100 words, when compared with their intermediate counterparts.
Proficiency is a strong driving force for accuracy as evidenced by the medium to large
effect sizes.
Task readiness 77

Table 7.  The effects of topic familiarity, strategic planning, and proficiency on accuracy
Topic familiarity Planning Proficiency

Fam. Unfam. Plan’d Unp’d High Interm.

Error-free .544 (.13) .517 (.14) .537 (.14) .524 (.13) .586 (.13) .475 (.11)
clause ratio
p = .020 d = .22 p = .618 ns d = .10 p = .000 d = .69
70% Accuracy 3.73 (2.27) 3.68 (2.17) 3.79 (2.63) 3.61 (1.96) 4.4 (2.49) 3.0 (1.66)
Clause length
p = .850 ns d = .02 p = .656 ns d = .08 p = .001 d = .57
Errors per 100 6.86 (2.46) 7.71 (2.61) 6.92 (2.59) 7.64 (2.45) 6.16 (2.25) 8.41 (2.30)
words
p = .000 d = .38 p = .121 ns d = .29 p = .000 d = .77
Notes: 1. Standard deviation in (). 2. d = Cohen’s d which is a measure of effect size.

Complexity
Table 8 gives the findings for the three different complexity measures. Topic familiarity
seems irrelevant to any of the complexity measures, but two measures, namely ‘clauses
per AS unit’ and ‘words per AS unit’, are significantly influenced by planning. In these
cases planners outperformed non-planners, with small and large effect sizes respectively.
Participants of higher proficiency also spoke with significantly longer AS units than
those of lower proficiency. Though only approaching significance (p = .067), the p value
in ‘clauses per AS unit’ shows a similar trend in that the advanced learners are probably
able to produce a higher subordination ratio than the intermediate ones. In comparison
to the effect size for proficiency, planning appears to be a stronger variable in promoting
complexity. A bit unexpectedly, the newly developed measure of ‘words per clause’ does
not seem to be sensitive to the influence of familiarity, planning, or proficiency.

Table 8.  The effects of topic familiarity, strategic planning, and proficiency on complexity
Topic familiarity Planning Proficiency

Fam. Unfam. Plan’d Unp’d High Interm.

Clauses per AS unit 1.74 (.32) 1.73 (.35) 1.81 (.31) 1.67 (.35) 1.79 (.34) 1.68 (.32)
p = .747 ns d = .03 p = .018 d = .39 p = .067 ns d = .33
Words per AS unit 12.93 (2.69) 12.43 (3.36) 13.96 (2.2) 11.39 (3.36) 13.49 (2.70) 11.85 (3.15)
p = .089 ns d = .16 p = .000 d = .81 p = .002 d = .52
Words per Clause 7.11 (.77) 6.97 (.85) 7.13 (.62) 6.95 (.75) 7.15 (.81) 6.92 (.82)
p = .195 ns d = .17 p = .22 ns d = .26 p = .112 ns d = .28
Notes: 1. Standard deviation in ( ). 2. d = Cohen’s d which is a measure of effect size.
78 Bui Hiu Yuet Gavin

Two interaction effects are also found between proficiency and planning for the
measure of “clauses per AS unit” (p = .002) and ‘words per AS unit’ (p = .026). Table 9
suggests two noteworthy points. Firstly, though the more advanced participants always
scored higher than the intermediate ones in complexity, the gap between them is sig-
nificantly narrowed after planning. Secondly, while planning raises the length of AS
units for all, it appears to help participants of lower proficiency more than the higher.

Table 9.  Interaction effects in “clauses per AS unit” and “words per AS unit”
Proficiency
Planning Significance
High Intermediate
Clauses per AS unit Unplanned 1.82 (.40) 1.52 (.20) p = .002
Planned 1.77 (.27) 1.85 (.34)

Words per AS unit Unplanned 12.78 (3.18) 9.99 (2.90) p = .026


Planned 14.21 (1.93) 13.71 (2.14)
Note: Standard deviation in ( ).

Discussion

The Results section has provided a detailed description of the three major perfor-
mance areas (fluency, complexity, and accuracy). This section will further synthesize
the results in terms of topic familiarity, strategic planning and L2 proficiency so that
the effects of these three independent variables can be explored more directly.

Topic familiarity
A recapitulation of the results shows that topic familiarity enables learners to produce
longer speech with greater fluency with fewer breakdowns and slightly higher accu-
racy and repair fluency. What topic familiarity was not so effective with is syntactic
complexity. Several aspects derived from these results have theoretical significance.
First, topic familiarity seems to affect both the Conceptualization and the Formula-
tion stages in Levelt’s (1989) speaking model. The Conceptualizer is responsible for
drawing information from memory and forming a pre-verbal message as input for the
Formulator. It seems to take less time to access more familiar information due to an
immediacy effect, since speakers are more primed in the relevant knowledge domain.
As a Conceptualizer effect, too, speakers have a more ready-made schematic struc-
ture at their disposal which could be accessed on a macro basis. The faster-accessible
message plus an existing framework into which the message can be structured helps
Task readiness 79

ease the workload at the Conceptualization stage. The longer account produced on the
familiar topics indicates that more familiar information can be retrieved from long
term memory in any given time period.
Topic familiarity also appears to exert an influence on Levelt’s (1989) Formulation
stage. The Formulator receives the pre-verbal message from the Conceptualiser, then
draws on lemmas and lexemes from the mental lexicon and assembles them into a
linguistic plan waiting to be articulated at the next stage. In this process, lexis can be
retrieved not only at higher speed, as evidenced by the fewer breakdowns (Table 4),
but also in a larger quantity (more total words and more varied words (Bui, in prepa-
ration). In addition, the greater mean length of run and fewer mid-clause pauses on
the familiar topics all suggest that the more familiar topics facilitate the use of bigger
chunks in which more lexical items are packed into an uninterrupted stream, which
is an indication that topic familiarity helps learners with lexicalized language. This
would not only explain the superior temporal aspects of speaking, but also the slightly,
but significantly higher accuracy results because if some expressions are memorized as
wholes, it reduces the computational workload and thus error probability. To sum up,
learners are able to more efficiently access the exemplar-based system with faster word
searches, and reduce the analytic computation in their rule-based system (­Skehan
1998) with more efficient on-line assembly of utterances when they are in possession
of relevant prior knowledge.
An additional explanation that might not be as general as those discussed above
is also relevant here. The medium of instruction for all the participants in their major
courses in both academic groups is primarily English, and all the textbooks and lec-
ture notes are in English. According to the encoding specificity principle (Tulving &
Thomson 1973), the language in which knowledge is stored in long term memory
will speed up access. Therefore, participants in the unfamiliar condition might have
to go through one more step at the Formulation stage, that of transforming their gen-
eral knowledge about the unfamiliar topic from Chinese into English. This could then
hamper their performance in terms of fluency and lexis. Such an observation might
have some implications for content-based language teaching in that if a certain domain
knowledge is learnt in one’s L2, it appears that future retrieval of the knowledge and
production in the L2 will be enhanced at least as far as fluency and lexis are concerned.
Another perspective on these findings is to make the point that the unplanned
condition effectively triggered more pressured communication – there was only scope
for on-line planning (Ellis 2005). Their limited processing capacity (Skehan 1998) cre-
ates difficulties for L2 speakers whose target language system is not yet automatized
to do efficient parallel processing. Consequently, more attentional resources allocated
to the Conceptualization stage means there may be difficulties at the later Formula-
tion and Articulation stages. Learners had to slow down their speech rate and pause
more often with a shorter average speaking time in order to cope with the unfamiliar
80 Bui Hiu Yuet Gavin

t­ opics. This result for fluency is largely consistent with some studies in L1 (e.g. Good &
Butterworth 1980; Bortfeld et al. 2001) and L2 (Chang 1999; Skehan & Foster 1999;
Robinson 2001) research. However, the discovery from the present research is that
pre-task planning is able to attenuate the difference between unfamiliar and familiar
topics in many of the fluency measures.
The second point to consider concerns form-meaning connections in relation
to topic familiarity. The primary concern in a speaking task is obviously to get the
message across. Meaning expression is more likely to be attended to than the other
aspects of speaking. However, it appears that the familiar topics also raise accuracy,
enabling meaning and form to be handled at the same time. In addition to the theory
of better access to the exemplar system and chunking, two more possibilities from a
processing perspective are worth noting. First of all, the attentional resources released
from the Conceptualization and the Formulation stages can help learners with self-
monitoring. With the more familiar topics, speakers may shift their attentional focus
partly from ‘what to say’ to ‘how to say’ and even ‘how to say well’, whereas they will
have to struggle with the content to express in the unfamiliar situations, which results
in greater working memory load for monitoring and correction (see also Bygate &
Samuda 2005). Secondly, on-line planning studies (e.g. Yuan & Ellis 2003) provide
evidence that unpressured within-task planning can contribute to more accurate per-
formance. As a task-internal readiness construct, topic familiarity appears to achieve
a similar effect because it prepares learners not only prior to the task, but through
the whole process of speaking. This resemblance of on-line readiness to unpressured
­on-line planning may partly explain the higher accuracy scores in the familiar tasks.
At the same time, the small effect sizes may also be justified simply because task-
internal readiness is still time-pressured when compared to the unpressured task-
external ­on-line planning.

Strategic planning
Before going on to the discussion on strategic planning, a recapitulation of its gen-
eral effects is helpful. Briefly, strategic planning greatly helps learners to improve their
fluency (with both breakdowns and repairs) and syntactic complexity, though it was
not so effective in raising accuracy. The results seem generally consistent with the
bulk of the literature in planning, but the comparison and contrast between strategic
planning and topic familiarity would add more insight into the story. We can start
with fluency. First of all, planning works in a very similar way to topic familiarity in
term of fluency, especially with breakdown fluency. Such a pattern is reflected in the
measures on which both planning and familiarity have similar effects. Secondly, plan-
ning should at the same time be distinguished from topic familiarity in terms of the
strength and the range of their influence on fluency performance. Strategic planning is
Task readiness 81

likely a more powerful pedagogical means that constitutes a potentially higher level of
task-readiness than familiarity as a task-internal readiness, although this also depends
on how thoroughly the planners are able to anticipate the detail of the task, how much
they can cover during planning, and also how much they can retain and recall dur-
ing task performance. The effectiveness of such pre-task planning is supported by the
effect sizes that planning produces with fluency measures. To account for these two
observations, one could argue that the ten-minute planning time allows learners to
formulate a conceptual plan for the relevant message to convey (Ellis 2005; Mehnert
1998), which greatly reduces the need for online macro-structure planning. Instead,
L2 learners can allocate scarce attentional resources for the Formulator, thus speaking
with fewer pauses and at a faster rate. While speaking on a familiar topic without plan-
ning is still a pressured process, planned speech is much less so, which may explain
why planning is able to cut down on the frequency of repairs but topic familiarity is
much weaker in this regard.
What further distinguishes topic familiarity from planning is that planning pushes
learners to higher structural complexity. The lexicalized language or chunks that are
more readily and speedily accessible due to topic familiarity would likely involve less
complex syntactic processing partly due to being lexicalised, as well as because limited
working memory capacity does not allow overly long utterances to be processed and
passed on for long-term memory storage. Therefore, a reasonable assumption here
would be that the prefabricated expressions which are available in long term memory
are usually relatively short expressions. A comparison with topic familiarity shows that
strategic planning helps learners not only to access formulaic language (Foster 2001)3
and hence achieve higher fluency, but also assemble the pre-fabricated chunks into
longer psychological units of planning (AS units), as shown in higher scores in the
two complexity measures (“words per AS unit” and “clauses per AS unit”). In addition,
strategic planning encourages learners to stretch their speech content, which results
in their more adventurous attempt to produce more elaborated language. This result
is consistent with most studies, that planning drives learners to take risks to produce
more elaborated language. To some extent, this study, combined with Foster (2001),
helps to better explain why task-external readiness can, but task-internal readiness
cannot, promote greater complexity.
Rather disappointingly, strategic planning does not seem to affect the ‘words per
clause’ measure of clause length even though Ortega, Iwashita, Norris, and Rabie (in
preparation) argue that it is a better measure for more advanced learners. Bei (2010)

.  Foster (2001) found that, given planning time, native speakers tend to use less formulaic lan-
guage and be more creative, whereas non-native speakers will use more formulaic language after
planning.
82 Bui Hiu Yuet Gavin

conducted two factor analyses (one for a familiar task and the other for an unfamil-
iar tasks) that included most of the available task performance measures, and both
confirmed that ‘words per clause’ appears to be very closely connected to the F-score
(Heylighen & Dewaele 1999), an index of formality, and less closely but significantly
with lexical sophistication. The F-score measures the extent to which nouns and
noun-associated word classes such as articles and adjectives are employed in speech,
while lexical sophistication is a yardstick for the frequency of rare words use. Taken
together, Bei (2010) argued that “words per AS unit”, together with the F-score and
lexical sophistication, belongs to a new construct “noun phrase complexity” which
should be treated distinctively from the syntactic or lexical complexity indentified in
the literature. The relationship between strategic planning and noun phrase complex-
ity warrants further studies.
What remains opaque is the relationship between planning and accuracy. The
previous literature has been unclear in this respect (Ellis 2009), and the present
study did not find a significant accuracy effect from planning (but see discussion in
Pang & Skehan (this volume) and Wang (this volume)). A thorny question emerges
naturally at this point: if as mentioned above, planning enables L2 learners to bet-
ter access their lexicalized language (formulaic chunks) as topic familiarity does, why
can topic familiarity raise accuracy but planning cannot? Possibly the puzzle can be
disentangled with the following three arguments. Firstly, planning drives learners to
embark on more complex language and in the process more pre-fabricated expres-
sions need to be assembled into an AS unit. The more syntactic work there is, the more
errors there might be (Crookes 1989), especially when strategic planning is largely
concept-oriented with little attention to grammar. Secondly, from a limited processing
capacity point of view (Skehan 1998), there is likely to be a trade-off between accu-
racy and complexity (Skehan & Foster 1997). Learners’ L2 systems are, by and large,
controlled but not automatized, and so attentional resources allocated to the over-
whelming workload when complexity is prioritised mean a reduction of attentional
focus on accuracy. Thirdly, it is possible that pre-task planning cannot affect on-line
monitoring (Skehan 2009) as what learners bring to the task from strategic planning
would most focus on getting the message across, whereas topic familiarity as a form of
task-internal readiness prepares learners anytime they speak, acting as both pre-task
and on-line readiness, and reduces the on-line processing workload to enable more
within-task monitoring.

Proficiency
The previous task-based literature has not seen proficiency as an area of primary and sys-
tematic concern. The few exceptions (e.g. Kawauchi 2005; Ortega 2005; W ­ igglesworth
1997), however, suggest that task performance, as influenced by ­strategic ­planning,
Task readiness 83

differs according to learners’ proficiency levels. The present study re-examines the
effects of planning at different proficiency levels, whilst adding to it a new dimension
of planning: topic familiarity. As mentioned in Section 3.3, measured through HKALE
results and the IELTS system, the current participants are at relatively high proficiency
levels. In contrast, participants in past studies were mostly at lower proficiency levels.
The following discussion will take this caveat into consideration.
In terms of the main effects, proficiency shows consistently strong effects on all
accuracy measures and some effects on complexity (p = .000, d = .52 for “words per AS
unit”; p = .067 for the conventional “clauses per AS unit”), with performances of learn-
ers at the higher proficiency level being more accurate and more syntactically com-
plex. More advanced learners were also able to reduce the number of pauses between
clauses. However, proficiency seems to be, at least in this context, largely irrelevant to
fluency (either breakdown fluency or repair fluency), and even noun phrase complex-
ity (Bei 2011). An emerging pattern from these results is that proficiency tends to have
much greater influence on syntactic than semantic aspects of performance.
Learners of higher proficiency consistently made fewer errors in performance
than their lower proficiency counterparts did, regardless of familiarity or planning
time. Furthermore, the “70% accuracy clause length” measure indicates that the lower
error rate obtained by higher proficiency students was not achieved by the avoidance
strategy with which one might make fewer errors by resorting to shorter and simpler
utterances. Higher proficiency participants in fact spoke with longer error-free clauses
than the lower proficiency participants did. All this suggests that accuracy in perfor-
mance is basically a by-product of one’s underlying linguistic competence. The lack of
interaction effects between proficiency and the other two independent variables (plan-
ning and familiarity) further supports this claim, and might partly explain why accu-
racy in performance was less sensitive to task manipulations like strategic planning.
It could be argued that better performance in accuracy originates from two sources: a
well-developed linguistic system and a good ability to monitor speaking (see Li (this
volume)). A more advanced linguistic system plays a main role with error-free utter-
ances and it almost becomes a cliché to say that the actual ‘performance’ is a reflection
of implicit ‘competence’. A more fully-fledged underlying system is usually a more
automatized one, which frees up more attentional resources for monitoring errors.
All this contributes to the significantly and consistently better accuracy performance
among the higher level learners in all three accuracy measures. The medium to large
effect sizes (Cohen’s d values ranging from .57 to .77) suggest that the difference in
accuracy between the two proficiency levels is substantial.
Only one out of the three complexity measures, namely ‘words per AS unit’, was
significantly affected by proficiency. However, the effects of proficiency nearly reached
significance in the conventional ‘clauses per AS unit’ measure (p = .067). These results
suggest that proficiency does show its influence on syntactic complexity, though its
84 Bui Hiu Yuet Gavin

effects are not as big as those for accuracy. Compared to strategic planning, proficiency
is much less a driving force for higher complexity; compared to topic familiarity, pro-
ficiency is a much more important indicator for higher accuracy. Therefore, we might
postulate that L2 learners tend to opt for a conservative stance in speaking and try to
avoid mistakes. Planning time encourages them to be more willing to task risks and
use more elaborated language. Higher proficiency itself can liberate L2 learners from
their timidity only to a limited extent.
Regarding fluency, proficiency only has an effect on the “number of end-of-clause
pauses” (p = .027). Higher proficiency learners do not pause as frequently as their inter-
mediate counterparts do between clauses, but there is no difference between the two
proficiency levels in terms of the frequency of mid-clause pauses. Mid-clause pauses
have been shown to be a trait of L2 speaking (Skehan 2009), so both high and inter-
mediate proficiency learners in this study remained by and large L2 speakers whose
oral performance was not very native-like, as far as fluency is concerned. However, the
higher proficiency level did appear to reduce the hesitations between clauses. This was
probably because a more automatized linguistic system can assemble information in a
more coherent manner, making it less likely that the utterances will be fragmented or
loosely connected to each other.
When it comes to fluency and “nouny” language use (or rather, noun phrase com-
plexity), however, higher proficiency seems of no great relevance in most cases. Past
research has shown that fluency and complexity were more easily affected by task-
external influences (e.g. planning and task repetition), but fluency and complexity
were the two places in this study that proficiency had no effect or only a weak effect on.
Taken together, the possibility emerges that learner proficiency and task conditions
could stand in competition. That is, if a certain performance area, such as accuracy, is
merely a reflection of learners’ underlying competence, it is more likely to be resistant
to task conditions or task characteristics, such as planning. On the other hand, areas
less closely connected to proficiency (e.g. fluency in this study) are more prone to task
manipulations. There also appears to be a trade-off between task conditions and pro-
ficiency levels. Such a claim needs to be verified in future studies as it might suggest
limits as to how far task manipulations can go from short-lived performance enhance-
ment to genuine competence improvement in an L2. If the much researched area of
task-external readiness has little impact on L2 proficiency, it would then be time for us
to turn to new areas. A few studies (Skehan & Foster 1997; Li, Chapter 5, this volume)
have begun to show promise in making significant influence on accuracy performance
by employing post-task activities. There is room for more research in how different
effects of task manipulation could be integrated.
Two interaction effects in the literature between proficiency and planning are
noteworthy, both concerning complexity. Wigglesworth (1997) found that the oppor-
tunity to plan allowed learners of higher proficiency, but not those at the lower level,
Task readiness 85

to produce more complex language. Similarly, Kawauchi’s (2005) high proficiency par-
ticipants benefited most in the case of complexity (and fluency), with the lower profi-
ciency participants gaining less (but they gained the most in accuracy, with the most
advanced learners benefiting the least). On the contrary (at first sight), a general pat-
tern from the interactions between planning and proficiency in both ‘clauses per AS
unit’ and ‘words per AS unit’ in this study is that the intermediate learners were much
better than their high proficiency counterparts in making the most out of planning
time to achieve higher complexity. For the AS length measure, the difference between
high and intermediate participants was narrowed to virtual non-existence after plan-
ning. More significantly, in terms of the conventional ‘clauses per AS unit’ measure,
the intermediate proficiency planners even slightly surpassed the high proficiency
planners, though the high proficiency non-planners were much better than the inter-
mediate proficiency non-planners. As for accuracy, though Kawauchi (2005) found
that learners at a lower level gained the most in accuracy after planning, Wigglesworth
(1997) and Ortega (1999) claimed that planning helped learners at an advanced level
to achieve better accuracy in performance. The evidence in the present study does not
support either side in this disagreement. No matter whether given planning time or
not, the higher proficiency learners were always better than the intermediate ones (c.f.
the main effects of proficiency above).
Some inconsistency between the present study and the literature in terms of the
effects of planning on complexity and accuracy on different proficiency levels may
probably be attributed to the operationalization of the independent variable ‘profi-
ciency’ per se. As mentioned in Section 3.3, and the beginning of this Section (5.3),
the “intermediate” participants in this study were already quite proficient speakers
of English given the high entry requirement of their university. If the participants
of intermediate proficiency in this study are at a level similar to the ‘high’ partici-
pants in Kawauchi (2005) and Wiggleswoth (1997) (and if the ‘high’ here is equal to
the ‘advanced’ in Kawauchi), then, instead of contradicting, this study could in fact
support Kawauchi’s results for complexity. That said, such a claim remains a specula-
tion before a commonly acceptable way of equating different proficiency measures is
available.

The magnitude of task-internal and task-external readiness effects


Table 10 below sums up the effect sizes produced by topic familiarity and strategic plan-
ning. The reason for choosing effect sizes is obvious: effect sizes highlight the magni-
tude of the effects of the independent variables. Also, its existence per se indicates that
there is a significant effect. Bearing this in mind, we can conclude that familiarity and
planning displayed very similar patterns with the measures of fluency: total words,
breakdown fluency, repair fluency; but they differed in the formal or ­organizational
86 Bui Hiu Yuet Gavin

aspects of language (accuracy and complexity). Another interesting feature is that


topic familiarity showed small effects in most cases, whereas planning generally pro-
duced much higher values of Cohen’s d. Take breakdown fluency as an example. Effect
sizes for planning were almost always nearly twice as high as those for topic familiar-
ity. Furthermore, in the formal features of L2 speaking, the effect sizes in complexity
produced by planning were also much higher than those in accuracy produced by
topic familiarity. Therefore, an answer to the question as to which is a stronger variable
seems to be emerging: planning, or task-external manipulation, appears to be a more
powerful influence on task performance than topic familiarity, a task-internal variable.

Table 10.  Effect sizes produced by topic familiarity and strategic planning
Topic familiarity Strategic planning

Pruned total words .61 .44


Breakdown fluency .17 – .38 .32 – .71
Repair fluency .31 – .40 .43 – 1.02
Complexity .03 – .17 (ns) .39 – .81
Accuracy .22 – .38 .08 – .29 (ns)

Some recapitulation on the general framework of task-readiness (Table 1) would


probably help to explain this pattern. Task-internal readiness (including topic famil-
iarity, schematic familiarity, task familiarity, and task repetition) is a form of implicit or
unconscious preparation that a learner brings to a task which will function both before
and during the actual performance. An important characteristic of task-­internal readi-
ness is that learners are not necessarily aware of the advantage that they enjoy. In con-
trast, task-external readiness (i.e. rehearsal, strategic planning, and online planning)
provides an explicit and clear push to help learners to be prepared for the subsequent
tasks. It would therefore be fair to say that task-external readiness constitutes more
of a preparation and thus becomes more powerful in areas that it has influence on
than most types of task-internal readiness. That said, one exception in task-internal
readiness, task repetition, is worth noting. Though it has not been tested in this study,
Bygate (2001) and Wang (Chapter 2, this volume) both reported very strong effects of
repeating a task. Different from the task-external rehearsal, people re-do the same task
a second or third time, but without the earlier encounters being explicitly signalled
as preparations for a later performance. It is therefore categorized as a task-internal
readiness (and implicit planning) (Bygate, personal communication, May 2013). On
this basis, task-internal readiness, in the form of task-repetition, can also have facilita-
tive effects on fluency, accuracy and complexity comparable to task-external readiness
(see Wang, Chapter 2, this volume).
Task readiness 87

Task-internal readiness in form-meaning connection


Though strategic planning has a greater effect on fluency and complexity than does
topic familiarity, topic familiarity nevertheless was more able to influence learners
with accuracy, suggesting that task-internal readiness functions in different areas
from task-external readiness. Topic familiarity seemed to enable participants, to some
extent, to strike a balance between meaning and form, which might signal an inte-
gration of their linguistic knowledge into genuine performance. Bygate and Samuda
(2005) pointed out that ‘a common learning and teaching problem is to get learners
to integrate knowledge that is available to them into their active language use’ (p. 37).
In this sense, providing learners with familiar topics to practise may better encourage
them to achieve this pedagogical end.
Strategic planning promotes pre-task readiness while on-line planning results in
real time preparation. Though much less powerful in comparison to each of these
two task-external means taken separately, task-internal readiness appears to consist
of the features of pre- and during-task readiness as it is inherent within each learner
and could take effects both prior to and during a task. As discussed earlier, the on-line
readiness nature of topic familiarity may probably contribute to the more accurate
performance. Therefore the integration of linguistic knowledge into communicative
use could be an important area in exploring task-internal readiness in future.

Compensation effects in fluency between task-internal


and task-external readiness
Data from the present study do reveal compensation effects in breakdown fluency, but
the conclusion is that planning could compensate for the unfamiliar topics much bet-
ter than familiar topics could do for the unplanned conditions. With five breakdown
measures, planners reached almost the same fluency level with both familiar and unfa-
miliar topics. The adverse condition in fluency induced by their lack of domain knowl-
edge was clearly removed when planning time was provided. However, the significant
difference between planners and non-planners continued to exist even when familiar
topics were involved. This result echoes the above discussion that task-external manip-
ulation is a stronger driving force for many areas, especially fluency.

Implications
The pedagogical implications regarding task-external readiness (e.g. strategic planning)
have been researched in many studies (see Ellis 2005, 2009, for a detailed discussion),
but the benefit of using task-internal readiness has rarely been touched upon in the lit-
erature. Evidence from this study, however, showed that task-internal readiness should
not be ignored in language education, and this for a number of different reasons.
88 Bui Hiu Yuet Gavin

First of all, as noted above, previous research has shown that receptive language
use, namely reading comprehension (Shimoda 1993; Chang 2006; Lee 2007; Leeser
2007; Barry & Lazarte 1995; Bügel & Buunk 1996; Chen & Donin 1997; Johnson
1982; Lee 1986) and listening comprehension (Markham & Latham 1987; Long 1990;
­Chiang & Dunkel 1992; Schmidt-Rinehart 1994; Leeser 2004), are greatly influenced
by background knowledge. The present study further provides evidence for the effects
of familiarity in L2 speech production, as productive language use. Familiarity may
therefore become an inevitable issue in test fairness. It is highly likely that one per-
forms well not because s/he is in fact more proficient but simply because s/he is more
familiar with the topic. Matches and mismatches between test content and learner
background have to be taken into serious consideration in either language compre-
hension or production tests.
Second, one of the important issues in task-based language instruction is to
encourage learners to participate actively in various task activities. This study shows
that providing learners with more familiar topics will reduce learner anxiety and elevate
their willingness to communicate, as evidenced by the significantly longer accounts
they give with familiar topics. On the one hand, longer performance produced by an
L2 learner is an indication of his/her willingness and readiness to communicate. On
the other hand, this certainly helps to enhance learner confidence, which may work
especially for low to intermediate learners.
Third, strategic planning was shown to help learners produce more fluent and
more complex language. Accordingly, it would appear to be a good idea to allow
learners some time prior to any actual performance. Planning encourages learners to
embark on more elaborated language, attempting more complex structures through
which they could experiment with newly acquired linguistic knowledge. Planning also
serves to narrow the gap between high and low proficiency, and between familiar and
unfamiliar tasks, in terms of fluency and complexity. In classrooms, then, teachers may
take advantage of planning when learners are facing adverse situations (such as low
proficiency and unfamiliar topics).
Fourth, the results suggest that, learners should be provided with familiar top-
ics in tasks if accuracy is the primary concern. Given the way familiarity seems to
function as mini-online-planning, it appears to help learners by providing them more
resources to attend to form. As mentioned above, this may increase their confidence
and reduce feelings of frustration.
Fifth, this study may also have implications for task sequencing. We have seen the
separate benefits for pedagogy from each individual variable, but it is far more impor-
tant to examine how these different influences are organized to form a coherent and
organic whole. It is certainly too early to make any claims on the “whole picture” based
on the three variables in this study alone. Nonetheless, this study indicates that at the
pre-task stage planning is a useful tool, whilst at the during-task stages familiarity may
Task readiness 89

help. Then, beginners should receive the most familiar topics and planning time in
order that they could be fully supported in tasks. As their language ability develops, at
some points and to some extent it may be possible for either familiarity or planning to
be reduced so that they would face greater (but appropriate) challenges and be moti-
vated to proceed further.
Last but not least, the present study supports content-based instruction (Mohan
1986) in language teaching. Topic familiarity proved to be a positive influence on flu-
ency and accuracy, with indications that it helped to push learners to a more integra-
tive approach to language learning. Compared to ‘pure’ or intensive language teaching,
language seems more effectively taught when the domain knowledge (not linguistic
knowledge) is imparted to learners in their L2, leading to a genuine need to solve real
world problems, and that domain knowledge then serves as a continual reference point
for the growing language curriculum. In a language classroom where general knowl-
edge is not the focus, language can still be taught using tasks involving connections to
real life so that tasks become the medium between classroom and the real world.

Conclusion

This chapter proposes a theoretical framework of task-readiness as an alternative con-


ceptual model to various types of conventional planning. It is argued with evidence in
this study that while allowing extra time as explicit planning opportunity prior to or
during a task yields facilitative effects in doing L2 tasks, the inherent preparedness that
learners bring to the task (in the form of familiarity) helps to improve learner perfor-
mance in a comparable manner. Exploring the individual effects of topic familiarity
(task-internal readiness), strategic planning (task-external readiness) and proficiency
levels (individual difference), and their interaction effects, this chapter has the follow-
ing findings:

1. The concept of planning is better regarded as a component of task-readiness which


involves two macro dimensions: task-internal readiness and task external readi-
ness, each with their micro dimensions. Task-internal readiness further subsumes
topic familiarity, schematic familiarity, task type familiarity, and task repetition,
while task-external readiness includes rehearsal, strategic planning, and online
planning. This proposal for a general framework of task-readiness can potentially
serve as a theoretical platform to unify and synthesize research in various types of
planning, familiarity, and even other kinds of preparatory activities for a task.
2. Both planning and topic familiarity raise fluency, indicating that participants with
task-readiness prioritize meaning expression. When planning or topic familiar-
ity is present, proficiency appears to be largely overridden in its effect on fluency.
90 Bui Hiu Yuet Gavin

However, planning produces bigger effect sizes than topic familiarity with fluency.
Planning is also able to greatly reduce the gap between familiar and unfamiliar
topics in fluency. This leads us to the conclusion that task-external readiness is
in general more powerful than task-internal readiness in improving meaning-­
oriented performance.
3. Planning raises syntactic complexity, while topic familiarity increased accuracy. It
would then appear that task-internal readiness encourages learners to a conserva-
tive stance (thus higher accuracy), but task-external readiness pushes learners to
task risks (hence higher complexity). Interestingly, higher proficiency produces
much higher accuracy and moderately higher complexity, confirming a close rela-
tion between syntactic performance and linguistic competence.
4. With the above points taken together, an intriguing pattern emerges – task
influence and proficiency influence do not always complement each other. The
proficiency-oriented variables (e.g. accuracy) are affected more by proficiency
levels and less by task manipulations, whereas task-oriented variables (e.g. flu-
ency) function just on the opposite. There are also intermediate variables, such as
complexity.

This study was conducted in the context of TBLT research and established very close
connections to prior studies, thus enabling cross-study comparisons. It is then the
hoped that this research will be a link between the literatures on planning and the
future studies on the extended concept of planning, that is task-readiness, to explore
task-based language learning from an even wider perspective.

References

Baddeley, A. (1997). Human memory: Theory and practice. New York, NY: Psychology Press.
Barry, S., & Lazarte, A. (1995). Embedded clause effects on recall: Does high prior knowledge of con-
tent domain overcome syntactic complexity in students of Spanish? Modern Language Journal,
79, 491–504.
Banks, J. (2004). The impact of event familiarity on the complexity and coherence of children narra-
tives of positive events. Unpublished MSc thesis. North Carolina State University.
Bei, X.G. (2010). Exploring task-internal and task-external readiness: The effects of topic familiarity
and strategic planning in topic-based task performance at different proficiency levels. Unpublished
Ph.D. thesis. The Chinese University of Hong Kong.
Bei, X.G. (2011). Formality in second language discourse: Measurement and performance. Interdis-
ciplinary Humanities, 28(1), 22–31.
Bei, X.G. (2013). Effects of immediate repetition in L2 speaking task: A focused study. English Lan-
guage Teaching, 6(1), 11–19.
Bui, H.Y.G. (In review). L2 fluency as influenced by content familiarity and planning performance
and methodology. Submitted to Language Teaching Research.
Task readiness 91

Bui, H.Y.G. (In preparation). Lexical diversity, lexical sophistication and lexical density in L2 speak-
ing tasks. Unpublished manuscript.
Bortfeld, H., Leon, S.D., Bloom, J.E., Schober, M.F., & Brennan, S.E. (2001). Disfluency rates in
conversation: Effects of age, relationship, topic, role, and gender. Language and Speech, 44(2),
123–147.
Bügel, K., & Buunk, B. (1996). Sex differences in foreign language text comprehension: The role of
interests and prior knowledge. Modern Language Journal, 80, 15–31.
Bygate, M. (1996). Effects of task repetition: Appraising the developing language of learners. In
J. Willis & D. Willis (Eds.), Challenge and change in language teaching (pp. 136–146). Oxford:
Heinemann.
Bygate, M. (2001). Effects of task repetition on the structure and control of oral language. In
M. Bygate, P. Skehan, & M. Swain (Eds). Researching pedagogical tasks: Second language learn-
ing, teaching and testing (pp.23–48). Harlow: Longman.
Bygate, M., & Samuda, V. (2005). Integrative planning through the use of task repetition. In R. Ellis
(ed.), Planning and task performance in a second language (pp. 37–74). Amsterdam: John
Benjamins.
Chang, C. (2006). Effects of topic familiarity and linguistic difficulty on the reading strategies and
mental representations of non-native readers of Chinese. Journal of Language and Learning, 4,
172–198.
Chang, Y.F. (1999). Discourse topics and interlanguage variation. In P. Robinson (Ed.), Represen-
tation and process: Proceedings of the 3rd Pacific Second Language Research Forum (Vol. 1,
pp. 235–241). Tokyo: PacSLRF.
Chen, Q., & Donin, J. (1997). Discourse processing of first and second language biology texts:
Effects of language proficiency and domain-specific knowledge. Modern Language Journal, 81,
209–227.
Chiang, C.S., & Dunkel, P. (1992). The effect of speech modification, prior knowledge, and listening
proficiency on EFL lecture learning. TESOL Quarterly, 26, 345–373.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.
Crookes, G. (1989). Planning and interlanguage variation. Studies in Second Language Acquisition,
11, 367–383.
Dornyei, Z., & Katona, L. (1992). Validation of the C-test amongst Hungarian EFL learners. Lan-
guage Testing, 9, 187–206.
Ellis, R. (2005). Planning and task-based performance: Theory and research. In R. Ellis (Ed.), Plan-
ning and task performance in a second language (pp. 3–36). Amsterdam: John Benjamins.
Ellis, R. (2009). The differential effects of three types of task planning on the fluency, complexity, and
accuracy in L2 Oral production. Applied Linguistics, 30(4), 474–509.
Ellis, R., & Yuan, F.Y. (2005). The effects of careful within-task planning on oral and written task per-
formance. In R. Ellis (Ed.), Planning and task performance in a second language (pp. 167–192).
Amsterdam: John Benjamins.
Foster, P. (2001). Rules and routines: a consideration of their role in task-based language production
of native and non-native speakers. In M. Bygate, P. Skehan, & M. Swain (Eds.), Researching
pedagogic tasks: Teaching, learning and testing (pp. 75–97). Longman, London.
Foster, P., & Skehan, P. (1996). The influence of planning and task type on second language perfor-
mance. Studies in Second Language Acquisition, 18, 299–323.
Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Measuring spoken language: A unit for all reasons.
Applied Linguistics, 21(3), 354- 375.
92 Bui Hiu Yuet Gavin

Gardner, R.C. (2001). Psychological statistics using SPSS for Windows. Upper Saddle River, NJ:
Prentice-Hall.
Good, D.A., & Butterworth, B. (1980). Hesitancy as a conversational resource: some methodologi-
cal implications. In H. Dechert & M. Raupach (Eds.), Temporal variables in speech production
(pp. 145–152). The Hague: Mouton.
Heylighen, F., & Dewaele, J. (1999). Formality of language: Definition, measurement and behavioral
determinants. Internal report, Center “Leo Apostel”, Free University of Brussels.
Johnson, P. (1982). Effects on reading comprehension of language complexity and cultural back-
ground of text. TESOL Quarterly, 16, 169–181.
Kawauchi, C. (2005). The effects of strategic planning on the oral narratives of learners with low
and high intermediate proficiency. In R. Ellis. (Ed.), Planning and task performance in a second
language (pp. 143–164). Amsterdam: John Benjamins.
Kintsch, W. (1988). The role of knowledge of discourse comprehension: A construction-integration
model. Psychological Review, 92, 163–182.
Kintsch, W. (1998). Comprehension: A paradigm for cognition. Cambridge: CUP.
Lee, J.F. (1986). Background knowledge and L2 reading. Modern Language Journal, 70, 350–354.
Lee, S.K. (2007). Effects of textual enhancement and topic familiarity on Korean EFL students read-
ing comprehension and learning of passive form. Language learning, 57, 87–118.
Leeser, M. J. (2004). The effects of topic familiarity, mode, and pausing on second language learnres’
comprehension and focus on form. Studies in Second Language Acquisition, 26, 587–615.
Leeser, M.J. (2007). Learner-based factors in L2 reading comprehension and processing grammatical
form: Topic familiarity and working memory. Language Learning, 57(2), 229–270.
Levelt, W.J.M. (1989). Speaking: From intention to articulation. Cambridge MA: The MIT Press.
Long, D.R. (1990). What you don’t know can’t help you: An exploratory study of background knowl-
edge and second language listening comprehension. Studies in Second Language Acquisition,
12, 65–80.
Markham, P., & Latham, M. (1987). The influence of religious-specific background knowledge on the
listening comprehension of adult second-language students. Language Learning, 37, 157–170.
Mehnert, U. (1998). The effects of different lengths of time for planning on second language perfor-
mance. Studies in Second Language Acquisition, 20, 83–108.
Merlo, S., & Mansur, L.L. (2004). Descriptive discourse: Topic familiarity and disfluencies. Journal of
Communication Disorders, 37, 489–503.
Mohan, B.A. (1986). Language and Content. Cambridge, MA: Addison-Wesley.
Ortega L. (1999). Planning and focus on form in L2 oral performance. Studies in Second Language
Acquisition, 21, 109–148.
Ortega, L. (2005). What do learners plan? Learner-driven attention to form during pre-task planning.
In R. Ellis (Ed.), Planning and task performance in a second language (pp. 77–109). Amsterdam:
John Benjamins.
Ortega, L., Iwashita, N., Norris, J., & Rabie, S. (in preparation). A multi-language comparison of syn-
tacticcomplexity measures and their relationships to foreign language proficiency. Manuscript
in preparation.
Robinson, P. (2001). Task complexity, task difficulty and task production: exploring interactions in a
componential framework. Applied Linguistics, 22, 27–57.
Samuda, V. (2001). Guiding relationships between form and meaning during task performance: The
role of the teacher. In M. Bygate, P. Skehan, and M. Swain (Eds), Researching pedagogic tasks:
Second language learning, teaching and testing (pp. 119–140). London: Longman.
Task readiness 93

Schmidt-Rinehart, B.C. (1994). The effects of topic familiarity on second language listening compre-
hension. The Modern Language Journal, 78, 179–189.
Shimoda, T.A. (1993). The effects of interesting examples and topic familiarity on text comprehen-
sion, attention, and reading speed. Journal of Experimental Education, 61, 93–103.
Skehan, P. (1998). A cognitive approach to language learning. Oxford: OUP.
Skehan, P. (2009). Lexical performance by native and non-native speakers on language learning tasks.
In B. Richards, H.M. Daller, D. Malvern, P. Meara, J. Milton, J. Treffers-Daller (Eds.), Vocabu-
lary studies in first and second language acquisition: the interface between theory and application
(pp. 107–124). Basingstoke: Palgrave Macmillan.
Skehan, P., & Foster, P. (1997). Task type and task processing conditions as influences on foreign
language performance. Language Teaching Research,1(3),185–211.
Skehan, P., & Foster, P. (1999). The influence of task structure and processing conditions in narrative
retellings. Language Learning, 49(1), 93–120.
Skehan, P., & Foster, P. (2005). Strategic and online planning: the influence of surprise information
and task time on second language performance. In R. Ellis. (Ed.), Planning and task performance
in a second language (pp. 193–216). Amsterdam: John Benjamins.
Tavakoli, P., & Skehan, P. (2005). Strategic planning, task structure, and performance testing. In
R. Ellis. (Ed), Planning and task performance in a second language (pp. 239–273). Amsterdam:
John Benjamins.
Thalheimer, W., & Cook, S. (2002). How to calculate effect sizes from published research articles: A sim-
plified methodology. Retrieved April 18, 2009 from http://work-learning.com/effect_sizes.htm.
Tulving, E., & Thomson, D.M. (1973). Encoding specificity and retrieval processes in episodic mem-
ory. Psychological review, 80(5), 352–373.
Yuan, F., & Ellis, R. (2003). The effects of pre-task planning and on-Line planning on fluency, com-
plexity and accuracy in L2 monologic oral production. Applied Linguistics, 24(1), 1–27.
Wang, Z. (2009). Modeling L2 Speech Production and Performance: Evidence from Five Types of Plan-
ning and Two Task Structures. Unpublished Ph.D. thesis. The Chinese University of Hong Kong.
Wigglesworth, G. (1997). An investigation of planning time and proficiency level on oral test dis-
course. Language Testing, 14(1), 85–106.
chapter 4

Self-reported planning behaviour and second


language performance in narrative retelling

Francine Pang & Peter Skehan


Macao Polytechnic Institute / St. Mary’s University, Twickenham

The second language planning literature has been mainly quantitative in nature,
with very few qualitative investigations of planning (but see Ortega 2005). This
chapter tries to redress that imbalance and reports on a study of what second
language learners say they do when they plan. Participants were from a university
in Macao, and completed a narrative task, followed by retrospective interviews. The
interview data was coded, and a coding scheme emerged from this work which had
some affinity to the Levelt (1989) model of speaking. As a result, this may be of use
in other contexts. In addition, relationships between the self-reported planning
behaviours and actual performance on the task were explored. This suggested
some generalizations as to what planning behaviours are associated with higher
performance, and, interestingly, which are associated with lower performance. The
former tend to implicate the Conceptualiser stage of speech production and are
specific and limited in range, whereas the latter are frequently concerned with ­
over-ambition during the planning stage, a concern for form, and participants
attempting to do too much.

Introduction

Early publications on planning


What we think of as contemporary second language planning research started with
two publications (Ellis 1987 and Crookes 1989), which demonstrated the importance
of the opportunity to plan before doing a second language task, and which disagreed in
ways that are still interesting and influential. In the quarter century since Ellis’ publica-
tion, the field of second language planning research has grown enormously, and has
produced many research articles. A great deal has been found out regarding the effects
of different planning conditions (Mehnert 1998; Skehan & Foster 1997); the impact
of planning with different proficiency levels (Wigglesworth 1997; Tavakoli & Skehan
2005); the relevance of different task factors (Michel et al. 2007; Foster & ­Tavakoli 2008);
96 Francine Pang & Peter Skehan

the time perspective under which tasks are completed (Robinson 2011); the time when
planning occurs, with a contrast between pre-task or strategic planning compared to
on-line planning which takes place when time is available while speaking is taking place
(Ellis 2005b) (see other chapters in this volume). As a result, we are now in a much bet-
ter position to predict what the impact will be on performance of manipulating differ-
ent task features and different task conditions. Indeed, an index of the success of these
developments is that we have competing accounts of what produces the different effects
which have been reported. Whereas Skehan (2009a) argues that limitations in atten-
tion frequently lead to trade-offs between different areas, and that careful task choice
and use can mitigate the impact of these tradeoffs, Robinson (2001, 2011), through the
Cognition Hypothesis, analyses attention differently, as less limited, and proposes that
task difficulty can push for different aspects of performance (complexity, accuracy) to
be simultaneously raised.
The nature of performance itself has been the focus for much research, r­ eflecting
a wider interest in second language performance dimensions. Following Crookes
(1989), task researchers have usually focused on the dimensions of complexity, accu-
racy, and fluency. More recently measures of lexis have also started to become more
common in task research (Skehan 2009b). Essentially, these four aspects of perfor-
mance are regarded as distinct, so that one or two might be raised, while the others are
not. This connects with one of the most interesting debates on the effects of planning:
whether it impacts on all areas of performance, or only on complexity and fluency.
Some researchers, including Crookes (1989), and Ortega (2005), argue that planning
raises these two areas only, whereas others, notably Foster and Skehan (1996), argue
that planning can also have an impact on accuracy.
Some experimental studies have tried to address some of the disagreements, (see
for example Wang (Chapter 2, this volume) and Bui (Chapter 3, this volume), as do
studies by Michel et al. (2007) and Revesz (2009). Their hope has been to design stud-
ies in such a way as to tease out differences and predictions from theoretical positions
which will resolve disagreements. Such research has been useful, but so far, not defini-
tive. In reflecting on this it is important to point out that the vast majority of stud-
ies on planning have been quantitative in nature. Hypotheses have been framed, data
collected, coded, and scored, and quantitative techniques have been used to explore
the match or mismatch between hypotheses and results. Next, interpretations of the
experimental conditions and their effects in relation to the results have been put for-
ward, hence the claims about Cognition, Tradeoff, accuracy versus complexity effects,
and so on. What has been strikingly absent is any tradition of qualitative research
used to gain insights into what happens during the period when planning is under-
taken. Researchers seem to have been keener to try to infer the mental processes of
participants from quantitative patterns, rather than to discover what the participants
themselves have to say.
Self-reported planning behaviour and second language performance in narrative retelling 97

The major exception to this comes from two studies by Ortega (1995, 1999), and
the broader account she published of this work (Ortega 2005), where she herself won-
ders why there had been so little qualitative research in this area. Several years later, it
is even more striking that this state of affairs has not really changed, particularly given
that qualitative studies have the potential to unlock a great deal in relation to debates
within the literature. They can provide insights into the aims learners have during
the planning period, the processes they try to engage in, and their satisfaction subse-
quently with the activities they have engaged in. The present research tries to redress
this situation and report qualitative data on planners’ activities, an endeavour which,
if nothing else, will add to Ortega’s initial work.

Ortega’s research into planning


First, though, Ortega’s research is worth reviewing, because it does make major contribu-
tions to our understanding of what learners say about what they do during planning. She
used narrative retellings of picture stories from Hill (1961) as the basis for her research.
The participants in her studies were learners of Spanish at the ­University of Hawaii. Her
first study involved learners she characterises as low intermediate, and the second study
focused on advanced learners. Participants first listened to a tape recording of the story
in their L1 (not a typical approach in the task literature). Then, following a planning
period, learners provided their own narrative account, after which they were engaged
in retrospective interviews, in which they were probed about what they had done while
planning. An important aspect of this research is the coding scheme that was developed
to work with the data. A strong influence here were schemes developed to taxonomise
learner strategies, particularly O’Malley & Chamot (1990), but also Oxford (1990). The
categories in these two schemes were supplemented by examination of the transcripts of
the retrospective interviews, which enabled further categories and themes to emerge in
their own right. The coding system ultimately used was a mixture of the existing learner
strategies schemes (consisting of thiry-four categories), and the additional categories
which achieved salience in the transcripts, generating a further six new codes.
Ortega (2005) reports that retrieval and rehearsal strategies were particularly
important with her participants. She also reports that the advanced group had more
of a balance in their use of these two strategy types than the low intermediate partici-
pants, with these latter using more retrieval strategies. She also reported that a range
of monitoring strategies were used, such as production monitoring, although this was
less effectively done with the lower proficiency participants. In the main, her partici-
pants felt that planning was helpful. This was partly because it gave them more time
to organise, to formulate thoughts, to solve lexical problems, to practise and rehearse.
­Writing notes was also regarded as helpful, enabling the formulation of thought,
­helping ­lexical retrieval and lexical choice, and also helping to monitor grammar.
98 Francine Pang & Peter Skehan

There were, h ­ owever, some reports of planning not being helpful. One reason pro-
posed was that the narrative tasks were rather easy, and did not need much planning.
There were also reports of lack of transfer from planning to actual performance. Many
of these points are prescient with respect to the results to be reported here.
Ortega (2005) makes two more general points which have importance. First, she
draws attention to individual differences. She contrasts communicatively-oriented
participants and those more focused on form, and argues that participants brought
this predisposition to the way planning time is exploited. Second, she draws attention
to issues deriving from the presence of a listener. Participants were put in pairs, with
one as speaker and the other as listener. Both participants were ‘valued’ in the encoun-
ter, but in fact, it was only the data from the speakers which was used. However, the
speakers were clearly aware of the listener as an important factor in the encounter.
Ortega (2005) reports this had a major impact on performance, with speakers report-
ing thinking of how to use planning time to make content more accessible, of how
they could retrieve easier vocabulary, and how they could avoid more advanced gram-
mar. There was also a reluctance to self-correct and even a willingness to slow down
­delivery in order to make comprehension easier for the listener.

Motivation for the present research


An earlier pilot study carried out by the researchers (Pang & Skehan 2006) was their
first attempt to find out what learners planned before doing a speaking task. The plan-
ners, undergraduates at a university in Hong Kong, were asked what they did during
the ten-minute planning time they were allowed, what they prioritized, and whether
the planning activities helped them in performing the actual task. The ­retrospective
interviews (generally conducted in Cantonese) were translated, transcribed and
coded. A preliminary coding scheme was developed from the codes and c­ ategories
which emerged through a process of iteration. This preliminary coding scheme was
very revealing, demonstrating the viability of using a model of speaking (Levelt 1989)
as the basis for the categories of codes which were developed.
Against this background of previous research, we can now outline the reasons
which motivated the present research. First, it is desirable to gather qualitative data
in more settings with different participants to clarify the robustness and replicability
of extant findings and generalizations. Second, there is the coding scheme. Ortega
(2005) based hers on the work of O’Malley & Chamot (1990) and Oxford (1990).
There was a stage in which coding categories additional to those derived from these
two schemes could emerge. However, in Ortega’s final coding scheme (Ortega 2005,
pp. 84–85) the number of ‘emergent’ categories is not large in relation to the total
used (as noted above), so that most of the coding category headings are those from
O’Malley & Chamot (1990). A difficulty here is that these systems target learning
Self-reported planning behaviour and second language performance in narrative retelling 99

rather than speaking strategies, and so they may not be totally appropriate. In par-
ticular they are not based on any theory of speaking, either first or second language
(Levelt 1999; ­Kormos 2006). There would seem scope, therefore, to use an emergent
category approach from the beginning, but to have in mind while categories emerge
the possibility of relating them to a model of speaking, such as Levelt’s, which has
been applied to the second language case (DeBot 1992; Kormos 2006; Skehan 2009a).
In this way, from retrospective interviews, one could look for comments which might
relate to the different stages in the Levelt model (Conceptualisation, Formulation,
and Articulation), as well as associated processes such as monitoring. At the same
time, one could also explore whether and how far Levelt’s proposals on the function-
ing of a mental lexicon have relevance for the reports which are gathered.
A third motivation for the present research is that there is no research we are aware
of that explores the relation between participants’ reports on what they did during
planning and their subsequent performance. Ortega’s work gives us excellent insights
into what participants say they do during planning, and also what they say about how
effective they think their planning was, but we have no information about whether
the reports on planning are associated with success or failure. This is important to the
extent that the planning literature is centrally concerned with trying to establish link-
ages between planning and performance, with performance generally conceived of in
terms of complexity, accuracy, fluency and lexis. Indeed, the debates within the litera-
ture are less about the desirability of planning (because in the main, researchers assume
its value), but rather how different interpretations of planning, perhaps with different
tasks, can impact upon different aspects of performance. So, to gather retrospective data
on planning, and to link this to performance, would relate to wider debates within the
planning literature. For instance, such data might shed light on which planning behav-
iours are most effective, in such a way that one could make relevant suggestions for ped-
agogic intervention, and even offer suggestions for how more effective planning could
be trained. This, too, would go beyond planning as being a rather monolithic and crude
pedagogic option, and suggest how it could be fine-tuned and targeted more effectively.

Method

Research Questions
This background generates two fairly straightforward research questions. It is inap-
propriate, given the exploratory, qualitative nature of the proposed research, to put
forward research hypotheses and predictions. Instead the two general questions are:

1. In the context of planning ahead of a narrative task, is a coding scheme based on


categories which emerge from the data consistent with models of speaking?
100 Francine Pang & Peter Skehan

2. Is frequency of use of the emergent categories related to different levels of perfor-


mance on a narrative task, particularly in terms of complexity, accuracy, fluency,
and lexis?

Research methodology

Participants and setting


The participants were selected from a university in Macao. Five hundred and sixty-
seven students who took English courses in the English Centre were invited to take a
listening comprehension test, which included a short conversation, a long conversa-
tion and a short talk, with 50 questions in total. Cronbach’s alpha for this test is 0.82.
Students who got marks between 15 and 24 were considered to be low intermediate
EFL learners, and those who got marks higher than 34 as high intermediate EFL learn-
ers for this study. In total 48 students were selected to participate in the study includ-
ing 24 high intermediate and 24 low intermediate EFL learners, with 24 male and
24 female learners, and 24 students majoring in Language and Communication and
24 in Business Administration (see Table 1).

Table 1.  Profile of the 48 selected participants


Male Female Remarks

Language & 6 6 Dyads:


High Communication 2: M+F, 2: F+F, 2: M+M
Intermediate Business 6 6 Dyads:
Administration 2: M+F, 2: F+F, 2: M+M
Language & 6 6 Dyads:
Low Communication 2: M+F, 2: F+F, 2: M+M
Intermediate Business 6 6 Dyads:
Administration 2: M+F, 2: F+F, 2: M+M
Subtotal 24 24

The researcher met each dyad of participants in an individual room. She briefed the
two participants that they would have ten minutes to plan a picture story ­individually
and would take turns to tell the story in English for about 2 minutes to each other
(see the instructions in Appendix 1). The listener could not see the pictures and was
told to ask at least one question after the story was told. All storytellings were audio-
recorded. When participants finished telling the story, the researcher interviewed each
student individually about what they did during the 10-minute planning time. The
­retrospective interview questions, trialed in the pilot study mentioned earlier, were
intended to collect planning activities in a range of areas including words, g­ rammar,
Self-reported planning behaviour and second language performance in narrative retelling 101

ideas, story structure. The interview was conducted in Mandarin or Cantonese ­Chinese
and was audio recorded.

Tasks
Selecting interesting and appropriate story pictures for this study was a challenging
process. Given the success of the Shaun the Sheep video narrative retellings (Wang &
Skehan, this volume), it was decided to adapt the video stories as the basis for mak-
ing a cartoon series. A wide range of Shaun the Sheep episodes were initially identi-
fied. These were then scrutinised by the researchers and reduced to seven. The seven
selected episodes were converted into picture story series, and these were each evalu-
ated by around 10 MA TESOL students. Based on the ratings of the story series given
by the graduate students in terms of clarity, humor, and depth, four picture series were
selected to be used in the pilot study. The two aims of the pilot study were to trial
the retrospective interview questions, and to select two story pictures for the present
study. Fourteen students from the same university in Macao participated in the pilot
study. Two picture series were finally selected based on the following criteria: amount
of useful retrospection about planning, variety of self-reported planning behaviour,
and ratings by the participants (clarity, humor, depth, and difficulty in completion).
The pilot also enabled a decision to be made about the length of planning time to be
used. The two selected story pictures adopted in this study each had 19 pictures in total
and were printed in color for use in the research sessions.

Procedures
The Retrospective Interviews (RIs) of the 48 participants were audio-recorded. All
the 48 digitally recorded RIs were transferred to computer as MP3 files. They were
transcribed (and translated at the same time) using Soundscriber, to facilitate control
over the sound file during transcription. The prompts for these interviews are shown
in Appendix 2.
The data handling for the narrative performances followed the procedures used
in most of the chapters in this volume, and therefore does not need to be discussed
in great detail. A broad transcription was made of each sound file. Transcriptions
were segmented into AS units, and copied to contain two identical lines for each AS
unit. The first line was then coded following CHAT conventions (MacWhinnie 2000),
and represented as the CHAT tier. The second line was coded following TaskProfile
conventions, containing clausal segmentation, error coding, measurement of pauses
longer than 0.40 seconds, and coding for a range of repair types (reformulation, rep-
etition, etc.). In addition, the length of time taken, at millisecond level, for each AS
turn was recorded as a third line. These codings enabled TaskProfile to generate all the
measures required in the present study (for a fuller discussion of performance cod-
ings, see Chapter 1).
102 Francine Pang & Peter Skehan

Performance measures
Five performance measures were used in this study. Complexity was measured using
the subordination measure described in Chapter 1: The total number of clauses was
divided by the total number of AS units, generating an index with a minimum value
of 1 (no AS unit contained anything other than a matrix clause, with no subordi-
nation), with most values falling between 1 and 2. Accuracy was measured as the
proportion of clauses that were error-free, and in this case, although the data was
coded for gravity of error, the measure which was actually used, on the basis of effec-
tive discrimination, was that based on all errors (rather than only serious errors, as
in Skehan and Shun (this volume)). Fluency was measured by two indices, both of
pausing: pauses per 100 words at AS boundary points, and pauses, again per 100
words, which occured mid-clause. Skehan (2009b) has shown that pauses at these
two locations need to be considered separately. Finally, lexical sophistication was
measured as the Lambda score, the index which captured the extent to which the
contribution of the speaker contained less frequent words (see Chapter 1 for a more
detailed account). These five measures constitute a basic set of those described more
fully in Chapter 1.

Segmenting the retrospective interviews


After the transcriptions of the retrospective interviews (RIs) were completed, the
segmentation of the 48 RIs was undertaken. There are different methods to segment
such qualitative data, such as grammatical-based, idea-based, and activity-based
approaches. The activity-based method was applied in this case, because the main
purpose in analyzing the RIs is to examine the types of planning activities ESL speak-
ers would engage in before telling a picture story. Furthermore, using the activity-
based approach to segment the RIs allowed the feasibility of building an RI corpus
which might result in more sophisticated analysis of the segments both qualitatively
and quantitatively.

First coding: Constructing the coding scheme


The first task was to code each segment, that is, each RI Unit (the term used in this
study) as a CODE, to represent a planning activity. There were several influences on
this stage. These included an earlier pilot study (Pang & Skehan 2006) based on dif-
ferent narrative tasks and participants, but which had generated a provisional cod-
ing scheme. The Ortega (2005) scheme was also examined and was kept in mind as
relevant. Finally, the first author’s initial recognition of emerging planning activities
when doing the earlier transcription and segmentation of the RIs had sensitised her to
the sorts of behaviours which had been reported.
Self-reported planning behaviour and second language performance in narrative retelling 103

The provisional Coding Scheme consisted of little more than a list of codes with
a provisional description of each of them. Although the codes and the categories
were preliminary, they created an initial framework for coding the data in this study
by taking advantage of the similar features of the participants, tertiary Chinese non-­
English major students in the Pilot Study and in this study. The 48 RIs were coded
using the method of constant comparison (Strauss & Corbin 1990). That is, the
researcher attempted to closely examine and re-examine each RI Unit, compare for
similarities and differences, and ask questions about the planning activities reflected
in the retrospective interviews. In addition, every effort was made to ensure the
coding system was sensitive to the variety of planning activities the ESL speakers
might use. Detecting all the planning activities reported by each participant, (either
reported directly by the participants or inferred from the interview) was the starting
point for this.
Having constructed the provisional Coding Scheme and having coded the 12
RIs in the previous pilot study, the first author became more sensitive throughout the
investigation to the possibility of any emergent planning activities. The view is that
the more exhaustive the analyses, the more realistic they would be with respect to the
planning activities used by both groups of speakers, the high intermediate and the low
intermediate groups. Therefore, in constructing the Coding Scheme, no quantitative
criterion was used; that is, regardless of the frequency with which a planning activ-
ity occurred, it was incorporated into the Coding Scheme. For example, the follow-
ing three planning activities are included in the Coding Scheme although they only
occurred once: (A) 2. Macro Planning Plan sequence: Look at pictures one by one, then
describe; (D) 6. Lexical choice: Advanced words; (E) 8. Lexical: Planned but not used/
correctly used; (see Appendix 3).
This first pass through the 48 RIs to develop coding categories took a significantly
longer time than was anticipated. This is not only because of coding the data itself (as it
would have taken much less time if a fixed, established coding scheme had been used)
but also because the final Coding Scheme underwent an iterative process of multiple
revisions. The action of examining, re-examining, comparing and asking questions
challenges the RI Units themselves and the method of coding the RI Units continually.
In other words, how to match an RI Unit to a code subtly and how to code all RI units
consistently created considerable complexity.
The first coding of all the 48 RIs resulted in the identification of 42 planning activi-
ties (i.e. 42 codes). This Coding Scheme included: the codes of the planning activities,
a description of each code, and an appropriate example, demonstrating the planning
activity. As a brief example of the scheme in operation, the code “Connect the ­pictures
to develop the story plot” (described as “Try to connect or structure the pictures to develop
the story plot”) is the result of conceptualizing an RI Unit “I emphasized on the plots.
I considered how to connect the pictures to make the story better.”
104 Francine Pang & Peter Skehan

The next stage was to explore whether any order could be brought to the codes.
It proved possible to organise the entire set of 42 planning activities (i.e. the codes)
into five groups reflecting their functions. These were (A) Macro planning; (B) Micro
planning; (C) Lexical and grammar planning; (D) Metacognitive planning, and (E)
Post-task perception and evaluation. The last category will not be pursued further in
this chapter, for reasons of space. This first Coding Scheme was not intended to be a
complete representation of all possible planning activities. Nevertheless, it does rep-
resent an exhaustive list of the planning activities the participants used to prepare for
telling a story from a series of pictures.

Second coding: Real coding


The 48 RIs were coded a second time based on the final Coding Scheme (shown in
Appendix 3). During the first coding, while the Coding Scheme was evolving, an
RI Unit that was examined after a code had been added or deleted might be coded
­differently to an RI Unit coded earlier although both exemplified the same concept.
Therefore, the second coding was regarded as the real coding, which would be the
basis for the quantitative analysis and the associations with actual performance.
At this point, the first author’s theoretical familiarity and sensitivity had grown
significantly from coding the 12 RIs in the previous Pilot Study (Pang & Skehan 2006)
and the coding of the 48 RIs during the first coding. This sensitivity helped in distin-
guishing the slightly different concepts between closely-related codes and therefore
made it easier to detect examples of codes in use, and also to make final decisions
with some RI Units which were close to falling between two codes or even three
codes. For example, the concept is very similar for the two codes: (D) 5. Metacognitive:
Rehearse: Memorization and (D) 8. Metacognitive: Memorization and so the actual RI
Unit needed to be closely reexamined with coding sensitivity to decide which one was
appropriate in any particular case.
Finally, all the coded retrospective interviews were incorporated within an Excel
file. The same codes were grouped together, and as a result the same RI units could
be reexamined and compared to see whether they fitted into each code so that final
­revision of the coding system could be undertaken. In addition, at this stage, the
description of each code was modified to reach its final form.

Results

Basic quantitative analyses


Table 2, below, shows the raw values for each of the coding categories that emerged
from the retrospective interviews. Each line gives one of the coding categories (and
the fuller version is provided in Appendix 3), together with the raw frequencies for
Self-reported planning behaviour and second language performance in narrative retelling 105

Table 2.  Frequency data for all codes


Low prof. High prof. Total

Number of mentions 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4

Macro Planning
Plan sequence: Scan, then describe  0 24  0 24  0 48
Plan sequence: Look at each picture, 23 1 24 0 47 1
describe

Micro Planning
Understand pictures in detail  5 10 7 2 0 10 6 4 3 1 15 16 11 5 1
Plan general things 16 8 12 12 28 20
Plan small details  8 14 2   2 12 10 10 26 12
Plan how to tell the story  8 11 4 1 12 9 3 0 20 20 7 1
Plan how to express oneself better 13 7 4 13 7 4 26 14 8
Think of ideas beyond the pictures 17 7 10 12 2 27 19 2
Organise the ideas developed from 17 6 1 14 8 1 31 14 2 1
pictures
Connect the pictures to develop 14 9 1  6 12 4 2 20 21 5 2
the story

Lexical and grammar planning


Lexical: general retrieval 12 12 0  7 12 5 19 24 5
Lexical Choice: Appropriate words 21 3 19 3 2 40 6 2
Lexical Choice: Simple words 16 7 1 20 4 0 36 11 1
Lexical Choice: Connective words 17 6 1 12 12 29 18 1
Lexical Choice: Personification 24 0 22 2 46 2
words
Lexical Choice: Advanced words 24 0 23 1 47 1
Lexical Choice: Variety of words 23 1 21 3 44 4
Lexical Choice: Accurate words 24 0 19 5 43 5
Lexical Compensation: 21 3 21 3 42 6
Approximation
Lexical Compensation: 15 6 2 1 15 7 2 0 30 13 4 1
Circumlocation
Lexical: No or little concern 19 5 23 1 42 6
Grammar: General use 18 5 1 19 5 37 10 1
considered
Grammar: Correct use of tense 17 7 15 9 32 16
Grammar: No or little concern 12 12 11 13 23 25

(Continued)
106 Francine Pang & Peter Skehan

Table 2.  Frequency data for all codes (Continued)

Low prof. High prof. Total

Number of mentions 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4

Metacognitive Planning
Rehearse: General   9 15 16 8 25 23
Rehearse: To be accurate 18 6 17 6 1 35 12 1
Rehearse: To be fluent 15 9 13 11 28 20
Rehearse: To be logical or clear 24 0 19 4 1 43 4 1
Rehearse: To help to memorise 24 0 22 1 1 46 1 1
Take notes to help plan 16 7 0 1 15 7 2 0 31 14 2 1
Take notes: No need 11 13 13 11 24 24
Memorisation 24 0 22 2 46 2
Try to be aware of the listener   3 18 2 0 1   6 11 3 4   9 29 5 4 1

the lower proficiency group and the higher proficiency group, as well as the entire
group. This shows the number of times a given coding was made. So, for the first
line (Macro Planning: plan sequence; scan then describe), in the low proficiency group,
no-one coded zero (i.e. no one failed to report this planning behaviour), so that the
table shows that all twenty-four lower proficiency participants reported using this
behaviour. This contrasts with the first of the micro planning behaviours: Understand
pictures in detail. Here, five participants (still with the low proficiency group) did not
report using this behaviour, ten participants reported it once, seven reported it twice,
two reported it three times, and no-one in this group reported using it four or more
times (although in the high proficiency group there was one participant who reported
this behaviour four times). These raw values have been reported, rather than averages
or percentages, because they communicate the situation more effectively.
The table gives a general picture of the frequency with which different codings
were found for the participants. Not a great deal will be said about these figures at
this stage, since more discussion will be provided when we link coded behaviours to
actual performance. Even so, a number of points are worth making. First, there is the
issue of discrimination and whether there is variation between participants in the
use of a particular code. If the goal were simply to characterise self-reported plan-
ning behaviours, this would not be important. They are what they are, and it is the
patterns amongst them which would be of interest. But if we are to link such behav-
iours to performance, it is helpful if there is dispersion. On these grounds, then,
both of the macro behaviours (the two Plan sequence behaviours), as well as several
of the lexical codings, (e.g. Advanced words, plus one or two of the metacognitive
Self-reported planning behaviour and second language performance in narrative retelling 107

behaviours) are problematic, since effectively only one value is reported, with this
often being zero or one, indicating that the behaviour is simply not reported by the
vast majority of the participants. A second point which stands out is the connection
with proficiency level. Several of the codes show interestingly different patterns for
the low and high proficiency students. For example, the micro planning behaviour
Connect the pictures to develop the story sees fourteen of the low proficiency partici-
pants code ‘0’, while only six of the high proficiency participants code in this way.
One wonders, therefore, if this behaviour is facilitated by students’ higher levels of
proficiency.

The codes and the Levelt model


We can now discuss the different codes in relation to the Levelt model of speaking. The
broad categories are Macro Planning, Micro Planning, Lexical and Grammar Plan-
ning, and Metacognitive Planning. Both Macro and Micro Planning are concerned
with Levelt’s Conceptualiser stage, and with the speaker’s processing of the ideas that
are going to feed into the pre-verbal message. These codes vary in focus (pictures,
ideas, outside the ideas, manner of expression) and also in scale (local versus general)
but they are all concerned with thinking. Lexical and Grammar planning are much
more focused on performance, and are, fairly obviously, linked with the Formula-
tor stage in speech production (though Formulation processes clearly take place in
relation to prior conceptualisations). Several of the codes are clearly concerned with
lexical retrieval, others are focused on grammar and the building of syntactic frames.
Yet others involve a mixture of the two, both lexical and grammatical, and are also
implicated in Formulation processes that are anticipated, such as handling difficulty
in communication. The one higher order coding category which straddles Leveltian
stages are the Metacognitive codes. Here we have some which are concerned with
Conceptualisation, where the focus is on ideas, or on the communication as part of
a speech event with a listener present. There are a number of codes concerned with
rehearsal, and these seem directed at Formulator operations (although even here, one
is concerned with a form of cognitive monitoring). In any case, it is not difficult to
link the coding categories which emerged with aspects of the Leveltian analysis of
speaking.

Quantitative data
Table 3 shows the performance results for the participants. The data is shown for one
measure of accuracy (error free clauses), one of complexity (subordination), two paus-
ing measures (number of pauses at AS boundaries per 100 words, number of pauses
mid-clause, per 100 words), length of run, and Lambda, so covering accuracy, com-
plexity, fluency, and lexis. The measures are given for the entire group, and then also
108 Francine Pang & Peter Skehan

for low and high proficiency participants. In this case, significance values are also
given, based on between subjects t-tests. The Length of Run measure is only given to
provide a limited degree of comparison with Ortega (2005) who used a very similar
index. For all values in this table the N is 48 overall, with 24 low proficiency partici-
pants and 24 high proficiency participants.

Table 3.  Performance measure for participants


Performance measure Total group Low High Significance
mean profic.group profic. group low vs. high
(St.Dev.) mean mean proficiency
(St.Dev.) (St.Dev.)

Error free clauses .40 .34 .47 0.002


(.16) (.14) (.15)
Subordination 1.66 1.62 1.69 0.410
(.30) (.26) (.33)
AS boundary pauses 3.38 3.57 3.20 0.31
(1.26) (1.48) (.99)
Mid-clause Pauses 3.64 4.07 3.21 0.14
(1.98) (2.34) (1.48)
Lambda 1.85 1.80 1.91 0.15
(.26) (.27) (.26)
Length of run 6.12 5.42 6.82 0.001
(1.42) (1.0) (1.44)

We will first consider the general values in this table. There are now a wide range
of studies (including in this volume) which use the set of measures shown in the table,
and so one can relate the values shown here to the wider literature. In this respect, the
values for accuracy are relatively low (although there may be issues here with Chinese
L1 EFL learners of English, they are somewhat lower than those reported by research
conducted in a U.K. context). The values for fluency are fairly normal for the sorts of
narrative retellings involved here, and are low, if anything, relative to other research
studies. The remaining values, though, are in fact, higher than is normally reported.
The subordination values for tasks of this sort are usually a little lower, possibly more
in the 1.4 to 1.5 range for planned performances. Similarly, the Lambda values, as an
index of lexical sophistication, are definitely higher than is typical, probably around
0.2 to 0.5 above what one normally finds (Skehan 2009b). Finally, the length of run
values are also clearly higher than the norm, since one often sees values here of 3 or 4
rather than the 5.42 and 6.12 shown for the two groups. Indeed, these values approach
those found with native speakers. If one makes a rather tentative comparison with
Ortega’s (2005) ‘words within one intonation contour’ index, one would estimate that
the participants in this study are between her two groups, and perhaps closer to her
Self-reported planning behaviour and second language performance in narrative retelling 109

advanced group. In all, one could characterise these performances as lacking in accu-
racy, but lexically rich and complex.
Turning to the comparisons of the low and high groups, it is surprising how few sig-
nificant differences are reported. In fact, there are only two, for accuracy and for length
of run, although each of these comparisons reaches quite a high level of significance.
So the advanced group is more accurate (consistent with Bui (this volume)), and they
produce ‘smoother’ language, producing units of speech which are longer. In contrast,
with fluency and with lexical and structural complexity, there are no significant dif-
ferences. It is noteworthy that in all these cases, the high proficiency group produces
arithmetic means which indicate a higher level of performance, but none of these com-
parisons actually reach significance. But one important point does need to be made here
regarding the accuracy contrast. In the next section we are going to turn to the associa-
tions between self-reported planning behaviours and actual performance. For structural
complexity, for lexical sophistication and for fluency, we shall treat the two proficiency
groups as effectively one group, given the lack of significant differences found. But the
two groups have to be considered differently for accuracy. As we will see, this poses a
problem for interpretation. If certain coded behaviours are associated with higher levels
of performance and also discriminate between the two proficiency groups, we cannot
tell whether these behaviours are ‘enabled’ by the higher proficiency, or whether they
contribute to that higher level of performance. We will return to this problem below.

Frequency of reported planning behaviour and performance levels


We turn next to exploring the relationship between the different coded behaviours
and performance in the narrative retellings. To this end, every code (with its values
of 0, 1, 2, 3 for the use of that code) was related to performance in terms of accuracy,
complexity, fluency (both pausing measures), and lexical sophistication. For example,
Lexical Code 1, General retrieval tallied as 19 individuals with 0 occurrences, 24 with
1 occurrence, and 5 individuals with two occurrences. These three values (0, 1, 2) and
the associated participants were then examined for mean error-free clauses scores, as
shown in Table 4. These figures, based on Lexical Code 1, suggest that there is some
association between the use of this behaviour during planning and level of accuracy,
in that greater use of this code seems to be associated with greater accuracy. It should
be made clear that, given the exploratory nature of this study, and the strong reliance
on qualitative data, these figures are only presented descriptively, to gain some insight
into what is associated with higher performance.
The same descriptive procedure was followed with all the codes used in this study.
For each code, number of uses of a code was the basis for calculating a mean score for
those individuals who used the code that often, and then frequency of use was related
to the mean performance score (accuracy, complexity, fluency, lexis) involved. Finally,
110 Francine Pang & Peter Skehan

Table 4.  Frequency and Error-Free clause mean scores: Lexical Code 1 – General retrieval
Code Number of reports Mean Error free clauses score

0 19 .37
1 24 .41
2 5 .45

for the different performance areas, all codes which seemed to have some association
with performance were brought together (whereas codes which generated no such
relationship were not included). Table 5 presents the findings for the Error-free clauses
measure, both positive and negative. The first two columns give information about the
coding involved, and fuller information is provided in Appendix 3. The third column
shows whether there is a linkage to proficiency, and the fourth column shows the dis-
tribution of coding frequency (0, 1, 2, etc.) and also the mean error-free clauses score
associated with each frequency.

Table 5.  Codes associated with greater accuracy


No. CODE Description of CODE. Proficiency Performance influence
linkage

Positive
LE1: Lexical: Try to remember the words used in Yes Distrib: 19 -24 – 5
General retrieval the task EFC .37/.41/.47
LE8: Lexical choice: Try to use accurate words Yes Distrib: 43 – 5
Accurate words EFC: .40/.46
Meta2: The notes taken are helpful to No Distrib: 35 -12 – 1
Comment on notes: structure a clear story EFC: .38/.47/.54
Structure clear story
Meta3: Rehearse to be fluent No Distrib: 28 - 20
Rehearse: Fluent EFC: .36/.47
Meta4: Rehearse to check whether what is Yes Distrib: 43 – 4 - 1
Rehearse: planned is logical or clear EFC: .39/.55/.50.
Logical or clear
Micro 8: Try to connect or structure the Yes Distrib: 19 -21 – 5 - 2
Connect the pictures to develop the story plot EFC: .35/.43/.43/.56
pictures to develop
the story plot

Negative
Le 10: Lexical Use a few words or another way No Distrib: 30 -13 - 4
compensation: to replace a word which cannot be EFC: .43/.38/.27
Circumlocution recalled
Mic5: Plan how to Plan how to describe the story more No Distrib: 26 -14 - 8
express better vivid, interesting, or clearer etc. EFC: .43/.38/.-37
Self-reported planning behaviour and second language performance in narrative retelling 111

Only the relations with error-free clauses have been shown here, and the other per-
formance areas are covered in the tables which follow. It may be, therefore, that codes
appear in more than one table, if a particular code has a relationship with more than
one performance area. Intriguingly, one or two codes have positive associations with
one performance area and negative associations with another. For example, LE1, Lexi-
cal General Retrieval, the first coding shown in Table 5, and with a positive relationship,
also has a negative relation with mid-clause pausing (negative, that is, with greater flu-
ency, in that LE1 is associated with more mid-clause pausing). In any case, and setting
aside proficiency linkages for the moment, it appears that higher accuracy scores are
obtained when more focused behaviour is involved, whether this is rehearsing specific
words or rehearsing in a more targeted way. Rehearsing (note-taking) linked to structure
(Meta2) is beneficial, consistent with focused behaviour within planning being effec-
tive. In contrast, lower accuracy is associated with planning leading to problems, either
through lexical difficulties or with over-extension in what is attempted. It is interesting
that these suggest the potential for planning to be two-edged: It can lead the speaker
into trouble, as well as be helpful, depending on how the planning time is used.
Table 6 below shows the comparable information for the Subordination measure.
Once again the linkage with proficiency level is shown, but it should be borne in mind
that there was no significant contrast here between the two proficiency levels.
An obvious first remark here has to be that the number of positive and negative
associations is somewhat reversed for those with accuracy. There, positive associa-
tions predominated. Here we find quite a few more negative connections than posi-
tive. Regarding the positive influences, it does come across that ideas lead the way
when subordination increases, and grammar takes a back seat. It also appears that
organising, and going from big to small, is a good strategy to raise subordination. The
literature on tasks suggests that task structure is generally a good thing, and that earlier
findings that accuracy was advanced by structure have now been extended to suggest
that complexity is also affected. The results in this section are that if learners can use
planning time to bring their own structure to the narrative retelling, this seems to
raise the subordination measure. The negative influences do seem to have a common
quality here. It is over-ambition. This could be over-ambition in lexical choices, or
over-ambition generally in what can be done during planning time. This seems to be
associated with performance being damaged to some degree, particularly with regard
to complexity. In addition, it seems as if those who focus on grammar do so at the
expense of complexity, at least as indexed by subordination.
Next, we turn to the two measures of fluency, AS pauses and mid-clause pauses.
They are treated separately, mainly because while there is a certain amount of overlap
in the associations found, mostly the two fluency measures are influenced by different
things, and in one case a code is negatively associated with one, and positively associ-
ated with the other, as we shall see. The information for AS-pauses is given in Table 7.
A slight difference in this compared to the other tables is that where there is a relevant
112 Francine Pang & Peter Skehan

Table 6.  Codes associated with higher and lower subordination scores
Positive

Le 14: Grammar: No or very little concern about No Distrib: 23 - 25


No/Little concern grammar use Subord: 1.62/1.69
Mi3: Plan small Plan small details, such as detailed Yes Distrib: 10 - 26 - 12
details description Subord: 1.6/1.62/1.78
Mi4: Plan how to Plan how to tell the story in general Yes Distrib: 20 – 20 - 7 - 1
tell the story Subord: 1.65/1.63/1.72/1.89
Mi7: Organize the Try to organize the ideas developed No Distrib: 31 – 14 – 2 - 1
ideas developed from different pictures to have a clear Subord: 1.63/1.7/1.72/1.63
from the pictures story plot

Negative
Le2: Lexical choice: Choose appropriate words for telling No Distrib: 40 - 6 - 2
Appropriate words the story Negative
Subord.: 1.68/1.58/1.56
Le4: Lexical choice: Choose to use some connective words Yes Distrib: 29 - 18 - 1
Connective words Negative,
Subord. 1.71/1.58/1.37
Le7: Lexical choice: Try to use various words to talk about No Distrib: 44 - 4
Various words the same thing Negative,
Subord: 1.67/1.46
Le8: Lexical choice: Try to use accurate words Yes Distrib: 43 - 5
Accurate words Subord: 1.67/1.58
Le9: Lexical Use a word similar in meaning to No Distrib: 42 - 6
compensation: replace the word which can’t be Subord: 1.67/1.53
Approximating recalled
Le 12: Grammar: Think of general use of grammar No Distrib: 37 - 10
General use Subord: 1.68/1.62
Le 13: Grammar: Think of the use of correct tense No Distrib: 32 - 16
Tense Subord: 1.7/1.57
Mi2: Plan general Plan general things, such as describing Yes Distrib: 28 - 20
things the general plot of the story Subord: 1.69/1.61
Mi5: Plan how to Plan how to describe the story more No Distrib: 26 – 14 - 8
express better vivid, interesting, or clearer etc. Subord: 1.69/1.63/1.59
Mi8: Connect the Try to connect or structure the Yes Distrib: 19 – 21 - 5 - 2
pictures to develop pictures to develop the story plot Subord: 1.71/1.64/1.56/1.5
the story plot

mid-clause pausing association, that too is shown. The same thing is done in Table 8,
since AS pause information is shown in a table focusing on mid-clause pauses. In this
way, the two tables provide separate information on these two aspects of dysfluency,
but also facilitate interpretations of shared influences, such as Lexis 14, in the positive
section of Table 7, or discrepant influences, such as Lexis 8, in the Negative section of
the same table. Note also that greater fluency is indexed by lower pausing scores.
Self-reported planning behaviour and second language performance in narrative retelling 113

Table 7.  Codes associated with differences in AS clause boundary pausing per 100 words
Positive

Le7: Lexical choice: Try to use various words to talk No Distrib: 44 - 4


Various words about the same thing AS pausing: 3.41/3.07
Le 10: Lexical Use a few words or another way No Distrib: 30 - 13 - 4
compensation: to replace a word which cannot AS pausing 3.62/2.96/3.06
Circumlocution be recalled
Le 11: Lexical: No or very little concern about Distrib: 42 - 6
No/Little concern vocabulary. AS pausing 3.42/3.16
Le 14: Grammar: No or very little concern about No Distrib: 23 - 25
No/Little concern grammar use AS pausing 3.88/2.93
Positive,
Mid pause: 4.22/3.10
Me4: Rehearse: Rehearse to check whether what Yes Distrib: 43 - 4 - 1
Logical or clear is planned is logical or clear AS pausing 3.44/2.88/3.05
Mi3: Plan small Plan small details, such as Yes Distrib: 10 – 26 - 12
details detailed description AS pausing 3.68/3.27/3.37
Positive,
Mid-pause: 5.25/3.43/2.77
Mi7: Organise the Try to organise the ideas No Distrib: 31 – 14 - 2
ideas developed developed from different pictures AS pausing 3.53/3.16/2.16
from the pictures to have a clear story plot

Negative
Le2: Lexical choice: Choose appropriate words for No Distrib: 40 - 6 - 2
Appropriate words telling the story AS pausing 3.34/3.54/3.72
Le4: Lexical choice: Choose to use some connective Yes Distrib: 29 - 18
connective words words AS pausing 3.15/3.65
Negative,
Mid-pause: 3.54/3.79
Le8: Lexical choice: Try to use accurate words Yes Distrib: 43 - 5
Accurate words AS pausing 3.35/3.69
Positive,
Mid-pause: 3.8/2.26
Le12: Grammar: Think of general use of grammar No Distrib: 37 - 10-
general use AS pausing 3.18/4.0
Le13: Grammar: Think of the use of the correct No Distrib: 32 - 16
Tense tense AS pausing 2.98/4.19
Negative,
Mid-clause: 3.18/4.56
Mi6: Think of ideas Think of more ideas beyond the Yes Distrib: 27 – 19 - 2
beyond pictures pictures AS pausing 3.32/3.42/3.93
Positive,
Mid-pause: 3.82/3.49/2.6
Mi8: Connect the Try to connect or structure the Yes Distrib: 19 – 21 – 5 - 2
pictures to develop pictures to develop the story plot AS pausing 3.17/3.48/3.58/4.08
the story Negative, Mid, 3.37/3.99/3.93/2.36
114 Francine Pang & Peter Skehan

AS pauses, clearly, are at a natural pausing point in speech, as evidenced by native


speakers pausing at this point also (Skehan 2009b). But the issue with them, with sec-
ond language speakers, is when pausing at this point is greater than would be typical of
native speakers. The data here are consistent with this interpretation, as indexed by the
native speaker data given in Skehan (2009b). Once again, we can consider the positive
influences, that is, those that lead to less pausing at this point, and negative influences,
that lead to more pausing, separately. Regarding the content of what is said, it appears
that AS-pausing is reduced when ideas are organised, and so speakers embark on more
extensive contributions. With lexis, what comes across here is that it is important to
be resourceful and flexible with words, and that if one is, pausing is reduced. Perhaps
going along with both these points, it seems to be advantageous for this aspect of flu-
ency if one rehearses and works small (presumably so that what is prepared transfers
from planning to performance more easily). Finally, it seems beneficial for fluency if
the speaker avoids a focus on form. Most of the negative influences on AS boundary
fluency are the reverse of the positive influences. Being fixed and inflexible with words
is not good for fluency, as one might expect. Being very concerned with form, simi-
larly, leads to more AS pausing. And finally, it seems harmful for fluency if the speaker
tries to be ambitious and fancy in what they say.
A final note on these results is the degree of correspondence between AS paus-
ing and mid-clause pausing. Two positive codes are shared (Le14 (don’t worry about
grammar) and Micro3 (plan small details)), as are three negative codes (Le4 (use con-
nective words), Le13 (think of the correct tense), and Micro8 (Structure the pictures)).
Surprisingly, two codes diverge. Le8 (try to use accurate words) and Micro6 (think of
ideas beyond pictures) are negative for AS pausing and positive for mid-clause pausing,
which is, to say the least, intriguing.
We turn next to Table 8, which shows the data for the influences on mid-clause
pausing. For the positive influences here, the general theme seems to be one of avoid-
ing specific sources of difficulty, of avoiding the areas which might cause difficulty.
These, of course, include avoiding preoccupation with form, but more generally the
strategy seems to be to find paths where difficulties are less likely. There is certainly a
sense of anticipating difficulty so as to be better prepared when it does occur (as per-
haps it inevitably will), and this is allied to a sense of what to do when that difficulty
arises. There is also a (grudging?) willingness to be pushed to be more ambitious, but
only when this does not take the speaker into waters which are too uncharted. The
negative influences are also interesting. First of all, there is the possibility that one
can be pushed too far. Once again, being too fancy does not seem to be a good influ-
ence. Similarly, (and this chimes with other performance areas), focusing on form,
and being general, seem to have some costs in terms of mid-clause pauses. Finally, and
perhaps surprisingly, taking notes can contain dangers, perhaps because this too leads
speakers to go beyond their abilities.
Self-reported planning behaviour and second language performance in narrative retelling 115

Table 8.  Codes associated with differences in mid-clause pausing


Positive

Le3: Lexical choice: Choose to use simple words No Distrib: 36 – 11 – 1


simple words Mid.Cl.Pausing: 3.95/2.67/3.26
Le8: Lexical choice: Try to use accurate words Yes Distib: 43 - 5
accurate words Mid.Cl.Pausing: 3.8/3.26
Negative: AS: 3.35/3.69
Le9: Lexical Use a similar word to that No Distrib: 42 - 6
compensation which can’t be recalled Mid.Cl.Pausing: 3.71/3.14
Le14: Grammar, No or very little concern No Distrib: 23 – 25
Little concern about grammar use Mid.Cl.Pausing: 4.22/3.10
Positive, AS: 3.88/2.93
Mi3: Plan small Plan small details, such as Yes Distib: 10 – 26 - 12
details detailed description Mid.Cl.Pausing: 5.25/3.43/2.77
Positive, AS: 3.68/3.27/3.37
Mi6: Think of ideas Think of more ideas beyond Yes Distrib: 27 - 19 - 2
beyond pictures the pictures Mid.Cl.Pausing: 3.82/3.49/2.6
Negative, AS: 3.32/3.42/3.93
Negative

Le1: Lexical: Try to remember the words Yes Distrib: 19 – 24 – 5


General retrieval used in the task Mid.Cl.Pausing: 3.22/3.94/3.82
Le4: Lexical: Choose to use some Yes Distrib: 29 – 18
Connective words connective words Mid.Cl.Pausing: 3.54/3.79
Negative, AS: 3.15/3.65
Le13: Grammar: Think of the use of correct No Distrib: 32 – 16
Tense tense Mid.Cl.Pausing: 3.18/4.56
Negative: AS: 2.98/4.19
Meta2: Rehearse, Rehearse to be accurate No Distrib: 35 – 12
Accurate Mid.Cl.Pausing: 3.52/4.12
Meta7: No need to There is no need to take No Distrib: 24 – 24
take notes notes Mid.Cl.Pausing: 3.48/ 3.8
Mi8: Connect pictures Try to connect or structure Yes Distrib: 19 – 21 – 5 - 2.
to develop story the pictures to develop the Mid.Cl.Paus.: 3.37/3.99/3.93/2.36
story plot Negative: AS: 3.17/3.48/3.58/4.08

The final area to be considered is that of lexical sophistication, as indexed by the


value Lambda. The relevant data are shown in Table 9 below. Perhaps the first thing
to say here is how disappointingly small this table is. It would have been nice to have
a range of positive and negative associations between coded planning behaviours and
lexical performance, similar to other performance areas. In the event there are only
two positive influences and two negative, which seems remarkably slight. Even they
are not terribly revealing. Positively, we have a focus on words and the desirability of
116 Francine Pang & Peter Skehan

being general with ideas. Negatively, there is the behaviour of avoiding lexical dif-
ficulty, of being (too) unambitious, and of relatively unfocussed rehearsal. There may
be connections here with other areas – level of achievable ambition is relevant, as is
the issue of generality-specificity, although here the influence is positive for generality
for ideas, and negative for rehearsal. The most we can draw from this is that there does
seem to be a specific attraction or rejection of words for different participants.

Table 9.  Lexical sophistication linked to coding


Positive

Le8: Lexical choice: Try to use accurate words Yes Distrib: 43 – 5


Accurate words Lex.Sophist.: 1.83/2.02
Micro5: Plan how Plan how to tell the story Yes Distrib: 20 – 20 – 7
to tell the story in general Lex.Sophist.: 1.83/1.87/1.92

Negative

Le3: Lexical choice: Choose to use simple words No Distrib: 36 – 11 – 1


Simple words Lex.Sophist.: 1.9/1.73/1.59
Meta1: Rehearse, Rehearse what is planned to say Yes Distrib: 25 – 23
General (and hopefully remember better) Lex.Sophist.: 1.91/1.68

Discussion

In this discussion section we will first explore convergence and contrast with Ortega
(2005). Then we will examine successes and failures within the present coding scheme
in terms of its broader categories, notably the macro, and lexico-grammar categories,
and then move to relate this data to dimensions of performance (complexity, accuracy,
fluency, lexis) as well as the Levelt model. We will finish by briefly discussing debates
in the planning literature, as illuminated by the present study, and then make some
suggestions for training and pedagogic applications.
The coding scheme developed in the present research has proved usable and illu-
minating. It contains the broad categories of Macro Cognitive Codes, Micro Cognitive
Codes, Lexical and Grammar Codes, and Metacognitive Codes. This ‘packaging’ may
contain a number of similar elements to those in Ortega (2005), but their arrangement
is sometimes different. The major change is the introduction of macro and micro codes.
Some of the detailed codes here relate to Ortega’s metacognitive strategies, since they
concern organisational planning and various forms of attentional focus, (though, they
do not emphasise monitoring and evaluation as much as she does in relation to the
Meta-cognitive codes.) Also the present scheme has a number of lexical and grammar
planning codes, which in principle connect with cognitive strategies. ­However, here
Self-reported planning behaviour and second language performance in narrative retelling 117

the overlap with Ortega’s scheme is not extensive. In fact, our system treats rehearsal
as part of metacognitive planning (on the basis that there is self-awareness involved),
whereas Ortega includes it as a form of cognitive strategy. Our rehearsal codes are also
more explicitly linked with aspects of performance, which can be closely associated
with different stages of Levelt’s model.
We now shift focus a little and consider how the codes are associated with differ-
ences in performance. Here we have some interesting contrasts. The two Macro Codes
(Table 2) were of little help in the analysis, in that they totally failed to discriminate
between participants. (As a result, there was no scope for any association with per-
formance to emerge.) In contrast, the Micro planning codes were far more success-
ful, though only one (Micro1) had no connection with performance. The other seven
discriminated, and also had associations with different performance areas, with a ten-
dency to link with complexity (Table 6) and pausing, both AS pausing (Table 7) and
mid-clause pausing (Table 8). Turning to the Lexical and Grammatical codes, their
contribution was more mixed, with two lexical codes yielding nothing. The remainder,
though, did make some contribution to the associations with performance. The lexical
codes had associations with all performance areas, both negative as well as positive,
although fluency (Tables 7 and 8) was the commonest area to crop up. Interestingly,
the three grammar codes, which all revealed associations with aspects of performance,
were consistent: they showed no relation to accuracy (Table 5), and showed negative
relationships with subordination (Table 6) and pausing (Tables 7 and 8)! Finally, the
metacognitive codes were a mixed bag. Around half either failed to discriminate or
had no connection with performance. The focus here is on rehearsal, and while this
was important for accuracy (the most consistent sub-area to have this connection:
Table 5), other metacognitive codes, such as involving notes, or memorisation, or
being aware of the listener, had little to provoke discussion. Clearly these results sug-
gest that some areas of reported planning behaviour are more rewarding than others.
We turn next to exploring in greater depth why codes were associated with perfor-
mance success. We will propose five wider principles which seem to subsume the more
detailed codes which have been discussed so far. The principles are:

–– Build your own structure


–– Avoid trouble, and be realistic
–– Handle trouble when it occurs
–– Plan small or specific (versus plan general)
–– Avoid grammar focus
The principles emerged from a close scrutiny of Tables 5 to 9, from which wider
generalizations seemed warranted. These generalizations were based on the specific
codes which were associated with stronger and weaker performance. The generaliza-
tions always subsumed the separate codes into the more general principle concerned.
118 Francine Pang & Peter Skehan

I­ nterestingly, four of the five principles cut across the performance areas, and so they
are proposed as general principles for good use of planning time, though they manifest
themselves in different performance areas in different ways. Only the fifth is directly
connected with any particular performance area. In fact, the first two ‘code bundles’
are associated with widespread improvements in performance, whereas as we go on,
the focus for improvement is narrowed somewhat.

Build your own structure


Several codes are relevant here. Plan how to tell the story (Micro4), Organise the ideas
(Micro7), Rehearse to check whether what is planned is logical and clear (Meta4). They
have in common that the speaker imposes some organisation on what is to be said. This
is particularly interesting given the independent strand of task research (see S­ kehan &
Shun (this volume) and Wang & Skehan (this volume)) which argues that tasks
containing structure lead to higher peformance (Skehan, this volume, C ­ hapter 10).
Equally interesting is that, consistent with the task structure literature, many aspects
of performance are involved, including accuracy, complexity, and AS-boundary paus-
ing, a powerful combination. One assumes that having a clearer structure makes it
more likely that the speaker can be ‘ahead of the game’, as it were, and create on-line
planning opportunities, enabling errors to be avoided, more ambitious language used,
and also, with favourable conditions building on favourable conditions, more effective
clause boundary pausing to be possible, which in turn enables easier marshalling of
resources during speech.

Avoid trouble, and be realistic


Again, a number of codes are relevant. Choose to use simple words (LexGram3), Have
no or little concern about vocabulary (LexGram11), Have no or little concern about
grammar use (LexGram14), Rehearse (To be Accurate-Meta2: Fluent-Meta3, Logical
or Clear-Meta4), with these being positive relationships with performance, and then
Plan general (Micro2), a negative relationship, versus Plan small details (Micro3), a
positive relationship, and Plan how to express better (Micro5, a negative relationship,
Lexical choice – appropriate words (LexGram2) – a negative relationship, Use accurate
words (LexGram8) which was positive with accuracy, but negative for complexity and
fluency, and Plan how to express better (Micro5) a negative relationship with accuracy
and complexity. When one reflects on the positive and negative influences here, the
common thread seems to be better performance on the occasions when speakers use
planning time to prepare simpler things and to work within their limited abilities. The
negative relationships reflect the ways a speaker can go wrong and overdo things, and
thereby create trouble for themselves. So speakers who give themselves ­reasonable chal-
lenges (plan small and simple, don’t worry about grammar or v­ ocabulary, rehearse),
Self-reported planning behaviour and second language performance in narrative retelling 119

and do not plan their way into trouble (plan general, plan how to be better, and to use
more appropriate words), do better. Most interesting of all, this strategy for using plan-
ning time seems to raise accuracy, complexity and both aspects of fluency.

Handle trouble when it occurs


Of course, for second language speakers, trouble is likely to be inevitable, and so an
important positive attribute is to be able to deal with that trouble when it arrives. One
aspect of this connects with the first construct proposed above, ‘build your own struc-
ture’. Skehan (Chapter 10, this volume) proposes that one of the benefits of structure is
that it enables the speaker, after there has been difficulty, to rejoin the discourse thread
that the structure makes possible. So, rather than fall behind further, the speaker can
find a new starting point, and in that way, and perhaps with a bit of luck, recover
a parallel mode of processing, as opposed to the serial mode that is provoked by a
mental lexicon giving the speaker retrieval problems (Kormos 2006). There are other
planning codes that are relevant here. LexGram9 (Lexical compensation) has a posi-
tive relationship with mid-clause pausing, while LexGram10 (Lexical compensation
and circumlocution), is positive in its effects on AS-boundary pausing. In each case,
though, there is also a negative relationship with some aspect of form, so dealing with
trouble has some costs, too.

Plan small or specific (versus Plan General)


The main evidence here comes from the Micro codings, Micro2, Plan general, which
has a negative relationship with subordination, compared to Micro3, Plan small details,
which is positive in its effects on subordination and pausing, and also Rehearse General
(Meta1) which has a negative association with lexical sophistication), and Meta2 and
Meta3, Rehearse Accurate and Rehearse Fluency, respectively, which are positive. An
issue which perhaps underlies these factors is that of transfer from the planning phase
into actual performance. It appears here as though being focused and specific in what
one does (and this also means ‘plan small’, a further example of avoiding trouble),
enables the more limited aims to be converted from the earlier planning phase into
the focused performance that is intended. General planning processes, in contrast, do
not seem to endure, and do not have the same sort of impact. One way or another, the
impact of planning small, and avoiding more general planning (Micro 2), can impact
on pretty much all aspects of performance.

Avoid grammar focus


The key codings here are LexGram12 (General grammar use), LexGram13 (Grammar,
Tense), and LexGram14 (Grammar, no concern). None of these has any impact upon
120 Francine Pang & Peter Skehan

accuracy or error. In contrast, the first two, implying a concern for grammar, are asso-
ciated negatively with subordination and fluency, and the third, a negative portrayal of
grammar, is positively associated with subordination and fluency. So, the reverse effect
is found to what might be expected here, and it suggests that focusing on grammar
confers only disadvantages, and no advantages.
Reflecting on these five ‘principles’ for effective use of planning time, the most
notable reaction one is likely to have is how negative they are, and that they seem to
convey that we have learned more about how to use planning badly than how to use
planning well. There are suggestions of some principles associated with a good use
of planning, such as to impose structure, to be led perhaps by ideas and not form,
and to plan small and detailed. But in general, it is what not to do that emerges more
strikingly.
Indeed, the preponderance of the codes where positive relationships are involved
are concerned with complexity and fluency. This is consistent with the generally
accepted finding in the literature (e.g. Ortega 2005) that planning has a beneficial effect
on complexity and fluency. So it seems as if our results are consistent with the broad
quantitative results that have been published (although of course, there are exceptions,
such as Ellis (2009) showing that accuracy effects are not at all uncommon). In other
words, the range of influences we have just covered are consistent with the findings
from the literature, and provide, therefore, some detailed support in terms of what
second language speakers say they do when they plan.
To put this another way, the reported behaviours which are associated with raised
accuracy and with raised lexical sophistication are not so numerous, which is some-
thing of a disappointment. There are some, however, such as Lexical Choice, Accu-
rate Words, as well as General Lexical Retrieval, which make intuitive sense, as well
as the Micro code of Connect or Structure the pictures, implying the value of giving a
structure to the story for accuracy. But Rehearsal, Fluency, and Rehearsal to be logical
or clear are less obviously relevant. So what underlies the association between self-
reported planning behaviours and greater accuracy remains a puzzle. In addition, the
Accurate Words coding, while good for accuracy, seems bad for Complexity and Flu-
ency, suggesting some degree of trade-off in performance. Accurate Words is, though,
the main positive influence on lexical sophistication, while the other influences in this
performance area are the more generalised negative influences of focusing on simple
words, and engaging in general rehearsal. We are left, in other words, with few clear
and convincing influences on either accuracy or lexical sophistication, which may
have some relevance for the less consistent findings in this area. Behaviours generally
concerned with rehearsal of specific things seems good, but the avoidance of harmful
influences (in general) seems just as important.
The other issue arising from the literature which is worth commenting on is the
respective claims of the Trade-off approaches and the Cognition Hypothesis. Basically,
Self-reported planning behaviour and second language performance in narrative retelling 121

the present study has little direct to say on this. But perhaps two points are worth mak-
ing. First, there is often competition between different performance areas when one
looks at the influence of individual coded behaviours, and so raised performance in
one area is often associated with lower performance in another. In general, it looks as
if complexity and fluency often go together, and do not compete. In contrast, accuracy
does seem to compete with other performance dimensions. The Cognition Hypoth-
esis proposes that under certain circumstances complexity and accuracy can both be
raised. When one looks at the way influences on these two areas which arise out of
planning seem rarely to go together, one can conclude that the present study does not
seem particularly supportive for the Cognition Hypothesis. The second point relates to
the way task complexity is seen as the driver, in the Cognition Hypothesis, for raising
accuracy and complexity jointly. One can see from the present study the existence of
influences which cause ideas to predominate and therefore push the speaker to make
the task more complex. On these occasions, however, there is no sign that there is a
beneficial influence on accuracy as well.
Some of these issues are taken up in the final chapter of this volume. Two other
chapters (Bui (this volume) and Wang (this volume)) explore other facets of planning
quantitatively. In the final chapter these different findings will be brought together
to offer a more general account of the role of planning in second language task
performance.

Conclusion

In general, the planning research supports the idea that using planning in pedagogic
contexts where a communicative approach is prevalent is a good thing (Ellis 2005a).
The literature suggests that it is rare to find studies which suggest that planning is
harmful. There are studies which point to its limitations, but it is clear that using
planning is far better on most occasions than not using it. But at the same time, we
have not made that much progress over the last twenty-five years in making sug-
gestions as to when planning is most effective, what alternatives are available to the
planner, and ultimately, whether effectiveness in planning can be trained. The pres-
ent study provides no clear answers to any of these issues, but it is suggestive. The
differences in reported planning behaviours certainly suggest that not all planners
do the same things, and that some behaviours are likely to be more effective than
others. The discussion above suggested that planning choices can be most effectively
regarded as a set of operating principles (build your own structure, avoid trouble,
don’t over-extend, handle trouble, plan small, don’t be too focused on grammar). It
appears, then, that it would be worth exploring whether these principles are general;
whether speakers who do not at first think of using them could be trained to use
122 Francine Pang & Peter Skehan

them (and whether this would then be more effective); and perhaps most ambi-
tiously of all, whether speakers could be induced to use planning behaviours likely
to target particular performance dimensions. The research possibilities here are con-
siderable, and they have the important quality that they would seem likely to have
considerable pedagogic payoff.

References

Bei, X. (2010). The effects of topic familiarity and strategic planning in topic-based task performance at
different proficiency levels. Unpublished Ph.D. thesis. Chinese University of Hong Kong.
Crookes, G. (1989). Planning and interlanguage variation. Studies in Second Language Acquisition,
11, 367–383.
De Bot, K. (1992). A bilingual production model: Levelt’s “Speaking” model adapted. Applied Lin-
guistics, 13, 1–24.
Ellis, R. (1987). Interlanguage variability in narrative discourse: Style shifting in the use of the past
tense. Studies in Second Language Acquisition, 9, 1–20.
Ellis, R. (Ed.). (2005a). Planning and task performance in a second language. Amsterdam: John
Benjamins.
Ellis, R. (2005b). Planning and task-based performance: Theory and research. In R. Ellis (Ed.), Plan-
ning and task performance in a second language (pp. 3–36). Amsterdam: John Benjamins.
Ellis, R. (2009). The differential effects of three types of task planning on the fluency, complexity, and
accuracy in L2 oral production. Applied Linguistics, 30(4), 474–509.
Foster P. & Skehan P. (1996). The influence of planning on performance in task-based learning. Stud-
ies in Second Language Acquisition 18(3), 299–324.
Hill L.A. (1961). Picture composition book. London: Longman.
Kormos J. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence
­Erlbaum Associates.
Levelt, W.J.M. (1989). Speaking: From intention to articulation. Cambridge, MA: The MIT Press.
Levelt, W.J. (1999). Language production: a blueprint of the speaker. In C. Brown & P. Hagoort (Eds.),
Neurocognition of language, (pp. 83–122). Oxford: Oxford University Press.
MacWhinney B. (2000). The CHILDES Project: Tools for analysing talk, Volume 1: Transcription for-
mat and programs (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Mehnert, U. (1998). The effects of different lengths of time for planning on second language dis-
course. Studies in Second Language Acquisition, 20, 52–83.
Michel, M.C., F.Kuiken, & Vedder, I. (2007). Effects of task complexity and task condition on Dutch
L2. International Review of Applied Linguistics, 45(3), 241–259.
O’Malley, J.M., & Chamot, A.U. (1990). Learning strategies in second language acquisition. ­Cambridge:
CUP.
Ortega L. (1995). The effect of planning on L2 Spanish narratives. Research Note 15. Honolulu, HI:
University of Hawai’i Second Language Teaching and Curriculum Center.
Ortega L. (1999). Planning and focus on form in L2 oral performance. Studies in Second Language
Acquisition, 21, 109–148.
Ortega, L. (2005). What do learners plan? Learner-driven attention to form during pre-task planning.
In R. Ellis (Ed.), Planning and task performance in a second language (pp. 77–109). Amsterdam:
John Benjamins.
Self-reported planning behaviour and second language performance in narrative retelling 123

Oxford R. (1990). Language learning strategies: What every teacher should know. Rowley, MA:
­Newbury House.
Pang F., & Skehan P. (2006). ‘What do learners do when they plan: a qualitative study’. Paper p
­ resented
at St. Mary’s University College, Twickenham.
Revesz A. (2009). Task complexity, focus on form, and second language development. Studies in
Second Language Acquisition, 31(3), 437–470.
Robinson P. (2001). Task complexity, task difficulty, and task production: Exploring interactions in a
componential framework. Applied Linguistics, 22, 27–57.
Robinson P. (2011). Second language task complexity, the Cognition Hypothesis, language learning,
and performance. In P. Robinson (Ed.), Second language task complexity: Researching the Cogni-
tion Hypothesis of language learning and performance (pp. 3–38). Amsterdam: John Benjamins.
Skehan, P. (2009a). Modeling second language performance: Integrating complexity, accuracy, flu-
ency and lexis. Applied Linguistics, 30(4), 510–532.
Skehan, P. (2009b). Lexical performance by native and non-native speakers on language-learning
tasks. In B. Richards, H. Daller, D. Malvern, & P. Meara (Eds.), Vocabulary studies in first
and second language acquisition: The interface between theory and application. (pp. 107–124).
­London: Palgrave Macmillan.
Skehan, P., & Foster, P. (1997). Task type and task processing conditions as influences on foreign
language performance. Language Teaching Research, 1(3), 185–211.
Strauss, A., & Corbin, J. (1990). Basics of qualitative research: Grounded theory procedures and tech-
niques. Newbury Park, CA: Sage.
Tavakoli, P., & Foster, P. (2008). Task design and second language performance: The effect of narra-
tive type on learner output. Language Learning, 58(2), 439–473.
Tavakoli, P., & Skehan, P. (2005). Planning, task structure, and performance testing. In R. Ellis (Ed.),
Planning and task performance in a second language, (pp. 239–276). Amsterdam: John Benjamins.
Wang, Z. (2009). Modelling speech production and performance: Evidence from five types of planning
and two task structures. Unpublished Ph.D. thesis. Chinese University of Hong Kong.
Wigglesworth, G. (1997). An investigation of planning time and proficiency level on oral test
­discourse. Language Testing, 14(1), 85–106.

Appendix 1

Instructions for the Picture Story Telling Task


In this task you will look at a series of pictures, and then you will need to tell the story
in these pictures to the other student. When you finish the story, the other student will
ask you a question or more than one question.
You will have ten minutes, by yourself, to plan what you are going to say during
the picture story telling. Use the ten minutes effectively to tell a good and clear story.
If you go first, then you will describe the story in your pictures to the other stu-
dent. Do not show the pictures you are describing to the other student. The other
student does not have these pictures to look at.
If you go second, the other student will describe the story in their (different) pic-
tures to you.
Try to talk for 2 minutes or more.
124 Francine Pang & Peter Skehan

Instructions when you are a listener


Listen to the other student telling the story in their pictures. When they finish, try to
ask a question or more than one question.

–– Ask a question if you do not understand something


–– Or ask a question if you would like the other student to say more about the series
of pictures.

Appendix 2

Retrospective interview prompts


Name: Major: Gender:

General Prompts

Planning What did you do? How did you plan? Tell me what you did during the
(Self report) time you’re planning?
Then (Notes) Here are your notes. Do they help you remember more about what
you did when you planned? Did making notes help in the actual task
although you’re not allowed to look at them?
General reactions to Do you think the planning time was useful? Why or why not?
self report Do you think the planning was useful for the general way or for small
(more focus Qs) things? Why?
What effect did the planning have on the way you did the task?
Emphasis What did you emphasise?
(Self report)
More specific questions on 1. WORDS
emphasis. –  To remember words that might be useful?
(If nothing said on each of –  To use words that might be diverse, accurate?
the expected area, ask one 2. GRAMMAR
by one.) –  To remember grammar?
–  To avoid mistakes (correctness)?
3. IDEAS
–  To think of ideas?
–  To organize ideas?
4. STRUCTURE OF THE STORY (Picture Story Telling Task)
–  To structure the flow of pictures
– To use language to show how the pictures are connected and
developed
5. REHEARSE
–  To be accurate
–  To be fluent
6. To THINK HOW TO SAY things to make it easier and clearer for
your partner?
Self-reported planning behaviour and second language performance in narrative retelling 125

Appendix 3

Coding Scheme: Planning activities of ESL speakers doing picture


story telling task

No. CODE Description of CODE Example

(A) Macro planning

1. Plan sequence: Scan all the pictures, I first went through the pictures. After I got
Scan pictures, then understand what the story a general idea, I began to think how to tell
describe is about, then think of the story in English.
how to describe the story
2. Plan sequence: Look at the pictures one I looked at the pictures one by one, and
Look at picture by one and at the same think about how to tell each picture at the
one by one, then time think about how to same time.
describe describe each picture

(B) Micro planning

1. Understand the Try to understand the I first read the instruction, but I had no
pictures in details pictures in details and idea when I saw so many sheep in the
know what the story is grids. I went through the pictures first and
about then looked at the details.
2. Plan general things Plan general things, such I planned general things. I needed to have
as describing the general a concept first, and the details could be
plot of the story added while I spoke.
3. Plan small details Plan small details, such I think it was useful for the subtle things.
as detailed description Maybe I could tell the story in a general
way right away but I might make it a mess.
4. Plan how to tell Plan how to tell the story During the ten minutes, I was thinking
the story in general how to tell the story.
5. Plan how to Plan how to describe Based on the pictures, I considered how to
express better the story more vivid, describe them in a better way and
interesting, or clearer etc. I organized my words.
6. Think of ideas Think of more ideas With some time to plan, I could add my
beyond pictures beyond the pictures ideas if the links were strange or if
I couldn’t understand the pictures.
7. Organize the ideas Try to organize the ideas Yes, I read it. Then, I turned to the details
developed from developed from different and figured out how to organize them.
the pictures pictures to have a clear I sorted out how many times the sheep was
story plot weighted and how many different sports
it did, and I also concluded that at last it
succeeded to be the same size as the other
sheep.
8. Connect the Try to connect or I emphasized on the plots. I considered
pictures to develop structure the pictures to how to connect the pictures to make the
the story plot develop the story plot story better.

(Continued)
126 Francine Pang & Peter Skehan

Appendix 3 (Continued)

No. CODE Description of CODE Example

(C) Lexical and grammar planning


1. Lexical: General Try to remember the Looking at a picture, I needed to consider
retrieval words used in the task and recall the English words to be used for
that picture.

2. Lexical choice: Choose appropriate I wanted Yuni to know that the tree is
Appropriate words words for telling the very important. I would think about
story the language of every scene and the
appropriate words to the scenes.
3. Lexical choice: Choose to use simple I considered using simpler words which
Simple words words could be understood most easily.
4. Lexical choice: Choose to use some Secondly, I added some connective words
Connective words connective words between sentences to connect all the
pictures together.
5. Lexical choice: Choose to use some and added some personification words.
Personification personification words
words
6. Lexical choice: Try to use some … and also use some relatively advanced
Advanced words advanced words words.
7. Lexical choice: Try to use various words A little. For example, for the cake… I
Various words to talk about the same thought of two words, tempt and attract.
thing
8. Lexical choice: Try to use accurate I tried to use some accurate words to
Accurate words words describe the pictures.
9. Lexical Use a word similar in If I had any words that I didn’t know how
compensation: meaning to replace the to express, I tried to replace them with
Approximating word which can’t be other words.
recalled
10. Lexical Use a few words or Secondly, for those words I didn’t know or
compensation: another way to replace forget how to say, I need time to find other
Circumlocution a word which cannot be ways to explain them.
recalled
11. Lexical: No/Little No or very little concern No, not particularly think of the use of
concern about vocabulary. words.
12. Grammar: General Think of general use of Yes, I considered the use of grammar as
use grammar grammar plays an important role in story
telling.
13. Grammar: Tense Think of the use of I feel it’s necessary to consider it. I thought
correct tense if I should use present, past or continuous
tense.
14. Grammar: No/ No or very little concern For me, sometimes I didn’t pay much
Little concern about grammar use attention on grammar. Instead, I rely more
on my sense of the language and didn’t
think much about the correctness.
Self-reported planning behaviour and second language performance in narrative retelling 127

No. CODE Description of CODE Example

(D) Metacognitive planning

1. Rehearse: General Rehearse what is planned I did not rehearse word by word. I just
to say (and hopefully considered the sequences of what I would
remember better) say.
2. Rehearse: Accurate Rehearse to be accurate At the same time, I think the rehearsal
could help me to be more accurate.
3. Rehearse: Fluent Rehearse to be fluent I rehearsed as I want to tell a more fluent
story.
4. Rehearse: Logical Rehearse to check I think the rehearsal could help to check
or clear whether what is planned the logic of the story, and to see whether
is logical or clear my story is in accordance with the pictures
as well as our common way of thinking.
5. Rehearse: Rehearse to help The rehearsal could also help me to
Memorization memorizing what is memorize some of the things I’ve planned
planned in order to deliver my story more
smoothly.
6. Take notes Take notes to plan the I made some point-form notes on the draft
task (although cannot paper. I usually make point-form. I noted
see it when doing the down the flow.
task)
7. Take notes: No There is no need to take I didn’t since the story is short; if it’s a long
need notes one, I would take notes.
8. Memorization Try to memorize what Finally, I went through my notes, referring
is planned before doing to the pictures; and memorize the points
the task planned.
9. Aware of listener’s Try to make the listener Because the task has no words but just
understanding understand the story, pictures, the planning time could help me
such as using simple think about how to say things to make my
grammar or words partner more easily understand.
8. Lexical: Planned During planning, lexical Though I did think about the word, when
but not used/ is considered, but it is I was telling the story, I forgot these things
correctly used not used or not correctly and just said whatever in my mind.
used when doing the task
9. Grammar: During planning, Yes, I’ve thought about grammar, but I
Planned but not grammar is considered, didn’t pay much attention on it when
used/ correctly but it is not used or not actually doing the task.
used correctly used when
doing the task
chapter 5

Get it right in the end


The effects of post-task transcribing
on learners’ oral performance

Li Qian
Guangdong University of Foreign Studies, China

Given the small body of existing research concerning focus on form at the post-task
stage in task-based language teaching, the present study uses a post-task transcribing
condition as a focus on form activity and explores the effects of transcribing under
various conditions. Eighty participants, divided into four experimental groups and
one control group completed four tasks with a one-week interval between each task.
Different experimental groups were assigned various post-task activities respectively.
No post-task activity was adopted in the control group. Task performance was
measured in terms of complexity, accuracy and lexical performance. The findings
are multifaceted. First of all, the adoption of post-task transcribing, in general, was
found to be efficient for different formal aspects of task performance. In the second
place, pair-based transcribing led to more syntactically complex language, whereas
the individual-based transcribing at the post-task stage led to an improvement in
lexical sophistication. Thirdly, further revision after transcribing had mixed effects
on accuracy and complexity. The findings are discussed in light of the concepts of
noticing and attention, interaction theory and other related SLA theories. Based on
the theoretical discussion, pedagogical implications are proposed.

Introduction

In second language pedagogy, one of the major issues is what Stern (1983) called
the ‘code-communication dilemma’ (Ellis 2008). This is reflected in the dichotomy
between “instructed” and “naturalistic” L2 learning. There are advocates of gram-
mar teaching who view grammar instruction as the foundation for second language
acquisition (Bialystok 1990; McLaughlin 1990; Rutherford 1988). By contrast, there
are also advocates of the “zero option” (Ellis 2008) which proposes abandoning for-
mal instruction and allowing learners to construct their interlanguage naturally
“through communication” rather than “for communication” (Krashen 1982, 1985;
Prabhu 1987).
130 Li Qian

In the past two decades or so, researchers have come to realize that adopting a one-
sided approach, either communicative-based or grammar-based, leads us nowhere.
Pedagogical interventions need to be interwoven into primarily communicative activi-
ties so as to overcome the limitations of both traditional grammar instruction and
communicative language teaching (Doughty & Williams 1998c). Among the variety
of proposals regarding the incorporation of formal instruction in communicative set-
tings (see the review in Norris & Ortega 2000), Focus on Form (FonF) has received
increasing interest in the last two decades. In his seminal work, Long (1991) initially
introduced the notion as follows: ‘focus on form…overtly draws students’ attention to
linguistic elements as they arise incidentally in lessons whose overriding focus is on
meaning or communication’ (Long 1991, p. 45–46). Based on this theoretical notion,
Long and Robinson (1998) later raised a more pedagogically applicable definition:
‘Focus on form consists of an occasional shift in attention to linguistic code features –
by the teacher and/or one or more students – triggered by perceived problems with
comprehension or production’. (Long & Robinson 1998, p. 23)

A plethora of studies have been conducted either in L2 classrooms or in laboratory


settings (Doughty 2003; Doughty & Williams 1998c; Ellis 2001; Fotos & Nassaji 2007;
Norris & Ortega 2000; Spada 1997). There is now substantial evidence that when
learners’ attention is directed at linguistic forms and the meanings that they encode –
in the context of meaning-focused activities – learning takes place (see reviews in
Ellis 2001, 2008). Focus on form is claimed to be necessary to push learners beyond
­communicatively effective language use toward target-like second language proficiency
(Doughty & Williams 1998b). It is, therefore, desirable that the focus on form option
should be embedded in a communicative context for the learner to achieve both com-
municative effectiveness and high levels of language performance. As a strong version
of communicative language teaching, task-based instruction provides such a setting
for the operationalization of focus on form.

Literature review

Based on such general agreement on the importance of a focus on form in a com-


municative setting, researchers have explored, in a variety of effective ways, how to
achieve form focus. Within a task-based framework (Ellis 2003; Skehan 1998), most
of the previous focus on form studies have concentrated on the pre-task or during-
task stages. In these studies, focus on form options, such as pre-task planning, negoti-
ation of meaning, feedback, and collaborative dialogue tend to occur before or during
task performance (Ellis 2003, 2008; Leeser 2004; Lightbown & Spada 1990; Loewen
2005; Pica 2002).
Get it right in the end 131

In contrast, there is, rather surprisingly, a paucity of research with regard to the
effects of focus on form at the post-task stage. One of the reasons may be that in a
research context, some researchers have viewed task-based instruction as consisting
only of pre-task activity and task performance (or even task performance only in some
cases). Once the task is accomplished, the job is done. However, that should not neces-
sarily be the case in L2 language pedagogy. Willis (1996) pointed out that:
‘task-based learning is not just about getting learners to do one task and then another.
If that were the case, learners would probably become quite expert at doing tasks and
resourceful with their language, but they would almost certainly gain fluency at the
expense of accuracy. ….to promote constant learning and improvement, we should
see it (to do a task) as just one component in a larger framework’. (p. 40)

Willis (1996) outlined a framework for task-based learning as consisting of three


phases: a pre-task phase, a task cycle and a post-task language-focus stage, and argued
that in addition to exposure and use of language, it is necessary to provide certain
kinds of form-focused instruction, either teacher-led or student-centered, after the
task cycle. Similarly, task researchers (Ellis 2003; Skehan 1996, 1998) found it neces-
sary to include a post-task stage and distinguish three major stages for the imple-
mentation of tasks (pre, during and post-task stages). In particular, Skehan (1996,
2007) has suggested that post-task activities cannot be neglected, and he proposes that
learners’ foreknowledge of a post-task activity would influence how they allocate their
attention during an actual task.
Skehan and Foster (1997) examined the effect of the anticipation of a certain
post-task activity (to redo the task publicly) on three tasks (a personal, a narra-
tive and a decision-making task). As they predicted, foreknowledge of public per-
formance did not influence fluency and complexity, but had a significant effect on
accuracy in the decision-making task. Although only one task (out of three) showed
a significant accuracy effect, the research results were still encouraging in that the
study showed that first, a post-task activity can be functional when it is operation-
alised in a suitable task context; secondly, the clearest effect of a post-task activity is
on accuracy. This supports the claim that the post-task stage may be effective in pro-
moting a focus on form. In an attempt to account for the lack of an effect of the pub-
lic performance condition on two of the tasks, Foster and Skehan (2013) proposed
that the weakness of the effect in Skehan and Foster (1997) might have been due
to the nature of the activity – that is, public performance might have had a remote
influence on all the participants since only a small number (not all) of the students
would be selected to perform in public. With regard to individual differences, public
performance may not be viewed as a threat by certain participants (especially the
more confident learners). In such an activity, for learners with different orientations
in their performance (complexity-oriented, fluency-oriented or accuracy-oriented),
132 Li Qian

their attention may not necessarily be directed to form to achieve higher levels of
accuracy. In brief, ‘public performance’ does not represent the whole picture of what
post-task activities are about.
In a subsequent study, Foster and Skehan (2013) used an alternative post-task
activity – “transcribing” one’s own performance, in order to deal with the restrictions
of public performance. Transcribing is an individual activity in which every partici-
pant re-examines their own task performance. When pushed to ­transcribe their own
performance, all learners are forced to pay attention to the formal aspects of their own
language during the task (Foster & Skehan 2013). The researchers divided the par-
ticipants into experimental and control groups. The experimental group transcribed
extracts of their own task performance as a post-task activity, while the control group
did no post-task activity. Both groups performed two types of tasks: narrative and
decision-making, in two counterbalanced task cycles. The results showed that (1) fore-
knowledge of transcribing as a post-task activity had a significant accuracy effect
on task performance in both narrative and decision-making tasks, (2) significantly
greater complexity was found for the experimental group in the decision-making task,
(3) with regard to fluency, length of run (i.e. the number of words uttered before any
breakdown or repair occurs) was significantly greater for the post-task condition in
the decision-making task. As compared with Skehan and Foster (1997), the results of
this study are clearly more positive and supportive not only for the accuracy effect,
but also with regard to the effects of a post-task transcribing phase on complexity and
one measure of fluency. As far as task type is concerned, the findings suggested that
the decision-making task was more sensitive to post-task effects, not only in terms
of accuracy, but also of complexity. In contrast, narrative performance appears to be
more difficult to influence. These results may push researchers to pay more attention
to differences in task type and how these interact with other task conditions (Skehan &
Foster 2001; Skehan 2007).
Skehan and Foster’s post-task research is pioneering in the task-based research
field and shows some preliminary results which could inspire further studies. In addi-
tion, the post-task phase has also attracted some attention in the literature on second
language pedagogy. From a teacher’s perspective, Lynch (2001, 2007) investigated the
process of transcribing as a post-task activity in an L2 classroom setting. Based on
observation of classroom learning, two limitations were identified by Lynch (2001).
First, learners received too much feedback on learner activity, and had too little time
for reflection on the forms of the language. They kept on doing activities with few
opportunities to reflect on their language gains and deficiencies. Second, given that
only high-proficiency learners were aware of the changes in their language during the
activity (Lynch & Maclean 2001), devising ways to help learners analyse their per-
formance is necessary. In such a context, Lynch employed transcribing as a reflective
noticing activity for classroom learning. In contrast to employing transcribing as an
Get it right in the end 133

individual task, as in Foster and Skehan’s (2013) study, Lynch (2001, 2007) designed
the activity to be conducted in pairs as a form of collaborative transcribing. In Lynch’s
(2001) study, learners were asked to transcribe together, then discussed and revised
the transcripts, and submitted the revised transcripts to the teacher for further correc-
tions and reformulation. The analyses of the process and product of these cycles sug-
gested that collaborative transcribing and revising can encourage learners to focus on
form in a relatively natural way. Furthermore, the teacher can play an important role in
this post-task intervention, especially with regard to the improvement of vocabulary
use (Lynch 2001).
In a subsequent study, Lynch (2007) compared the effects of two different tran-
scribing groups – student-initiated transcribing (students in pairs transcribed their
own performance and then revised the transcripts) and teacher-initiated transcribing
(the teacher transcribed problematic extracts of learners’ performance, and the tran-
scripts with errors were given back to the pairs for their revision). The analyses of the
subsequent performance showed that both procedures are manageable under normal
classroom conditions, and suggested that the student-initiated transcribing was more
effective in helping the learners to maintain higher accuracy levels in the highlighted
forms which were revised by students themselves.
The previous studies, either from a researcher’s or from a teacher’s perspective,
show encouraging results with regard to the effect of post-task activities. Comparing
the findings of two post-task activities (redo the task publicly or transcribing task per-
formance) in Skehan and Foster’s two studies (1997, 2013), we find that transcribing
may be adopted as a more feasible, manageable and effective post-task activity in com-
municative language classrooms. Similarly, Willis and Willis (2007) also suggest that
transcribing as an effective post-task pedagogical choice is appealing to both teach-
ers and learners. Some teachers have already begun to employ this activity in their
classrooms and found positive effects of transcribing on students’ oral performance
­(Clennell 1999; Mennim 2003, 2011; Stillwell et al. 2010).
In view of the relative infancy of the research base on post-task activities, it is
not surprising that the available studies have some serious limitations. For instance,
in Lynch’s two studies and some L2 classroom-based studies (Mennim 2003, 2011;
­Stillwell et al. 2010), the sample sizes were not large enough for statistical analyses,
and so no statistical results were reported, which causes problems in generalizing
to other classrooms. In Foster and Skehan (2013), post-task transcription was per-
formed outside the actual classroom. So, some unexpected intervening variables may
have been at play with transcribing taking place beyond the supervision of the teach-
ers. In addition, in the previous studies (Clennell 1999; Mennim 2003, 2011; ­Stillwell
et al. 2010; Foster & Skehan 2013), participants were engaged in the activity of post-
task transcribing only twice, which may not be sufficient to demonstrate strong treat-
ment effects.
134 Li Qian

Aims of the present study

Given these limitations with the previous studies, the present study explores the effects
of post-task transcribing under various conditions. First of all, transcribing is carried
out either individually or in pairs. In Foster and Skehan (2013), transcribing was per-
formed individually. That is, each participant was asked to transcribe their task per-
formance (including interactive task performance) by him/herself. In contrast, Lynch
(2001, 2007) adopted a pair work style which he called “collaborative transcribing”. The
present study aims to explore which of these two conditions (individual versus collab-
orative work in pairs) is more effective in terms of enhancing language performance.
Secondly, some of the experimental groups will take part in a revision condition.
In Lynch (2001, 2007), when they were involved in revising and reformulating, learn-
ers showed a clear performance improvement. Given the small sample size in Lynch’s
study (N = 16), no generalizations could be made concerning the effects of revision.
Participants in the current study (N = 80) will be engaged either in reflective self revi-
sion, interactive peer revision or no revision conditions to disentangle the distinctive
impacts of these alternative procedures.
In particular, the goals of the current study are (i) to investigate whether transcrib-
ing as a post-task activity has an effect on formal aspects of task performance; (ii) to
compare the effects of different transcribing conditions (individual work versus pair
work, revision versus no revision) on language performance.
In addition, as compared with previous research, participants in the present study
are engaged for a longer period, that is, four task sessions with a one week interval
between each session. Adopting multiple task sessions is expected to make the mea-
surement of the treatment effect more revealing in exploring learners’ performance
changes over time.
The research questions which guided this study are the following:

1. Does post-task transcription have an effect on second language learners’ oral


performance?
2. Do individual transcription and pair transcription have differential effects on
­second language learners’ oral performance?
3. Do transcribing-only and transcribing-and-revising conditions have differential
effects on second language learners’ oral performance?

Research methodology

Participants
Eighty participants were included in this study. All of them were second-year univer-
sity students from a South China university aged between nineteen and twenty-one.
Get it right in the end 135

They were non-English majors, among whom forty-one were female and thirty-nine
were male. They had been studying English for 7–10 years, with low intermediate to
intermediate English proficiency. The participants were randomly divided into four
experimental groups and one control group only according to the time slots which
would be available for them to attend the study.
Prior to the experiment, to explore the comparability of the five groups regard-
ing English proficiency, the participants were administered a cloze test. In language
testing, cloze tests have frequently been adopted as a valid and reliable instrument to
assess overall language proficiency (Brown & Rodgers 2002). In this study, the cloze
test was composed of three cloze passages, which were adapted from the nation-wide
standardized China College English Test Band 4 (CET-4) Database for non-English
majors at low intermediate to intermediate English proficiency level.
A one way ANOVA showed no significant difference among the five groups on the
cloze test results, F(4, 78) = .628, p = .679. On this basis, the groups were found to be
comparable with regard to English proficiency.

Experimental tasks
The present study used six tasks in total. There were three narratives (one for ­practice
and two for actual data collection), and three interactive decision-making tasks (again,
one for practice and two for data collection). The four treatment tasks were carefully
arranged in order to tease out the intervening influence of task type and task order. The
two sub-groups under each treatment group were assigned the same tasks in reverse
order to counterbalance any intervening effect of task sequence. In addition, the dif-
ferent topics were arranged in a balanced order. Table 1 below shows the arrangement
of task type and task topics.
In the narrative tasks, the participants described stories from cartoon episodes
of Tom and Jerry. They watched the cartoons, and then retold the story. In the inter-
active decision-making tasks, the participants, in dyads, acted as the editors of the

Table 1.  Arrangement of task types and task topics


Sub-group 1 Sub-group 2

Cycle 1 narrative task a interactive task b


(topic: puppy tale) (topic: unbalanced degree)
Cycle 2 interactive task a narrative task b
(topic: cyber love) (topic: baby butch)
Cycle 3 interactive task b narrative task a
(topic: unbalanced degree) (topic: puppy tale)
Cycle 4 narrative task b interactive task a
(topic: baby butch) (topic: cyber love)
136 Li Qian

problem column of a magazine (cf. Skehan & Foster’s (1997) Agony Aunt task). In
each task, they discussed the problem in a letter written to the magazine and agreed
upon the best advice for the writer. Each letter described a certain tricky personal
situation that did not have a simple or obvious solution (Skehan & Foster 2001).
(See Appendix for task instructions and problem letters for the interactive decision-
making tasks).

Procedures
The participants were seen five times at one-week intervals, the first time for orienta-
tion and the other four times for main study data collection. Prior to the data collection,
an orientation session was given to ensure that the participants were well informed
regarding the task procedure and the basic transcribing skills that were required (for
the experimental groups). In addition, task practice for both task types was expected
to reduce the participants’ performance anxiety (Bygate 1996, 2000, 2001).
In the task session, each participant was provided with a tape-cassette recorder.
For the narrative task, a cartoon episode from Tom and Jerry was played to the partici-
pants. After two minutes planning, every participant was asked to describe the episode
to the recorder as if they were telling the story to someone else who had not watched
the cartoon. The recordings were then used for post-task transcribing. With the inter-
active decision-making tasks, participants, working in dyads, were given the problem
letter and then discussed with each other to agree what good advice could be given.
The pairs were the same in each session. Their discussion performances were recorded
for transcribing as well.
At the post-task stage, participants transcribed part of their recordings from the
tapes with paper and pencil. As for the length of the transcribed performance, in a
narrative task, the participants who worked individually transcribed a 3-minute per-
formance starting from a certain story point. For the pair-work groups, this was more
complicated. Each member of the dyad contributed a 1.5-minute performance in a
continuous storyline. For example, starting from a story point (The door is too small
for the puppy to come in…), participant A’s 1.5-minute performance were transcribed,
and the transcription ended with another story point (Tom was angry…) from which
participant B’s 1.5-minute performance started. In this way, the story content contrib-
uted by the dyads was supposed to be different from each other so as to avoid any com-
petition concerning the quality of the oral performance between the two members.
Several story turning points in the cartoons were provided for free selection by each
pair. In the decision-making tasks, considering that between-interlocutors’ pauses
tended to occur more frequently than in the narrative task, a five-minute conversation
between a dyad was assigned to be transcribed either individually or in pairs. To fol-
low previous research procedures (Lynch 2001, 2007) that five minutes are needed and
enough for learners to transcribe their own one-minute speech, in the present study
Get it right in the end 137

fifteen and twenty minutes were allocated for the transcription of the narrative and
interactive performance respectively.
The four experimental groups were assigned to carry out post-task transcribing
activities in different conditions as follows (see the research design in Table 2):

–– Group I individual transcribing group: the participants worked individually to


transcribe the recorded performance.
–– Group II individual transcribing and revising group: the participants individually
transcribed the recorded performances, and then revised the original transcripts.
–– Group III pair transcribing group: the participants worked in pairs to transcribe
the recorded performance.
–– Group IV pair transcribing and revising group: the participants worked in pairs to
transcribe the recorded performance, and to revise the original transcripts.
–– Group V the control group did the same tasks as the experimental groups did.
However, no post task activities were involved after the task performance.

The transcripts were then collected by the researcher for further qualitative study.
At the end of the last task cycle, an interview was carried out to gather feedback
on the study, specifically participants’ reflections on their task performance and on the
post-task activities.

Table 2.  Research design


Individual Individual Pair Pair Control
transcribing transcribing & transcribing transcribing & group
group revising group group revising group (N = 16)
(N = 16) (N = 16) (N = 16) (N = 16)

Sub- Sub- Sub- Sub- Sub- Sub- Sub- Sub- Sub- Sub-
group 1 group 2 group 1 group2 group 1 group 2 group 1 group2 group 1 group 2
(n = 8) (n = 8) (n = 8) (n = 8) (n = 8) (n = 8) (n = 8) (n = 8) (n = 8) (n = 8)

cycle 1 Na1 Ib Na Ib Na Ib Na Ib Na Ib
P12 P1 P2 P2 P3 P3 P4 P4
cycle 2 Ia Nb Ia Nb Ia Nb Ia Nb Ia Nb
P1 P1 P2 P2 P3 P3 P4 P4
cycle 3 Ib Na Ib Na Ib Na Ib Na Ib Na
P1 P1 P2 P2 P3 P3 P4 P4
cycle 4 Nb Ia Nb Ia Nb Ia Nb Ia Nb Ia
P1 P1 P2 P2 P3 P3 P4 P4
 a: narrative task puppy tale; Nb: narrative task baby butch;
Note: 1. N
Ia: interactive decision-making task cyber love; Ib: decision-making task unbalanced status
     2. P1: post-task individual transcribing; P2: post-task individual transcribing & revising;
P3: post-task pair transcribing; P4: post-task pair-transcribing & revising.
138 Li Qian

Research design
In this large-scale study, a 4 × 2 × 2 research design was employed (see Table 2).
The first independent variable, the post-task transcribing condition, is a between-
subject factor with five levels: (1) individual transcribing only, (2) individual tran-
scribing and revising, (3) pair transcribing only, (4) pair transcribing and pair
revising, plus a control group. The second independent variable, task type, is a
within-­subject factor with two levels: the narrative task and the decision-making
task. The third independent variable, task session, is a within-subject factor with
two levels: the first and the second sessions for either narrative or decision-making
tasks. The dependent variable is the oral performance which was measured in terms
of complexity, accuracy, and lexical performance. The major focus in this chapter
is the post-task transcription condition, but with some consideration of task dif-
ferences (narrative vs. interactive). Space does not enable extensive coverage of the
factors of time or task-session.

Data transcription and coding


The data (i.e. participants’ task performances) were first digitized and transcribed for
research analysis. Then, the transcribed performance data were further divided into
speech units (AS-units) (Foster, Tonkyn & Wigglesworth 2000). Subsequently, the
documents with AS-unit divisions were further arranged according to two formats:
the CHAT format to enable CLAN sub-programs to be used, particularly VOCD, and
the Task Profile (TP) format (Skehan, Chapter 1, this volume) which outputs a wide
range of complexity and accuracy measures, as well as the index Lambda of lexical
sophistication (Read 2000, and see discussion in Chapter 1, this volume). The different
measures of learners’ performance are summarized in Table 3.

Table 3.  Different measures of task performance

Performance Index Description

Complexity 1 Clause per AS unit –  The number of clauses per AS unit


2 Mean length of AS unit –  The number of words per AS unit
Accuracy 3 Ratio of error-free – The total number of error-free
clauses clauses divided by the number of clauses
4 Errors per 100 words –  The number of errors per 100 words
Lexical Diversity 5 D – Corrected type/token ratio
(Malvern & Richards 2002)
Lexical 6 Lambda –  Use of less frequent words
Sophistication
Get it right in the end 139

Data analysis
Data were analysed using SPSS15.0. To address Research Question One concerning
the effects of post-task transcribing, a Multivariate Analysis of Variance (MANOVA)
was performed. For Research Questions 2 and 3 concerning the effects of pair/indi-
vidual transcribing and the effects of further revision, two-way MANOVAs were per-
formed to consider the two independent variables simultaneously. All the MANOVAs
were followed by post-hoc comparisons of all the examined conditions to identify
which groups were significantly different from the others. Furthermore, effect size
(Cohen’s d)1 calculations were conducted to demonstrate the magnitude of any sig-
nificant effect.

Results

The presentation of the results is organized to address Research Questions 1 to 3 in


sequence. For Research Question 1, the focus is on the general effects of post-task
transcribing by comparing the four post-task groups with the no post-task control
group. To address Research Questions 2 and 3, the focus is on the effects of individual/
pair conditions and the effect of revision on learners’ task performance, and the com-
parison was among the four experimental groups.

Results for Research Question 1


To explore the effect of post-task transcribing, a comparison was made between the
post-task groups and the no-post-task control group. As a preliminary step, perfor-
mance on the first task performed by the experimental groups was compared with that
of the control group, to explore whether there were any significant differences between
the five groups at the beginning. The descriptive statistics for the two task perfor-
mances of each task type are presented in Table 4. The rows show mean scores and
standard deviations for the different experimental conditions and the control group,
with scores for the narrative task and the decision-making task. Columns show the
scores for each dependent measure, for the first performance of the task (the ­baseline
condition) and then for the second performance. The latter represents the crucial
value for the present study, and the one used in statistical comparisons.

.  (1) when d is smaller than 0.2, it can be regarded as a small effect; (2) when d is between 0.2
and 0.8, a medium effect; and (3) when d is larger than 0.8, a large effect. (Cohen 1988)
140 Li Qian

Table 4. Descriptive statistics for two task performance of each task type
Group Task Accuracy Complexity Lexical performance

Ratio of Errors/100 words Clause ratio Mean length of Lexical diversity Lexical
error-free clauses AS unit sophistication

Task 1 Task 2 Task 1 Task 2 Task 1 Task 2 Task 1 Task 2 Task 1 Task 2 Task 1 Task 2
Mean Mean Mean Mean Mean Mean Mean Mean Mean Mean Mean Mean
(SD) (SD) (SD) (SD) (SD) (SD) (SD) (SD) (SD) (SD) (SD) (SD)

Individual N* .39 .52 12.46 9.61 1.25 1.38 7.84 9.20 30.75 36.78 1.99 2.12
transcribing (.12) (.13) (5.88) (3.94) (.12) (.13) (.86) (1.25) (5.33) (6.28) (.37) (.33)
(n = 16) I .60 8.73 1.77 1.88 5.52 6.22 57.83 57.70 1.37 1.64
.70 7.51
(.11) (.07) (3.02) (2.70) (.14) (.09) (1.72) (1.77) (12.82) (11.46) (.25) (.25)
Individual N .37 .54 13.36 8.87 1.33 1.42 8.49 9.44 34.65 33.28 1.89 2.43
transcribing (.13) (.11) (5.60) (3.26) (.12) (.15) (1.75) (1.33) (13.69) (5.97) (.30) (.11)
& revising 1.76 6.07 6.87 54.66
I .63 .78 7.37 6.03 1.70 54.39 1.49 1.72
(n = 16) (.12) (.25) (.15) (1.61) (2.02) (12.36) (11.53) (.22) (.14)
(.05) (2.70) (1.91)
Pair N .34 .51 14.71 10.35 1.29 1.53 7.95 8.79 29.54 34.43 1.86 2.17
transcribing (.11) (.10) (4.34) (3.47) (.16) (.13) (1.34) (1.29) (6.96) (5.49) (.39) (.28)
(n = 16) I .55 1.66 1.90 6.58 9.71 56.80 57.93 1.35 1.54
.71 9.62 5.50
(.12) (.10) (4.42) (2.72) (.13) (.14) (2.02) (1.78) (8.25) (8.20) (.21) (.13)
Pair N .32 .51 12.63 8.85 1.30 1.47 7.79 8.16 31.44 35.78 1.89 2.11
transcribing (.11) (.13) (5.10) (3.18) (.12) (.14) (1.06) (1.30) (5.63) (5.09) (.41) (.30)
& revising I .56 9.17 1.63 1.86 6.16 9.47 53.35 57.46 1.36 1.45
.77 6.21
(n = 16) (.08) (3.47) (.10) (.15) (1.12) (2.03) (10.96) (9.97) (.17) (.15)
(.05) (2.72)
Control N .35 .38 13.14 12.06 1.32 1.35 7.60 7.80 29.55 37.78 1.93 2.04
(n = 16) (.11) (.08) (5.20) (5.49) (.14) (.12) (1.31) (1.32) (6.58) (7.69) (.56) (.48)
I .55 .56 10.30 9.84 1.67 1.67 5.70 5.78 50.75 60.96 1.24 1.33
(.06) (.06) (2.86) (3.14) (.14) (.14) (.52) (.60) (9.28) (11.13) (.25) (.23)
(*N: narrative I: interactive)
Get it right in the end 141

A series of MANOVAs performed on the Task One (baseline condition) values in


terms of complexity, accuracy and lexical performance showed no significant differ-
ences between the control group and the experimental groups.
The second task performance was analyzed to see whether the scores of the exper-
imental groups, as a result of the involvement of post-task transcribing, were signifi-
cantly different from the control group. The detailed statistics show that in terms of
accuracy in the second narrative task, the four experimental groups produced more
error-free clauses (.52, .54, .51, .51 for the experimental groups and .38 for the control
group respectively) and fewer errors per 100 words (9.61, 8.87, 10.35, 8.85 for the
experimental groups) than the control group (12.06). In the second interactive task,
the experimental groups produced more error-free clauses (.70, .78, .77, .71 for the
four experimental groups) than the control group (.56). The former produced fewer
errors per 100 words (7.51, 6.03, 5.50, 6.21 for the experimental groups) than the con-
trol group (9.84). One-way MANOVA results (see Table 5) show that, in the second
narrative task, the experimental groups produced significantly more error-free clauses
than the control group did (p = .001, Cohen’s d = 1.72); in the second interactive task,
the experimental groups produced significantly more error-free clauses than the con-
trol group did (p = .001, Cohen’s d = 3.74), and significantly fewer errors per 100 words
than the control group (p = . 001, Cohen’s d = 1.81).
As for complexity, the detailed statistics show that in the second narrative task, for
the clauses per AS unit measure (1.38, 1.42, 1.53, 1.47) and the mean length of the AS
units in words (9.20, 9.44, 8.79, 8.16), the scores of the experimental groups were higher
than those of the control group (1.35 for clause ratio, 7.80 for mean length of AS unit).
In the second interactive task, the experimental groups produced more clauses per
AS unit (1.88, 1.76, 1.90, 1.86) than the control group (1.67), and also p ­ roduced more
words per AS unit (6.22, 6.87, 9.71, 9.47) than the control group (5.78). MANOVA
results (see Table 5) show that in the second narrative task, the ­experimental groups
produced significantly more clauses per AS unit than the control group (p = .007,
Cohen’s d = 1.43). In the second interactive task, the experimental groups were signifi-
cantly superior to the control group in both complexity measures (clause ratio per AS
unit: p = .003, Cohen’s d = 1.88; mean length of AS unit: p = .001, Cohen’s d = 3.06).
Regarding lexical performance, the detailed statistics show that the control
group (37.78 for the narrative task; 60.96 for the interactive task ) scored higher than
the four experimental groups (36.78, 33.28, 34.43, 35.78 in the narrative task; 57.70,
54.39, 57.93, 57.46 in the interactive task) in terms of lexical diversity. As for lexical
sophisitication the control group (2.04 for the narrative task;1.33 for the interac-
tive task) scored lower than the experimental groups (2.12, 2.43, 2.17, 2.11 for the
narrative task; 1.64, 1.72, 1.54, 1.45 for the interactive task). MANOVA results (see
Table 5) show that the experimental groups used significantly more sophisticated/
infrequent words than the control group (narrative task performance: p  =  .010,
142 Li Qian

Cohen’s d = 1.16; ­interactive task performance: p = .000, Cohen’s d = 2.12). There was
no significant difference between the experimental groups and the control group as
far as lexical diversity was concerned.
Table 5 provides summary information on the MANOVA results for Research
Question 1. The results concerning the performance on two different task types are
presented separately. Under each task type, probability values of the multiple indexes
of complexity, accuracy and lexical performance are provided, together with the effect
sizes.

Table 5.  One-way MANOVA results for Research Question 1


Task type Task performance Dependent variables F Sig. Effect size

Narrative task
Complexity clauses per AS unit 3.43 .007* 1.43, large
words per AS unit 2.25 .056 0.57, medium
Accuracy ratio of error free clauses 4.39 .001* 1.72, large
error per 100 words 1.45 .214 0.46, medium
lexical performance lexical diversity 1.13 .350 0.4, medium
lexical sophistication 3.11 .010* 1.16, large
Interactive task
Complexity clauses per AS unit 4.02 .003* 1.88, large
words per AS unit 2.83 .000* 3.06, large
Accuracy ratio of error free clauses 26.63 .000* 3.74, large
error per 100 words 7.50 .000* 1.81, large
lexical performance lexical diversity .68 .643 0.31, medium
lexical sophistication 8.30 .000* 2.12, large
(*p < .01)

In brief, the experimental groups, as a result of post-task involvement, were


s­ ignificantly superior to the control group in terms of accuracy, complexity and lexical
sophistication.

Results for Research Question 2


Research Question 2 considers whether there are any significant differences between
individual-based and pair-based post-task transcribing. MANOVA results show that
in the second narrative task, the pair transcribing groups produced significantly more
clauses per AS-unit (1.53, 1.47) than the individual-based groups (1.38, 1.42) (p = .007,
Cohen’s d = 0.7). On the other hand, the latter used significantly more words per ­AS-unit
(9.20, 9.44) than the former (8.79, 8.16) (p = .05, Cohen’s d = .051,). It may, therefore, be
Get it right in the end 143

inferred that the pair transcribing groups produced more but shorter clauses or clause
elements than the individual groups, whereas the latter adopted more words but sim-
pler syntax (with less subordination).
In the second interactive task, the pair groups used more words per AS-unit (9.71,
9.47) than the individual groups (6.22, 6.87) (p = .001, Cohen’s d = 1.76,), without any
significant differences noted for the ratio of clauses per AS unit (1.88, 1.76 for the indi-
vidual groups; 1.90, 1.86 for the pair groups). Table 6 shows the results for both task
types in terms of the complexity measures.
With both task types, there were no significant effects of individual/pair transcrib-
ing for accuracy and lexical performance.

Table 6.  Significant effects of individual/pair conditions in both task types: Complexity
Groups Dependent variables F Sig. Effect size

pair > individual clause ratio 7.69 .007* 0.7, medium


Narrative Task
individual > pair words per AS-unit 3.96 .050 0.51, medium
Interactive Task pair > individual words per AS unit 6.28 .001* 1.76, large
(*p < .01)

Results for Research Question 3


Research Question 3 investigated whether there is any effect for revision after post-
task transcribing as compared to a no-revision condition. The MANOVA results show
that in the second interactive task, as far as accuracy is concerned, the revision groups
produced a significantly larger proportion of error-free clauses (.78,.77) than the no-
revision groups (.70, .71) (p = .001, Cohen’s d = 1.09,). No significance was found for
the other accuracy measure.
As for complexity, in the second interactive task, the no-revision groups used more
clauses per AS-unit (1.88, 1.90) than their counterparts (1.76, 1.86) (p = .014, Cohen’s
d = 0.64), but they did not significantly differ in terms of words per AS-unit (6.22, 9.71
for the no-revision groups; 6.87, 9.47 for the revision groups). Table 7 shows the sig-
nificant effects of revision/no-revision condition in the interactive task performance,
together with associated effect sizes.

Table 7.  Significant effects of revision/no-revision condition: Accuracy & Complexity


Groups Dependent variables F Sig. Effect size

Interactive Task revision> no revision accuracy: error-free ratio 7.16 .001* 1.09, large
no revision> revision complexity: clause ratio 3.56 .014 0.64, medium
(*p < .01)
144 Li Qian

The MANOVA results showed that in the second narrative task, the involvement
of revision brought about no significant differences in terms of the various aspects of
task performance. Nor was any significance found with regard to lexical performance
in both task types. In brief, the involvement of revision led to a more accurate, but less
complex interactive task performance, although there was no such effect of revision on
narrative task performance.
In addition to the above main effects of both post-task conditions, there is an
interaction effect between the individual/pair condition and the revision/no-revision
condition, although this is only on the measure of lexical sophistication (p = .007,
Cohen’s d = 0.7). Specifically, in the narrative task, the revision condition pushed
the individual transcribing groups to produce significantly more low-frequency
words than the pair groups. On the other hand, the no-revision condition was associ-
ated with the pair transcribing groups using more low-frequency words than their
counterparts.

Summary of the results


To sum up, in the present study, post-task transcribing, as a focus on form activity at
the post-task stage, was effective in producing more accurate and complex language
in task performance. Furthermore, given that post-task transcription was operation-
alised in more than one way, the distinctive role of individual/pair transcribing and
the effect of revision after transcribing were explored. In this study, pair-based tran-
scribing was effective, although to a limited extent, for the improvement of syntactic
complexity. The involvement of revision after transcribing brought about a positive
effect on accuracy, but a negative effect on complexity.

Discussion

There are four major sections to this discussion section. First, I will discuss the general
effects of post-task transcribing, followed by a discussion of the differential effects of
transcribing on the various aspects of performance. This is followed by a section on the
role of interaction, while the last section discusses the importance of revision as a step
which follows transcription itself.

Effects of post-task transcribing


The results reveal that the post-task groups are superior to the control group in terms
of accuracy, complexity and lexical sophistication. In other words, focus on form at
the post-task stage is beneficial for the improvement of L2 performance. This finding
is consistent with previous studies (Mennim 2003; Stillwell et al. 2010).
Get it right in the end 145

To account for the effects of post-task transcribing, two issues may be related: the
foreknowledge of post-task transcribing, and the operationalization of t­ ranscribing.
Regarding the first, prior to task performance, participants were informed that they
would transcribe their performance recordings afterwards. It appeared that the
­foreknowledge of transcribing played a role in directing participants’ attention to
­formal aspects of performance because this may remind them that task performance
is not an end in itself, but instead is connected with wider pedagogic concerns
­(Foster & Skehan 2013). This may have emphasized the importance of the quality of
task performance. Participants, therefore, were cautious during performance to keep
a balance between fluent communication and language accuracy. Accordingly, they
appeared to pay attention not only to meaning transmission for task accomplish-
ment, but also allocate certain attention to the formal aspects of performance for a
more satisfactory transcribed performance. Even so, it was not clear whether they
shifted their attention unconsciously or intentionally.
The operationalization of post-task transcribing possibly may have had some
effects on language development as well, although these suggestions are rather specu-
lative. One of the most evident advantages of post-task transcribing is that it affords
participants opportunities to attend to formal aspects of language performance.
­During task performance, most of the learners’ attentional focus was probably on
communication and meaning to get the task done. In contrast, at the post-task stage,
it was likely that more attention could be released to consider the formal aspects of
task performance, because meaning would not compete for major attention any longer
(Foster & Skehan 2013; Lynch 2001, 2007). Under these conditions, noticing, which is
a prerequisite for language change and acquisition (Schmidt 2001), may occur more
easily and naturally at the post-task stage.
However, if attention for formal aspects of language is available, this only offers
the possibility for noticing to take place, but does not guarantee its occurrence. In the
present study the performance transcripts pushed participants to notice, remember,
and reproduce the processed language forms (Lynch 2007). On the one hand, tran-
scripts transformed the oral task performance into a written form which may have
further prompted the learners to attend to the formal aspects of their performance
(Doughty & Williams 1998a). On the other hand, the transcription reactivated the task
performance and, in this way, may have led to deeper processing, such as cognitive
comparison. As Doughty (2001) says:

‘If the verbatim format of recent speech remains activated in memory and available for
use in subsequent utterance formulation, this can be taken to be an important cognitive
underpinning for facilitating the opportunity to make cognitive comparisons’ (p. 253).

Cognitive comparisons may be made between the transcripts and the target language
(i.e. noticing the gap) or between the missing forms in the transcripts and the existing
146 Li Qian

counterparts in the target language (i.e. noticing the hole), both of which functioned
effectively for the improvement of formal aspects in the current research.

Different effects of post-task transcribing on various aspects


of task performance
Post-task transcribing proved to be effective for language improvement. However, the
effects of focus on form were not uniform for different aspects of task performance,
with the strongest effect of transcribing on accuracy and a more limited effect on
complexity.
In line with previous post-task studies (Skehan & Foster 1997; Foster & Skehan
2013; Lynch 2001, 2007), the present study reveals that accuracy is the performance
area that most clearly shows the effects of post-task transcribing. Accuracy in language
use can arise from three interacting sources: the degree of accuracy of the language
representation itself; the strength of competing representations; and the degree of
automatization of language production (Wolfe-Quintero et al. 1998). The first source
of accuracy is dependent upon the learner’s established interlanguage (IL) system and
long-term memory, and the other two pertain to on-line real-time language use and
rely on the allocation of attention. Given its cross-sectional nature, the present study
is mainly concerned with the factors related to on-line accurate language use, namely
the competition between different representations and the degree of automatization of
language production. It is reasonable to assume that between the two competing rep-
resentations (i.e. accuracy and complexity), participants focused most of their atten-
tion on language conformity to the target forms and avoided errors in their attempts
to achieve such a goal. Further, the multiple involvements of task practice and post-
task transcribing increased the likelihood for language use to be automatized to some
extent and consistently channelled learners’ attention to the accuracy aspect of their
performance.
Even so, we found some effects of post-task transcribing on complexity, although
the effects were not as strong and consistent as those on accuracy. It was found that the
effects of post-task transcribing on complexity were shown in all the pair-transcribing
groups in the interactive tasks. Thus, it may be inferred that it was the interactivity
resulting from either the pair transcribing activity or the interactive task type, rather
than the simple involvement of post-task transcribing itself, that generated the posi-
tive effects on complexity. The role of interaction in the pair transcribing condition is
discussed in the next section.
The current study reveals that focus on form at the post-task stage may be
facilitative for the improvement of accuracy and complexity, although to a differ-
ent extent. In the literature, many of the focus-on-form studies have only been
concerned with the effects on accuracy, using measures related to target-like forms
Get it right in the end 147

(Doughty & Williams 1998a). In fact, the emergence of many intermediate IL


forms that often represent increasing IL complexity rather than increasing accuracy
(­Skehan 1996) may be facilitated by focus on form as well. Consistent with this,
Doughty and Williams (1998b) argued that:
‘focus on form does not always immediately lead to IL changes that are reflected in
increased accuracy. It may also lead to restructuring that reflects increased complexity,
an equally important aspect of IL development. In this respect, focus on form has the
advantage of affecting both IL development and IL accuracy’ (p.254).

So far, the discussion has concerned the general effect of post-task transcribing, regard-
less of the differences between various transcribing conditions. However, in view of
the pedagogical applications of this study, post-task transcribing was operationalised
in various ways. The following sections present a discussion on these different opera-
tionalisations in greater detail.

The role of interaction in pair-based transcribing


In the present study, the post-task transcribing was carried out either individually or
in pairs. Despite the slightly contradictory result concerning the mean length of AS-
unit in the narrative tasks, the main trend in the results indicates that pair-based tran-
scribing in both tasks encouraged more complex syntax than the individual condition.
From the perspective of cognitive SLA, restructuring may have caused this growth in
complexity (Wolfe-Quintero et al. 1998). The process of restructuring “increases the
chances that new forms will be incorporated into IL systems; promotes risk-taking
and requires attention being devoted to the new forms of language which are being
assembled” (Skehan 1996, p. 50). In this sense, unlike accuracy, which reflects greater
control over internalized forms, complexity is more related to the internalization of
new forms (Swain & Lapkin 1995). There are at least two potential ways to promote
IL restructuring: production of output plus metatalk, and production of output plus
feedback (Swain 1995, 2005). Both metatalk and feedback may result from interac-
tions between speakers. Skehan (1996) also proposed that interactive opportunities
are important to achieve IL restructuring and higher complexity. Self-evidently, the
pair-based transcribing in this study provided more interactive opportunities than the
individual transcribing condition.
From a psycholinguistic perspective, pair-based transcribing seemed to offer par-
ticipants the opportunities to engage in the kind of moves which are facilitative of L2
learning (Long 1983, 1996), such as seeking and receiving confirmation, and providing
each other with explanations about the original task performance. Swain and ­Lapkin
(1998) pointed out that requests for confirmation about language form or language
choice direct learners’ attention to a specific language item. As the participants indi-
cated in the interview, during pair transcribing, there were cases when participants
148 Li Qian

could not fully understand what their partner exactly said in the recordings or why the
partner said what they said. Requests for confirmation and the corresponding expla-
nations occurred in the interaction. An exchange that follows a confirmation move
“forces the learner to clarify and organize their own knowledge and thus enhances
their own understanding” (Storch 2007, p. 155). Such exchanges between the partners
provided an advantage which was missing when participants transcribed individually.
Joint responsibility over the creation of the transcripts means that students may be
more receptive to peer suggestions and feedback comments (Storch 2007).

The role of revision after transcribing


In pedagogical practice, mere transcribing, even if in different forms (e.g. ­individually
or in pairs), may have limitations and not be ideal because it stifles learners’ further
interaction with, and development of the transcripts. Once learners are asked to tran-
scribe their task performance, they tend to revise the transcripts to produce a bet-
ter version by means of error correction, or text editing etc (Willis & Willis 2007).
The present study revealed that in the interactive tasks, the involvement of revision
after transcribing promoted learners’ accuracy, but at the same time it had a negative
effect on complexity. These results are consistent with previous research in second
language writing (Ferris 2003; Hyland & Hyland 2006) which shows that the involve-
ment of revision has positive effects on language accuracy. When participants were
asked to revise their transcripts, they were pushed to produce “modified output”. As
Swain (1993) put it, for IL development, learners need to “reflect on their output and
consider ways of modifying it to enhance comprehensibility, appropriateness, and
accuracy” (pp. 160–161). Swain (1995, 2005) claimed that modified output is likely
to promote language learning. To push learners to revise or modify their own output
may cause not only attention to form, but also an underlying cognitive comparison
(Doughty 2001) and then reprocessing (c.f. Swain’s Output Hypothesis). In Lynch
(2001, 2007), students were involved in revising and reformulating. They showed per-
formance improvement as a result of this process. Lynch’s studies revealed that revi-
sion after post-task transcribing provides the opportunity for explicit feedback, both
positive and negative, and this is a central requirement for formal language learn-
ing (Ferris 2003). In teaching practice, some teachers reflect that “during the post-
task transcription phase, many trainees wanted to write what they wish they had said
rather than what they had actually said” (Willis & Willis 2007: p. 173). In other words,
without communicative pressure, during the revision process, learners tend to recall
their memory for better forms.
In addition, in the modifying and revising process, learners’ primary concern was
on the process of error correction (Ellis 2008; Kormos 1999). Prior to error correc-
tion, needing to judge whether something was an error or not (i.e. the identification
Get it right in the end 149

of errors) channelled participants’ attention to reflect on their earlier performance,


making use of their language resources to notice the gaps between their own IL system
and the target language. The errors themselves, producing negative evidence in L2 lan-
guage use, may have pushed learners to alter their performance priorities by assigning
greater importance to accuracy in task performance (Leeman 2007).
In contrast to the active role revision played with accuracy, a negative effect
of revision was noted as well: once the participants had been involved in revision
after transcribing, their language performance became less complex than that of the
no-revision groups. This finding is in line with previous research which found that
once learners paid strong attention to corrected errors, they tended to simplify their
writing to avoid errors in their output (Kepner 1991; Sheppard 1992). Avoidance
strategies were identified in early error analysis studies: The learners who found a
construction difficult tended to avoid it, using it only when they were confident that
they could get it right, or when they had no choice (Truscott 2007). It is possible
that in the present study, due to the involvement of revision, the participants were
more aware of the accuracy of the task performance. Reliance on an error avoidance
strategy may have given rise to the counterproductive risk-avoidance strategy in the
interactive tasks.
From a psycholinguistic perspective, the contrasting effects of revision on accu-
racy and complexity may be explained by the trade-off between these two perfor-
mance areas (Skehan 1998). In the present study, the learners’ primary concern during
revision was for accuracy. Given the limited attentional resources available for the
formal aspects of performance, complexity, as a competing area for attention, there-
fore received less attention during revision. The participants tended to use simpler
structures which they could control well without needing to allocate extra attentional
resources to the task performance. As such, more accurate but simpler performances
were produced by the revision groups.
Given that revision was not consistently supportive for different language aspects,
whether or not to adopt revision in task-based language pedagogy may depend on the
different goals of instruction. Where accuracy is the focus, it is clearly appropriate.
Where complexity and development are the goal, this may not be the case.
Last but not least, the only interactive effect between the revision condition and
the individual/pair condition is worthy of further explication. In this study, it was
found that further revision pushed the individual transcribing groups to use more
infrequent words in the narrative task than the pair transcribing groups. In brief, the
involvement of revision brought about superior narrative task performance in terms of
lexical sophistication for the individual transcribing groups. Since both the narrative
tasks and the individual transcribing activity were carried out individually, and the
individual groups used more advanced words, it may be assumed that individual work
may give rise to some improvements in certain aspects of task performance, such as
150 Li Qian

lexical complexity in this study. While the effect of pair work has been established in
previous research (see a review in Storch 2007), research work with an emphasis on the
benefits of individual condition in L2 learning may be a fruitful field as well.

Pedagogical implications

The present study has interesting implications for second language instruction. First
and foremost, teachers in task-based settings are recommended to include post-task
activities in their teaching practice. The present study focussed on post-task transcrip-
tion and showed a striking effect for improvements in formal aspects of language. The
procedure is perfectly feasible in regular classrooms in that only recorders and pens
are needed for transcribing and the average time for transcribing a 1-min extract is
around five minutes, both of which are manageable in L2 classrooms. In addition,
other types of post-task activities can also be examined in further research so as to
provide more focus-on-form options for pedagogical application.
In the second place, the findings highlighted the need to monitor the variations
in post-task transcribing carefully. Not all the transcribing conditions were beneficial
for overall language improvement. For example, only the pair transcribing condition
was favorable for syntactic complexity improvement. L2 learners at different proficient
levels may be primarily concerned with different aspects of language performance.
Teachers should, therefore, carefully design transcribing conditions to allow students
with different needs and at different stages of IL development to focus on different
aspects of task performance achievement.
Thirdly, teachers need to understand the factors that impact in contrasting ways
on different performance aspects. For instance, the effect of revision is complex. It is
generally accepted among teachers that the involvement of revision is helpful for L2
learners (Willis & Willis 2007). However, the results of this study reveal that revision
in a general sense facilitates improvement in accuracy, but may hinder the use of com-
plex language. Thus, we should be cautious when we adopt further revision in post-
task transcribing unless raising accuracy is the current pedagogic goal. One strategy
that could be employed is for a teacher to make it clear to the students that the focus
of revision is on both error-correction and structural improvement prior to revision.
This may help learners direct their attention to both aspects. This might reduce the
potentially negative effect of revision on complexity to a certain extent.
Finally, it should be acknowledged that all the above pedagogical recommenda-
tions, based as they are on just one study, cannot really be warranted unless further
replication studies are carried out. It should be noted as well that transcribing, when
adopted as a type of post-task activity, may be beneficial to induce learners to focus
on form, but might not necessarily bring about an immediate improvement in L2
performance.
Get it right in the end 151

Conclusion

Second language acquisition is a complex phenomenon. So is focus-on-form research:


‘Researchers are torn between the desire to test theoretical claims about L2 acquisition,
which requires the investigation of precise and discrete instructional options, and the
desire to ensure that form-focused instruction is ecologically valid, which leads to
combining options into treatments that are pedagogically defensible.’ 
(Ellis 2008, p. 900)

This research has been explorative in terms of both theoretical and pedagogical issues.
The findings have underscored the necessity for task-based research and pedagogy to
give equal weight to a post-task focus on form as during pre- and during-task stages. As
Skehan (2007) noted, a task-based approach has much to offer form-focused instruc-
tion in a variety of ways. Focus on form at the post-task stage is a promising area which
is worthy of future exploration.

References

Bialystok, E. (1990). Communication strategies: A psychological analysis of second Language use.


Oxford: Basil Blackwell.
Brown, J.D. & Rodgers, T. (2002). Doing second language research. Oxford: Oxford University Press.
Bygate, M. (1996). Effects of task repetition: Appraising the developing languages of learners. In
J. Willis & D. Willis (Eds.), Challenge and change in language teaching (pp. 136–145). Oxford:
Macmillan Heinemann.
Bygate, M. (2000). Introduction. Language Teaching Research, 4, 185–192.
Bygate, M. (2001). Effects of task repetition on the structure and control of oral language. In
M. Bygate, P. Skehan, & M.Swain (Eds.), Researching pedagogic tasks: Second language learning,
teaching and testing (pp. 23–48). Harlow: Longman.
Clennell, C. (1999). Promoting pragmatic awareness and spoken discourse skills with EAP classes.
ELT Journal, 53, 83–91.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ:
­Lawrence Erlbaum Associates.
Doughty, C. (2001). Cognitive underpinnings of focus on form. In P. Robinson (Ed.), Cognition and
second language instruction (pp. 206–257). Cambridge: CUP.
Doughty, C. (2003). Instructed SLA: Constraints, compensation, and enhancement. In C. Doughty &
M. Long (Eds.), Handbook of second language acquisition (pp. 256–310). New York, NY:
Blackwell.
Doughty, C., & Williams, J. (1998a). Issues and terminology. In C. Doughty & J. Williams (Eds.),
Focus on form in classroom language acquisition (pp.1–11). Cambridge: CUP.
Doughty, C., & Williams, J. (1998b). Pedagogical choices in focus on form. In C. Doughty &
J. ­Williams (Eds.), Focus on form in classroom language acquisition (pp.197–261). Cambridge:
CUP.
Doughty, C., & Williams, J. (Eds.). (1998c). Focus on form in classroom language acquisition.
­Cambridge: CUP.
152 Li Qian

Ellis, R. (2001). Introduction: Investigating form-focused instruction. Language Learning, 51,


1–46.
Ellis, R. (2003). Task-based language learning and teaching. Oxford: OUP.
Ellis, R. (2008). The study of second language acquisition (2nd ed.). Oxford: OUP.
Ferris, D.R. (2003). Response to student writing: Implications for second language students. Mahwah,
NJ: Lawrence Erlbaum Associates.
Foster P., & Skehan P. (2013), Anticipating a post-task activity: The effects on accuracy, com-
plexity and fluency of L2 language performance. Canadian Modern Language Journal 69, 3,
249–273.
Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Measuring spoken language: A unit for all reasons.
Applied Linguistics, 21, 354–375.
Fotos, S., & Nassaji, H. (Eds.). (2007). Form-focused instruction and teacher education: Studies in
honor of Rod Ellis. Oxford: OUP.
Hyland, K., & Hyland, F. (2006). Feedback in second language writing: Contexts and Issues. ­Cambridge:
CUP.
Kepner, C.G. (1991). An experiment in the relationship of types of written feedback to the develop-
ment of second-language writing skills. Modern Language Journal, 75, 305–313.
Kormos, J. (1999). Monitoring and self-repair. Language Learning, 49, 303–342.
Krashen, S. (1982). Principles and practice in second language acquisition. Oxford: Pergamon.
Krashen, S. (1985). The Input Hypothesis: Issues and implications. London: Longman.
Leeman, J. (2007). Feedback in L2 learning: Responding to errors during practice. In R. Dekeyser
(Ed.), Practice in a second language: Perspectives from applied linguistics and cognitive psychology
(pp.111–137). Cambridge: CUP.
Leeser, M. (2004). Learner proficiency and focus on form during collaborative dialogue. Language
Teaching Research, 8, 55–81.
Lightbown, P., & Spada, N. (1990). Focus-on-form and corrective feedback in communicative lan-
guage teaching: effects on second language learning. Studies in Second Language Acquisition,
12, 429–448.
Loewen, S. (2005). Incidental focus on form and second language learning. Studies in Second Lan-
guage Acquisition, 27, 361–386.
Long, M. (1983). Native speaker/non-native speaker conversation and the negotiation of compre-
hensible input. Applied Linguistics, 4, 126–141.
Long, M. (1991). Focus on form: A design feature in language teaching methodology. In K. de
Bot, R. Ginsberg, & C. Kramsch (Eds.), Foreign language research in cross-cultural perspective
(pp. 39–52). Amsterdam: John Benjamins.
Long, M. (1996). The role of the linguistic environment in second acquisition. In W. Ritchie &
T. ­Bhatia (Eds.), Handbook of research on second language acquisition (pp.413–468). New York:
Academic Press.
Long, M., & Robinson, P. (1998). Focus on form: Theory, research and practice. In C. Doughty &
J.  Williams (Eds.), Focus on form in classroom language acquisition (pp. 15–41). Cambridge:
CUP.
Lynch, T. (2001). Seeing what they meant: Transcribing as a route to noticing. ELT Journal, 55,
124–132.
Lynch, T. (2007). Learning from the transcripts of an oral communication task. ELT Journal, 61,
311–320.
Lynch, T., & Maclean, J. (2001). A case of exercising: Effects of immediate task repetition on learners’
performance. In M. Bygate, P. Skehan, & M.Swain (Eds.), Researching pedagogic tasks: Second
language learning, teaching and testing (pp.141–162). Harlow: Longman.
Get it right in the end 153

Malvern, D., & Richards, B. (2002). Investigating accommodation in language proficiency interviews
using a new measure of lexical diversity. Language Testing, 19, 85–104.
McLaughlin, B. (1990). Restructuring. Applied Linguistics, 11, 113–128.
Mennim, P. (2003). Rehearsed oral L2 output and reactive focus on form. ELT Journal, 57, 130–138.
Mennim, P. (2011). Learner negotiation of L2 form in transcription exercises. ELT Journal, 66(1),
52–61.
Norris, J., & Ortega, L. (2000). Effectiveness of L2 instruction: A research synthesis and quantitative
meta-analysis. Language Learning, 50, 417–528.
Pica, T. (2002). Subject-matter content: How does it assist the interactional and linguistic needs of
classroom language learners? Modern Language Journal, 86, 1–19.
Prabhu, N.S. (1987). Second language pedagogy. Oxford: OUP.
Read, J. (2000). Assessing vocabulary. Cambridge: CUP.
Rutherford, W. (1988). Second language grammar: Teaching and learning. London: Longman.
Schmidt, R. (2001). Attention. In P. Robinson (Ed.), Cognition and second language instruction (pp.
3–28). Cambridge: Cambridge University Press.
Sheppard, K. (1992). Two feedback types: Do they make a difference? RELC Journal, 23, 103–110.
Skehan, P. (1996). A framework for the implementation of task-based instruction. Applied ­Linguistics,
37, 38–62.
Skehan, P. (1998). A cognitive approach to language learning. Oxford: OUP.
Skehan, P. (2007). Task research and language teaching: Reciprocal relationships. In S. Fotos &
H. Nassaji (Eds.), Form-focused instruction and teacher education: Studies in honor of Rod Ellis
(pp. 55–69). Oxford: OUP.
Skehan, P., & Foster, P. (1997). Task type and task processing conditions as influences on foreign
language performance. Language Teaching Research, 1, 185–211.
Skehan, P., & Foster, P. (2001). Cognition and tasks. In P. Robinson (Ed.), Cognition and second lan-
guage instruction (pp. 183–205). Cambridge: CUP.
Spada, N. (1997). Form-focused instruction and second language acquisition: A review of classroom
and laboratory research. Language Teaching, 30, 73–87.
Stern, H.H. (1983). Fundamental concepts of language teaching. Oxford: Oxford University Press.
Stillwell, C., Curabba, B., Alexander, K., Kidd, A., Kim, E., Stone, P., & Wyle, C. (2010). Students
transcribing tasks: Noticing fluency, accuracy and complexity. ELT Journal, 64, 445–455.
Storch, N. (2007). Investigating the merits of pair work on a text editing task in ELS classes. Language
Teaching Research, 11, 143–159.
Swain, M. (1993). The output hypothesis: Just speaking and writing aren’t enough. The Canadian
Modern Language Review, 50, 158–164.
Swain, M. (1995). Three functions of output in second language learning. In G. Cook & B. Seidhofer
(Eds.), Principles and practice in applied linguistics: Studies in honor of H.G. Widdowson
(pp. 125–144).Oxford: OUP.
Swain, M. (2005). The output hypothesis: theory and research. In E. Hinkel (Ed.), Handbook on
research in second language teaching and learning (pp. 471–483). Mahwah, NJ: Lawrence
­Erlbaum Associates.
Swain, M., & Lapkin, S. (1995). Problems in output and the cognitive processes they generate: A step
towards second language learning. Applied Linguistics, 16, 371–391.
Swain, M., & Lapkin, S. (1998). Interaction and second language learning: Two adolescent French
immersion students working together. The Modern Language Journal, 82, 320–337.
Truscott, J. (2007). The effect of error correction on learners’ ability to write accurately. Journal of
Second Language Writing, 16, 255–272.
Willis, D., & Willis, J. (2007). Doing task-based teaching. Oxford: OUP.
154 Li Qian

Willis, J. (1996). A framework for task-based learning. Harlow: Addison Wesley Longman.
Wolfe-Quintero, K., Inagaki, S., & Kim, H.Y. (1998). Second language development in writing:
­Measures of fluency, accuracy and complexity (Technical Report #17). Honolulu, HI: University
of Hawaii, Second Language Teaching and Curriculum Center.

Appendix

Task instruction and letters for interactive decision-making tasks


Instruction: In this task, you have some letters which were sent to the Problem Page of
a magazine, to a “problem aunt” called Sue. She replied to each of them with advice to
help the writer solve each of the problems.
Imagine that the two of you together are “Sue” and that your task is to agree on the
advice to put in the letter you send to each of these people. In each case, to think of the
different sorts of advice which are possible, of why one bit of advice would work better,
or of why some bit of advice might contain difficulties or dangers. Work out what the
best advice is that you could put in your letter of reply.

Letter A: Cyber love


We have a daughter of 16 years old. When she was in junior middle school, she was
excellent.
Last year, she began to be addicted to internet exploration. She made some net-
friends through the internet. Recently she disappeared for two weeks. Finally, we found
her in a boy’s house. She told us that she was going to marry that boy whom she got to
know through the Internet. The boy is 12 years older than her, and now is jobless. We
locked her in the bedroom and didn’t allow her to go out. However, she escaped from
the window to the boy’s house. What shall we do now?

Letter B: Unbalanced degree


I have been in love with my girlfriend for one year. Now she is studying at a university
and I work as a clerk in a company after my graduation from a technology institute.
Being afraid of her parents’ objection, she didn’t tell her parents about our love until
recently. Several days ago, she told them about our love and quarreled with them. Her
mother came to my company and asked me to break up with her, because I have a
lower academic degree than her daughter. I am in despair. What shall I do now?
chapter 6

Structure, lexis, and time perspective


Influences on task performance

Zhan Wang & Peter Skehan


University of Pittsburgh / St. Mary’s University, Twickenham

The Cognition and Tradeoff Hypotheses account for task performance in different
ways. The former sees task complexity as the driver for higher accuracy and structural
complexity whereas the latter, within the constraints of limited attentional capacities,
sees performance as being accounted for through the interaction of influences
from task characteristics and task conditions. This chapter reports on a study
which contrasts these two accounts, manipulating task structure (as an influence
on primarily accuracy, but secondarily complexity), vocabulary difficulty (as a
disruptor of smooth processing during performance), and time perspective (as a
method of operationalising task complexity). The results do simultaneously produce
raised accuracy and complexity, but this is best accounted for through the separate
contribution of task structure and a there-and-then perspective (analysed differently
to that within the Cognition Hypothesis), rather than through greater task complexity.
Vocabulary difficulty did not have the predicted impact. The results are discussed in
terms of the Tradeoff and Cognition Hypotheses.

Introduction

The last twenty-five years haveseen great practical interest in task-based approaches to
instruction (Ellis 2003; Van Den Branden 2006; Van den Branden et al. 2009). At the
same time, there has also been a parallel focus on research into task-based performance
(Skehan & Foster 2008), in an attemptto develop a research-based view on language
instruction. Indeed, research in this area has the dual attractions of connecting with
interesting theoretical issues in the domain of second language acquisition (see, e.g.
Housen & Kuiken 2009) and practical concerns within the field of pedagogy (Skehan
2011). The available research allows for a range of generalisations, which add to our
understanding of how differences in task features and task conditions can have system-
atic influences on performance, and so, perhaps, pedagogy. For example, tasks based
on familiar information or more concrete information are easier (Brown et al. 1984)
156 Zhan Wang & Peter Skehan

and also associated with greater accuracy (Foster & Skehan 1996). Similarly, tasks which
require information m ­ anipulation (i.e. those requiring the creation of a storyline to link a
series of pictures) and integration (i.e. those requiring the integration of foreground and
background information in a narrative task) are more difficult, but are associated with
greater language complexity (Skehan & Foster 1997; Tavakoli & Skehan 2005). These
findings are the result of research studies which have focussed on task types or character-
istics ­(Skehan & Foster 2008), but there has also been research on the conditions under
which tasks are performed. Planning, for example, has been shown to be beneficial to
performance, whether strategic, that is pre-task, or on-line, (that is conducted while the
task is running), with the former consistently producing more complex and more flu-
ent performance (Foster & Skehan 1996; Ortega 1999), and the latter more consistently
producing greater accuracy (Yuan & Ellis 2003; Ellis 2009). Other task conditions, such
as repetition (Bygate 2001; Wang this volume), or post-task activities (­Skehan & Foster
1997; Li this volume) have also proved to be beneficial.
Even though the research base on task performance has grown steadily, there is
still a heated debate on the theoretical underpinnings that can explain the results we
see. At present, there are two competing theoretical models aiming to account for the
impact of task type and task conditions on performance, the Trade-off H ­ ypothesis
(­Skehan 1998, 2009a) and the Cognition Hypothesis (Robinson 2001a, b, 2012). The
starting point for the Trade-off Hypothesis is the assumption that there are attentional
limitations on performance, associated with limited working memory size, and that
pressure on such limited resources will have implications for what a second language
speaker can produce. Task research has frequently portrayed performance in terms
of language complexity, accuracy, and fluency (and more recently lexis also, Skehan
2009b). So, applying attentional limitations to this view of performance, prioritising
one area of performance, complexity, say, might have significant effects on perfor-
mance in other areas. In fact, the Tradeoff Hypothesis has proposed that there is a
particular tension between complexity and accuracy, such that it is difficult to produce
high levels of performance in both of these areas simultaneously. In contrast, high
accuracy and high fluency, or high complexity and high fluency are in conflict to a far
lesser extent (Skehan & Foster 1997).
This, though, is a rather basic account of the Trade-off Hypothesis. The fundamen-
tal assumption is that if tasks become more difficult, the significance of attentional and
memory limitations becomes greater. But this does not mean that the effects of Trade-
off are unavoidable. Indeed, Trade-off is a fundamental constraint, and then a major
contribution of task research is to explore how task characteristics and task conditions
can mitigate its effects. In other words, influences which singly might elevate perfor-
mance in a single direction may, when operative together, raise performance in more
than one area. Indeed, the purpose of much Trade-off research is to see to what extent
such limitations can be overcome. For example, Tavakoli and Skehan (2005), and
Structure, lexis, and time perspective 157

­ oster and Tavakoli (2009), each using picture story narrative retelling, have shown
F
how task structure, which ordinarily promotes accuracy and fluency, and information
integration, which normally promotes complexity, can have a conjoined positive influ-
ence and raise accuracy and complexity together. This particular interactive influence
may be difficult to achieve ordinarily, but the above studies show that it is possible.
The fundamental assumption is that attentional limitations have to be assumed, but
this can be taken as the necessary starting point to explore how pedagogic goals, even
if not easy to achieve, can be reached within such constraints.
A final aspect of the Trade-off Hypothesis is its dependence on the Levelt model
of first language speaking (Levelt 1989; Kormos 2006). This model proposes (amongst
other things) that there are three broad stages in speaking: Conceptualisation, Formu-
lation, and Articulation. The first of these is concerned with the ideas to be expressed,
with an evaluation of the context of speaking, and with decisions about the stance
towards what is being said. The stage ‘outputs’ the pre-verbal message. Formulation
then takes the pre-verbal message, accesses the mental lexicon, and engages in clothing
the propositions to be expressed with language, first through lexis, and then through
syntactic encoding. Skehan (2009a) takes this first language model and applies it to
second language case, particularly in relation to task-based performance. He discusses
four types of influence on performance: complexifying, pressuring (both of which
make demands on the processing system), and easing and focussing (which reduce
processing pressure, or direct it). He then relates findings from the task performance
literature to these four influences, and links them to stages within the Levelt model. In
this way, an attempt is being made to construct a theoretical base for the claims which
are made, and also to link task performance to the psycholinguistic processes second
language speakers engage in when speaking. Such a theoretical base is also important
in combating the claim (Robinson 2007) that the Trade-off Hypothesis is vacuous, and
only makes post-hoc claims rather than predicting where trade-off effects will occur.
The contrasting approach is represented by Robinson’s Cognition Hypoth-
esis (Robinson 2001a; Robinson & Gilabert 2007). This hypothesis explicitly rejects
notions of attentional limitations, and proposes that tasks should be designed and
sequenced on the basis of gradual increases in cognitive complexity. A triadic compo-
nential framework is proposed, embracing task features, which impact on task com-
plexity, task conditions, which draw on interactive factors, comprising participation
and participant variables; and learner factors, both affective and ability, which are
important for task difficulty (being defined in reference to the language learner rather
than task features). For our present purposes task complexity factors are most relevant;
the other two areas will not be pursued here. As for task complexity, a distinction is
made between resource-directing factors and resource-dispersing factors. The former
category contains sub-headings such as number of elements in the task, time perspec-
tive (Here-and-now vs. There-and-then), and reasoning demands. It is assumed that
158 Zhan Wang & Peter Skehan

more elements, there-and-then tasks, and more reasoning demands individually (and
­presumably collectively) make a task more complex, and as a result raise the level of
accuracy and complexity. In other words, task complexity pushes up performance in
each of these general areas, which is in direct contrast with the default position of
the Trade-off Hypothesis. Indeed, Robinson (2005) makes the claim that increasing
complexity in each of these areas pushes speakers to produce particular aspects of
language, such as the use of articles, hence the resource-directing label. In contrast,
resource-dispersing influences, while increasing task complexity, do “not direct learn-
ers to any particular aspects of language code which can be used to meet the additional
task demands” (Robinson 2005: p. 7). These lead Robinson to note, that resource-
directing factors will affect fluency negatively but accuracy and complexity positively.
In contrast, increasing task complexity through resource-dispersing factors will influ-
ence fluency, and accuracy and complexity, negatively (e.g. through lack of provision
of planning time, or through multiple tasks, or through the need to use unfamiliar
information).
Broadly there are two types of critique that one can raise against the Cognition
Hypothesis. First, there is the issue of evidence. The hypothesis has been around for
some time now, and its proponents have published a wide range of research studies.
However, on the whole, this research has not been outstandingly supportive of the
predictions, especially regarding the above-mentioned joint influence on accuracy and
complexity. Frequently one aspect of performance is raised, but not the other (see
Iwashita et al. 2001; Michel et al. 2007; Kuiken & Vedder 2007, 2008; Rahimpour 1997;
Robinson 1995; Gilabert 2007 regarding the positive effect of more complex task on
language accuracy; and Foster & Skehan 1999; Foster & Tavakoli 2009; Robinson 2007;
Tavakoli & Foster 2008, 2011 on language complexity); it is rare to see the prediction
of joint raising fulfilled. Occasionally this is the case, (as in Ishikawa 2006), but these
results were obtained with written performance, which renders comparison with the
spoken language studies difficult. There are a few studies (e.g. Foster & S­ kehan 1999;
Tavakoli & Skehan 2005; Foster & Skehan 2013) where both accuracy and complexity
are higher. In view of these studies, Skehan (2009a) argues that it is insufficient, given
the Cognition Hypothesis, to demonstrate that accuracy and complexity are raised –
one must also demonstrate that, at the individual level, the two variables are correlated.
Otherwise there is the possibility that some learners may raise complexity, some may
raise accuracy, and the outcome will be significant gains for each, but this, then, would
not apply at the individual level. In the above three ‘favourable’ studies, for example,
the correlations between accuracy and complexity were not significant, which makes it
hard to defend that they provide any support for the Cognition Hypothesis.
But another type of critique can be raised with regard to the extent to which each
of the components of task complexity actually give rise to higher complexity levels.
The fundamental claim is that resource-directing influences, through greater cognitive
Structure, lexis, and time perspective 159

complexity, push learners to higher accuracy and structural complexity levels. Take
Here-and-now vs. There-and-then, for instance. The interpretation favoured by the
Cognition Hypothesis is that the second condition is more complex (hence, the dif-
ferences in performance that are predicted). But one can ask why this would be the
case, and demand greater clarity on the exact meaning of cognitive complexity. Speak-
ing about Here-and-now is certainly easier with respect to the availability of infor-
mation to be communicated. But it is also less negotiable, and has more prominent
input which needs to be attended to unavoidably, factors which add to complexity.
Speaking about There-and-then is certainly more difficult regarding the lack of input
to be easily referred to, and it also makes memory demands. But it is potentially less
input-dominant and provides greater scope for negotiation, and the shaping of contri-
butions on the part of the speaker, since the stimulus material, the input provided, can
be responded to selectively, sometimes ignored, and more easily repackaged to make
it easier to handle. With regard to resource-dispersing influences the assumption is
made that the different categories of influence are unproblematic and work in predict-
able ways. This, however, is doubtful. For instance, planning, which is interpreted in
the Cognition Hypothesis as resource-dispersing, is claimed to produce lower perfor-
mance (if planning time is not available). But the research on planning raises argu-
ments against this interpretation. The literature suggests that planning does not have
equal effects on all aspects of performance, leading to stronger effects on complexity
and fluency, and smaller and less dependable effects on accuracy. There is also the
issue of how strategic and on-line planning interact (see Wang, this volume). In addi-
tion, evidence from qualitative studies of planning (Ortega 2005; Pang & Skehan this
volume) show that planning consists of many processes and many goals. These include
planning-for-task-interpretation (leading to complexity?), planning-for-organisation
(leading to accuracy?), and planning-as-rehearsal (again leading to accuracy but also
fluency?). Planning cannot be treated as monolithic: its effects are subtler. So, all in all,
the categories which make up the Cognition Hypothesis are not without problems,
and require clearer construct definition.
These considerations motivated the authors to design a study which systematically
investigated typical Trade-off variables (structure and lexical demands) and a typi-
cal Cognition variable (time perspective) to explore the various questions raised by
these two models. Before we describe the study itself, we need to review the evidence
relating to these specific variables a bit further. As a starting point, task structure was
inferred to be important by Skehan and Foster (1997), but this was only post-hoc from
the results of Foster and Skehan (1996) and Skehan and Foster (1997). Skehan and
Foster designed a subsequent study to explore this influence (Skehan & Foster 1999)
broadly confirming the original results. Tavakoli and Skehan (2005), and Tavakoli and
Foster (2008) published subsequent research consistent with the claim that tasks that
contain clear macrostructure (and so ease Levelt’s Formulator stage), favour accuracy,
160 Zhan Wang & Peter Skehan

and fluency. However, the later studies have complexified the picture somewhat, since
structure has emerged as a generally favourable influence on performance, and in
some cases was even associated with greater complexity (Tavakoli & Skehan 2005). It
was therefore decided to use Structure as an independent variable in the present study.
The broad motivation is that, following the Trade-off Hypothesis, researchers try to
account for raised performance not through any need to posit greater task complexity,
but instead through the use of specific targeted variables such as structure which have
been shown to enhance performance in particular areas.
As for the time perspective (Here-and-now versus There-and-then), this has
featured in a number of Cognition Hypothesis studies. It has, however, mainly been
studied through map tasks. The Here-and-Now condition is implemented with a par-
ticipant describing a route on a map that is available and visible. The There-and-then
condition requires the participant to describe the route without the map being visible.
Predictions are made that, since the non-present condition is more cognitively com-
plex, it will push speakers to greater accuracy and complexity. This prediction is rarely
fulfilled, and the most typical result is that accuracy is raised, while complexity is not
(Gilabert 2007; Rahimpour 1997; Robinson 1995), a result which is inconsistent with
the Cognition Hypothesis.
As a matter of fact, the strength of the claims about time perspective would be
much greater if alternative operationalisations (other than through map tasks) of the
same construct were used, potentially generating consistent results. In the present study
we decided to create a condition that differed from the above-mentioned map task in
two ways. First, we used a video-based presentation. We felt a video, with actual char-
acters, would constitute a more involving challenge for our participants. In addition,
with a video narrative, engagement might potentially be richer, since causal links could
be worth commenting on, as might the motives of the characters in the video. But the
essential contrast – Here-and-now vs. There-and-then – would be maintained. In this
way, the Here-and-now condition is very clear and makes demands only on working
memory within processing. But the flow of input is considerable, which puts the speak-
er’s ability to plan and organise under considerable pressure. In contrast, the There-
and-then condition does not have the same pressure of heavy input. On the other hand,
memory demands are much greater and no new stimulus material is involved, or can
be referred to. The speaker can, though, ‘shape’ the narrative in whatever way is desired,
and so plan what is going to be said. Further details will follow in the Materials section.
Secondly, following up on previous studies, (Skehan 2009b), we included lexical
demands as an additional variable, since this appears to have an impact on perfor-
mance across a range of task-based studies. Two aspects of this work are relevant.
First, Skehan (2009b), following Meara and Bell (2001), discusses the use of a ­statistic,
Lambda, which measures the extent to which, in the small texts ­typical of second
Structure, lexis, and time perspective 161

l­anguage task work, speakers use less frequent lexis. The procedure divides a text up
into ten-word chunks and then establishes how many words, in each ten word chunk,
are outside a certain frequency range. A statistic is then calculated, Lambda, which
uses a Poisson distribution (appropriate for infrequently occurring events) to capture
the extent to which less frequent words ‘penetrate’ the text. Second, Skehan (2009b)
discusses the extent to which the use of less frequent lexis has an impact on other
aspects of performance. He argues that greater use of less frequent lexis, prompted
by the demands of a particular task, is associated with lower complexity and accuracy
scores. He suggests that the need for second language speakers to access less frequent
language from a less well developed mental lexicon leads to disruption at the Formula-
tor stage in speech production. He offers the conclusion that tasks which do require
less frequent lexis can therefore have a damaging effect on task performance generally.
But this conclusion is based on post-hoc analyses of a range of studies. It was not the
result of research design. For that reason, the variable of lexical demands is included
in the present study in a more systematic way to explore its effects.
This background leads to four general research questions, and their associated
hypotheses. The research questions are:

Research Question 1: What will be the effect of time perspective (Here-and-now versus
There-and-then) on complexity and accuracy?
Research Question 2: How will task structure affect accuracy and fluency?
Research Question 3: How will the use of less frequent lexis affect accuracy and
complexity?
Research Question 4: How will time perspective, task structure, and frequency of lexis
interact?

The specific hypotheses are as follows (and see also Table 1):

Hypothesis One: There-and-then tasks will raise complexity, but not accuracy. This
follows from the analysis presented earlier regarding the differences between the
There-and-then and Here-and-now conditions, and their implications for the psy-
cholinguistics of processing. Essentially, the There-and-then condition, since it allows
‘repackaging’ of content, will give speakers more opportunity to express ideas more
densely and to bring out connections between events and to clarify the motives of
the participants in the narratives. Interestingly here, the Cognition Hypothesis should
predict that both complexity and accuracy will be raised, even though Cognition
Hypothesis motivated research has tended to report an accuracy effect only. In fact, it
is further assumed that the There-and then condition has no influence on accuracy,
since it is proposed here that There-and-then is not a more complex condition, merely
a different condition, characterised by different processing demands.
162 Zhan Wang & Peter Skehan

Hypothesis Two: Task structure will raise accuracy and fluency in performance. This
hypothesis follows from the review of previous studies which have used this variable
to explore task-based performance. The hypothesis is exploratory regarding complex-
ity, since previous results have been inconsistent. Tentatively, we can hypothesize that
there will be an increase in this area.

Hypothesis Three: Tasks which lead to the use of less frequent lexis will show lower
scores for accuracy and complexity. The motivation here derives from Skehan (2009b),
which argues (on the basis of a post-hoc interpretation of findings) that such tasks lead
to lowered performance in these areas. The present study is more systematic with the
use of tasks intended to provoke different frequencies of lexical items.

Hypothesis Four: The variable of time perspective will show interactions with task
structure and lexical frequency, and produce stronger effects, specifically more com-
plex and accurate performance for structured tasks performed under the There-
and-then condition and tasks with easy lexis performed under the There-and-then
condition as well. It is argued that the There-and-then condition, despite posing
different memory demands, contains less demanding processing conditions, so that
there is more likelihood that additional variables such as structure and lexis can have
an impact. The impact of these variables is predicted to be more muted under the
Here-and-now condition because of the pressure of input that is involved. There is
also the point here that more structured tasks, because of their greater structure, will
enable memory pressures to be lessened because of the more organised nature of the
narratives to be told.

Table 1.  Hypotheses and predictions


Hypotheses Variables Predictions* Reasons

C A F L

Hypoth.1 Time Perspective (Here-and-now > Foster & Skehan 1999;


versus There-and-then) Trade-off Hypothesis
Hypoth.2 Structured versus Unstructured task >? > > Tavakoli & Foster 2008;
Tavakoli & Skehan 2005
Hypoth.3 Task with less freq lexis versus < ­­­< > Skehan 2009b
more freq lexis
Hypoth.4 Interactions ++ ++
C: syntactic complexity; A: Accuracy; F: Fluency; L: lexis
* = the predicted directions for the hypotheses are from the 1st variable to the 2nd variable as this is shown
in the Variables column.
>? means the hypothesis is tentative: ‘+’ indicates that interactions will occur
Blank cell refers to no effect
Structure, lexis, and time perspective 163

The various hypotheses, summarized in Table 1, and now looked at more gener-
ally, propose that different individual variables, motivated by psycholinguistic pro-
cessing concerns, will account for the results that will be obtained. Main effects are
important, but so are interactive, or conjoint effects: the one prediction from Hypoth-
esis Four, that there will be an effect on both complexity and accuracy, is derived from
such interactive effects on performance. In other words, it is not proposed that it is
necessary to hypothesise greater task complexity to achieve these results (as the Cog-
nition Hypothesis, in contrast, would claim); instead they are claimed to be the result
of the interplay of processing factors.

Methods

To examine task complexity from the three dimensions reviewed above: time perspec-
tive (Here-and-now versus There-and-then), lexical difficulty (easy vocabulary versus
difficult vocabulary), task structure (structured task versus unstructured task), and
also allow comparisons within and across these factors, this study is based on a 2x2x2
research design, with lexical difficulty and task structure as within-subject factors, and
time perspective as a between-subject factor.

Participants
Participants were 72 Chinese L1 (Mandarin) speakers who were learning English
as a second language, with slightly more female than male participants. They were
recruited from a major university in Hong Kong. Most (71%) participants were year 1
students; 14% were year 2, 5% were year 3, and 3% were year 4 students. They volun-
tarily participated in the study and received time compensation fees for their partici-
pation. Student consent forms were collected during the study.

English proficiency pre-test


In order to assign the 72 participants into two groups of equivalent English speak-
ing proficiency (the Here-and-now and There-and-then speaking conditions), a pre-
test was administered. A version of the TOEFL Listening subtest (extracted from
Hinkel 2004) was used as the pre-test because TOEFL listening was reported to be a
strong indicator of general English proficiency measured by TOEFL exams (Sawaki
et al. 2009). In addition, listening may involve relatively similar processes to speak-
ing, ­especially regarding the degree of resources required on-line for problem solving
(Yuan & Ellis 2003, p. 9). The results showed that English proficiency was balanced
across the two groups. The Here-and-Now group had a mean score of 38.18 (.69) and
164 Zhan Wang & Peter Skehan

the There-and-Then group had a mean score of 37.72 (.69) in the pre-test. A between-
subjects t-test showed no significant difference between the groups.

Material and tasks


Following Skehan and Foster (1999) and Wang (2009), we used video-based tasks
as the basis for narrative retellings. These previous studies used videos from the Mr.
Bean television series. For the present research, we switched to the use of Shaun the
Sheep cartoons. Trial runs with these cartoons suggested that they provoked a richer
and more varied type of narrative. The Shaun the Sheep video series was selected
because it was animation made for children which was easy to comprehend; it had no
speech or conversation in it so that speakers could concentrate on doing the speaking
tasks; the videos were fun to watch and speak about, and they were relatively new at
the time the research study was conducted – all the participants reported in after-task
interviews that they had not watched the series before. Each video was six to seven
minutes long.
The research design manipulated two variables relevant to the video-based
prompts: plus or minus structure, and plus or minus less frequent lexis. The struc-
tured tasks were selected by using the problem-solution structure used in Tavakoli
and Skehan (2005) and Tavakoli and Foster (2009), where a problem-theme organises
the story, and the narrative develops as attempts to solve a problem are tried out and
evaluated. In this respect two videos were chosen. In Tooth Fairy, the dog character
in this series experiences toothache, and so the major part of the story concerns the
flock of sheep failing to ‘help’ the dog to extract the tooth, followed by the dog actually
going to a vet to get the tooth extracted professionally. In Bathtime, the farmer orders
the dog to bathe the (very dirty) sheep, but there is no hot water. The major part of
the story then relates how the sheep and dog collaborate to obtain hot water for their
collective bath, mainly by stealing the farmer’s hot bath water. In each of these video
stories, the underlying problem connects the different events which take place, and
gives them a driving narrative force. The two other videos were unstructured. In Off
the Baal, the sheep ‘obtain’ a cabbage, which is used as a football. They then engage
in a game of football, with various unconnected events, including the football being
stolen, retrieved, and then lost again. In Fetching, while the Farmer is away, and he is in
charge, the sheepdog meets an attractive female dog he is so smitten by that he doesn’t
notice the mayhem that is occurring in the farmhouse when the flock of sheep invade
it. Desperate last minute measures are required when the farmer returns. Although
there are ‘problems’ within these latter two stories, the problems do not really tie the
events of the stories together, and so the videos can be regarded as unstructured.
Both researchers, together with a group of experienced EFL teachers, agreed on these
­characterisations of the videos.
Structure, lexis, and time perspective 165

Identifying the vocabulary demands of the tasks was more complex. Two proce-
dures were followed, and the tasks which were used were the ones that survived these
procedures. First, groups of experienced teachers viewed candidate videos and rated
them for perceived vocabulary demands. On this basis two groups of five videos each
were identified which differed clearly in rated vocabulary demands. At a second stage,
these videos were described by several people, native as well as non-native speakers,
and these performances were assessed by means of a version of Meara’s PLex computer
program (Meara & Bell 2001). The program outputs a statistic for each performance,
Lambda, which captures the use in the performance of less frequent vocabulary (see
Skehan 2009b for discussion). The videos which were chosen were identified through
their contrasting Lambda means, which differed markedly: Tooth Fairy and Fetching
provoked use of more frequent vocabulary (and therefore avoidance of less frequent
vocabulary), and Bathtime and Off the Baal were associated with higher Lambda
scores, and a reliance on less frequent vocabulary.

Operationalization of the Here-and-now and There-and-then conditions


For the Here-and-now group (n = 45), participants were asked to narrate the story in
the present tense while they were watching the Shaun the Sheep video. For the There-
and-then group (n = 27), participants were asked to narrate the story in the past tense
after having watched the video once, and they were not allowed to watch the video
as they were performing the narrative task. This is in line with ­operationalizations of
the There-and-then condition in the literature (e.g. Robinson 1995a; Gilabert 2007),
except, obviously, that Robinson and Gilabert used map tasks rather than video
­narrative tasks.

Procedure
One of the researchers collected the data in a language lab during a one-on-one meet-
ing with each of the participants. Participants were asked to take an English profi-
ciency pre-test first. Next, a training session was conducted to ensure that participants
understood what they had to do, and were familiar with the Shaun the Sheep series in
general terms and the characters it contains. There was instruction and explanation,
with examples (see Appendix 1). In addition there was a brief oral trial run to make
sure that participants were familiar with speaking in these circumstances. Then partic-
ipants in each group performed narratives of the four Shaun the Sheep videos as a main
session. The four videos were selected according to the ­combination of task structure
and vocabulary difficulty. Table 2 presents the operationalization of the main session.
To avoid practice effects, the administration order of these four videos was arranged
according to a Latin Square design which was pre-programmed into the computer.
During the main session, both the Here-and-now and There-and-then groups narrated
166 Zhan Wang & Peter Skehan

stories facing the computer screen to make the two performance conditions as similar
as possible. Participants were also told that they were narrating to someone who had
not watched the movie so as to create imagined listeners for the task. Finally, the par-
ticipants filled out a questionnaire and had a short interview with the researcher. The
whole data collection process took approximately 1.5 hours.

Table 2.  The operationalization of the main task session


Here-and-now There-and-then
Here-and-now (N = 45) (N = 27)

Voc_easy Tooth Fairy Tooth Fairy


Structured
Voc_dif Bathtime Bathtime
Voc_easy Fetching Fetching
Unstructured
Voc_dif Off the Baal Off the Baal

Data handling and coding


While completing the tasks, participants were recorded on MP3 players. The ­digitised
sound files generated by this procedure were transferred to computer and then
­transcribed broadly using Soundscriber software. The transcription was then o ­ perated
upon in a series of stages (similar to the other empirical chapters in this volume).
First, each performance was coded into AS-Units (Foster, Tonkyn & Wigglesworth
2000) as the basic segmentation unit. Next, each AS ‘line’ was copied to form, at that
stage, a second identical line. The first line, edited to begin with an asterisk and a
participant identifier, was a CHAT tier, which was analyzed by CLAN software. The
second line, edited to begin with a percentage sign and a participant identifier, was
a TaskProfile line, appropriate for the more specialised software developed to quan-
tify second language task based data. The coding conventions for each line followed
CHAT (MacWhinney 2000) and TaskProfile (Skehan, Chapter 1, this volume ;ms) con-
ventions respectively. CHAT conventions (see MacWhinney 2000 for details), which
enable the use of CLAN software, allowed the calculation of a range of sophisticated
language features such as part of speech morphosyntax and lexical D (MacWhinney
2000; Malvern & Richards 2002; Richards & Malvern 1998). Taskprofile allows compu-
tational ­analysis of features of second language speech data, especially the measures of
complexity, accuracy, fluency, and lexis directly. This line was coded for subordinate
clauses; for error free clauses, as well as type of error; repair fluency indices, such as
reformulation, repetition; and silent pause length (see below). In addition, one other
line (the “%snd” line) was included. It simply contained start and finish time infor-
mation for each AS unit, given down to millisecond level. This was important for the
computation of speed fluency measures.
Structure, lexis, and time perspective 167

A sample of coding is provided in the following:


*LVY: One day 〈&m〉 [/] morning, Bitzer is helping 〈her〉 [///] his (0.836) farmer to
(0.674) number the 〈&sh〉 [///] flocks.
%snd: 〈00.04.41〉 〈00.14.14〉
%LVY: |One day {&m} *morning, Bitzer is helping {her} rpl his (0.836) farmer errfr:::
to (0.674) number the {&sh} rpl flocks. err_2_l:;;a |
This sample coding shows the three lines that have been described, as well as examples
of repair coding (‘*’ for repetition, ‘rpl’ for replacement), some unfilled pauses, and
two clauses, one coded as error-free, the second coded for a medium gravity lexical
error (“err_2_l”). There is also a coding for a main clause ‘:::’ and coding for a non-
finite subordinate clause occurring after the main clause ‘:;;a’. Incomplete or modified
contributions are shown enclosed in curly brackets. Chapter 1 provides further infor-
mation on this system of conventions.
Four Ph.D. students of applied linguistics coded the data.1 The researchers
arranged training and regular meetings to discuss the coding issues with them every
two weeks while the coding was taking place. One of the researchers also sampled 10%
of the coded data from each coder for reliability checking before each meeting. Once
there was any disagreement, the researchers and coders tried to reach consensus dur-
ing the meetings and keep consistency of coding.

Measures
The combination of CLAN and TaskProfile software meant that a wide range of mea-
sures were used in this study. These are shown in Table 3.

Research design and statistical analysis


The research design consisted of a three-way factorial design, and multiple d­ ependent
measures. There were two within-subject factors, vocabulary difficulty and task
­structure, and one between-subjects factor, time perspective. There were also a large
number of dependent variables, measuring structural complexity, language a­ ccuracy,
lexical content, repair fluency, breakdown fluency, and speed fluency. After an explor-
atory factor analysis to explore the data structure for the dependent variables, a
MANOVA was run in the first instance, followed by appropriate univariate tests, using
SPSS Version 17.

.  The authors would like to thank Cai Jing, Gavin Bui, Christina Li, and Ren Hongtao for this
work.
168 Zhan Wang & Peter Skehan

Table 3. Measures of speech performance explored in this study


Complexity Total Words –  Total number of words in a speech sample.
Mean Length AS –  The average number of words per AS unit
Main Clauses –  Total number of main clauses per AS-unit.
Subordination – Amount of subordination clauses and verb
infinitives per AS unit (Foster et al. 2000).
Accuracy Error Free Clauses – Total number of clauses which has no error in
syntax, morphology, or word order, etc.
Error Free Proportion – Total number of error free clauses divided by
total number of clauses.
Error Degree – Degree of error (level 1, 2, 3 from large gravity,
medium to small gravity judged by coders)
Error Type –  Type of error (a, b, n, l, m, s, p, x)
Lexical D – Type token ratio (Malvern & Richards 2002)
  diversity Lambda – An index of lexical sophistication
 sophistication (Meara & Bell 2001; Skehan (2009c)
Fluency
 speed Speech Rate –  Pruned words per minute
 breakdown AS Pausing_100 – Number of pauses at the end of AS units per
100 words.
Mid Clause – Number of pauses in the middle of AS units.
Pausing_100
 repair Repetition_100 –  Number of Repetitions per 100 words
Replacement_100 – Number of lexical and syntactic replacements
per 100 words
Reformulation_100 – Number of phrases or clauses per 100 words
repeated with some modification to syntax,
morphology, or word order.
False Starts_100 –  Number of false starts per 100 words
# Measures in bold are those reported in this chapter.

Results

This section will present the results of the study. After some preliminary discussion on
the measures to be included, first, descriptive information will be presented, followed
by MANOVA results, and then the subsequent univariate analyses.
The data collected in this study are part of an ongoing exploratory attempt
to establish the structure of second language performance, and to research which
­measures best capture the different dimensions which have been identified. To that
Structure, lexis, and time perspective 169

end, the data were subjected to a series of factor analyses, for the four different
tasks which were used. In all analyses, clear factors emerged for accuracy and
complexity. The measures which showed highest typical loadings were the index
of error-free clauses and the measure of subordination per AS-unit respectively.
Accordingly, these will be included in the main statistical procedures. In addition,
lexical sophistication, indexed by the value for Lambda, will also be included since
it is fundamental to the research design. This leaves the major area of fluency, for
which a wide range of indices were available. Separate factor analyses of this area
suggested three sub-fluency dimensions: end of clause pausing (standardised to
100 words), mid-clause pausing (standardised similarly), and repair, best indexed
in the present case by number of false starts per 100 words. Interestingly, a speed
fluency factor did not emerge. Equally interestingly, the location of pausing gener-
ated separate factors. It appears that the influences on pausing at the end of a clause
are not quite the same as those which are concerned with pausing within a clause.
On the basis of the factor analysis, therefore, the most useful dependent variables
to include are:

–– Amount of subordination per AS-unit


–– Proportion of error-free clauses
–– Lambda as an index of lexical sophistication
–– AS Pauses per 100 words
–– Mid-clause pauses per 100 words
–– False starts per 100 words

Descriptive statistics for the data are presented in Table 4. The table shows mean
scores, standard deviations, and N sizes for the two groups from the between-subjects
condition, with scores for the four tasks on each variable used.
Given the presence of six dependent variables, as well as a complex three-
way design with both between and within factors, the first step was to conduct a
MANOVA. The initial MANOVA showed clear significance (Pillai’s trace: p < .001).
In addition, tests of sphericity were acceptable. Accordingly, it was permissible to
proceed to the univariate tests. Regarding the between-subject condition of time
perspective, the results for those measures which attained significance are shown
in Table 5.
The significant results are for complexity, with means of 1.28 (Here-and-now)
­versus 1.69 (There-and-then); AS boundary pausing (9.09 pauses per 100 words
versus 4.38 pauses) and false starts (as an index of repair, (with 0.87 false starts per
100 words for Here-and-now versus 1.33 for There-and-then). In other words, the
There-and-Then condition produced greater structural complexity, with a very strong
effect. There was also a significant difference with AS-boundary pausing, but not
170 Zhan Wang & Peter Skehan

Table 4.  Descriptive statistics for condition, lexis, structure


Here and now (n = 45) There and then (n = 27)

Freq. lexis Less freq. lexis Freq. lexis Less freq. lexis

Complexity Structured 1.31 1.33 1.80 1.81


(.15)# (.17) (.27) (.28)
Unstructured 1.26 1.21 1.58 1.58
(.16) (.10) (.27) (.19)
Accuracy Structured .50 .51 .57 .54
(.13) (.15) (.12) (.13)
Unstructured .49 .51 .50 .48
(.15) (.15) (.14) (.13)
Lexis Structured 1.49 1.70 1.69 2.09
(.36) (.41) (.37) (.34)
Unstructured 1.57 1.81 1.48 2.03
(.36) (.43) (.34) (.30)
AS Pausing Structured 8.81 8.87 3.92 4.14
(3.10) (2.83) (1.76) (1.35)
Unstructured 8.96 9.70 4.71 4.75
(2.90) (2.89) (1.72) (1.78)
Mid-clause Pausing Structured 10.27 11.63 10.94 11.50
(4.02) (5.34) (6.87) (5.56)
Unstructured 9.92 12.03 10.56 12.72
(4.75) (4.73) (5.35) (6.59)
False starts Structured 0.84 1.00 1.33 1.17
(0.90) (1.01) (1.02) (1.08)
Unstructured 0.69 0.96 1.02 1.78
(0.88) (0.94) (0.82) (1.26)
# Standard deviations are given in parentheses

Table 5.  Effects of time perspective


Measure Here-and-now There-and-then

M SD M SD F Sig

Complexity 1.28 0.15 1.69 0.25 94.56 .001


AS Pausing 9.09 2.93 4.38 1.65 85.14 .001
False Starts 0.87 0.93 1.33 1.05 9.16 .004

with m­ id-clause pausing, suggesting that the difference in pausing between these
two ­conditions is located at the point where pausing can be considered to be more
‘­appropriate’ (­Skehan 2009b). Finally, the There-and-then condition produced more
repair, although the absolute values here were not very great.
Structure, lexis, and time perspective 171

Next, we turn to the within-subject effects and those for interactions. Once again,
only the significant results are shown. (As it happens, there were no results close to
significance. Results were either clearly significant or clearly non-significant here.) The
relevant results are shown in Table 6.

Table 6.  Effects of structure


Measure Structured tasks Unstructured tasks

M SD M SD F Sig

Complexity 1.51 0.21 1.37 0.17 44.01 .001


Accuracy 0.52 0.13 0.50 0.14 4.67 .04
AS Pausing 6.96 2.41 7.53 2.45 10.77 .002

Structure has a major impact on complexity, with means of 1.51 (Structured tasks)
versus 1.37 (Unstructured tasks), and end-of-AS unit pausing, with means of 6.96 for
Structured tasks versus 7.53 for Unstructured tasks, suggesting that the Structure con-
dition produces much greater subordination, and also that the amount of pausing at
AS Unit boundaries is much reduced. Speakers in this condition appear to produce
much denser language, with complex organisation within propositions. They also
manage to organize this discourse effectively, with fewer pauses at the end of clauses.
In addition, there is an accuracy effect, although this is not so strong (with means of
0.52, the proportion of error free clauses for Structured tasks vs 0.50 for Unstructured
tasks). In other words, the structure condition does support less error (or to put this
another way, the unstructured condition provokes more error), suggesting that a pro-
cessing condition is able to raise both aspects of form. We will return to this below.
However, the correlations between accuracy and complexity for the four tasks do not
provide strong evidence that this was sustained at the individual level, with two posi-
tive and two negative correlations between accuracy and complexity, none of which
reached significance.
The findings for Lambda, as a measure of lexical sophistication, are shown in
Table 7. As before, only variables with significant effects are shown. There was a signifi-
cant difference between the putatively high vocabulary demand and low vocabulary
demand conditions (Table 7), confirming that this condition did have the impact on
performance that the experimental design was expected to produce. In other words,
the two ‘hard vocabulary’ videos, Tooth Fairy and Off the Baal, did lead to the use of
less frequent vocabulary (which produced means of 1.87 measured by Lambda), while
the other two videos, Bathtime and Fetching, were associated with the use of more
frequent vocabulary (with means of 1.55 lambda). (In passing, it could be noted that
there was no difference in D, as an index of lexical diversity, confirming the results
reported in Skehan 2009b).
172 Zhan Wang & Peter Skehan

Table 7.  Effects for lexis


Measure Freq. lexis Less freq. lexis
tasks tasks

M SD M SD F Sig

Lexis 1.55 0.36 1.87 0.38 93.961 .001


Mid-clause pausing 10.35 5.06 11.94 5.44 11.014 .002
False Starts 0.93 0.90 1.17 1.05 12.296 .001

There are also significant interactions for vocabulary with other variables, specif-
ically mid-clause pausing (with significantly more mid clause pausing for hard vocab-
ulary tasks) and false starts (with significantly more false starts for hard vocabulary
tasks too). In other words, the condition which provoked the use of less frequent
words was associated with more breakdown in the middle of a clause, and also the
need to use more repair. There was no significant result for end-of-AS unit paus-
ing, only pausing where specific lexical choices might be an issue. Equally interest-
ing is the lack of any significant interaction with complexity and accuracy. It does
appear that using less frequent vocabulary had an impact on performance, but this
was related to mid-clause pausing, rather than disrupting structure-building or influ-
encing accuracy. This conflicts with the results reported in Skehan (2009b), although
this might be considered a favourable outcome from a pedagogic perspective, since
it implies that scrutinising teaching tasks for lexical demands may not be as vital as
Skehan (2009b) proposed.
Finally, we turn to interactions. The results are presented in Table 8, and val-
ues are given for Structure-by-Condition, Vocabulary Difficulty-by-Condition, and
­Structure-by-Vocabulary Difficulty.

Table 8.  Interaction effects for time perspective, structure, and lexical difficulty
Structure-by-time perspective
Complexity Accuracy Lexis

HnN TnT HnN TnT HnN TnT

Struct.    1.32# 1.81 0.50 0.56 1.59 1.89


(0.16) (0.28) (0.14) (0.13) (0.39) (0.36)
Unstruct. 1.24 1.58 0.50 0.49 1.69 1.75
(0.13) (0.23) (0.15) (0.14) (0.40) (0.32)
F = 8.96; p = .004 F = 5.40; p = .024 F = 10.10; p = .001
# Mean (SD)
Structure, lexis, and time perspective 173

Vocabulary difficulty-by-time perspective

Lexical sophistication

HnN TnT

Freq. Lexis Tasks 1.53 (0.36) 1.59 (0.37)


Less Freq. Lexis Task 1.76 (0.42) 2.06 (0.32)
F = 6.89; p = .012
# Mean (SD)

Structure-by-vocabulary difficulty

False starts

Freq. lexis tasks Less freq. lexis task

Structured 1.03 (0.95) 1.07 (1.04)


Unstruct. 0.82 (0.86) 1.28 (1.07)
F = 4.44; p = .04

There are three significant results for the Structure-by-Condition interaction.


The picture appears to be quite consistent: the There-and-then Structured condition
­produces noticeably more elevated performance than any of the other combinations.
The combination of a structured narrative being done under the There-and-then
­condition is particularly effective for each of the three performance areas. However,
there is some variation. The clearest effect is with complexity. Against the background
of a main effect for time perspective, the additional contribution of a structured nar-
rative produces a much higher level of subordination. It appears that the full effects
of time perspective need a structured task to manifest themselves, while, equally, the
Here-and-now condition is so powerful in the other direction that it seems to prevent
the advantages of a structured task from manifesting themselves. In other words, while
structure contains the potential for the speaker to indicate connections and use sub-
ordination, this potential is more difficult to realise when input has a more dominat-
ing influence in the Here-and-now condition. Accuracy shows the same pattern, but
perhaps a little less strongly: the advantage of the joint condition here is not so great.
Interestingly, also, the joint condition here has no effect on any of the fluency indices –
such effects as were found with fluency were simple main effects. But in general, it is
clear that any aspect of form, accuracy or complexity, benefits considerably when the
major variables in this study are combined in joint conditions.
The results for the interaction between lexis and time perspective follow a similar
pattern, essentially. Against the background of a general effect for the manipulated
174 Zhan Wang & Peter Skehan

variable of vocabulary, the There-and-then condition leads to the use of even more
less frequent words. So it accentuates the effect of vocabulary demands. Finally there
is one significant interaction result involving a fluency measure – that of false starts as
an index of repair, and here the relevant variables at work are structure and vocabu-
lary difficulty. Harder vocabulary and an unstructured task lead to a particularly great
amount of repair, while the easy vocabulary unstructured task leads to least repair. The
strength of this effect, though, is not great.

Discussion

Given the length and complexity of the Results section, it may be worth restating the
main findings first:

–– The There-and-then condition produced greater language complexity, fewer


pauses at clause boundaries, and more repair.
–– The Structured tasks generate greater complexity, less pausing at AS boundaries,
and more accuracy.
–– The lexical difficulty conditions produced greater use of less frequent words, more
mid-clause pausing, and more repair.
–– The interaction of the There-and-then and the Structured Conditions generated
more complexity, and more accuracy.
–– The interaction of the There-and-then and lexical difficulty conditions led to par-
ticularly greater use of less frequent words.
–– The interaction of structure and vocabulary difficulty led to greater repair.

First, we will discuss the significant main effects. The There-and-then condition pro-
duced more complexity, less pausing at AS boundaries, and more repair; however,
there was no increase in accuracy. So once again, regarding the Cognition Hypothesis,
there are mixed findings. Complexity was higher, as predicted, as was fluency (oppo-
site to the Cognition Hypothesis prediction) and accuracy was unaffected (again, not
consistent with Cognition Hypothesis predictions). In some ways, it is easier to start
with the Here-and-now condition, which did not produce elevated performance in
any way. As discussed earlier, the Here-and-now condition may have the advantage
of presence of material to be described (and so lack of memory burden), but it has
considerable disadvantages. Most important are the dominance of the input and the
way this input, if all attended to, is remorseless while the video is running. The major
consequence of this is that the speaker has little time to repackage ideas, or to be selec-
tive as to what will be said. They are forced to maintain a descriptive immediate level
without an opportunity to shape their contribution. In the There-and-then condition,
Structure, lexis, and time perspective 175

in contrast, memory demands may be higher, but the speaker has the opportunity to
be selective, to organise what is being said, and even to indicate causality and character
intentions. This is not because the task (i.e. the video narrative) is more complex: it is
simply because it is crucially different. As a consequence, there is very clearly more
complex language, whether indexed by the AS-based measure of subordination or by
the number of words in clauses. We would argue, in other words, that the results for the
time perspective comparison do not provide support for the Cognition Hypothesis. In
contrast, they are consistent with pressures of psycholinguistic processing, and with
the Trade-off Hypothesis. The Here-and-now condition, in other words, deprives the
Conceptualiser of potential depth, while the There-and-then condition does enable it
to work, and to do better, despite memory limitations.
Lexical difficulty impacts upon three variables across the board: vocabulary itself,
mid-clause pausing, and false starts. This is an interesting effect. Fluency has many
sub-dimensions (breakdown fluency, repair fluency, speed, automatisation: Skehan
2009b). It seems the effect of using less frequent lexis is to disrupt processing mid-
clause, when unexpected problems of lexical selection may be thrust upon the speaker.
Not surprisingly, perhaps, repair is also associated with the engagement of more chal-
lenging lexis. In other words, the need to access less frequent words from the second
language lexicon disrupts automatisation in performance. Retrieving such words, and
the important information contained in lemmas that enables syntax building, has a
price, and this is most clearly reflected in the extent to which language is produced
atuomatically. (Length of run and overall speed were also significantly affected.)
The effects of structure are also very clear. The two structured tasks lead to higher
complexity and lower end-of-clause pausing, as well as greater accuracy. Both aspects
of form are affected, in fact, together with greater fluency, specifically with regard to
‘normal’ pausing. This does suggest relatively smooth processing, and a capacity to
approach more parallel processing.
As interesting as these main effects may be, the interactions are even more so.
First, there is the interaction between Structure and Time Perspective. Tasks which
are both structured and There-and-then elicit language which is more complex and
more accurate. In other words, under the less demanding processing conditions of
There-and-Then production, and if the task eases Formulator operations by providing
a clear macrostructure, it appears that second language speakers have more attention
available for all aspects of form. Greater lexical and structural complexity, and error
avoidance are the outcome of supportive conditions. Many second language speakers
may want to avoid error, but many things may get in the way. It appears that Here-
and-Now processing or unstructured narratives each got in the way in this particular
study. If neither is operative, the surface of language can be given more attention and
error is reduced. It is interesting that while There-and-then and the structured condi-
tion, as main effects, impact upon complexity, they also have a synergistic, interactive
176 Zhan Wang & Peter Skehan

effect. It is possible that, as in Wang’s study (this volume) with her supported on-line
planning condition, the Conceptualiser and Formulator work in harmony for second
language speakers.
In addition, the correlations between structural complexity and accuracy (a rela-
tionship of some significance to the Cognition Hypothesis) are quite intriguing. The
correlations for the two unstructured tasks are close to zero, suggesting independence
of the two performance areas. For the structured tasks, under the There-and-then
condition, the correlations are 0.31 for Bathtime (difficult vocabulary) and 0.42 for
Tooth Fairy (easier vocabulary), the latter one being significant at the 0.05 level. The
correlation may not be particularly high, accounting for only 16% of the variance,
but this is the first time that a joint effect has been demonstrated plus a correlation at
the individual level. We still argue that these results are the consequence of separate
variables working together. We do not see, for example, why time perspective linked to
structure should lead to greater task complexity, even though we accept that Cognition
Hypothesis supporters might offer a different interpretation.
Equally interesting is the interaction effect between lexical difficulty and time per-
spective, even if this is quite limited. More words of lower frequency are used in the
There-and-then condition, suggesting that the lack of Here-and-now time pressure,
together with the ability to repackage ideas, creates sufficient attentional capacity for
wider lexical retrieval. The greater flexibility in this condition enables second language
speakers greater opportunity to search for less obvious lexical choices. There is also an
interaction between structure and vocabulary, but only for the dependent variable of
repair. The focus for this interaction is a slightly raised repair mean score for the dif-
ficult vocabulary, unstructured combination (i.e. the most challenging combination).
It appears that this combination pushes learners into a greater need to modify the lan-
guage they have produced. This effect though does not impact on any other variables,
such as mid-clause pausing or accuracy.
We now need to look at the results more generally, to determine what these patterns
reveal about the nature of second language speaking. The alternative models we have
considered contrast a viewpoint that task complexity, free of attentional limitations,
drives performance (the Cognition Hypothesis), and a viewpoint that certain influ-
ences on psycholinguistic processes (e.g. through task features and task conditions),
and subject to attentional constraints, lead to systematic differences in performance
(the Trade-off account). In general, the results of the study do not sit well with the Cog-
nition Hypothesis. The Cognition Hypothesis prediction of greater complexity with the
There-and-then condition is fulfilled, but the prediction of accuracy is not, and worse,
the results for fluency are the opposite of prediction. There-and-then conditions elicited
more false starts in learners’ speech performance – in a sense, a less fluent accomplish-
ment, and the opposite to the higher fluency prediction of the Cognition Hypothesis.
In addition, the analysis provided earlier suggests that it is by no means obvious that
Structure, lexis, and time perspective 177

the There-and-then condition produces a more complex task. It has been argued that it
is, simply, different, and the contrasts in performance are associated with the difference
rather than greater task complexity (as the next paragraph makes clear). The other vari-
ables in play are not so central to the Cognition Hypothesis. Task Structure has come
to be included in more recent accounts of the Cognition Hypothesis as a resource-­
dispersing variable (Robinson 2011), but in a way which is not seen as integrally linked
with task complexity and with facilitating specific form-function mappings. This vari-
able does not straightforwardly plug into clear predictions. Perhaps the role of less fre-
quent lexis would be interpreted as increasing task complexity, in which case it should
raise language complexity and accuracy as the Cognition Hypothesis would predict. If
this is the case, the results of this study are not supportive, since the condition provok-
ing use of less frequent lexis has no impact on complexity and accuracy scores.
A Trade-off interpretation of the differences between Here-and-now and There-
and-then emphasizes different aspects. First, there is the impact of input pressure in
a Here-and-Now condition, since the amount of material which has to be handled,
understood, processed, and expressed is considerable. The input keeps coming, and
so momentary attempts on the speaker’s part to encode things through language are
put under pressure by newly incoming input. Just as one set of propositions may be
assembled, a new set of pressures arrive. These factors have considerable potential for
disruption. In contrast, in the There-and-then condition, there is no immediate pres-
sure from incoming input. The speaker can be selective and choose to encode ­whatever
they like. In this way, they can, possibly, orient the story to their own strengths and
their linguistic knowledge. They can also repackage the material from the video and
even make links between different sections. They can interpret motives and focus
more clearly on the point of what is happening. (In passing, it should be noted that
there was no difference in overall number of words between the two conditions, and
speakers did, in both conditions, generally try to do justice to the stories concerned.
Neither condition was clearly worse than the other in general ‘narrative quality’.) So,
the difference in burden of input processing was marked. The second issue is memory.
In a sense, the Here-and-Now condition makes less demands on memory in general
(although working memory operations are intense), since what is narrated reflects
what is immediately shown on screen. In contrast, the There-and-then condition is
demanding in a different way, because there is nothing to refer to; yet a six minute
video has to be narrated. The story has to be kept in mind while the retelling proceeds.
This makes demands, but it is not clear how severe these demands are; in addition,
structured narratives by definition are organised, which may facilitate the retelling.
The Cognition Hypothesis sees the memory demands as the crucial aspect that push
for greater task complexity. From the perspective of the Trade-off Hypothesis this is
less obvious, because this hypothesis attaches greater importance to the (damaging)
processing demands of the Here-and-now condition.
178 Zhan Wang & Peter Skehan

A Trade-off interpretation is fairly clear when it comes to the other two variables,
structure and less frequent lexis. A general interpretation for structure effects (e.g.
­Skehan & Foster 1999; Tavakoli & Skehan 2005) is that the speaker’s capacity to rely
on knowledge of macrostructure removes the need to engage in ‘broad brush’ planning
during performance, since the overall shape of a story is known. As a result, attention is
available to focus on the surface features of language. In other words, a significant part of
what the Conceptualiser component has to do is clear, straightforward, and undemand-
ing, so that Formulator concerns can be prioritized. Interestingly, in the present study,
the general results are modified in two ways. First, there is a main effect of complex-
ity (and some measures of fluency). It appears that participants have responded to the
potential of structured tasks to indicate more complex relationships by using more com-
plex subordination. Second, the accuracy effect only occurs in the There-and-then con-
dition. It appears to be the case that Structure can also have an organising effect which
facilitates language complexity. But where accuracy is concerned, it seems that the input
dominance of the Here-and-now condition washes out any structure effect. For struc-
ture to enhance accuracy, minimum attentional conditions must be able to operate, and
the There-and-then condition provides these, because there is space for the speaker to
use organisation and planning. This is largely a Formulator-based explanation, but it is
clear that structure is not powerful enough a variable to work in all conditions.
The need to use less frequent lexis has a similar Formulator-based explanation.
The Formulator stage in speech production has lexical and then syntactic phases,
where the lemma retrieval from the mental lexicon drives the building of syntactic
frames, assuming rich information (beyond simple word meaning) is available in the
lemma. Consistent with Skehan’s (2009b) post-hoc suggestions from previous work,
the need to access less organised, less robust, and less elaborate lemma information
derails performance, reducing mid-clause fluency, and leading to more repair. The
use of easier vocabulary, at least in the sense of more frequent vocabulary, enables
smoother processing, and perhaps a greater approximation, on the second language
speaker’s part, to parallel processing as opposed to the need to engage in a more serial,
effortful processing.
Skehan (2009a) offers an account of second language task-based spoken perfor-
mance organised in terms of the Levelt model of first language speaking. The account
is based on the evidence which has accumulated through the range of task-based
research over the last twenty-five years. The Conceptualiser, Formulator-Lexis and
Formulator-Syntax stages are the ‘spine’ of this account; the various influences are cat-
egorised as complexifying (in that they provoke the use of more complex language);
pressuring (in that they create more demanding processing conditions); easing (which
is essentially the reverse of pressuring); and focussing (in that accuracy is selectively
given greater priority in attention). We can pursue this approach here to try to inte-
grate the findings from the present study into this account.
Structure, lexis, and time perspective 179

What is particularly interesting is that two of the variables, time perspective and
structure, each appear twice in this Figure. This is shown in Figure 1 where the vari-
ables in question are italicised. We will deal with these first in the discussion.

Complexifying, Levelt Stage Easing, Focussing


Pressuring

There-and-Then Conceptualiser
Structure

Less frequent lexis Formulator: Lexis More frequent lexis

Here-and-Now Formulator: Syntax Structure


There-and-Then

Figure 1.  The impact of time perspective, structure, and lexical frequency on second language
spoken performance

Regarding time perspective, it is helpful to discuss Here-and-now and There-


and-then separately, and not as different points on a continuum, or as different polar-
ities on the same dimension. There-and-then can impact upon the Conceptualiser
and enable the speaker, through the freedom in time and negotiability of the task that
are available, to produce denser, more organised syntax, with more subordination
and with more extensively developed clauses (as indexed by number of words). The
speaker is not forced into a lower level of immediate description and, in contrast, can
show links and causality and motives in a more satisfactory manner. Similarly, struc-
ture in the task enables the speaker to have a wider perspective on what is happening
and to do the story more justice, again to show links, since there is less domination by
immediate events which have to be recounted. Events form a pattern, and this pattern
can then be reflected in the complexity of the language which is used. So, both these
influences on the Conceptualiser are positive and lead to an interpretation of the task
in which more challenging propositions are expressed.
But both There-and-then and Structure also have an easing role. There-and-then
essentially achieves this by not being Here-and-now. In other words, the lack of time
pressure eases processing, and removes the need to continually respond to new input.
The speaker, as a result, has the freedom to choose what to say and to devote attention to
saying it. This is distinct from the capacity to respond to the latent complexity of the story.
With structure, easing derives from the way that a clearer macrostructure allows speakers
to know where they are in the wider discourse, so that they can devote more attention to
the details, to the surface of language, rather than wrestling with extensive conceptualisa-
tion. They are ‘licensed’, as it were, to get on with sub-sections of the story that they have
to relate, more confident that they can rejoin the main narrative drive without difficulty.
180 Zhan Wang & Peter Skehan

In contrast, there are two pressuring influences. The first is the need to use less
frequent lexis. This impacts upon the Formulator at the lemma access stage. Effec-
tive, automatised, parallel communication is disrupted when lexical items are needed
which are not instantly available. When these are encountered, the speaker has to do
something to solve a processing problem, and the need for attentional resources to
do this has an impact on the ongoing processing. This is where what would ideally be
parallel processing becomes serial in nature (Kormos 2006). Since communication
has to continue as smoothly as possible, this disruption has a major impact on the
cycles of Conceptualisation, Formulation, and Articulation which normally proceed
in parallel. Instead of a modular system working effectively, particular stages (in
this case the lemma retrieval stage) interfere with ongoing processing. The second
pressuring influence is the need to engage in Here-and-now processing. In this case,
at least in the context of a video-based narrative retelling, the quantity of incom-
ing (non-verbal) input which has to be encoded is considerable, and the (limited)
second language speaker has difficulty in analysing this input, extracting what is
important, and then formulating a response quickly while more input is arriving.
The result is that performance is disrupted (cf. the large phonation time differences,
the large average pause time differences) as the pressures of communication become
too great.
Happily, at least, not all the influences in the present study are so demanding.
Structure has an easing role at the Formulator stage, for reasons given earlier. The
clarity provided by structure eases Formulator operations. The same applies to more
frequent lexis. This too provides accessible material during speaking, so that the sec-
ond language speaker is more likely to be able to sustain parallel processing, at least
some of the time.

Conclusions

As an extension of the model provided in Skehan (2009a), which is developed further


in the final chapter of this volume, the present study helps to clarify the influences on
second language task performance which are most salient. The range of influences
whose operations are now beginning to be understood is growing. This enables more
precise predictions of task performance to be conducted in the future, because we
have improved analytic schemes to understand tasks as research units. In addition,
the way these influences can be related to the psycholinguistic processes described in
the Levelt model of first language speaking gives them even greater validity. Models of
second language speaking which are not grounded in such psycholinguistic processes
are inevitably weakened.
Structure, lexis, and time perspective 181

But there are also some pedagogic implications. In general, the results add to our
understanding how task choice, based on, for example, degree of structure and nature
of lexical content, and task conditions, such as time perspective, have systematic rela-
tionships on different performance areas, such as language complexity, accuracy, and
fluency. Hence, if teachers wish to promote one of these areas particularly, then results
such as those reported here can make a contribution. There are, though, some specific
areas which are worth highlighting. The results of this study while broadly supporting
previous research regarding the way structure promotes accuracy, also suggest that
structure may have some contribution to make to language complexity. This suggests
that structure can function similarly to information integration (Tavakoli & Skehan
2005; Tavakoli & Foster 2009) under certain conditions, making it a very useful tool
for teachers wishing to engender a focus on form into their communicative activities.
Time perspective also has some interesting implications. It would appear that where
video-based material is concerned, there is little to be said for the Here-and-now condi-
tion. This seems generally to create conditions which pose problems and depress levels
of achievement. The There-and-then condition seems much more supportive of peda-
gogic work, at least where the intention is that learners should be supported in gaining
control over newer or less salient language. Correspondingly, greater ­understanding
of what constitutes pressure enables more effective pedagogic decision-making where
the intention is to help learners mobilise their abilities to cope with pressure.
Finally, the results for lexical frequency might have the greatest relevance for peda-
gogic decision-making. If we assume that less frequent lexis is more difficult lexis, then
tasks which draw upon such lexis create difficulties for learners. They seem to lead to
lower levels of automatisation. In interaction with the There-and-then condition, they
also create problems for accuracy. If it is possible to predict which tasks will draw upon
difficult lexis, there is the possibility of pre-teaching such lexis so that when the task is
done, the lexis will become more easily available and the task can run more smoothly. To
put this another way, with tasks in classrooms and with tasks in research, it seems very
important to investigate the lexical demands that will be made. In classrooms, overly dif-
ficult lexical demands might compromise the pedagogic usefulness of tasks. In research,
overly difficult lexis (which is unidentified as such) in a particular experimental condition
can introduce unwanted variance, compromising interpretations of any research results.

Acknowledgments

This work was supported in part by The Research Grants Council, Hong Kong (grant
number 450307). The authors would like to thank Martin Bygate, John Norris, and
Kris Van den Branden for their helpful comments on an early draft of this.
182 Zhan Wang & Peter Skehan

References

Brown, G., Anderson, A., Shilcock, R., & Yule, G. (1984). Teaching talk: Strategies for production and
assessment. Cambridge: CUP.
Bygate, M. (2001). Effects of task repetition on the structure and control of oral language. In
M. Bygate, P. Skehan, & M. Swain (Eds.), Researching pedagogic tasks: Second language learning,
teaching, and testing (pp. 23–48). Harlow: Longman.
Ellis R. (2003), Task-based language learning and teaching. Oxford: OUP.
Ellis, R. (2009). The differential effects of three types of task planning on the fluency, complexity and
accuracy in L2 oral production. Applied Linguistics, 30, 474–509.
Foster, P., & Skehan, P. (1996). The influence of planning on performance in task-based learning.
Studies in Second Language Acquisition, 18, 299–324.
Foster, P., & Skehan, P. (1999). The influence of source of planning and focus of planning on task-
based performance. Language Teaching Research, 3, 185–214.
Foster, P., & Skehan, P. (2013). Anticipating a post-task activity: The effects on accuracy, complexity
and fluency of L2 language performance. Canadian Modern Language Review 69, 3, 249–273.
Foster, P., & Tavakoli, P. (2009). Native speakers and task performance: Comparing effects on com-
plexity, fluency and lexical diversity. Language Learning, 59(4), 886–896.
Foster, P., & Tavakoli, P. (2011). Task design and second language performance: The effect of narra-
tive type on learner output. Language Learning, 61(suppl.1), 37–72.
Foster, P., Tonkyn, A., & Wigglesworth, J. (2000). Measuring spoken language: A unit for all reasons.
Applied Linguistics, 21(3), 354−75.
Gilabert, R. (2007). Effects of manipulating task complexity on self-repairs during L2 oral produc-
tion. International Review of Applied Linguistics, 45, 215–240.
Hinkel, E. (2004). TOEFL test strategies with Practice Tests (3rd ed.) Hauppauge, NY: Barron’s.
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition.
Applied Linguistics, 30(4), 461–473.
Ishikawa, T. (2006). The effects of task complexity and language proficiency on task- based language
performance. The Journal of Asia TEFL, 3(4), 193–225.
Iwashita, N., McNamara, T., & Elder, C. (2001). Can we predict task difficulty in an oral proficiency
test? Exploring the potential of an information-processing approach to task design. Language
Learning, 51(3), 401–436.
Kormos, J. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence
­Erlbaum Associates.
Kuiken, F., & Vedder, I. (2007). Task complexity and measures of linguistic performance in L2 writ-
ing. International Review of Applied Linguistics, 45(3), 261–284.
Kuiken, F., & Vedder, I. (2008). Cognitive task complexity and written output in Italian and French
as a foreign language. Journal of Second Language Writing, 17, 48–60.
Levelt, W.J.M. (1989). Speaking: From intention to articulation. Cambridge, MA: The MIT Press.
MacWhinney, B. (2000). The CHILDES Project: Tools for Analyzing Talk (3rd ed.). Mahwah, NJ:
­Lawrence Erlbaum Associates.
Malvern, D., & Richards, B. (2002). Investigating accommodation in language proficiency interviews
using a new measure of lexical diversity. Language Testing, 19, 85–104.
Meara, P., & Bell, H. (2001). P_Lex: A simple and effective way of describing the lexical characteris-
tics of short L2 texts. Prospect, 16, 5–19.
Michel, M., Kuiken, F., & Vedder, I. (2007). the influence of complexity in monologic versus dialogic
tasks in Dutch L2. International Review of Applied Linguistics, 45, 241–259.
Structure, lexis, and time perspective 183

Ortega, L. (1999). Planning and focus on form in L2 oral performance. Studies in Second Language
Acquisition, 21, 109–148.
Ortega, L. (2005). What do learners plan? Learner-driven attention to form during pre-task planning.
In R. Ellis (Ed.), Planning and task performance in a second language (pp. 77–109). Amsterdam:
John Benjamins.
Rahimpour, M. (1997). Task complexity, task condition, and variation in L2 oral discourse. Unpub-
lished Ph.D. thesis. University of Queensland, Australia.
Richards, B.J., & Malvern, D.D. (1998). A new research tool: Mathematical modelling in the measure-
ment of vocabulary diversity (Award reference no. R000221995). Final Report to the Economic
and Social Research Council, Swindon, UK.
Robinson, P. (1995). Task complexity and second language narrative discourse. Language Learning,
45, 99–140.
Robinson, P. (2001a). Task complexity, task difficulty, and task production: Exploring interactions in
a componential framework. Applied Linguistics, 22(1), 27–57.
Robinson, P. (2001b). Task complexity, cognitive resources, and syllabus design: A triadic framework
for examining task influences on SLA. In P. Robinson (Ed.), Cognition and second language
instruction (pp. 287–318). Cambridge: CUP.
Robinson, P. (2007). Task complexity, theory of mind, and intentional reasoning: Effects on L2
speech production, interaction, uptake and perceptions of task difficulty. International Review
of Applied Linguistics, 45, 193–214.
Robinson, P. (2011).Task-based language learning: A review of issues. Language Learning, 61(Suppl. 1,
June 2011), 1–36.
Robinson, P., & Gilabert, R. (2007). Task complexity, the cognition hypothesis and second language
learning and performance. IRAL, 45, 161–176.
Sawaki, Y., Stricker, L.J., & Oranje, A.H. (2009). Factor structure of an internet-based test. Language
Testing, 26(1), 5–30.
Skehan, P. (2009a). Modelling second language performance: Integrating complexity, accuracy,
­fluency and lexis. Applied Linguistics, 30(4), 510–532.
Skehan, P. (2009b). Lexical performance by native and non-native speakers on language-learning
tasks. In H. Daller, D. Malvern, P. Meara, J. Milton, B. Richards, & J. Treffers-Daller. (Eds.),
Vocabulary studies in first and second language acquisition: The interface between theory and
application (pp. 107–124). London: Palgrave Macmillan.
Skehan, P. (2009c). Models of speaking and the assessment of second language proficiency. In
A. Benati. (Ed.), Issues in second language proficiency (pp. 202–215). London: Continuum.
Skehan, P. (2011). Researching tasks: Performance, assessment, pedagogy. Shanghai: Shanghai Foreign
Language Education Press.
Skehan, P. (manuscript). Conventions for coding complexity, accuracy, fluency and lexis: The use of
TaskProfile. The Chinese University of Hong Kong.
Skehan, P., & Foster, P. (1997). The influence of planning and post-task activities on accuracy and
complexity in task-based learning. Language Teaching Research, 1(3), 16–33.
Skehan, P., & Foster, P. (2008).Complexity, accuracy, fluency and lexis in task-based perfor-
mance: A meta-analysis of the Ealing research. In S. Van Daele, A. Housen, F. Kuiken,
M. Pierrard, & I. Vedder. (Eds.), Complexity, accuracy and fluency in second language use,
learning and teaching (pp. 263–284). Brussels: Royal Flemish Academy of Belgium for ­Sciences
and Arts.
Tavakoli, P., & Foster, P. (2008). Task design and second language performance: The effect of narra-
tive type on learner output. Language Learning, 58(2), 439–473.
184 Zhan Wang & Peter Skehan

Tavakoli, P., & Skehan, P. (2005). Strategic planning, task structure, and performance testing. In
R. Ellis (Ed.), Planning and task performance in a second language (pp. 239–276). Amsterdam:
John Benjamins.
Van den Branden K. (2006). Task-based language education: From theory to practice. Cambridge:
CUP.
Van den Branden, K., Bygate M., & Norris, J. (2009). (Eds.), Task-based language teaching: A reader.
Amsterdam: John Benjamins.
Wang, Z. (2009). Modeling L2 speech production and performance: Evidence from five types of planning
and two task structure. Unpublished Ph.D. thesis. The Chinese University of Hong Kong.
Yuan, F., & Ellis, R. (2003).The effects of pre-task planning and online planning on fluency, complex-
ity, and accuracy in L2 monologicoral production. Applied Linguistics, 24, 1–27.

Appendix A Task Instructions

Instructions for There-and-Then narration


You will see several short cartoon films. Each film lasts for about 5 minutes or so. The
films will be played only once. After watching each of them, you are required to tell
a story based on what you have watched to someone who has never seen it. You are
required to:

i. Recall what you have watched; and tell the story as clearly as possible and in the
order that the film was presented.
ii. Since you will not have time to plan how to tell the story, you should be thinking
about the story retelling even when you are watching the film.
iii. Please narrate the story from a 3rd person view point. Instead of using “I”, please
use “Shaun”, “Bitzer” for example, as the names of the main sheep. (A card of the
main sheep characters with their names is provided.).
iv. Please use the past tense. Here are some examples:
  Shaun entered the room.
  He wanted to call his friends.

Instructions for Here-and-Now narration


You will see several short cartoon films. Each film lasts for about 5 minutes or so.
While watching, you are required to tell the story to someone who has never seen the
film. You are required to:

i. Since you are required to tell the story simultaneously while the film is playing,
when the film starts (after the theme song), you should be ready to start telling the
story; when the film stops, you should be finishing your story too.
Structure, lexis, and time perspective 185

ii. Tell the story as clearly as possible and in the order that the film is presented.
iii. Please narrate the story from a 3rd person view point. Instead of using “I”, please
use “Shaun”, “Bitzer” for example, as the name of the main sheep. (A card of the
main sheep characters with their names is provided).
iv. Please use the present tense. Here are some examples:
  Shaun enters the room.
  He wants to call his friends.
chapter 7

Structure and processing condition


in video-based narrative retelling

Peter Skehan & Sabrina Shum


St. Mary’s University, Twickenham / Chinese University of Hong Kong

This chapter reports on a study of video-based narrative retellings, in which the


major variables are degree of structure and the nature of the processing conditions
under which the retellings were done. The two variables were manipulated in a 4 × 4
design. Four Mr. Bean video clips were used, with different levels of structure, ranging
from no structure to a clear, well organised problem-solution structure. In addition
to a control group, there were two online processing conditions (opportunity to
pause, and provision of a summary before the task), and one offline Watch-then-Tell
condition. The results of the study show that two of the online conditions had some
mitigating influence, that is, the opportunity to pause the video, and the provision of
a summary before the video was seen. More structured narratives and less pressured
processing conditions produced more accurate and more complex performances.
The same influences lead to less end-of-clause pausing but more reformulations.
The results are discussed in terms of the Levelt model of speaking, applied to second
language performance.

Introduction

In some earlier second language task-based research, Skehan and Foster (1997, and
see also Foster & Skehan 1996) proposed that tasks which contain structure are associ-
ated with more accurate performance. They made this inference, post-hoc, after ret-
rospectively analysing tasks which were found to contain structure and elicit higher
accuracy in performance. This inference led to the design of a new study (Skehan &
Foster 1999), in which task structure was varied more systematically. In the earlier
studies, the tasks were either personal information exchange tasks or narrative retell-
ings based on a set of cartoons. In Skehan and Foster (1999), the stimulus material
consisted of two Mr. Bean videos, which differed in the structure of the story that was
shown. In one, ‘Mr. Bean plays Crazy Golf ’, after a ‘conventional’ beginning, Mr. Bean
hits the golf ball outside the course, and slavishly following an admonition not to
188 Peter Skehan & Sabrina Shum

touch the ball under any circumstances, endures a series of chaotic adventures which
have no development or connection, until he finally completes the course. In con-
trast, ‘Mr. Bean goes to a restaurant’ follows a familiar ‘schema’ (the restaurant script)
in which unpredictable things happen, but against the structure of a familiar set of
events, that is, dining out in a fancy restaurant. The results in this study partly followed
the predictions, but not wholly. There was an increase in accuracy, but not as consis-
tently as was predicted.
Two possible interpretations of this study presented themselves. The first is that
video-based retellings are, for some reason, not so supportive of demonstrating exper-
imental effects of structure. A second possibility is that the concept of structure should
be more carefully analysed than had been done for the Skehan and Foster (1999)
study. Accordingly, Tavakoli and Skehan (2005) analysed structure more subtly. They
­suggested a number of ‘levels’ of structure. These were:

–– no structure: an unrelated series of events


–– a story which has a clear beginning, middle and end
–– a story which has a familiar script, e.g. a restaurant script
–– a story which has clear causal links to drive development
–– a story which has a problem-solution structure (and therefore contains causal
links, but within a tighter and larger structure)

It was reasoned that there is a scale of structure in these different forms of story, and
that the degree of looseness is reduced as one works through the ‘scale’.1 In other
words, the second and third steps in the scale have a certain arbitrariness, but con-
ventions dictate how the story will develop, or at least the framework within which
it is told. The fourth and fifth steps, though, have a more logical, story-coherent pro-
gression, and therefore can be considered to be tighter. They derive from discourse
analysis work, e.g. that of the Winter-Hoey analysis of problem-solution structures
(Winter 1976; Hoey 1983), and reflect the way a story develops through a problem
arising from a situation, followed by a solution (or solutions) and then perhaps an
evaluation of the entire story.
Tavakoli and Skehan (2005) designed a study to explore the relevance of the scale
(omitting the third step, since it had been included in Skehan & Foster 1999). The study
used cartoon picture series, designed to represent the other four steps. The results were
partly consistent with the predictions. A scale with four distinct steps of structure
did not emerge clearly, but it was evident that ‘discourse’ structure (i.e. the final two

.  Tavakoli and Skehan (2005) proposed, for cartoon picture series, that this ‘looseness’ can be
operationalised by the number of pictures in the series, other than the first or last, whose order can
be changed without impairing the capacity to tell the story.
Structure and processing condition in video-based narrative retelling  189

steps) did lead to greater accuracy, with or without planning, and at both proficiency
levels included. So there was something of a split between no structure and beginning-
middle-end organisation, on the one hand, and a causal (and problem-solution) struc-
ture, on the other. While the performance under the beginning-middle-end condition
was a little disappointing, more importantly, the notion of tight structure did survive.
Another aspect of the results is interesting. In one of the structured tasks (with a loose
problem-solution structure), there was also an increase in structural complexity. In
this particular narrative, to tell the story effectively, background and foreground infor-
mation in various cartoon pictures had to be integrated. This was necessary in only
one of the four narratives used, and it was associated with the greater degree of subor-
dination in the stories used, suggesting that the details of the story structure can raise
complexity in addition to accuracy. These factors also functioned similarly in Foster
and Tavakoli (2009) and Tavakoli and Foster (2008). These researchers report on a
study which included additional variables. Using cartoon picture series as in Tavakoli
and Skehan (2005), they included the variables of information organisation, native
versus non-native speakerness, and foreign language vs. second language contexts as
independent variables. For our current purposes, it suffices to say that these studies
confirmed the importance of structure as leading to increased accuracy in perfor-
mance, and of information organisation as raising complexity.
Naturally, this raises the question as to why more structured narrative retellings
lead to increased accuracy. Skehan (2009a) draws on Levelt’s (1989, 1999) model of
first language speaking to account for this finding. Levelt distinguishes three broad
stages in speech production: Conceptualisation (where ideas are developed), Formu-
lation (where ideas are transformed into language), and Articulation (where speech
is actually produced). In turn, the Formulation stage consists of a lemma retrieval
stage, followed by a morpho-syntax building stage which is contingent on the preced-
ing lemma-retrieval sub-stage. The model is consistent with much evidence on speech
errors, pausing and hesitation phenomena, and slips of the tongue. The model has also
been widely applied to second language speech (de Bot 1992; Kormos 2006). Draw-
ing on this analysis, Skehan (2009a) (and see also Wang & Skehan this volume, and
Skehan, Chapter 8, this volume), argues that structured tasks provide a clearer macro-
structure for the story retelling. In this way, such tasks first circumscribe what needs
to be said (less demanding Conceptualisation). Next, Skehan (2009a) proposes that in
second language speaking, the basis for more accurate speech comes from the Formu-
lation stage, and that structured tasks allow the speaker to draw upon the clearer mac-
rostructure to devote more attention to the Formulator stage and, as a result,have more
attention for lemma retrieval (solving problems of retrieval, enabling more complete
lemma information) and also devote more attention to syntax building and monitoring
of performance. All this implies a view of attention and working memory as limited. In
other words, factors which ease the speech production task (e.g. structured tasks and
190 Peter Skehan & Sabrina Shum

clearer macrostructure, which reduce the need for demanding Conceptualiser opera-
tions) release more attention which can be devoted to other speech production stages.
Reflecting on this literature, however, it seems that clearer effects for structure
have been found with cartoon story retellings, compared to video-based narratives.
However, the more sophisticated views of structure have largely been confined to such
cartoon retellings. This raises the question as to what would happen with video-based
retellings based on more theoretically defensible characterisations of structure. This is
more than a passing question. Video-based retellings are more demanding in process-
ing terms. As the video is running, the speaker is exposed to a considerable amount of
input, which has to be understood and then repackaged as production. In a theoretical
model based on limited attention capacity, anything which eases processing problems
would be particularly welcome to speakers having to wrestle with the demands on
their attentional resources as part of a video retelling. Accordingly, one aspect of the
present research is to explore whether more fine-grained task features related to struc-
ture will still have an impact even under more demanding processing conditions.
It is also worth discussing the results related to complexity reported in Tavakoli
and Skehan (2005). In this case, the task contained information which, if the story
was to be told well, required the speaker to link different bits of information, and
this seemed to push the speaker to use more subordination. In Tavakoli and Skehan
(2005), the interpretation of results was in terms of information organisation in that
foreground and background information had to be integrated in order to tell the story
effectively. But problem-solution structures themselves require different propositions
to be linked, and their causal connections to be clarified. So, a problem-solution struc-
ture may have multiple effects – the easing of processing through clear macrostruc-
ture leading to greater accuracy, and the push through the structure itself to express
relationships between elements more explicitly, thereby fostering subordination, and
raising measures of complexity based on this.
The previous discussion has concerned the nature of the tasks to be done. But it
is also worth exploring how differences in conditions can impact upon performance.
Once again, here, the starting point is the viewpoint that attentional resources are
limited, and so the conditions under which a task (e.g. a narrative retelling) is done
can be explored in terms of the attentional demands that they make. The most obvi-
ous contrast here is between what Robinson (2011) has termed ‘Here and now’, and
‘There and then’. In the former, the stimulus material is present and can be used while
the task is running. In the latter, the stimulus material is absent, but has been seen, and
so the task is to speak without the input material available. Robinson (2001) uses this
analysis of time perspective to make some challenging predictions about the nature
of performance. Essentially, he characterises the Here-and-now condition as simpler,
and the There-and-then condition as more complex. Then he proposes that the more
complex condition will lead to better performance, and specifically raise accuracy and
Structure and processing condition in video-based narrative retelling  191

complexity. This follows the Cognition Hypothesis claim that greater task complexity
pushes towards higher performance in particular areas (Robinson 2011). However,
most studies motivated by the Cognition Hypothesis have used static visual materials.
Most studies which explore this contrast in time perspective use tasks such as giving
map instructions, where the stimulus material does not change, even though it can
vary in degree of complexity.
The question is raised, then, as to what would be the influence of using video-
based presentations: in this case, the Here-and-now condition is one where the input
material is available and the task is to tell the story in a way which is appropriate
to what is happening on screen. The There-and-then condition would be one where
the video has been seen, and immediately afterwards, the speaker has to retell the
story. All this introduces a new set of psycholinguistic demands, especially concerned
with time pressure. Skehan (2009a) argues that, in this case, there is a genre difference
in time perspective and that the There-and-then condition is simply different (rather
than more complex) than the Here-and-now condition. In other words, although
memory demands are greater under the There-and-then condition, the opportunities
for shaping the task and repackaging what one wants to say are much greater than in
the Here-and-now condition.
Basically, the driving force for the comparison at issue is the impact of time
­pressure. This raises the possibility of retaining the time pressure dimension of Here-
and-now but trying to attenuate it in some way. Two such methods can be proposed
here. The first directly addresses the issue of time pressure itself. Ellis (2005) and Ellis
and Yuan (2004) have proposed the construct of on-line planning to capture what
­happens when speakers, who might otherwise be pressured by time, are able to operate
in less demanding time conditions, and so plan and regroup ‘on the fly’ (i.e. as they are
speaking). In other words, rather than using strategic or pre-task planning, they are
able to use planning-while-speaking. Ellis (2005) argues that such on-line ­planning is
associated with greater accuracy in performance. Wang (this volume) draws attention
to some research design concerns regarding this original research, which she addresses
in her own research by slowing down the videos to be retold (and so standardising the
conditions under which the online planning opportunities are created). But this is not
the only way to provide opportunities for on-line planning, especially as far as video-
based narratives are concerned.
The present study incorporates a different method of supporting preparedness
and opportunity for online planning. Participants can simply be given the power to
stop the video whenever they choose, so that they can compose themselves, ‘clear the
decks’ as it were, and prepare for what they are about to say. In this way they could, at
any point of difficulty, free themselves from the remorseless pressure of synchronising
the development of ideas and their generation of actual speech. While one cannot be
sure what learners will do while the video is paused, the fact that they can pause the
192 Peter Skehan & Sabrina Shum

video at will means that they only need to have a fairly limited ambition for what they
hope to achieve from their current pause since they know they can pause again soon.
It is likely, in other words, that they can focus on accuracy.
A contrasting approach to assisting learners while a task is running (and which is
different from strategic planning) is to give them an overview of what the video will
consist of. In other words, they can be provided with the outline of events, and thereby
be given a macrostructure. In this way, what subsequently happens may contain sur-
prises at the level of detail, but not in terms of the general things which will happen
while the video is running. As a result, they are being provided with a structure within
which they can operate. One would predict in these circumstances that knowledge
of this overall structure would assist learners and enable them to use the Formulator
stage more effectively, and so achieve greater levels of accuracy and lexical retrieval,
the aspects of speech Levelt associates with this stage.
Next, we focus on the nature of performance itself, and how it can be measured, a
concern that has permeated all chapters in this book. Most studies have used general
measures, although there are also approaches, such as Crookes (1989) and Robinson
et al. (2009), which use more specific measures. The general measures have shown some
development over the last two decades. Skehan (2009b) discusses how fluency mea-
sures have changed, and how they relate to different aspects of fluency (breakdown flu-
ency, repair fluency, speed). He also discusses pause location as particularly important
for second language speakers, addressing Segalowitz’s (2010) proposal that measures
which distinguish effectively between native and non-native speakers are particularly
useful Skehan (2009b). Regarding complexity, Norris and Ortega (2009) propose that
the commonest measure in task-based research, the use of some sort of subordina-
tion index, is not ideal and that it does not reflect improvement at higher proficiency
ranges, where complexification may occur through other processes, such as lengthen-
ing of nominal phrases (indeed, research suggests that subordination does not reflect
changes in the complexity of texts among higher proficiency learners, where other mea-
sures do). They propose that researchers should also use a measure based on number
of words per clause, which would reveal such finer-grained distinctions (and they also
suggest using larger-scale measures such as mean length of utterance or T-Unit, which
captures complexity more holistically). In this way, different aspects of c­ omplexity can
be captured. At the very least, the use of additional measures seems worth exploring,
alongside the more conventional measure of subordination per speech unit (Foster,
Tonkyn & Wigglesworth 2000; and also see discussion in Chapter 1).
The remaining area which is consistently measured in task performance is that
of accuracy. The ‘standard’ general measure has been to compute the percentage of
error free clauses. But there are alternatives. Gilabert (2007), for example, uses refor-
mulations as a measure of accuracy. Mehnert (1998) used a measure of errors per 100
words, arguing that this was more appropriate for German, the language used by her
Structure and processing condition in video-based narrative retelling  193

participants. In addition, Skehan and Foster (2005), who were concerned that mea-
sures of the proportion of error-free clauses might be inflated if a speaker used lots of
short clauses correctly, proposed a measure based on the length of clause that can be
accurately handled. In this measure, all clauses from a speaker are ranked for length,
and then accuracy is established for all clauses of particular lengths. Then the greatest
clause length that meets a criterion of accuracy (generally when 70% of the occur-
rences of that length of clause are error free) is taken as the measure of accuracy. This
measure does not correlate with complexity and so is not a confounded measure of
that construct. Instead, Skehan and Foster (2005) propose it as a more valid measure
of this aspect of performance.
Whichever of these measures is used, however, error-free clauses or errors per
100 words or clause length accuracy, they do not take error gravity into account in
any way. There are two reasons for building in some notion of error gravity to the
coding of second language performance. First, it may be that error scores are mislead-
ing if they reflect many but superficial errors. In other words, if one speaker produces
a large number of such errors, but few serious errors, but another speaker produces
the same overall error-free clause score based on a much higher proportion of serious
errors, a misleading index of accuracy is being created. Accordingly, separating error
scores as a function of gravity becomes desirable for reasons of validity. But second,
there is the more pragmatic goal of discrimination. Even if the general ratio of serious
to superficial errors is relatively constant across speakers, there is the problem that
lower-level students may achieve quite low scores if any error in a clause causes that
clause to be deemed incorrect. As a result, potential discrimination between speakers
may be lost.
For both these reasons, therefore, it may be desirable to code transcripts not sim-
ply for error, but also for error gravity. The clearest advocates of this procedure are
Foster and Wigglesworth (2010), who suggest that it is appropriate to separate three
levels of error gravity – low level, medium level, and high level, and that these three
levels should be defined in terms of the extent to which communication is impaired.
If an error does not really make the extraction of meaning difficult, they propose that
the error should be regarded as minor. On the other hand, if meaning cannot or can
hardly be extracted, then the error should be regarded as serious. Between these, a
level of error is one where meaning can be retrieved, but with some effort, and they
propose that these are best regarded as intermediate errors. Their system was used in
the present study, and so for all candidates we have two types of error score (error-free
clauses, length of clause error) with each of these represented at two difficulty levels
(since scrutiny of the data suggested that the intermediate and serious errors should
be combined, in that there were relatively few serious errors).
Drawing on the previous discussion, we can formulate a number of research ques-
tions, and associated hypotheses for the present study.
194 Peter Skehan & Sabrina Shum

Research Question One: In the context of video based presentation, what will be the
influence of varying the degree of structure in narrative retellings? This leads to:
Hypothesis One: Greater structure in the video-based narratives will lead to greater
accuracy in performance.
Hypothesis Two: Greater structure in the video-based narratives will lead to greater
complexity in performance.
Research Question Two: What will be the effects of varying and attenuating the time
pressure while narratives are being told? This leads to a series of sub-hypotheses:
Hypothesis Three (A): Unmediated narration while a video is running will lead to the
lowest levels of accuracy and complexity.
Hypothesis Three (B): Mediated narration while a video is running will raise
­accuracy, but it is an open question whether this will be higher for the condition
providing the opportunity to pause, or the condition giving provision of a summary
(“pre-narration”).
Hypothesis Three (C): There-and-then narration will lead to higher levels of accuracy,
complexity, and fluency.

Method

The present study used a series of Mr. Bean video-based narratives, which participants
then had to narrate, under various conditions.

Materials
A wide range of excerpts from the Mr. Bean television series were examined, and after
trialling, four were selected to capture different degrees of structure. The original nar-
ratives were video-edited to reduce their length so that they ran for some 5–7 minutes.
The four narratives were:

–– Mr. Bean plays Crazy Golf: In this story, Mr. Bean plays a round of Crazy Golf. The
attendant instructs him that he shouldn’t touch the golf ball under any circum-
stances. He then accidentally knocks the golf ball out of the Crazy Golf area, even
outside the park it is situated in. A series of unconnected misadventures result,
which culminate in Bean arriving back at the golf course after dusk, to finally
complete his round. (This video was used in Skehan & Foster 1999.)
–– Mr. Bean at Christmas: In this story, Mr. Bean meets his girlfriend on Christmas
Eve. In the window of a jewellery store, she sees a ring she would like. Afterwards
he goes home and prepares for Christmas rather eccentrically. Mr. Bean wakes up
on Christmas Day, receives the present he sent himself, and then prepares dinner.
Structure and processing condition in video-based narrative retelling  195

His girlfriend arrives, gives him a nice present, and he, having misunderstood
her interest in the ring they looked at on Christmas Eve, gives her a picture and a
hook, both of which he also saw in the window of the jewellery store.
–– Mr. Bean visits the Funfair: On a trip to a funfair, Mr. Bean’s car accidentally gets
hooked to a pram, containing a baby. He takes the baby with him to the funfair,
but still wants to have fun. So he ‘parks’ the baby in a rocking car, putting in lots
of money. He then tries out various rides in the funfair, before coming back to
find the baby who is still crying. He buys some (helium filled) balloons to amuse
the baby, but they carry the baby up into the sky. He responds by using a bow and
arrow to burst the balloons, causing the pram to sink to earth, as it happens right
next to the baby’s mother.
–– Mr. Bean catches a thief: Mr. Bean visits a park and want to take a photo of himself
with a statue. He fails, and recruits a passer-by who deceives him and steals his
camera. Mr. Bean then searches for the thief, finds him, and puts a rubbish bin
over his head to immobilise him, and jabs the man with a pencil, causing the man
to shout in pain. He fetches a policewoman but the immobilised thief has run
away. Later, he goes to a police station where suspects, including the actual thief,
have been rounded up. In an identity parade he fails to recognise the thief visually,
but then gets the police to put a rubbish bin on each suspect, and jabs each, finally
recognising the thief from his squeals.

The first of these videos was unstructured, but the remaining three were structured, to
different degrees. The Christmas story has a beginning, a middle and an end, but there
is no strong causal structure. The story concerns the relationships between two people,
and how these play out against the backcloth of Christmas conventions. The other two
stories, though, have causal links, and in each case, there is a problem which is eventu-
ally solved. However, in the Funfair story, there are random diversions, such as when
Mr. Bean goes on the roller coaster, or plays darts, before the thread of the kidnapped
baby is resumed. In the Thief story, in contrast, there are no diversions – everything is
concerned with the theft or the catching of the thief.
Materials were also involved in one of the processing conditions – Summary.
Under the Summary condition, participants were provided with a brief summary of
the main events in the story. A typical summary is given below:
Funfair: In his car, Mr. Bean goes to a funfair, on his own. By accident, when he
arrives he takes a baby in its pram away from its mother. He then thinks that the
best thing will be to try to look after the baby at the same time as he is having fun
in the funfair. So when he is going on the different rides and doing different things
in the funfair, he has to think of ways of looking after the baby. In the end, and
with a lot of luck, he is able to return the baby to its very worried mother, again by
accident.

Each of the summaries was just over 100 words.


196 Peter Skehan & Sabrina Shum

Research design
The present study has two factors, and each of the factors has four values. The study
uses four narrative tasks each chosen to exemplify a particular form of structure, as
indicated in the Materials section. These were (a) no structure, (b) a clear beginning-
middle-end structure, (c) loose problem-solution structure, (d) tight problem-solution
structure. Structure was a within-subject variable, in that all participants completed
all of the tasks, although in counterbalanced order. The second factor is processing
­condition, and this is a between-subjects variable. The four conditions were: Watch-
and-Tell; Pausing; Summary; and Watch-then-Tell. In Watch-and-Tell participants
viewed the video and were required simultaneously to tell the story that they were
watching. In the Pausing condition, they were provided with the video control which
enabled them to pause the video whenever they wanted. Otherwise they had to tell the
story as the video was running. In the Summary condition, participants had to view
the video and simultaneously tell the story, as in Watch-and-Tell, but prior to viewing
the video they were provided with a summary of the story (as shown above), and given
as much time as they needed to read and understand this version, which was presented
in English. Finally, in the Watch-then-Tell condition, participants viewed the video,
but were not allowed to make notes. Then they had to recount what they had seen in
the video.

Procedure: Interacting with students


One-on-one interviews were arranged to collect speech samples from the partici-
pants. First, a member of the research team explained to the participant what was to
be done (watch-and-tell, watch-then-tell, watch-and-tell with summary preview, or
watch-and-tell with pausing). The Mr. Bean videos were shown on a computer screen.
The participant, wearing a headset with a microphone which did the recording, then
­followed the instructions which had been given. As an additional means of recording,
whenever a participant gave his/her consent, a video recording of the procedure was
also made.

Data processing
Each narrative video retelling was recorded onto an MP3 player, generating a sound
file which typically lasted three or four minutes. Subsequently the sound file was
­transferred to computer, and then transcribed, broadly, using Soundscriber. Next,
the transcription was put into modified CHAT format (MacWhinney 2000), with
­appropriate headers and formatting. Each AS turn was represented in four lines. The
first was the CHAT line, and simply followed CHAT conventions. The second line
eventually became the part-of-speech coded line, using the Mor and Post subroutines
Structure and processing condition in video-based narrative retelling  197

from within CLAN.2 The third line contained timing information, in milliseconds,
regarding the start and finish times of the AS turn. The fourth line was a repeat of the
transcript from the CHAT (first) line, but was coded according to TaskProfile con-
ventions. The fourth line was processed by the computer software written by the first
author to analyse coded second language task performance. This line contained all
codings for clause boundaries, for error (including error gravity), for repair fluency,
for filled pauses, and for silence-based pausing.

Participants
The speech samples of 28 non-native speakers of English (NNSs) were included in this
study.
These were all second-year university students, who, at the time of the data col-
lection, were studying in South China University of Technology (SCUT), Guangzhou,
China, They were chosen following teacher recommendation that these students were
likely to accomplish the story-telling task. There were a few cases in which the student
had difficulty with the task and failed to produce a satisfactory quantity of speech.
These data were not included in any analysis. The participants all came from main-
land China, with L1s of Cantonese and Mandarin Chinese, and ranged in age from
nineteen to twenty-two, with a mean age of twenty-one. Fifteen were female and thir-
teen were male. Their proficiency, based on their College English Test scores, was low
intermediate.

Measures
The dependent variables in the present study were of fluency, accuracy, and complex-
ity. Fluency was measured with two indices. Previous research (Skehan & Foster 1997;
Tavakoli & Skehan 2005) has indicated a distinction within fluency between measures
based on pausing (i.e. unfilled pauses) and measures based on some sort of inter-
ruption to the message being expressed (e.g. reformulation). These have been termed
breakdown and repair fluency, respectively (Skehan 2001). In this study, breakdown
fluency was measured through the number of AS-boundary, and mid-clause pauses,
each standardised per 100 words. A pause was defined as an interruption to the speech
flow of more than 40 milliseconds. Skehan and Foster (2008) show that these mea-
sures are appropriate ones to capture breakdown fluency for non-native speakers.

.  These subroutines implement a part-of-speech tagger to the CHAT line, and accomplish this
in two stages. The Mor subroutine makes initial tagging judgements, but flags cases of ambiguity,
where more than one part-of-speech is possible. The Post subroutine then addresses these cases of
ambiguity, generating the final, part-of-speech tagged line.
198 Peter Skehan & Sabrina Shum

­ eformulations, as a measure of repair fluency, were based on the number of times


R
that a participant changed the nature of their utterance in a manner that was syntactic
or morphological (reformulation). This measure, too, was standardised per 100 words.
(See Wang & Skehan this volume, for more extensive description.)
The first measure of complexity used was calculated by dividing the data into syn-
tactic clauses and AS-units (Foster et al. 2000) and expressed as the ratio of clauses
to AS-units. In other words, the more clauses per AS-unit, the higher the complex-
ity score. An AS-unit is minimally defined as a single speaker’s utterance consisting
of either an independent clause, or sub-clausal unit, together with any subordinate
clause(s) associated with either. The second complexity measure, drawing on the work
of Norris and Ortega (2009), was of the number of words per clause. It was reasoned
that this reflects (different from the subordination measure) the extent of internal
complexity within clauses.
Given the exploratory nature of the measures of accuracy, two different ­measures
were used, with each being calculated in two ways. The first accuracy index, widely
used in the task performance area, was the proportion of clauses which were error-
free (Foster & Skehan 1996). However, additional measures were used to relate accu-
racy to the length of clause which could be handled without error (see Skehan &
Foster 2005, for additional discussion of this measure). Clauses were categorised
for length in words, and then the accuracy level for clauses of different lengths was
established, for example, three word clauses, four word clauses, five word clauses,
etc. ­Previous research (Skehan & Foster 2005) has shown that an accuracy criterion
of 70% (i.e. that 70% or more of clauses of that length are accurate) is both demand-
ing and discriminating. Accordingly, this criterion will be used here. In this way, a
measure of accuracy is available which avoids the possibility that a participant can
obtain a high score which is inflated because it is disproportionately influenced by
error free clauses that are quite short in length, for example, ‘I know’. Both measures
were calculated first by including all errors, however small, but each measure was also
calculated counting as error only those which to some degree impaired communica-
tion. Ten per cent of the sample was double coded, and all measures produced more
than 90% agreement.

Analyses
There were two independent variables in this study, structure (with four values – a
within-subject variable), and processing condition (a between-subjects variable – again
with four values). In addition, there were six dependent variables (two measures of
complexity, two of accuracy, and two of fluency). In addition to the calculation of basic
descriptive statistics, the central analysis used in this study was a repeated m
­ easures
multivariate analysis of variance, followed by appropriate univariate tests. Effect sizes
are also provided.
Structure and processing condition in video-based narrative retelling  199

Results

To gain a general picture of the results which were obtained, Table 1 shows the descrip-
tive statistics for each combination of the four tasks and the four processing conditions.
Standard deviations are given in parentheses. The dependent measures included are
two of complexity (Clauses per AS-unit, and number of words per AS-unit (ASComp
and WdsCom respectively)); two of accuracy (the proportion of error-free clauses and
the greatest length of clause, in words, that could be handled accurately at the 70%
level (EFC and LenAcc respectively)); and two of fluency (the number of pauses at the
end of a clause, standardised to 100 words, and the number of reformulations per 100
words (EoCPaus and Reform respectively)).
Given the two-dimensional nature of this research design, with a mixture of
between (processing condition) and within (task) factors, as well as the use of six
dependent variables, the data were subjected to a repeated measures multivariate

Table 1.  Descriptive statistics


Golf (N = 28) ASComp WdsClause EFC LenAcc EoCPaus Reform

W+tell 1.27 5.84 0.66 3.43 8.74 2.75


(N = 7) (0.14) (1.11) (0.05) (2.57) (1.63) (1.30)
Pause 1.31 6.20 0.68 3 7.24 1.77
(N = 7) (0.18) (0.56) (0.10) (4.04) (2.59) (1.06)
Summary 1.29 6.37 0.73 3.14 8.66 2.82
(N = 7) (0.09) (1.76) (0.06) (2.79) (2.52) (2.11)
WthenTell 1.33 7.68 0.77 6.29 5.71 5.53
(N = 7) (0.12) (1.71) (0.07) (3.04) (1.54) (2.52)
Mean 1.3 6.53 0.71 3.96 7.59 3.17
(0.13) (1.48) (0.08) (3.28) (2.37) (2.20)

Funfair (N = 28) ASComp WdsClause EFC LenAcc EoCPaus Reform

W+tell 1.31 5.33 0.80 6.43 9.24 5.40


(N = 7) (0.05) (0.40) (.08) (2.87) (1.14) (2.95)
Pause 1.40 5.76 0.80 6.29 7.67 2.83
(N = 7) (0.16) (0.50) (.06) (2.92) (3.54) (1.16)
Summary 1.36 5.46 0.85 7.29 8.65 4.20
(N = 7) (0.11) (0.80) (.08) (1.98) (2.49) (2.71)
WthenTell 1.41 5.98 0.81 7.71 5.56 6.71
(N = 7) (0.14) (0.44) (.06) (3.45) (2.56) (3.15)
Mean 1.37 5.64 0.81 6.93 7.78 4.79
(0.12) (0.58) (.07) (2.76) (2.82) (2.87)
(Continued)
200 Peter Skehan & Sabrina Shum

Table 1.  Descriptive statistics (Continued)


Christmas ASComp WdsClause EFC LenAcc EoCPaus Reform
(N = 28)

W+tell 1.28 5.30 0.72 4.00 9.65 3.13


(N = 7) (0.06) (0.49) (0.21) (3.65) (1.00) (1.86)
Pause 1.30 5.57 0.73 4.57 8.14 3.39
(N = 7) (0.16) (0.29) (0.08) (3.55) (3.20) (1.62)
Summary 1.24 5.45 0.81 7.14 10.28 2.97
(N = 7) (0.07)6 (0.29) (.06) (1.57) (2.96) (1.81)
WthenTell 1.40 5.85 0.8 7.43 5.45 5.47
(N = 7) (0.13) (0.28) (0.03) (1.62) (1.84) (2.39)
Mean 1.31 5.54 0.77 5.79 8.38 3.74
(0.13) (0.39) (0.28) (3.05) (2.97) (2.10)

Thief (N = 28) ASComp WdsClause EFC LenAcc EoCPaus Reform

W+tell 1.58 5.06 0.82 6 6.62 4.33


(N = 7) (0.12) (0.30) (0.06) (2.52) (1.89) (1.78)
Pause 1.49 5.44 0.77 5.43 6.23 2.12
(N = 7) (0.17) (0.54) (0.09) (3.41) (2.80) (0.77)
Summary 1.45 5.30 0.86 7.14 7.71 3.08
(N = 7) (0.11) (0.51) (0.06) (3.39) (3.02) (2.17)
WthenTell 1.61 5.71 0.85 7.43 3.60 6.35
(N = 7) (0.10) (0.39) (0.07) (3.15) (1.69) (3.20)
Mean 1.53 5.38 0.83 6.5 6.04 \3.97
(0.14) (0.48) (0.08) (3.07) (2.75) (2.60)
For each cell in this table, N = 7, so that N = 28 for each task, across processing conditions

analysis of variance. The data showed significance at the.001 level for processing con-
dition (Pillai’s trace = .999; F = 4.56; d.f. = 6), and at .001 for task structure (Pillai’s
trace = .944; F = 9.29; d.f. = 18). There were no significant interactions.
Moving on to the univariate tests, all tests for task structure were significant, as
shown in Table 2, and all of them generated effect sizes which were large.
The clearest pattern here is for accuracy. Error-free clauses generates an extremely
clear trend, in the order Golf < Christmas < Funfair < Thief, with values of 0.71, 0.77,
0.81, 0.83, with all values significantly different from the others. Length Accuracy 70%
is close to this, with values of 3.96, 5.79, 6.93 and 6.5 respectively, with Golf signifi-
cantly lower than Christmas, and then both of these significantly different from the
remaining two tasks, with the latter not differing from one another. In other words,
there seems to be a clear relationship between structure of task and accuracy of per-
formance, especially as this relates to the two tasks which contain some degree of
­Problem-Solution structure, a comparable result to Tavakoli and Skehan (2005).
Structure and processing condition in video-based narrative retelling  201

Table 2.  Univariate tests for task structure and associated effect sizes
Measure F df Significance Effect size
partial Eta squared

AS Complexity 38.4 3 .001 0.59


Words per clause 12.97 3 .001 0.32
Error Free Clauses (proportion) 15.95 3 .001 0.37
Length Accuracy 70% 7.36 3 .001 0.21
End of Clauses Pauses per 100 83.2 3 .001 0.41
Reformulations per 100 words 37.8 3 .001 0.23

The pattern for complexity is reasonably clear, but with one slightly anomalous
result. Regarding AS Complexity, the most widely used measure in the literature, the
results are broadly similar to accuracy. Golf and Christmas, the least structured nar-
ratives, do not differ from one another but they both differ from Funfair which itself
differs from the most structured task, Thief, with the respective values being 1.30, 1.31,
1.37 and 1.53. The pattern with words per clause contrasts with these results. The high-
est score, 6.53, is with the unstructured Golf task, whereas the other three tasks have
lower scores (Christmas, 5.54; Funfair, 5.64; and Thief, 5.71), and these do not differ
from one another. Structure, in other words, is associated with more subordination,
but shorter clauses. So, while there is clearly a trend towards a relationship between
complexity and structure, there are also some ways in which this trend is looser than
that for accuracy, and the results suggest that the two measures of complexity reflect
different facets of this construct, as Norris and Ortega (2009) argue.
The two fluency measures present a mixed picture. Reformulation is clearer, in
that Golf is significantly different to Christmas and both are significantly different to
the other two tasks, which themselves do not differ, with values of 3.17 (Golf) < 3.74
(Christmas) < 4.79 (Funfair) and 3.97 (Thief). In other words, the more structured
the task, the more reformulation there is, which is an intriguing result. The results for
End-of-Clause pausing present an unclear pattern. Here Funfair and Christmas, the
intermediate structured tasks, generate the highest values, which do not differ from one
another, but which do differ from the lower values Golf (unstructured) and Thief (most
structured). These become a set of results which present a challenge for interpretation.
Next, we turn to the between-subjects variable of processing condition. It should
be borne in mind that the cell size for any comparison is only seven, with the result
that the power of the statistical testing is much less than with Task Structure, where
the cell size was twenty-eight. With complexity, the pattern of results suggests that the
two conditions which eased immediate processing, Pause and Watch-then-tell had the
highest scores with both AS Complexity and Words Complexity, with ­Watch-then-tell
producing the highest value in each case (consistent with Wang and Skehan (this
202 Peter Skehan & Sabrina Shum

v­ olume)). Even so, there are no significances for the AS measure, with means of 1.36
(Watch-and-tell), 1.38 (Pause), 1.34 (Summary), and 1.44 (Watch-then-tell). There
are significant comparisons, though, with Words per Clause Complexity, between
Watch-and-tell (7.06) and Summary (7.20) versus Watch-then-tell (8.80). Watch-and-
tell and Summary, on the one hand, and Pause and Watch-then-tell do not differ. In
other words, it appears as though less pressured conditions, broadly, are supportive of
greater complexity in spoken performance, but that this relationship is not particularly
strong. (Once again, a result consistent with Wang & Skehan this volume).
There is a loose pattern also with accuracy. With the Error-free Clauses measure,
Watch-and-tell (0.75) is significantly different to Summary (0.83), and Pause (0.74)
contrasts with Summary and Watch-then-tell (0.81). Regarding Length, Accuracy
70%, Watch-and-tell (4.96) and Pause (4.82) are significantly lower than Watch-then-
tell (7.2). Summary, at 6.5, occupying a sort of middle ground, does not contrast
­significantly with any of the other groups. It appears that the Watch-then-tell and to
a lesser extent, Summary, support a focus on accuracy while language is being pro-
duced, although again, the relationship is not strong.
The two fluency measures generate exactly the same significant contrasts, but with
interestingly different directions. Essentially Watch-then-tell contrasts with all other
conditions, but the other conditions do not differ from one another. This is shown
most clearly in Table 3.

Table 3.  Significant contrasts with fluency measures


End of clause pauses Reformulations
per 100 per 100 words

Watch-and-tell 8.57 3.9


Pause 7.32 2.53
Summary 8.27 2.76
Watch-then-tell 5.08 5.96
Itacalised values differ from all other conditions. Other conditions do
not differ significantly

Clearly the There-and-then condition, operationalised as Watch-and-tell, is the


decisive influence here. It leads to significantly fewer pauses per 100 words, suggesting
that under this condition, second language speakers are more able to ‘control’ where
they need to pause, rather than having to regroup through the demands of the pro-
cessing conditions. But in contrast, they reformulate more. In other words, they are
engaged, mid-clause, with finding ways of expressing what they are saying in different
ways. This, possibly, reflects a greater on-line engagement with the content of their
speech (Skehan & Foster 2005).
Structure and processing condition in video-based narrative retelling  203

Discussion

We can start this section by restating the main results which were found.

–– Degree of structure, broadly, leads to greater accuracy.


–– Degree of structure also has a relationship with complexity, more clearly with the
measure of subordination, but this relationship is weaker than with accuracy.
–– Structure is associated with more reformulation and repetition.
–– Structure is associated with fewer end-of-clause pauses.
–– The Summary and Watch-then-Tell conditions lead to higher accuracy than the
Watch-and-Tell and Pause conditions.
–– Watch-then-Tell leads to higher levels of complexity than the other conditions.
–– Watch-then-Tell leads to higher levels of reformulation and fewer end-of-clause
pauses.

The first research question, and the associated hypothesis, concerned the ­relationship
between structure and accuracy. This hypothesis was broadly confirmed. The
­unstructured narrative, Golf, consistently produced the lowest level of accuracy. But
beyond this, although all three more structured narratives produced higher levels of
accuracy, there was something of a split between the two problem-solution narra-
tives (Thief, Funfair) and the more conventional story structure narrative (Christmas)
which ­contained development, but with some arbitrariness. The two problem-solution
narratives produced higher accuracy, with the Christmas video generating accuracy
levels between the unstructured narrative and the two tightest narratives. The ‘scale’
of structure worked very well with the error-free clauses accuracy measure and rea-
sonably well for length-accuracy, although with the latter, there was little difference
between the two problem-solution videos. Obviously, it is interesting that the effect has
been found with video narratives, in addition to what has been reported in ­previous
studies with cartoon picture series. Once again, one can offer the interpretation that
tasks such as Funfair and Thief provide a clearer macrostructure, so that second lan-
guage speakers can organise what they say in terms of this macrostructure, and do not
need so much to work at the highest discourse level while speaking. This, then, enables
them to allocate more attention to the Formulator and focus on the surface, the accu-
racy of what is being said, even under video-based time pressure.
There is also a clear effect of structure on complexity, particularly with the sub-
ordination measure. In this case, the major opposition is between the two problem-­
solution narratives and the two others. The combination of problem-solution structure
and the subordination measure is particularly interesting here. It seems as though
this structure pushes speakers to express connections between elements through
clause relations, pushing up the subordination measure. In contrast, the words-based
204 Peter Skehan & Sabrina Shum

­ easure of complexity is not so sensitive to these task changes, suggesting that the
m
factors which impact upon needing to use more words within clauses are different
from those which raise subordination. Indeed, with the words-based measure, it is the
Golf (unstructured) task which produces higher values than any except Thief. So in
this case, it seems as though specific task design qualities push the speaker to develop
clauses internally.
Turning to fluency, we have an interesting contrast in the two measures which
were used, end-of-clause pauses and reformulations. In the former case, structure
is associated with greater fluency, with fewer pauses, while in the latter, it is associ-
ated with less fluency, since there are more reformulations. The first case is perhaps
clearer and also more consistent with the available literature. It appears that paus-
ing is more controlled when tasks are structured. It seems as if clear macrostructure
and a straightforward and organised set of events to narrate facilitates organisation
of speech units, and a capacity to pause effectively, that is, not at the end-of-clause
points. So, it seems as though, when tasks are structured, the non-native speakers
are more able to use pausing opportunities while maintaining a good flow of speech.
This, perhaps, suggests effective Formulator functioning. But then there are the greater
reformulations to account for, which at first sight seems to tell a different story, since
these r­ epresent interruptions to the speech stream. We believe it is most likely that the
place of reformulation within fluency measures itself is ready for re-analysis. This is
because reformulations can be both negative and positive. In the former case, they are
‘thrust upon’ the speaker as trouble is encountered. However, one can also put a more
positive spin on reformulations. When there is effective overall discourse functioning,
sufficient attention may be available for changes in what is said, within the clause, that
reflect improvements and edits to be more precise in the message being conveyed. It is
possible that this is what is happening here. Structure, then, may be associated with an
effective flow of the discourse, and simultaneously with polishing what is said within
the clause, but without challenging the broader organisational structure of what is
said. If that is the case, then the two fluency measures seem to function as different
sides of the same coin.
Next, we turn to consider the effects of the different conditions under which tasks
were done, and so address the issues raised by Research Question 3 in its various forms.
Regarding accuracy, there is a clear contrast here between the Summary and Watch-
then-Tell conditions, on the one hand, which are associated with greater accuracy, and
the Watch-and-Tell and Pause conditions, which are associated with lower accuracy.
The predictions and the actual outcomes are shown in Table 4.
It was hypothesised that the Watch-and-Tell and Watch-then-Tell conditions
would differ most, which is, in fact, what has happened. The former is an online con-
dition, where the latter is not, and this is the difference that underlay the prediction in
favour of the latter. But the remaining conditions are both online in nature, with the
Structure and processing condition in video-based narrative retelling  205

Table 4.  Predictions and outcomes for task conditions


Predictions Outcomes

Most accurate Most accurate

Watch-then-Tell Watch-then-Tell
Summary: Pause Summary
Watch-and-Tell Pause: Watch-and-Tell

Least accurate Least accurate

need to retell a video which is running. But compared to the Watch-and-Tell condi-
tion, each is mediated to some degree, to ease the processing conditions relative to
the online demands. So the prediction was exploratory here, and it was not predicted
which would lead to higher accuracy, but it was assumed that they would both gener-
ate higher accuracy than the Watch-and-Tell condition.
In the event, the Summary condition has produced higher accuracy, although not
quite as much as the Watch-then-Tell condition, while the Pause condition has not
generated greater accuracy, and is usually around the same level as the Watch-and-
Tell condition. This is slightly surprising, but nonetheless interesting. We can discuss
the Summary condition first. In this respect, it is worth noting that this condition
produced the lowest complexity values (lower than Watch-and-Tell and Pause), and
slightly higher values for breakdown dysfluency. It appears that the Summary condi-
tion functioned so as to organise what was going to be said, without that content being
challenged, with the result that speakers accepted the outline of their narration, and
thereby were helped to focus on the surface and on the detail. The speakers in this
condition seemed to have the confidence to pause at clause boundaries because they
were surer of the overall organisation of what they were going to say.
In contrast, the Pause condition did not seem to confer any particular advantage
for accuracy. Mediation of the online nature of the task by offering the opportunity to
pause the videotape did not lead to any form of assisted online planning, and indeed
for some of the accuracy measures, the Pause condition is associated with the worst
levels of accuracy! However, this condition does lead to the lowest values for reformu-
lation, suggesting that speakers in this condition were using the opportunity to pause
to achieve some gain. But this was not translated into accuracy, which is something of
a disappointment. The only additional point to make here is that this condition was
an optional one. Participants were provided with the opportunity to pause, but they
didn’t have to avail themselves of this possibility. Therefore, the operationalisation of
this condition may need to be rethought in any future research.
Finally, it is particularly interesting that the effects found for structure and for
processing are remarkably similar (and independent, with no interaction effects). Both
206 Peter Skehan & Sabrina Shum

influence accuracy, in broadly similar ways. Both also influence complexity, although
structure has clearer effects with the subordination measure, whereas processing
shows more clearly with the Words per Clause measure. Finally, both have similar
effects on the two fluency measures, bringing about fewer end-of-clause pauses and
more reformulations. In the final section, therefore, we will explore why these patterns
are so similar and what brings structure and processing together.

Conclusions

Narrating a video-based story is a very difficult thing to do, and puts considerable
pressure on a second language speaker. It is the sort of predicament which can be very
revealing about how second language speakers wrestle with communication problems.
The flow of input is considerable, and the time pressure under which it arrives is also
unforgiving. So, anything which mitigates these fundamental influences is of interest
to the psycholinguistics of second language speech production as well, ultimately, to
pedagogy.
What we have seen in this study is that there are indeed options available which
can mitigate these pressures. First and foremost is how structured the narrative task
is. Structure, we have seen, is related to higher accuracy. This, in turn, leads to the
interesting question as to why this should be the case. Three interconnected factors
are proposed here. First, there is the issue that structured tasks circumscribe what is
to be said. In other words, if there is a structure to a task, the degrees of uncertainty
and unpredictability are reduced. What has to be said is more clearly demarcated,
and so the speaker has the task of being work-man-like, and getting the job done, in
the greater certainty of what the job actually is. In other words, blind alleys are less
likely in the discourse. Moreover, to the extent that the structure is a fairly univer-
sal one, such as problem-solution, the assistance is even greater, since the point of
the communication becomes clearer, and the imagined listener becomes more real.
­Second, there is the issue of organisation and framing. If there is a broader structure,
the speaker can make connections much more easily between where they are cur-
rently in the discourse, and the wider goals that they have in telling a story. In other
words, they can focus on what they are currently saying, for example, Mr. Bean try-
ing to find the policewoman, confident that they can make links with the broader
story and line of development once the current sub-section is finished. Both of these
influences, in other words, attenuate the demands placed upon the Conceptualiser.
The third influence, then, follows from the previous two. The speaker, cushioned by
this structure, is likely not to have used considerable attentional resources in deal-
ing with planning, and so can focus more clearly on what is currently being said. In
other words, attention is available to do immediate things like avoiding error and
Structure and processing condition in video-based narrative retelling  207

monitoring performance. This, then, underlies the greater degree of accuracy which
is achieved.
One might go even further with this, and propose that the greater time available
enables even better things to happen, in that time can be used to make choices which
lead to easier discourse, easier lexical selections, and even easier syntax, so that the
favourable conditions are magnified even further. The fluency effects are connected
here. Less pressure, through clearer structure, enables speakers to organise their
contributions more completely, and then pause, appropriately, at clause boundaries.
Within the clause, they are then able to concentrate on the surface of language, on
avoiding accuracy, with more opportunity to reformulate.
This, though, does not do justice to the complexity effects which were found, with
structure and with processing. In the former case, it seems that the specific effects of
problem-solution structure play themselves out through greater subordination (and
not so much through more words per clause), and speakers do justice to the need to
express the relation between different elements in the story. With processing, the lack
of time pressure in the Watch-then-tell condition (and see Wang and Skehan, this vol-
ume) enables repackaging and greater complexity, but in this case with a clearer effect
with the Words per Clause measure.
What structure seems to do here is produce a relationship between Levelt’s
­Conceptualiser and Formulator that is helpful for accuracy in second language speech
performance. It limits the work that the Conceptualiser has to do initially, in develop-
ing a general plan for the story. It also eases the Formulator’s access to Conceptualiser
operations, since these are likely to connect with the broader structure of the task
and change less than might be the case in other communications. So, from the overall
amount of attention available, the Formulator does not have to compete as much as is
usual with the Conceptualiser, and can get on with doing what it does best – shaping
current language, retrieving lemmas, and building syntax. And these can, accordingly,
be done a little better, and lead to higher accuracy rates.
The other factor in the research design fits in well with this analysis. The dif-
ferent processing conditions yielded different results, with the main opposition
between the Watch-and-Tell and Pausing conditions on the one hand, and the
Watch-then-Tell and Summary conditions on the other. As elsewhere (e.g. Wang &
Skehan this volume), the There-and-then condition produces higher performance,
reflecting the lower processing pressure that is involved, associated as this is with
more opportunity for the Formulator stage to function effectively. But, even more
interestingly are the performances for the Summary condition. What this condition
does, in effect, is to provide the speaker with something akin to structure, in that a
broad outline is given, and then the speaker can take this outline, and use it as ‘the
structure’ to be recounted. It provides the sorts of ‘conceptual hooks’ that structure
can provide all alone. In this way, although there is the constant pressure of the video
208 Peter Skehan & Sabrina Shum

which is ­rolling, the speaker has the general macrostructure which has been given to
cope more effectively with the potential for derailment that the constant video input
provides. Once again, the issue is the relationship between the Conceptualiser and
Formulator stages.
We can connect this discussion to an even broader perspective. Skehan (2009a)
offers an account of second language speaking which is more general than that pro-
vided here. Using the Levelt model as the spine of this account, he explores groups of
influences which are categorised as Complexifying, Pressuring, Easing, and Focussing
second language performance. Essentially, the variables which have been explored in
this study are all concerned with Easing, in that structure and favourable processing
conditions in this study are those which simultaneously limit the demands coming
from the Conceptualiser, while giving more attentional resources to the Formulator.
They provide a piece in the puzzle for understanding how we can foster more effec-
tive second language performance. They also provide hints as to how, pedagogically,
tasks can be chosen and implemented which enable learners to perform at a higher
level. They also, of course, indicate how, in reverse, the task of the learner/second lan-
guage speaker can be made more difficult. But above all, they do indicate that there are
choices that can be made here, and that knowledge of these options can make peda-
gogy more targeted and effective.
A couple of points are still worth commenting on, one a limitation and the other a
suggestion for further research. The limitation concerns the Processing variable which
has been manipulated in this research. The variable was interesting and suggestive in the
results found, and encouraging for future research, as the earlier discussion indicates.
But one has to admit first that the sample sizes, of only seven per cell, were small, with
the result that any comparisons were fairly weak in statistical power. Even within the
processing variable, the pause condition was particularly problematic. In addition to
small cell size, it is clear that the condition requires more careful monitoring than was
used. There was clearly variation in the extent to which participants availed themselves
of the opportunity to pause, but we do not have data on this, and cannot explore whether
those who exploited this possibility more performed differently than those who did not.
It would be worthwhile to carry out future research which addresses this limitation.
The suggestion for further research concerns the measures of complexity which
were used. What is interesting is the way they were similar, but also how they diverged.
Both showed an impact of structure and of processing, but it is interesting that struc-
ture had a clearer impact with AS subordination and processing with Words per
Clause. The former variable, in its Problem-Solution operationalisation in the pres-
ent research, intrinsically supports more explicit and complex clause relations and the
AS subordination measure picked this up. The processing variable was interesting in
that greater time to build language seemed to push learners to develop more complex
clauses internally. This will be a fascinating contrast to probe in further research.
Structure and processing condition in video-based narrative retelling  209

References

Crookes, G. (1989). Planning and interlanguage variation. Studies in Second Language Acquisition,
11, 367–383.
de Bot, K. (1992). A bilingual production model: Levelt’s ‘Speaking Model’ adapted. Applied Linguis-
tics, 13, 1–24.
Ellis, R. (2005). Planning and task-based performance: Theory and research. In R. Ellis (Ed.), Plan-
ning and task performance in a second language (pp. 3–36). Amsterdam: John Benjamins.
Ellis, R., & Yuan, F. (2004). The effects of planning on fluency, complexity, and accuracy in second
language narrative writing. Studies in Second Language Acquisition, 26(1), 59–84.
Foster, P., & Skehan, P. (1996). The influence of planning on performance in task-based learning.
Studies in Second Language Acquisition, 18(3), 299–324.
Foster, P., Tonkyn, A., & Wigglesworth, J. (2000). Measuring spoken language: A unit for all reasons.
Applied Linguistics, 21(3), 354−75.
Foster, P., & Tavakoli, P. (2009). Lexical diversity and lexical selection: A comparison of native and
non-native speaker performance. Language Learning, 59, 866–896.
Foster, P., & Wigglesworth, G. (2010). Towards a new measure of accuracy in task-based s­ econd
language performance. English Department, St.Mary’s University, Twickenham.
Gilabert, R. (2007). Effects of manipulating task complexity on self-repairs during L2 oral produc-
tion. IRAL, 45, 215–240.
Hoey, M. (1983). On the surface of discourse. London: George Allen and Unwin.
Kormos, J. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence
­Erlbaum Associates.
Levelt, W.J. (1989). Speaking: From intention to articulation. Cambridge: CUP.
Levelt, W.J. (1999). Language production: A blueprint of the speaker. In C. Brown & P. Hagoort
(Eds.), Neurocognition of language (pp. 83–122). Oxford: OUP.
MacWhinney, B. (2000). The CHILDES Project: Tools for analysing talk, Volume 1: Transcription for-
mat and programs (3rd ed). Mahwah, NJ: Lawrence Erlbaum Associates.
Mehnert, U. (1998). The effects of different lengths of time for planning on second language perfor-
mance. Studies in Second Language Acquisition, 20(1), 83–108.
Norris, J., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA:
The case of complexity. Applied Linguistics, 30(4), 555–578.
Robinson, P. (2001). Task complexity, cognitive resources, and syllabus design: A triadic framework
for examining task influences on SLA. In P. Robinson (Ed.), Cognition and second language
instruction (pp. 287–318). Cambridge: CUP.
Robinson, P. (2011). Second language task complexity, the Cognition Hypothesis, language learning,
and performance. In P. Robinson (Ed.), Second language task complexity: Researching the Cogni-
tion Hypothesis of language learning and performance (pp. 3–38). Amsterdam: John Benjamins.
Robinson P., Cadierno, T., & Shirai, Y. (2009). Time and motion: Measuring the effects of the concep-
tual demands of tasks on second language speech production. Applied Linguistics, 30, 533–554.
Segalowitz, N. (2010). Cognitive bases of second language fluency. London: Routledge.
Skehan, P. (2009a). Modelling second language performance: Integrating complexity, accuracy,
­fluency and lexis. Applied Linguistics, 30(4), 510–532.
Skehan, P. (2009b). Models of speaking and the assessment of second language proficiency. In
A. Benati (Ed.), Issues in second language proficiency (pp. 202–215). London: Continuum.
Skehan, P., & Foster, P. (1997). Task type and task processing conditions as influences on foreign
language performance. Language Teaching Research, 1(3), 185–211.
210 Peter Skehan & Sabrina Shum

Skehan, P., & Foster, P. (1999). The influence of task structure and processing conditions on narrative
retellings. Language Learning, 49(1), 93–120.
Skehan, P., & Foster, P. (2001). Cognition and tasks. In P. Robinson (Ed.), Cognition and second
­language instruction (pp. 183–205). Cambridge: CUP.
Skehan, P., & Foster, P. (2005). Strategic and on-line planning: The influence of surprise information
and task time on second language performance. In R. Ellis (Ed.), Planning and task performance
in a second language (pp. 193–218). Amsterdam: John Benjamins.
Skehan, P., & Foster, P. (2008). Complexity, accuracy, fluency and lexis in task-based performance:
A meta-analysis of the Ealing research. In S. Van Daele, A. Housen, F. Kuiken, M. Pierrard, &
I. Vedder (Eds.), Complexity, accuracy and fluency in second language use, learning and teaching
(pp. 263–284). Brussels: Royal Flemish Academy of Belgium for Sciences and Arts.
Tavakoli, P., & Skehan, P. (2005). Planning, task structure, and performance testing. In R. Ellis
(Ed.), Planning and task performance in a second language (pp. 239–276). Amsterdam: John
Benjamins.
Tavakoli, P., & Foster, P. (2008). Task design and second language performance: the effect of narrative
type on learner output. Language Learning, 58(2), 439–473.
Winter, E. (1976). Fundamentals of information structure: A pilot manual for further development
according to student need. Hatfield, Herts: The Hatfield Polytechnic Linguistics Group, School
of Humanities.
chapter 8

Limited attentional capacity, second language


performance, and task-based pedagogy

Peter Skehan
St. Mary’s University, Twickenham

This volume has reported a number of original empirical studies of task-based second
language performance. The main site for the studies was Hong Kong, and specifically
the Chinese University of Hong Kong, although some studies were actually conducted
in neighbouring areas (e.g. Macao, Guangdong). All the chapters emanate from the
Task-Based Performance Research Group which functioned at that university for some
six years, from 2004–2010. The studies all took a Complexity-Accuracy-Fluency-Lexis
framework as a starting point, and examined performance in these terms (with one
or two extensions here and there). They also all took a Tradeoff perspective to second
language performance, in that they assumed that attentional and working memory
resources are limited, and that the interest in studying such task-based performance is
to better understand the consequences of such limitations, as well as the factors which
lead to higher performance and overcome the limitations.
Sharing assumptions in this way across the different chapters makes this unusual
as an edited volume. Such volumes are often made up of disparate contributions which
may have some loose connections to one another, but essentially make individual and
possibly disconnected contributions. In the present case, the unified viewpoint means
that the different chapters cohere and provide a cumulative perspective on current
developments within the Tradeoff Hypothesis. Accordingly, it is the function of the
present chapter to bring together these different contributions, and to explore how,
taken together, they provide a clearer picture of how we can understand second lan-
guage task-based performance from within this framework.
There are three main sections to the chapter. The first, and by far the longest,
explores major themes that have emerged from the different studies, and covers issues
such as planning, structure, processing and cognition, selective attention, and work-
ing memory. A second brief section attempts to summarise the findings that have
been reported in terms of positive and negative influences. The third and final section
explores implications of the various chapters for pedagogy.
212 Peter Skehan

Major themes

This section will try to summarise the various chapters, but it will not do so sequen-
tially, taking things chapter by chapter. Rather, different themes will be explored and
then illustrated through the contributions that relevant chapters make. In this way,
common themes will be clearer, and studies which explored more than one variable
(i.e. most of them!) will be considered in more than one place. The discussion starts
with planning, which is the main focus for three of the empirical chapters, and then
moves on to explore the major task characteristic researched here, task structure. This
leads to a consideration of processing issues as well as notions of task complexity
and the Cognition-Tradeoff debate, before concluding with a discussion of selective
attention.

Planning, preparedness, and readiness

Introduction
The literature on planning has grown enormously over the last twenty-five years,
and one wonders what the authors of the two ‘seed’ articles, Ellis (1987) and Crookes
(1989), now think of the ‘beast’ that they have unleashed. So it is timely, given the
range of studies now extant, to stand back a little, at the outset, and think about what
planning consists of. The table below shows the different conceptualisations of plan-
ning that have motivated studies, and also which individual researchers have used the
different conceptualisations (with, of course, some researchers figuring in more than
one place).
Even though the literature on planning is now extensive, the table makes clear
that it is difficult to form generalisations given the range of different interpretations
of pre-task influence that have been used. The question then becomes whether one
can link these antecedents to different performance profiles. The chapters in this book
make some, albeit limited, contributions to clarifying some of these issues. But at the
outset one might even question whether it is appropriate to use the term ‘planning’ to
cover the different possibilities. That is the focus for Bui’s claim (this volume) that the
term ‘readiness’ might be more appropriate and of the proposal in Chapter 1 that we
need to discuss ‘preparedness’. Readiness, for Bui, contrasts task-internal factors (con-
tent familiarity, schematic familiarity, task familiarity) with task-external readiness
(rehearsal, strategic planning, and within-task planning). The former concerns what
the speaker already knows that is relevant for the task (and so readiness is exactly the
correct term here), while the latter is concerned with manipulable factors irrespective
of the familiarity the speaker might have with the task and its content.
Limited attentional capacity, second language performance, and task-based pedagogy 213

Table 1.  Different conceptualisations of planning


Conceptualisation Typical researchers

Using time to plan about something ‘cold’ Crookes, Skehan,


  – guided or unguided Pang, Foster, Tavakoli
  – different foci
      preparation for language
      preparation for ideas
      preparation for organisation and stance
      preparation for other people’s contributions
Speaking about something from experience Foster and Skehan
   –  something familiar vs. unfamiliar
Speaking about something which has been studied Bui
Speaking about something similar in schema, or task type, to what Bui, Bygate
has been spoken about
Speaking about something which has been spoken or written Ellis, Wang, Bygate
about before
   –  authentically, as part of life
   –  as a previous task
      immediately afterwards
      after a time interval
Speaking about something which someone else has spoken Ortega
about before
Speaking under conditions which enable ‘on the fly’ or on-line Ellis, Wang
planning

The notion of ‘preparedness’ is, of course, very close to this idea of readiness, but
there are some differences in emphasis. The major contrast is between what might be
termed a ‘cold’ versus ‘involved’ contrast. With the former, the information to be con-
veyed does not particularly relate to the speaker’s previous life or experiences. With
the latter, the speaker has some relationship with what is said. This could come from
the relevance of the task. It could also concern the relationship between previous expe-
rience and what is being talked about, reflecting whether similar things have happened
to the participant or not, or whether what is being said in the task has been spoken
about before, for example, recounting a near-death experience. But essentially whether
we are talking about readiness or preparedness, the intention is the same: to explore
what happens before a task as an organising concept to enable functional relationships
to emerge more clearly. Bui’s demonstration that readiness, in his study, has a lexi-
cal, accuracy, and fluency impact while strategic planning (or preparedness) has more
impact on structural complexity is a clear example of this. We have to wait and see
what future research tells us about the sort of fine-grained relationships with different
aspects of performance that these new concepts might reveal.
214 Peter Skehan

The three studies


Against this background, what do the chapters in the present volume contribute? Three
chapters are relevant here: Bui (Chapter 3), Wang (Chapter 2) and Pang and Skehan
(Chapter 4). Bui reports on a study where two variables from Table 1 are included:
planning-as-time and planning-as-familiarity, the latter in the sense of speaking
about something which has been studied. The results are very interesting. Familiarity
of this kind leads to significant but small effects on accuracy and fluency, as mea-
sured through effect sizes. There is no complexity effect here, i.e. speakers were no
more or less complex when they were speaking about matched viruses or mismatched
viruses (the speaking topics of Bui’s study). It can be argued that both of these effects
sit within Levelt’s Formulator stage, and so suggest that with familiarity, more atten-
tion was available for ongoing performance. But there is also a medium-size effect on
lexical sophistication, suggesting that when talking in the matched condition, speakers
access less frequent (and more appropriate and technical) words. So, while syntactic
complexity is not increased, lexical complexity is boosted. Speaking about something
with which one is familiar allows the mental lexicon to be searched and accessed in
a different way to what happens with less familiar material. One wonders, as a result,
whether similar results would be found with familiar topics which are less ‘bookish’.
(Even so, it must be stressed that this research design was not easy to implement since
finding ‘matched’ and ‘mismatched’ conditions is fiendishly difficult.) Bui (Chapter
3, this volume) also researched ‘conventional’ planning based on time, and here he
found fairly standard things – that planning opportunity produces greater complexity
and fluency, but did not lead to any increase in accuracy. In addition, the effect sizes
here were medium in nature, suggesting very interestingly that providing planning
time produces effects which are slightly greater than those produced by familiarity – a
non-trivial finding, since this could not really have been predicted – one might, in fact,
have expected the opposite.
Wang (this volume) reports a wider ranging study of planning which essentially
tries to explore three senses of planning from Table 1. She explores conventional pre-
task planning, Ellis’ notion of online planning, and also planning as previous perfor-
mance in the L2, through repetition (although this is immediate repetition, unlike
Bygate’s 2001, delayed repetition). Like Bui (this volume) she found that strategic plan-
ning yielded what might be considered to be conventional results: raised complex-
ity and fluency, with large effect sizes. But the two other areas she researched extend
our understanding of planning considerably. Using a more controlled implementation
of online planning than has been used in previous research, she showed that online
planning by itself did not produce greater accuracy, with no significant differences
whatsoever. But when online planning was preceded by strategic planning there was
a significant and large effect on accuracy, and complexity also. It appeared that online
Limited attentional capacity, second language performance, and task-based pedagogy 215

planning needs supportive conditions for it to be effective – the benefits of strategic


planning do not translate consistently into greater accuracy (although that is not to
say that strategic planning never generates effects in this area, (Ellis 2009)), perhaps
because the residue of the effects of strategic planning are swamped by the imme-
diacy of the processing conditions while a task is running. However, if the potential
of such planning is given scope to operate, as when online conditions prevail, a joint
accuracy-complexity effect can be achieved. The effects of strategic planning need to
be nurtured, in other words, just as the effects of online planning need the stimulus of
the wider perspective provided by earlier strategic planning.
While this is a very interesting result in itself, the findings with repetition are
even more striking. Here, unusually, all aspects of performance that were measured,
complexity, accuracy, and fluency, were significantly increased simultaneously. In
addition, the effect sizes were generally large, and as Table 7 in Wang (Chapter 2, this
volume) makes clear, this was not due to any anomalies in measurement or low stan-
dard deviations. In other words, getting participants to repeat a task immediately leads
to dramatic improvements in performance. Repeating what has been said in some
way prepares the speaker for the second performance, and this preparation seems to
enable errors to be avoided in the second telling, as though they were noticed on the
first occasion, but too late to change. Alternatively it may simply be that more attention
is generally available, and some of this is targeted at monitoring and avoiding error
(see Li, this volume). In addition, it appears that the engagement with the ideas to be
expressed in the first performance enables a more effective method of information
transmission in the second, more densely organised, with fewer ‘elementary’ proposi-
tions. Finally, the fluency effects are well worth commenting on. As Wang (this vol-
ume) indicates, actually producing the language which will be re-used smoothes the
subsequent performance hugely, as though speakers wrestling with a second language
are helped considerably at the processing level by having actual phonological plans
more readily available. The smoothing may also release some attentional resources
for Conceptualiser and Formulator operations. The last thing to note here is the con-
trast between these results and those of Bygate (2001) with more delayed repetition. It
appears that Wang’s findings indicate a clearly greater effect than he reports (encour-
aging though that was). So immediacy here confers considerable benefits, and now it
would be fascinating to vary time between performances to explore how rapidly this
advantage fades, and whether there is an optimum time for the repeated performance
to occur.
Pang & Skehan (Chapter 4, this volume) in contrast, take a much more quali-
tative approach to investigating planning. Participants in their study completed a
narrative retelling task, after being given ten minutes planning time, and then subse-
quently engaged in retrospective interviews (RIs). A coding scheme was developed
to capture the reported planning behaviours, one which had linkages with the Levelt
216 Peter Skehan

model of first language speaking. The codings so produced were then categorised,
into macro and micro codes, lexical-grammatical codes, and metalanguage codes, a
coding scheme which contrasted with that developed by Ortega (2005), which was
heavily influenced by O’Malley and Chamot’s (1990) coding scheme for learning
strategies. Even so, there is quite a lot of overlap between the two approaches. The
major change is that macro and micro codes figure more prominently in Pang and
Skehan’s (this volume) system. Monitoring and evaluation are not emphasized as in
her scheme, while Pang and Skehan (this volume) emphasise lexical planning codes
more, as well as some rehearsal codes as these relate to subsequent performance, an
area not explicitly included in the Ortega (2005) study. All the various codes were
also related to performance, and generalisations offered as to the sorts of planning
behaviours associated with success. These were:

Accuracy
–– Positive: Retrieve specific words; Structure the story: Rehearse in a targeted way
–– Negative: Create lexical difficulties for yourself; make the story more difficult than
you can handle

Complexity
–– Positive: Organise the story; link the big to the small; let the ideas lead the way
–– Negative: Be fancy with words; focus on grammar; be overambitious with planning

Fluency
–– Be resourceful and flexible with words; avoid a focus on form; rehearse and work
small; organise ideas; avoid difficulty; avoid getting stuck
–– Be fixed and inflexible with words; concentrate on form; try to be fancy; plan gen-
erally; take notes seriously

Lexis
–– Positive: Focus on words; be general with ideas
–– Negative: Be unambitious; rehearse generally not specifically

The most surprising thing here is how little in these categories is directly positive.
Building structure and being led by ideas are positive, but there is little to assist accu-
racy or even fluency in any direct way. Instead the emphasis is on things to avoid
doing, or to do in moderation. It seems that planning can easily contain pitfalls, so
good use of planning means avoiding the pitfalls just as much as doing ‘useful’ things.
It also helps to have realism about one’s abilities so as not to take on too much. Being
flexible and resourceful when things (inevitably) go wrong helps too.
Limited attentional capacity, second language performance, and task-based pedagogy 217

So with these three chapters on facets of planning, where do we end up? First,
there is the issue of needing a wider framework – either readiness (Bui, Chapter 3), or
preparedness (Skehan, Chapter 1), a framework which subsumes planning but ranges
more widely. Bui (this volume) shows that familiarity is a useful form of preparedness,
whose strongest impact is on lexical sophistication, but which also influences accuracy
and fluency, suggesting a clear Formulator focus. It seems that knowing an area, at least
in his study, enables the second language speaker to deal with pre-verbal messages with
attention, but does not seem to be associated with greater Conceptualiser operation.
Another facet of preparedness is to tell a story one has told before. In the present case
(from Wang’s chapter), that means retelling (repeating) a story which was previously
about something new. (One can imagine all sorts of other retellings of things which
were familiar, to various degrees, in the first place.) In her study, the retelling was imme-
diate, although obviously one can imagine other research designs with different time
intervals between the original and the retelling. In any case, in her study, the results
were very clear, leading to increase in performance of considerable magnitude in accu-
racy and fluency, and a smaller, but nonetheless very large effect in complexity.

Interpretations
The repetition effects in Wang (Chapter 2, this volume), are so strong that we have to
search for an explanation. Effective priming might be one such factor. The priming lit-
erature in psychology is extensive (McDonough & Trofimovitch 2009). An immediate
relevant preceding context can have a major impact on ease of access of related words.
It may be that memory traces from the first performance are still having an effect and
facilitate the subsequent processing. But plausible as this is, the size of the effect seems to
require a more powerful justification. In that respect, it is useful to compare rehearsal/
retrieval as processes within strategic planning, versus actual repetition of perfor-
mance. The background here is that (from a Leveltian perspective) the Conceptualiser-­
Formulator transition is mediated through access to the (second language) mental
lexicon. As mentioned elsewhere in this volume, the first language mental lexicon is
extensive, and the lemmas within it are rich, elaborate, organised and associative. It
contains information on meaning, phonological form, orthographic form, logical rela-
tionships to other lemmas, associative and collocational information, and so on. In the
second language mental lexicon, this is not the case. Lemmas, even where they exist, are
nothing like as rich, elaborate, organized, and associated (although, of course, at higher
proficiency levels this is much less the case). The implication of this for retrieval and
rehearsal as part of strategic planning is that only limited information may be retrieved,
partly because only limited information is available, and partly because even what is
there may not be so accessible as in first language lemmas, and in any case the process
may be very effortful. But this, from the speaker’s perspective, may well be a lot better
than nothing, and may then raise the level of performance subsequently.
218 Peter Skehan

In the case of repetition, though, (as compared to strategic planning), differ-


ent processes may be triggered. The partial or incomplete lemma access that may
be regarded as temporarily sufficient as a result of strategic planning is revealed as
inadequate during a first performance, and the need to actually produce language
means that the speaker has to with the problem of retrieving everything that can be
retrieved, including all the aspects of lemma information mentioned above. This is
what becomes the basis for syntax-building, and even making decisions that go further
than current knowledge, e.g. countability vs. non-countability. So the process required
by repetition is deeper and more comprehensive than is rehearsal. Not only may the
act of speaking establish a better trace for subsequent performance (in that it is more
enduring), it also, vitally, is a better preparation for subsequent performance, since the
speaker is pressured to solve problems, e.g. of phonological form, of likely agreement
implications, of morphology, and indeed of lexical or collocational selection. Indeed
Wang (this volume) also argues that there is a strong Articulator effect too, in that
having produced actual language eases the subsequent phonological performance, an
influence that might well facilitate the maintenance of parallel processing since other-
wise articulation itself could consume limited attentional resources. The phonological
solutions may be correct or incorrect, but they at least ease subsequent processing. The
results in Wang (this volume) indicate how effective this process is, for fluency (as one
might first expect) but also for complexity and accuracy, as the engagement with form
in the first performance pays dividends in the second, since the earlier retrieval depth
functions as a sort of investment for the later performance.
One final point is worth making about repetition, even though it might be slightly
misplaced since there is a section on pedagogy later in this chapter. It is clear that the
impact of repetition is greater than that of other conditions reported in this volume.
This suggests considerable potential for repetition as a pedagogic technique. In gen-
eral, within a communicative approach to teaching, it tends to be frowned on as lack-
ing in authenticity. This, though, assumes (a) that we do not engage in repetition in
real life, and (b) that since no new meanings are being conveyed, the language which
is used is not normal communication. Life, though, can often be repetitive, and so can
the language which is used (Tannen 1989). And despite possible claims of inauthentic-
ity, one needs to explore the reactions and perceptions of second language speakers
(rather than reactions of teachers) (Pinter 2005). Second language learners may well
derive satisfaction from a job done far better through repetition. At the same time,
they may be preparing themselves for even better communication in the future. As
a teaching technique, therefore, repetition may have a lot going for it – boring from
a teaching perspective, perhaps, but richly satisfying from the learner’s point of view
(Bygate 2006).
So, if other forms of preparedness such as repetition and familiarity are relevant,
what of conventional strategic planning itself? Bui (this volume) and Wang (this
Limited attentional capacity, second language performance, and task-based pedagogy 219

v­ olume; in her basic planning condition) confirmed the general finding from the lit-
erature – a complexity-fluency effect, but nothing for accuracy. Pang and Skehan (this
volume) also researched strategic planning and raise a different set of issues with their
hybrid qualitative-quantitative study. They record self-reports of behaviour of partici-
pants focusing on form, but very often these do not actually relate directly to perfor-
mance. Some of their codes (building structure, ideas) are positive in their impact and
reasonably clear to understand. But many are more complex and highlight avoiding
trouble, dealing with trouble, and the unhelpful effects of being over-ambitious. So
some planning behaviours contribute because they support actual performance, while
others are more concerned with what not to do. There are several implications here,
and most of these bear on the fragility of the accuracy effects in the literature. The most
general point is that it is clear that different people do different things when given the
opportunity to plan, and that some of these things raise performance in different areas,
some are neutral, and some are associated with reduced levels of performance in dif-
ferent areas. This being so, it is likely that if planners do the positive things which link
with accuracy (retrieving specific words, structuring the story, rehearsing in a targeted
manner), then error may be reduced. But if they do other things during planning then
it is unlikely to be. In other words, there is a certain degree of vulnerability in planning
behaviours linked to accuracy, and possibly chance factors in the ones which may be
used. The result is that different studies may report different effects depending on how
participants use their planning time. On some occasions the positive influences will
predominate. On others, the negative. Other performance areas, such as complexity
and fluency, do not seem so vulnerable to this variation, although with each, the quali-
tative data reveal potential negative factors – it seems, though, that they do not carry
the same weight. The general influence of over-extension as a result of over-ambition,
though, is there for all performance areas. It would seem that planners’ views of their
own abilities, and their capacity to match planning ambition to realism which is linked
to ability, may be a key factor, and one which has a particular connection to accuracy.
Related to this discussion is another conclusion one can draw from the Pang &
Skehan (this volume) study. This concerns the issue of memory when we examine
the transition from planning to performance. It appears that ideas, structure, and
organisation fade less, and make the transition better from planning to performance,
whereas form, most of the time, does not endure so well and transfers less effectively
(Bygate & Samuda 2005). So there is the possibility that, if ideas and form receive equal
focus during planning, it is the former far more than the latter which impact on per-
formance. This too may have connections to the smaller and less consistently reported
accuracy effects.
In this regard, there is a link to be made with another facet of the chapter by
Wang (this volume). She showed that on-line planning, in itself, was not effective, but
that her online planning condition, when preceded by a Watched condition (which
220 Peter Skehan

enabled preparedness) did raise accuracy, and complexity also, both with large effect
sizes. What we seem to have here is a synergy between ideas to be expressed and
the means to achieve such expression – Conceptualiser and Formulator working in
­harmony – the first coming from the opportunity to prepare, and the second, feed-
ing off the first, coming from the supportive conditions. Having less pressure when
speaking is associated with higher levels of performance, but only with the previous
opportunity to plan – not only when there is more time available. But this suggests
a slightly different interpretation of what happens during the supportive conditions,
which would be that less pressuring performance conditions create a better context to
remember what has been planned. In other words, the key could be better retrieval of
what has been prepared because the performance conditions provide enough time for
this to happen. The planning lays the foundation. The supportive conditions enable the
fruits of the planning (accuracy as well as complexity) to be realised.
Pang and Skehan (this volume) also shed light on this. In their study, self-reported
use of planning time to focus on form did not have strong relationships with actual
performance, and indeed the only codes which did relate positively to accuracy were
retrieving specific words, rehearsing in a targeted way, and organising the story. They
proposed that form is vulnerable to fading more easily than is the planning of ideas.
If this is the case, it fits in well with Wang’s results on supported on-line planning. In
this condition, there has been planning, quite possibly of form, and the gentler perfor-
mance conditions may allow that form to be retrieved and used. More time in itself is
not the key – what matters is that foundations have been laid and there is time. It may
well be that in conventional planning studies, participants have used the planning time
to focus on form, but unless this was very specific, the fruits of planning may not have
transferred to performance. Hence, possibly, the variations in reported results.
To sum up this section, it appears we now have to consider what might be called
a ‘planning efficiency’ factor. Not only do we need to consider what happens during
planning. We also need to consider how the potential benefits from this may or may
not be transferred into actual performance. To be sure, this is speculative, but it is
consistent with the results reported in this volume. What it does, fundamentally, is
suggest a need for more qualitative research (Ortega 2005), but research which is now
more focused in how it explores processes of planning and their subsequent impact
on performance.

Serial and parallel processing


Next we will consider the extent to which these different senses of preparedness or
readiness might have an impact on the serial versus parallel modes of processing which
we discussed earlier. Clearly, there is a basic serial quality to communication: one idea
has to follow another. But the Levelt model (1989, 1999), in addition to proposing
Limited attentional capacity, second language performance, and task-based pedagogy 221

­ ifferent stages in first language speech production (Conceptualisation, Formulation,


d
Articulation), also claims that these stages are modular, and can function in a (fairly)
encapsulated way in parallel (Kormos 2006). This means simultaneous operation.
Wang (Chapter 2, this volume), in her Table One, brings out, for example, how at any
one time that current Formulation will be (a) the result of previous Conceptualisa-
tion, and (b) the basis for future Articulation. Such simultaneous functioning is only
possible if each module does its job very quickly, and requires relatively little atten-
tional resources. When these conditions prevail, modularity is maintained, and fluent
speech production is possible, with viable ‘unit’ length at the level of phrase, minimally,
but more probably the clause or even AS-unit. If, on the other hand, one of the stages
encounters a problem (such as difficult ideas to express in Conceptualisation, or word
or syntax retrieval problems in Formulation, or difficult phonological realization in
Articulation) then parallel functioning is compromised, as attention is diverted to the
problem stage. The problems have to be repaired, and the thread of speaking returned
to. First language speakers tend to handle such problems typically without parallel pro-
cessing being disrupted. Second language speakers are less likely to do this (although
proficiency level is an important factor here, as will be discussed below.).
Interestingly, one of the goals of strategic planning is to complexify the ideas that
are to be expressed (leading to the very consistent finding that language complex-
ity increases are associated with such planning time). In other words, one interpreta-
tion of planning is to make serial processing more likely (other things being equal),
as Conceptualiser operations become more demanding, and probably, more difficult
lemmas need to be retrieved to handle the more complex pre-verbal ideas that are
generated. (This is very close to the interpretation offered by Crookes 1989, as to why
accuracy effects are not found in planning studies. He suggested that speakers created
difficulties for themselves by using planning to implicate more advanced, and so more
difficult, morphosyntax.) Of course there are beneficial aspects to this triggering of
more complex language, but one has to be alert to the way there may be consequences
for other aspects of performance, and one of these may be a greater need to use serial
modes of processing. Interestingly, the other proposed goals of pre-task planning,
rehearsal and organisation, do not pose similar problems for ensuing communication,
but instead equip learners (with greater probability but not certainty) for more paral-
lel processing. With rehearsal, including retrieval of relevant lemmas (Ortega 2005),
second language speakers are readied for the demands that will be made on them, and
planning-as-organisation probably functions similarly to structure, in that it provides
learners with an outline of what they are going to say. This may not impact upon paral-
lel processing directly, but it will enable them to regroup more effectively, in the sense
that if they lose the thread of parallel processing, they are better equipped to retrieve
this mode through the organisational structure which they have given themselves to
work within. The organization and structure provide what might be termed ‘pickup
222 Peter Skehan

points’ which can restart more fluent performance. This point is discussed more exten-
sively in the later section on structure.
The other forms of readiness can be interpreted differently, and all seem directed
to enhancing parallel processing. Knowledge of an area, and familiarity generally, (see
Bui this volume) provide organisation of ideas, and possibly, accessibility of lemmas,
as indexed in the Bui study by faster speech and slightly greater lengths of run. One
assumes that such knowledge, and organization and accessibility of ideas, means that
additional Conceptualiser operations are not so necessary, and so Formulator pro-
cesses can benefit from greater attention, and enhance parallel processing in the sense
that more capacity is available for attending to formulation during the current speech
production process. Previous speech (see the repetition condition in Wang, this vol-
ume) seems to promote effective Conceptualiser readiness with major enhancement of
Formulation and Articulation, at least where immediate repetition is concerned. The
impact on accuracy and fluency in Wang’s study is very clear, suggesting that drawing
on a repertoire which has been primed by the previous performance is very effective
indeed. This is all the more remarkable in that complexity also benefits hugely, sug-
gesting that repetition even creates space for a repackaging of the ideas that are to be
expressed, to some degree (Bygate 2001). Repetition is the only condition where all
three performance areas benefit in a very clear way, and so we can now say, the only
area where additional Conceptualiser activity does not seem to be at the expense of
Formulation and Articulation.
The final area to consider is on-line planning. Ellis (2005) has argued that this
form of planning is particularly effective for raising accuracy. We have seen in the pres-
ent volume, through Wang’s research, that simply slowing down the performance, in
itself, did not produce higher levels of accuracy – this had to be linked with some way
of involving pre-task planning or Conceptualiser work. When this was done, through
Wang’s supported online planning condition, which provided strategic planning
opportunity followed by slowed performance conditions to enable better on-line plan-
ning, there was a clear impact on accuracy and complexity, although not fluency. The
provision of greater processing time here does seem to lead to a greater opportunity
to engage in parallel processing, but only if adequate preparation has been achieved
first. Simply providing more time is not enough – there has to be some guidance to
enable this extra time to be appropriately exploited. But this raises another issue –
the relationship between Conceptualiser and Formulator operations. The supported
online planning condition led to the elusive and desirable result of a joint raising of
complexity and accuracy. What seemed to be happening here is that effective think-
ing for speaking took place in the earlier ‘watched’ phase, and this was then carried
over into a performance in which error could be avoided to a greater extent because
of the actual performance conditions in which the video speed had been slowed. Most
other task research designs find ways of promoting either complexity or accuracy. This
Limited attentional capacity, second language performance, and task-based pedagogy 223

particular way of generating preparedness linked to supportive processing conditions,


enabled both to come into play.
The other part of Wang’s (this volume) study which is relevant is her repetition
condition. As we have seen, this produced an appreciable improvement in perfor-
mance relative to the control group condition, in complexity, accuracy, and fluency.
Somehow, actually engaging with a task, with completing it, constitutes the most effec-
tive preparation of all. It appears that the first iteration lays the ground for Concep-
tualisation, Formulation, and Articulation to all proceed more effectively. Somehow
this activity confers a greater benefit for performance than do rehearsal and retrieval,
even though one might have thought they would be equally effective. Actually using
language is more effective than thinking about the language which could be used. So
while there are benefits for Conceptualisation (reflected in higher complexity scores),
Formulation also benefits, with a large increase in accuracy, and also fluency. As Wang
(this volume) points out, this study is unusual in that it engages Articulation as well
as the other stages outlined in the Levelt model. There seems to be something added
by having previously used the actual language that other forms of preparation do not
contribute so well. In a sense, any planning ought to lead to useful priming effects.
Repetition seems to do this particularly well (Wang 2009). This may be because the
act of speaking makes subsequent speaking and articulation easier (and so less atten-
tion consuming). It may also be that articulation does prime associated language very
effectively, and also that the deeper lemma access it generates provides a better basis
for the subsequent (parallel) performance. It would seem that having used language
is a way of maximising the chances that parallel processing can be maintained. Pos-
sibly similarly to the impact of task structure, having run through the entire task once
enables the speaker to locate new ‘restart’ points when difficulties are encountered.
Alternatively, breakdowns that occur in much second language speech may be less
likely because the memory of wrestling with the same problem is still available, and
tentative solutions from earlier can be re-applied and applied better. Whatever under-
lies this effect, this does seem to be a very effective way of getting ready for a subse-
quent performance, and more research into it would be very much worthwhile, as
Bygate and Samuda (2005) have also argued.
The final study of planning is the qualitative investigation by Pang and Skehan
(this volume). There are no new findings of effects on performance here, so much as
insights into what sort of things planners do, and how these might contribute to per-
formance. The study does, though, have contributions to make regarding serial and
parallel performance. For example, we have seen elsewhere that structure has a benefi-
cial impact on supporting parallel performance. What is interesting here is that there
is some evidence that some learners use planning time to impose their own structure
on what they are going to say. Further, this is then associated with higher levels of
performance, so some second language speakers, when they plan, seem to have come
224 Peter Skehan

upon this advantage for themselves. More generally one would expect the opportunity
to prepare, to get material ready for performance, would ease attentional demands and
therefore make parallel processing more likely. What is particularly interesting is that
this does not apply equally to all the things that could be planned for. More specific
ideas and content seem to fade less than do a concentration on form, and on planning
generally rather than specifically. So decisions by speakers to concentrate on Concep-
tualiser preparation seem to pay bigger dividends, and so might also be more effective
at smoothing the operation of speaking and maintaining parallel processing.
The self-reports on planning also convey an awareness, on the part of second lan-
guage speakers, of their limitations and the need to overcome these. It is clear that
over-ambition, relative to a particular speaker’s level of ability, is a major factor. Many
participants report behaviours which over-extend their performance and cause dif-
ficulty. Or, to put this another way, behaviours which push learners so that serial pro-
cessing is more likely because they are trying to be too ambitious, and cannot sustain
parallel performance. In addition, a number of participants show that they are per-
fectly aware that they will encounter difficulty, and have some idea of how they could
prepare to overcome such difficulties. This too is consistent with the idea that they are
aware that they need to get a higher level of performance (i.e. parallel processing) back
on track. In sum, therefore, the view from ‘the inside’ where planning is concerned
shows a lot of evidence that maintaining flow in performance, maintaining a parallel
mode of speaking, is a major factor, one that is influenced by self-reported behav-
iours during the planning period, and also something that the speakers themselves
are aware of.
This section, however, has to be finished with a major caveat. The studies in this
volume have not systematically explored the entire proficiency range. They have, with
one exception, focused on intermediate level learners, with relatively few of these
being at high intermediate level. This even applies to Pang and Skehan (Chapter 4,
this volume) where, even though two proficiency levels were involved, these did not
go outside the intermediate range. The exception is Bui (Chapter 3, this volume) who
did have some low advanced learners in his study, in his higher proficiency condition.
There are important consequences which follow from this limitation. First, it
reduces any claims for generality. The hope in this section, as well as those which fol-
low, is that results and conclusions are applicable more widely, rather than more nar-
rowly. So it would be preferable to be able to claim that insights regarding planning,
for example, are robust and likely to apply widely. The restricted proficiency range,
while not incredibly narrow (intermediate learners are an important group of lan-
guage learners in themselves) does, though, mean that claims can only be made about
performance on spoken language tasks by this group.
There is, though, an even more specific version of this caveat. The main part of this
section has explored issues connected to serial-parallel performance, and ­proposed
Limited attentional capacity, second language performance, and task-based pedagogy 225

that it is differences between the first and second language mental lexicons that are
vital in altering the serial-parallel balance. Clearly, as proficiency increases, it is likely
that the second language mental lexicon will develop (have more elements, better
organization, richer information in lemmas) and that the serial-parallel balance will
be strongly affected. This is likely to become very important as high intermediate and
low advanced levels of proficiency are reached. Such a conclusion simultaneously lim-
its the power of generalizations that can be made and also indicates the urgency of the
need for research in this area.

Structure

Introduction
As in the previous section, we can start by asking what structure in a task is. Of course,
taken more broadly this connects with the literature on discourse analysis (Winter
1976; Hoey 1983) and the psycholinguistics of text structure (Kintsch 1994), both
spoken and written. Discourse analysts have tried to explore how some texts have
analysable and familiar structure, a discourse framework which has stood the test of
time and acquired some universality. Psychologists have explored the importance for
comprehension of concepts such as scripts and schemas, and how these influence our
expectations about what is likely to be said, and how, if there are major cross-cultural
differences, they mislead us and make processing difficult. Discourse analysts have
explored how discourse structure might impact on the ways we organise what we
say, as in things like restaurant scripts, or descriptions of a house or apartment. What
happens in these descriptions is not arbitrary, and follows predictabilities which are
important for listener as well as speaker. The different structures which have been
researched demonstrate that we benefit from working within them, since they remove
unpredictability and provide a shell within which the interplay of ideas and language
is facilitated.
The literature that explores relatively brief oral task-based performance has been
concerned with only a subset of the different ways of characterising structure, and has
concentrated on simple narrative structures (beginning-middle-end) or the problem-
solution structure (Hoey 1983; Winter 1976). (Structure has not particularly figured
in research into interactive tasks.) With simple narrative structures, the sequence gen-
erally consists of some sort of contextualisation, then a development through events,
with some sort of resolution to bring things to a close. The important point here, with
simpler narrative structures, is that there is arbitrariness. There is a need in narra-
tives for development, and a satisfying resolution which brings together and com-
ments upon the events (possibly amusingly). But there is also freedom in what might
226 Peter Skehan

happen, and while the development is unfolding all one knows is that there will be an
ending. In contrast, in structures such as problem-solution, the development which
takes place is constantly being related to the problem which has been ‘announced’,
and so the degree of arbitrariness is considerably reduced. The final resolution, when
it comes, is then a comment on the satisfactoriness of the solution that is posed to the
problem which was set. The parameters within which things are judged are therefore
far more precise, and correspondingly, the expectations when the narrative is listened
to or produced are much clearer. What this means for the speaker is that development
consists of handling sub-sections of the structured narrative before one returns to the
broader structure that is motivating the story. In other words, there is a ‘license’ to get
on with minor developments insofar as these minor developments mesh nicely with
the broader development of the story. The speaker, in other words, knows their place
in the story. As a consequence, given the existence of a narrative frame, Conceptualiser
operations are considerably eased, and more attention is available for the Formulator.

The studies in this volume


Three chapters in this volume bear on this analysis, those by Skehan and Shun
(­Chapter  7), Wang and Skehan (Chapter 6), and Pang and Skehan (Chapter 4)
(although the third of these addresses issues of structure only partially). The results
from these chapters will be re-presented briefly next, but three points are important
before we get into this level of detail. First, both Skehan and Shun (this volume) and
Wang and Skehan (this volume) used video clips as the basis for the narratives which
were told. This contrasts with a great deal of the literature on narratives within a task-
based approach. Most studies have used cartoon picture series (Skehan & Foster 1999;
Bygate 2001 are exceptions), and so the performances which were elicited for each
of these two chapters were under contrasting processing conditions to most in the
literature. The videos in these two studies were natural speed videos, and so if a nar-
rative had to be retold while a video was running, this presented a considerable input
problem for the second language speaker to process and then act upon. To put this
another way, to find an effect for structure here is a significant test because it has to
be strong enough to withstand the real-time processing pressure that is involved. But
a second point mitigates this to some extent. The next section will discuss Processing
factors more explicitly, and this raises a problem, in that it is not totally possible, in
this discussion of structure, to ignore issues associated with Processing factors. The
two sections, in other words, are not as distinct as one would like. In each, there is a
contrast between Here-and-now and There-and-then performances, which is a strong
processing condition. There is also the complication that in the Skehan and Shun (this
volume) study there are three Here-and-now variations, only one of which is ‘classic’
Here-and-now. The other two each have some sort of mediation of the intensity of the
Limited attentional capacity, second language performance, and task-based pedagogy 227

processing condition, with a Summary given in one case, and the opportunity to pause
the video in the other. So these factors have to be borne in mind when interpretations
of the effects of structure are provided.
A third point is to consider how comparable the video clips were that were used
in each case. Skehan and Shun (this volume) used four Mr. Bean video clips. Wang
and Skehan (this volume) used four ‘Shaun the Sheep’ clips. There was no difference in
length, no difference in amount of overt dialogue (virtually none). Obviously Mr. Bean
contains ‘real’ characters while Shaun the Sheep is an animated cartoon. Yet one could
easily argue that the sheep, dogs, and pigs in Shaun the Sheep have more convincing
human characteristics than many of the people who appear in Mr. Bean! The key com-
parison we can make, however, is in terms of structure. Skehan and Shun (this volume)
range their four videos along a scale of structure, going from no structure (Crazy Golf)
to beginning-middle-end structure (Christmas) to loose problem-solution structure
(Funfair) to tight problem-solution structure (Thief). Tight problem-solution struc-
ture is characterised by clear conformity to Winter’s four step structure of Situation-
Problem-Solution-Evaluation, with no deviation or significant extraneous material,
or sub-threads within the narrative (and this is what distinguishes ‘Thief ’ from ‘Fun-
fair’). Wang and Skehan (this volume) contrast two structured videos (Tooth Fairy,
Bathtime) with two unstructured videos (Fetching, Off the Baal). The two structured
videos are most comparable to Thief from Skehan and Shun, in that Winter’s problem-
solution structure is clearly present in each case, and although there are many amusing
events along the way, they are all tightly bound into the problem-solution sequence (at
the level of abortive trial solutions, or slightly extended solutions). So, for present pur-
poses, it is fair to locate Wang and Skehan’s two videos as reflecting a tight problem-
solution structure.
We can now explore the results from the two chapters which directly focus on
structure. Skehan and Shun (this volume) report an effect of structure on complex-
ity, accuracy, and fluency, with structure leading to raised performance in each of
these areas. With complexity, the major contrast is between the most structured video
(Thief) and all the others. With accuracy, each degree of task structure raises accuracy,
although perhaps the major difference is between no structure (Golf) and all tasks that
have some structure, whatever it might be. The impact on fluency (end of clause paus-
ing) resembles that on complexity, in that the most structured video produces clearly
the greatest degree of fluency, and the performance on the other videos do not form
a scale. So it is clear that structure is beneficial here, and the obvious point is that the
effect has been found with a video-based narrative retelling, with the time pressure
that that implies. Wang and Skehan (this volume) report a similar but far from identi-
cal story. There are main effect influences for complexity and end-of-clause pausing,
but the major effect reported is that structure has its clearest effect in the There-and-
then condition in that study. In other words, when there is processing pressure, as
228 Peter Skehan

in Here-and-now, the effect of structure, while there, is not strong with complexity
and fluency, and not really evident at all with accuracy and lexis. So, despite the tight
structure which characterises the videos used, the structure condition does not really
overcome processing pressure to any degree. Possibly it is the mediated Here-and-now
performances in Skehan and Shun (this volume) which have generated the significant
effect for structure there. But at least with Wang and Skehan (this volume) structure
does have an effect on complexity and fluency (though not great), and a fairly large
effect on these areas for There-and-then. Structure also has an effect on accuracy, but
only with There-and-then, and this not particularly large.
A final note in covering the results concerns Pang and Skehan (Chapter 4, this
volume). They did not directly investigate structure, since theirs was a qualitatively-
driven study, and so what came up in the qualitative results depended on what the par-
ticipants said. But it is interesting that some participants report using planning time, in
a study based on cartoon picture narrative retellings, to impose some organisation and
structure on the narrative they were going to produce. They seemed spontaneously to
regard structure as valuable. In addition, very importantly, this use of planning time
was associated with higher levels of performance, confirming the results reported by
Skehan and Shun (this volume) and Wang and Skehan (this volume).

Interpretations
The next task is to try to account for these results, and to understand what is going on
psycholinguistically. At the simplest level, it appears that the existence of a macrostruc-
ture does release attention for the speaker, and that the focus for such free attention
will be form, but it would seem now that different aspects of form may receive priority.
Some second language speakers may exploit the released attention to achieve greater
accuracy, in the way that has been predicted in the past. The less pressure that follows
from having a clearer macrostructure means that capacity can be directed towards bet-
ter online planning, and also monitoring and repair. Hence the accuracy effects which
have been found – attention has been directed to the Formulator. But equally, any
available attention can also be directed towards rethinking ongoing conceptualisation
and achieving a higher level of structural density, or complex phrasal structure. In fact,
the notion of structure may be directly linked here, in that if the task itself is struc-
tured, there may be more scope to use more complex language, for instance through
subordination, to bring out more clearly the connections between different aspects
of the material in the task. This may be akin to the way planning time interacts with
task complexity, with planning having greater effects when tasks have greater poten-
tial through more elements or the need to transform elements. Task structure may be
functioning a little in the same way – giving learners something more challenging to
express. The greater complexity is a response to the demands of the task, and to the
attentional resources available.
Limited attentional capacity, second language performance, and task-based pedagogy 229

It is also helpful to revisit Levelt model for L1 speech, and to explore how it
operates differently in a second language context. As mentioned earlier, in the first
language case, one assumes parallel processing, in that the different modules work
together, so that each is ‘doing its work’ at the same time, dealing with developing
ideas (the Conceptualiser), clothing the ideas in language, in lexis and in syntax (the
Formulator), and then producing that language as actual speech (the Articulator).
The model implies a sequence of speech production, but where the product of each
module is then handed over to the next to accomplish actual speech. All the while
the Conceptualiser continues to produce pre-verbal messages to replace the ones that
the other modules have completed work on, in turn. The only other essential point to
make is that the mental lexicon is accessed to help in the overall process of translating
ideas into language, so that the lemmas in that lexicon (a) are an essential element and
(b) contain the information that is needed to enable language production, including
rich information about meaning, syntax, morphology, collocation, and even articula-
tion. With the efficient operation of this system, the result is that parallel processing is
achieved, in that stages do their jobs very quickly, and so do not consume attentional
resources, in the normal case, enabling the way each stage is simultaneously operative.
The central difficulty in the case of second language performance is that the differ-
ent stages can each encounter difficulties, independently, but in each case with the
result that the parallel flow of operation is disrupted since attention has to be allocated
disproportionately to one of the stages. (It is assumed, though, that the Conceptual-
iser, which is more language independent, is least vulnerable to such disruption.) As
a result, a serial mode of performance is frequently necessary, as the flow and cyclical
progression cannot be sustained.
This analysis of the pitfalls of second language speech production leads to two
central questions:

–– For the second language case, what conditions make it most likely that parallel
functioning can be maintained smoothly?
–– For the second language case, when there is breakdown, and serial processing
results, how can parallel processing be re-established?

A first major advantage of discourse structure is that it eases the relationship between
the Conceptualiser and the Formulator. Ongoing speech requires parallel operations
in which the speaker simultaneously has to keep track of immediate propositional
content, and also the relationship between that content and the wider discourse. As
a result, Conceptualiser operations can be demanding, and the relationship between
Conceptualiser and Formulator is ongoing and often attention consuming. On occa-
sions where there is structure, however, the speaker has a clear overall framework
within which to speak and so is more able to give attention to the more detailed level
of ongoing pre-verbal messages. The result is that, other things being equal, more
230 Peter Skehan

a­ ttention is available for Formulation, and so there is a little bit of spare capacity in the
system should occasions arise, as they will, where accessing the mental lexicon, and
retrieving and exploiting lemma information is more demanding. As a result of this, it
is less likely that the Formulator will require excessive attention, and parallel process-
ing can be maintained more often.
But the second advantage of structure to consider relates to retrieval from break-
down. It is a problem when one is speaking a second language that when things go
awry, it can be difficult to retrieve or keep track of the general plan one was trying to
put into operation. The second language mental lexicon is not as extensive, or elabo-
rate, or as well organised, or as fast-access, as the first language lexicon. The demands
placed upon it during continuous speech cannot easily be met, since its operation is
effortful and slow. The result is that one has to find attentional resources not only for
ongoing communication, but also for the route back, so to speak, to enable the original
plan to be recovererd and executed. This can have a very considerable effect on the
harmonious production of language.
A major advantage of structure in the speech production process is that a clear
macrostructure to what is being said provides the speaker with multiple opportunities
to restart from a reasonably well-defined point. For example, if a narrative is based on
a tight situation-problem-solution-structure, a particular sub-section may cause prob-
lems, but then when the next section is reached, the decks are cleared, as it were, at a
well-defined point in the overall structure, and smoother speech production can be
restarted. This support-through-structure avoids the need to have to reorganise the big
picture of what is being said (a difficult task indeed) and enables the speaker to get on
with relatively local proposition expression. In other words, although a parallel mode
of processing may have been disrupted, a new starting point can enable parallel pro-
cessing to be regained. The result is that once again Conceptualiser-Formulator rela-
tions become more harmonious, and the second language mental lexicon has attention
available to handle the pre-verbal message demands made by the Formulator. And of
course, this can be done more than once! So we see that structure can make a use-
ful contribution to both the questions posed earlier in relation to the maintenance
of parallel processing -easier availability of attentional resources for the Formulator,
and also multiple potential re-entry points to recover parallel processing in the wider
discourse.

Processing, task complexity, and cognition

All the chapters in this volume have subscribed to a view of attentional and working
memory capacities as limited and have explored consequences of such limitations.
The next section tries to bring together issues which derive from a central aspect of
Limited attentional capacity, second language performance, and task-based pedagogy 231

this – the impact of processing conditions on second language task performance. We


have touched on this briefly already in the section on planning, where on-line planning
research is essentially concerned with processing conditions (and so we will not revisit
that research in this section again). Here we will look at the chapters which make pro-
cessing more central in their research designs, and which, by so doing, shed light on the
Cognition-Tradeoff debate.
The Cognition Hypothesis (Robinson 2011) proposes that task complexity is an
important influence on performance, and that (counter-intuitively for me) greater task
complexity pushes speakers (or writers) to achieve higher complexity and accuracy
simultaneously, as they mobilise attention to do justice to the greater complexity of
the task which is being done. Language complexity is raised through the demands of
the greater task complexity, and accuracy is raised as the greater need for precision
becomes more influential. The specific influences derive from what Robinson (2001)
terms ‘resource-directing’ factors, such as time perspective, number of elements, and
reasoning demands, which he links to particular language needs. In contrast ‘resource-
dispersing’ factors, such as plus-or-minus planning time, prior knowledge, and single
tasks, affect attention generally and do not link with pushing attention to respond to
particular language demands. To restate this, first, the Cognition Hypothesis (CH)
proposes a particular set of task features, such as time perspective, which share the
quality of being resource directing (although what constitutes that common quality
is not always clear). Second, these factors drive task complexity. Third, when there is
greater task complexity, accuracy and language complexity are jointly raised. It should
be noted, therefore, that the Cognition Hypothesis is not simply saying that task com-
plexity can be defined variously – it has to be associated with a resource-directing
feature. In addition, it is not saying that task complexity leads to greater language com-
plexity alone – there needs to be an impact on language complexity and accuracy.
These stringent predictions are what give the Cognition Hypothesis its greatest dis-
tinctiveness and appeal.
The Limited Capacity (or Tradeoff) approach does not make any distinction
between resource-directing and resource-dispersing factors. Instead its central prem-
ise is that attention and working memory capacity are limited, and that these limita-
tions constrain what is possible in performance. There will be times, in other words,
when general available attention will be lower, and this will have a damaging effect
on performance. The Limited Capacity approach also proposes that task features and
task processing conditions can impact on selective aspects of performance (akin to
resource-directing factors) but does not propose any quality of ‘resource directedness’.
Where there are influences on specific aspects of performance, for example, complex-
ity, accuracy, it proposes that these have to be accounted for by specific independent
variables acting on specific performance measures. The areas explored in the previous
two sections (planning and task structure) are examples of this. Each of them has
232 Peter Skehan

a complex relationship with aspects of performance. Planning, as we have seen, can


push for greater task complexity (the opposite of a CH account), or it can ease process-
ing demands, depending on the particular nature of the planning undertaken. Struc-
ture can influence language complexity and accuracy, but, like planning, is regarded as
a resource-dispersing variable within the Cognition Hypothesis, which, from the pres-
ent perspective, is a little curious. Interestingly, a Limited Capacity account accepts
that there will be times when accuracy and complexity will be jointly raised, but pro-
poses that this is because of the separate effect of different task factors or processing
conditions. To justify these interpretations, it makes links with the psycholinguistics of
speaking, here also attempting to generalise Levelt’s first language model of speaking
to the second language case. A great deal that happens then follows from the ways a
second language mental lexicon is less adequate than that in the first language.
The chapters to be discussed in this section focus on processing and time per-
spective. Two are experimental studies, and one is largely (but not wholly) based on
qualitative research techniques. The two experimental studies used video-based nar-
ratives, as indicated earlier. This research design decision was made for two reasons.
First, given that the majority of studies of narrative task performance are based on
picture cartoon series, it simply widens the database of findings that is available, and
so might permit more robust generalisation. Second, the use of video-based narra-
tives, especially under conditions of simultaneous story telling, raises the processing
demands, since it gives the participants in the studies interesting input-handling prob-
lems, which might well make experimental effects more difficult to obtain. In other
words, the need to handle the remorseless flow of new input may swamp the learner
and give other influences such as structure little spare capacity to work with. The pres-
sure is on, in other words, for the variables which are used in the design of the studies
to show their worth.
The relevant studies here are Skehan and Shum (Chapter 7), Wang and Skehan
(Chapter 6), and Pang and Skehan (Chapter 4). The first two are also studies that fig-
ured in the discussion of task structure, and this is a good indicator that the two fac-
tors, structure and processing, are linked, so that the present section will simply have
a different emphasis and try to concentrate on processing issues even though they
are bound up with structure. The section is also the closest direct investigation of the
Tradeoff and Cognition Hypotheses, since the major implementation of a processing
variable concerns a contrast between Robinson’s Here-and-now and There-and-then
conditions, an example of his resource-directing variables.
Skehan and Shun (this volume) contrasted four processing conditions, three of
which were Here-and-now and one of which was There-and-then. A major focus of
their research concerned the different Here-and-now conditions. In addition to a ‘base’
condition, they also used the Here-and-now format, but with some mitigation, either
in the form of a Summary given to participants before they started a video narrative
Limited attentional capacity, second language performance, and task-based pedagogy 233

retelling, or by having the ability to pause the video. These two conditions were asso-
ciated, slightly, with higher levels of performance, with the provision of a summary
before the narrative was done having a good effect on accuracy. The clearest effects
here were with the There-and-then condition which generated raised performance in
all areas, but especially fluency, where end-of-clause pausing was significantly lower
and with reformulations, which were higher, i.e. more dysfluent, but where one could
argue that the greater number of reformulations indicated a greater engagement with
the discourse that was being produced. However, and this is a very important quali-
fication, the cell numbers for the comparisons of processing condition were small, so
the conclusions one can draw from this study are only tentative.
Pang and Skehan (this volume), in their qualitative study of reported planning
behaviours, draw attention to two types of report which bear upon processing. First,
there were participants who reported, in effect, overdoing their ambition when they
were planning, so that the subsequent performance was pressured because of their
own behaviour. Second, there were reports of participants anticipating the problems
of pressure, and preparing for it, to some degree. This study does not directly address
processing influences, but it is interesting that some of the participants themselves
seemed to be aware of the importance of processing pressure, and better performance
was associated with those participants who were realistic and prepared.
The major study in this volume which directly addressed the processing issue is
Wang and Skehan (this volume). As we have just seen, they used a research design
which manipulated structure (discussed above), vocabulary difficulty, and time per-
spective (as the variable bearing upon processing). They report a general and strong
effect for time perspective with There-and-then performances which have more struc-
turally complex, more accurate, more lexically complex, and more fluent language. But
in addition there is an effect for structure, but only with the There-and-then condition,
in that Structured There-and-then conditions produce the highest performance of all.
This is a much clearer effect than Skehan and Shun (this volume) and it shows that
processing pressure, which comes from the need to retell a narrative while a video is
running and therefore providing considerable and ever-changing input, has a clear
effect on performance, and one which is not good, in any performance area.
Broadly, then, processing pressure is an issue. One minor and two major factors
will be proposed here as relevant. The minor factor is that of vocabulary difficulty.
It was interesting to manipulate this factor for the first time, but unfortunately, its
impact was limited. Earlier post-hoc work with previous studies had suggested that
vocabulary difficulty can have a disruptive effect on processing, and push second lan-
guage speakers into more serial processing modes, as second language mental lexicon
problems have a strong impact. The evidence in Wang and Skehan (this volume) was
not supportive. Further research here may be warranted, but in a perverse way, we can
conclude for the present that vocabulary burdens for second language speakers were
234 Peter Skehan

not as troublesome as was expected, which may have its attractions, pedagogically! If
task input lexical demands had a strong impact on performance irrespective of other
variables, considerable effort would have to be put into scrutinizing pedagogic tasks
in order to avoid accidental points of difficulty. The first major factor is the issue of
quantity/speed of input that has to be handled for a task to be effectively transacted.
The faster and more extensive the input, the greater the problem that is posed for the
speaker. In a sense, this is the opposite of the claim made in the previous section about
structure – that it enables effective restarts after trouble has been encountered. Here,
the problem is the remorselessness of input, and the way this poses serious problems
for the second language speaker. More input means that the speaker has to struggle
more and more to keep up with the input, and its lexical and propositional demands,
with the result that a serial mode of speaking dominates. Restarting is possible, but
not with anything other than a reactive mode. There are no opportunities to regroup,
and link to any general discourse macrostructure – the speaker simply has to deal with
whatever is new in the input, with the result that effective parallel processing becomes
close to impossible.
Related to this is the second major factor – that of non-negotiability. In simultane-
ous narrative tasks, the input has to be heeded. But with other types of task, there are
times when the speaker can shape what is to be said, and in so doing, make things eas-
ier for themselves. In a way, an aspect of the difficulty of simultaneous narrative tasks
is that they are based on input that is non-negotiable and with no time to interpret or
reframe it – the speaker then has the role of describing that input in its own terms. In
other tasks, selection, reorganisation, and alternative orientations become possible.
These have the considerable advantage that the speaker can then play to their strengths
and away from their weaknesses (Foster & Skehan 2013). Since narratives provide less
scope for this to happen, it is clear that they make serial processing more likely, inde-
pendent of amount of input – they deprive the speaker of methods of personalising
the task. Perhaps discourse structure has a role here. At least with some awareness of
the overall structure the speaker can free themselves of input dominance, and decide
on narrative paths of their own, thereby enabling them to find a pathway through the
task that is strategically easier to manage, and so making parallel processing just a little
more likely. In that respect it is worth noting that the chapters in the present volume
(with the exception of Li, this volume) only used narrative tasks. It is likely that inter-
active tasks are going to be much less susceptible to this influence of non-negotiability.
They are much less input-based, and also more likely to be ‘shaped’ by the directions
suitable to the participants.
The results reported in Wang and Skehan (this volume) do provide some
encouragement for Cognition Hypothesis advocates. The There-and-then condi-
tion, proposed as more complex by this hypothesis, did generate higher accuracy
and complexity, as predicted by the Cognition Hypothesis. Unfortunately for the
Limited attentional capacity, second language performance, and task-based pedagogy 235

hypothesis, it also generated greater fluency, contrary to predictions. In addition,


Skehan (2009a) proposes that for the joint accuracy-complexity effect to be sup-
portive of the Cognition Hypothesis, there needs to be, in addition to statistical
group effects, a correlation between accuracy and complexity scores to demon-
strate that the effect operates at the individual level. The correlations reported were
not supportive of this. So this raises the question as to why there is such a joint
­accuracy-complexity group effect. As argued in Chapter 6, it is proposed here that
we have a processing effect, which contrasts the communicative pressure of a Here-
and-now narrative (despite the memory easing that might be involved) with the lack
of immediate processing pressure, and the time to make communicative choices,
which leads to much higher performance even though memory issues are involved.
In other words, the input dominance of the Here-and-now condition is avoided,
and the speaker has the space to shape and repackage the story, especially when a
structured task is concerned (which itself perhaps eases memory difficulties). Here-
and-now is non-negotiable. There-and-then is negotiable. This contrast seems to
have more importance than time perspective linked to memory, the factors that the
Cognition Hypothesis would propose as vital.
So once again a processing, Tradeoff-consistent interpretation is adequate,
and supports the claim (Skehan 2009a) that it is the conjoint influence of different
­processing-linked variables which can account for results. The lack of correlation
between accuracy and complexity in Wang and Skehan (Chapter 6, this volume) is
consistent with this. The lack of correlation (and see Skehan (2009a) for comparable
results in other studies) suggests that second language speakers can prioritise one
of these aspects of form, but find it difficult to do well with both. (And indeed, the
individual differences aspect of task performance beckons as one of the major unre-
searched aspects of the field.) Once again, we can relate this to the Levelt model, and
serial and parallel processes. A Here-and-now condition, with its remorseless input,
is constantly making fresh processing demands on the speaker. The immediate pres-
ence of input material, in its way, then constitutes a hindrance, since it provides the
speaker with even more information that could be encoded (since selectivity with the
input is more difficult to achieve), rather than an ‘easing’ factor for memory. A serial
mode is then unavoidable, and with that the unsatisfactoriness of trying to relaunch a
flow of discourse which is soon, in turn, disrupted. There-and-then, in contrast, is not
input pressured, and enables shaping and negotiating on the part of the speaker. Being
derailed by new input is then less likely, and a plan can be formulated which is more
likely to be stuck to. There are memory demands, it is true, but these are compen-
sated for by the other features of the There-and-then condition. When the narrative
is structured, so much the better, since the structure, presumably, makes the memory
demands less acute. The organisation of the structured story enables the speaker to
avoid getting lost, and to get on with immediate performance.
236 Peter Skehan

Selective attention and task conditions

We have looked, so far, at task features and conditions which impact on performance.
The previous section was concerned with processing issues more directly. We con-
tinue that emphasis here, but the focus is more on the act of speaking itself rather
than the input conditions which ‘surround’ that speaking. The broad theme is how
attention can be used selectively during task performance, and specifically how it can
be ‘nudged’ towards a focus on form. Two related questions underlie this discussion.
First, we have to ask whether attentional functioning and prioritising is influenced
by the learner, or by the task, or the conditions under which a task is done, or some
combination of all of these. Second, we need to explore whether, for performance
on second language speaking tasks, there is any sort of default position regarding
where attention will be directed – to meaning and fluency, to lexical or structural
­complexity, or to accuracy.
Learner characteristics have been remarkably under-researched in the task
literature. Working memory has been the most examined, but there are many
other possibilities. Skehan (1986) has discussed analysis-oriented learners versus
memory-oriented learners, and there are many other learner characteristics which
might be relevant here (Skehan 1989; Dornyei 2005), such as learning style, field
independence, personality, and so on. For now we can only recognise the possibil-
ity that these various factors might have some impact on typical approaches to
attentional priorities, and we can hope for future research to explicate matters.
More central to task explorations have been research studies exploring how dif-
ferent task characteristics can influence performance. Robinson (2001), through
the Cognition Hypothesis, proposes task complexity as the driver here, with its
joint impact on accuracy and complexity. Skehan (2009a), using a limited capac-
ity account, prefers to look for specific potential influences, explored separately or
in combination, to see if there are generalisations that can be made regarding task
quality-by-performance associations. For example, with complexity, tasks which
require information integration (Foster & Skehan 1996) or tasks with problem-
solution structure lead the speaker to encode the relationships which character-
ise the task in more complex syntax, essentially a resource-directing influence. In
fact, the limited attention approach is perfectly comfortable with the concept of a
resource-directing influence: what it does not extend to is a joint influence of task
complexity on accuracy and structural complexity, as a bundle. In any case, the
literature contains many reviews of systematic task influences on performance (e.g.
Skehan 2001; Ellis 2009). The basic point being made here is that task characteris-
tics induce speakers to devote attention to particular areas of performance, and so
the decision to choose a particular task, with its attendant qualities, is a decision to
push for higher levels of performance in particular dimensions. Similar arguments
can be put forward regarding task conditions, as we have seen in this volume, and
Limited attentional capacity, second language performance, and task-based pedagogy 237

factors such as planning or time perspective can be argued to lead to attention


being directed to particular performance areas.
But a wider issue with tasks is the notion of task difficulty, an issue of obvious
­relevance to assessment, but one which also has a strong role to play in how atten-
tion is used. The difficulty with difficulty is that performance is multi-dimensional:
good tasks can have multiple interpretations, and so establishing a simple scale along
which tasks can be ranged has resisted clear progress. Even so, we would all accept
that some tasks are more difficult than others, and more demanding of attentional
resources when they are being completed. So, even in the absence of clear definitions
of difficulty, we will proceed on the assumption that tasks vary in this regard. For the
sake of this argument, which is concerned with identifying appropriate tasks to work
with in research and pedagogic situations, we only need to describe tasks as easy,
intermediate, and difficult (with the meaning of these words obviously depending
on the abilities of the second language speakers concerned). We can characterise the
three levels as follows. Easy tasks are those where the challenge of the task (ideas, lan-
guage, etc.) do not pressure the attentional resources that are available. Difficult tasks
are those where there is serious challenge to attentional resources, to the extent that
performance may be difficult to sustain, and serial processing inevitable. Intermedi-
ate tasks, the most interesting tasks, are those where there is pressure on attention,
but at least some of the goals of the task can be met, provided that effective decisions
are made as to where to allocate attention. It is such tasks that we will assume are
operative in this section.
What this implies is that intermediate difficulty tasks are susceptible to influence
through the manipulation of task conditions. If attention is limited and if tasks can be
designed, or task conditions can be arranged, so that no undue demands are made on
attention, the consequence could be that there is greater accuracy. The link between
content familiarity and accuracy would attest to this (Foster & Skehan 1996). If second
language speakers would like, ideally, to achieve accurate performance, and if a rea-
son they do not do this is because things get in the way (as when excessive demands
are made on attentional resources during speaking), then easing tasks and condi-
tions could create space for attention to focus on form and, if not pushed to handle
greater complexity, then to achieve higher levels of accuracy. In this case, accuracy
would be the goal, but also something of a luxury, since it is a lower priority to achieve
than getting a task done. It is raised when all the conditions are right, but possibly at
the expense of stretching the second language speaker in other dimensions of per-
formance. It implies that the language which is chosen and the accuracy with which
­language is used may be affected through the conditions under which the task is done.
So such tasks are vital pedagogically, since decisions can be made which push the
learner in desired directions as far as development is concerned.
But a more challenging and interesting goal here is not simply to create unpres-
sured conditions and to hope that accuracy will be raised, as a sort of default for
238 Peter Skehan

a­ ttention, but instead to try to guide attention in some way, so that accuracy, spe-
cifically, is fostered and made more important for the speaker. The two studies to be
reviewed in this section are concerned with exactly this challenge, and they explore
ways in which that most difficult aspect of performance to influence, accuracy, can be
nurtured deliberately, rather than simply as a somewhat lucky consequence of a less
demanding task.
Wang’s study (this volume) manipulated several variables, as we have seen. Rel-
evant to the present section is her supported online planning condition. She reported
that when online planning was facilitated, with a slowed video retelling, there was no
impact on performance. However, when this online planning condition was preceded
by the opportunity to engage in strategic planning, it produced higher accuracy and
complexity. In other words, simply having more time was not enough here. It was also
necessary that there was some push towards an orientation towards form. As we saw
in Wang’s chapter, the planning probably pushed speakers to have more ideas that they
wanted to express. It may also have pushed them to retrieve and rehearse material,
material which could then be more effectively recalled and used because of the less
pressured performance conditions. A default view of attention here would have been
to argue that simply having more time should have led to an increase in accuracy. This
did not happen. It is clear that something more was needed to bring out the potential
for a focus-on-form. Language had first to be mobilised, and then it assumed greater
importance for the speaker. In other words, a form of guiding was necessary to exploit
the greater attentional potential that the on-line planning condition permitted. Wang’s
on-line planning condition when supported by pre-task planning raised form selec-
tively. Here it appeared that the organisation and preparation facilitated by the pre-
task planning needed the ‘space’ provided by the on-line planning condition (a slowed
video) to release attention which could raise accuracy and complexity. There was noth-
ing in the conditions here which oriented learners towards form – it was rather the
availability of attentional resources (released by the strategic planning) which could
be channelled in this way. One assumes that attentional availability was used to enable
more effective monitoring to be carried out.
The one chapter which directly addresses the issue of selective attention is Li
(Chapter 5). Following earlier research by Foster and Skehan (1997, 2013) she explored
whether anticipating the need to do a post-task transcription of one’s own performance
would have a selective impact on accuracy in performance. Confirming Foster and
Skehan (2013), she demonstrated such an accuracy effect. This suggests that within the
attentional resources that are available during task performance, where tasks are of the
appropriate level of difficulty, it is possible to prioritise particular areas. Li (this vol-
ume) showed that learners who were anticipating post-task transcriptions produced
significantly more accurate language. Knowing that they would be confronted by their
own voices seemed to alert them the problem of error and the way mistakes they made
Limited attentional capacity, second language performance, and task-based pedagogy 239

would have to be embarrassingly transcribed. So they devoted attention to avoiding


having to do this. This simply confirmed Foster and Skehan (2013). But the additional
feature of Li’s study is that different contexts of post-task transcription were used.
Two of these conditions seemed to induce a focus on complexity, in different aspects.
Individually-based transcription (as used in Foster & Skehan 2013) led to particularly
raised lexical complexity, as measured by the use of less frequent words. Pair-based
transcription, where collaboration was required, was associated with greater syntactic
complexity, as though this was the performance area which the act of transcription
highlighted and caused to be the focus of attention. Finally, transcription with revision
was, for the decision-making task, associated with greater accuracy. It appears that the
act of revision focusses on correcting errors, and this then becomes the performance
area, during tasks, which benefits from attention.
These two studies, the supported online condition from Wang (this volume) and
the post-task activities from Li (this volume), have in common that the conditions
under which a task is done can have an impact on accuracy, that most elusive of per-
formance goals, and also complexity. In reflecting on these two studies, it may seem
strange to start by exploring why second language speakers do tasks, but this is a use-
ful point of departure. After all, in research studies (and in many pedagogic activi-
ties) we ask participants to engage in task performance, ‘cold’, and so gaining some
insight into their motivations for their performance is hardly an irrelevant issue. Of
course there is the motive of reimbursement! Researchers recompense participants,
even if only modestly, and so one would hope this payment engages the participants
to some degree. But there is the issue that second language speakers often have to do
something, with language, which has no real relationship to their lives or their real
personalities. One can ask therefore how they react to this request, and whether there
are differences between learners, maybe across studies, because they make decisions
about how much to be engaged in different ways. A range of possibilities exist for how
participants behave:

–– To placate the researcher: We have just mentioned payment, and more generally,
participants may view a ‘minimum’ level of cooperation as being involved, and
even calculate how little they can get away with. Alternatively, if the researcher has
engaged their interest, they may try harder.
–– To handle the input: Obviously this only involves input-heavy tasks, but we have
seen several of these in the present volume.
–– To say something you want to say: The clear starting point here is that the chosen
task engages the speaker, who has relevant things that can be said. A decision-
making task could be of this nature, if the decisions connect with the value system
of the participant. Planning might make this more likely if it enabled the speaker
to bring to bear on the task their own personal opinions more cogently.
240 Peter Skehan

–– To look good, or at least, to avoid looking silly: In effect this would concern situ-
ations where the speaker has awareness of their own speaking, and might want to
look good in the most obvious way – to avoid error. A post-task condition might
fit in here.
–– To do better: Clearly here the starting point is to ask, better than what? Which
brings out that the repetition condition in Wang (this volume) would illustrate
this situation – a reference performance has been established which is still likely
to be in the memory of the speaker.
–– To get a good grade: Here the focus is clearly on being tested. This motive is worth
including because it draws attention to the split between findings in the task lit-
erature itself, and studies which have been done with tasks-as-tests (Iwashita et al.
2004). The difference may well be linked to differences in perceived purpose in
doing a test-task.

This discussion of purposes for doing tasks frames the discussion of the two studies
reviewed in this section. The discussion is proposing, essentially, that it is important to
have ‘drivers’ for tasks which are done, influences, that is, which inject some purpose
(Bygate & Samuda 2009). The purpose may come from the participant, or the purpose
may be contrived through the conditions which are used. When there is such a purpose,
either inherent to the participant, or contrived by the researcher, it is assumed that the
degree of focus that the participant brings to doing the task is heightened, and perfor-
mance may be influenced. In Wang (this volume), under the supported on-line condi-
tion, we see that the strategic planning gives the speaker something to say, something
which then energises the performance later, so that later the supportive time condi-
tions are exploited to do greater justice to what has been planned, under the conditions
where retrieval and rehearsal are more accessible. With Li (this volume), the post-task
conditions signal effectively to the speaker that doing the task is not everything, and
that there will be consequences later. As a result, anticipation of what will come later
is the motive which causes speakers to allocate attention to the aspects of performance
that they have been induced to value because of the later condition. An accuracy effect
was found for all conditions, but in addition, it was interesting that individual tran-
scription led to more impressive lexical performance, that pair-based transcription
pushed for greater complexity, and that transcription with revision strengthened the
accuracy effect. In broad terms, Li (this volume) is consistent in her findings with the
same broad class of influence reported in Skehan and Foster (1997) and Foster and
Skehan (2013), although the detail of her different conditions adds to our knowledge
considerably.
It is important to stress here that we assume that the tasks involved in both these
studies are neither very easy nor excessively difficult. But for speakers of the interme-
diate level of proficiency involved, they do constitute a challenge. The speaker has to
Limited attentional capacity, second language performance, and task-based pedagogy 241

make choices to allocate attention to particular performance areas, so the conditions


which were used are important: they induce selectivity, to some degree, because the
purposes and priorities that come from the conditions lead the speaker to value par-
ticular performance areas which otherwise they might not.
Interestingly, though, there is a connection here with the Cognition Hypothesis,
and one which can slightly modify the above conclusion. Robinson (2001, 2011), who
takes a radically different view to that represented here about the limitations in atten-
tional capacity, argues that attention can expand to meet the demands placed upon it.
For him, this is central in enabling accuracy and complexity to be jointly raised, when
pressured by task complexity. The present analysis suggests, in contrast, that attention
does have a maximum capacity, and that whatever the task complexity, that cannot
be exceeded. After all, limitations on working memory are very well established. But
it may be the case that the maximum available attention is not always used. In other
words, we may wish, as researchers, that participants in our studies give 100% all the
time. It is possible, though, that they are not galvanised to do so all the time, or even a
lot of time, whether by the token recompense they are receiving or from the low level
of inherent interest of the task. If variable commitment in maximum potential atten-
tional resources becomes a factor, then interpretations of findings in research studies
become even trickier!
And here the purpose of the task, as perceived by the participant, becomes vital.
If they are engaged fully by a task (through its interest) or if the purpose of the task is
clear to them, (and they fully accept this purpose), then their performance on the task
may change. General attentional availability may increase, but so could the attention
devoted to a particular performance area, such as error avoidance. In that respect, the
SLA literature on monitoring is extensive (Kormos 1999), and it is generally accepted
that it is an important process in second (and first) language performance (indeed, it is
integral to the Levelt model). What Li (this volume) has shown is that task purpose can
be manipulated to raise accuracy, and this presents strong evidence that what is hap-
pening is that a greater degree of monitoring is engaged in by these second language
speakers. The monitoring seems mainly to be directed towards avoiding error (which
would otherwise have to be embarrassingly transcribed), but it is clear it can lead to
other aspects of performance too. It appears that in the hurly-burly of task comple-
tion, monitoring is not the first call on scarce attention. With appropriate conditions,
though, its use can be enhanced.
This is the general effect that has been found, but there is now enough evidence
to go a little beyond such a generalisation. Two issues are relevant. First there is the
issue of task. Broadly, post-task research has mainly explored narrative and decision-
making tasks, and indeed, has demonstrated an accuracy effect with both sorts of task.
But it is intriguing that the effect tends to be larger with the decision-making tasks, as
if there is something about such tasks which is particularly supportive for the accuracy
242 Peter Skehan

focus engendered by a post-task activity. Second, and even more interesting, though,
is that there is now evidence that when a decision-making task is concerned, there
can also be effects for structural complexity. In other words, the focus on form is not
simply on accuracy, but also includes a sensitivity to using more complex language.
Once again there is no correlation between accuracy and complexity, suggesting that
while form is in focus, typically speakers can only manage to achieve more highly in
one area, not both.
We can return to the earlier discussion of the accuracy effect found in Wang's
study for supported online planning. There it was argued that such a condition makes
it more likely that there will be a Conceptualiser-Formulator balance, and that clar-
ity about the general task will free up attention during performance if conditions
are appropriate, as when the video on which the narrative is based is slowed. It may
be that decision-making tasks, because of their turn-and-turn-about nature, create
similar conditions. The opportunity to regroup while one interlocutor is speaking
can give a speaker the opportunity to create the equivalent of a structured task, and
with each new turn, embark on a parallel processing approach to speech. It appears
that with Li's revision condition, the interactive nature of the decision-making task
gives participants time to focus on language, and the revision condition directs this
attention to avoiding error. It is a combination of circumstances which produce a par-
ticular result. So in their way, Wang (this volume) and Li (this volume) have achieved
a similar thing – a good Conceptualiser-Formulator balance, and greater chances of
second language speakers engaging in parallel-process-based speech production.
A problem here though is that there are too many explanations for this one effect.
Li (2010) proposes a sociocultural account – participants collaborate and build an
encounter which takes them collectively further than they would go if operating alone.
At a lower level, and focussing on interactive opportunities, Foster and Skehan (2013)
propose that decision-making tasks enable ‘stealing’ of the interlocutor's language, a
finding which would perhaps apply to complexity and accuracy. They also suggest that,
within interaction, when it is the turn of the interlocutor, one could feign listening,
and thereby finesse planning time. Possibly, also, the immediate and obvious presence
of an interlocutor pushes for precision, and therefore greater accuracy. Finally, if one
has an interactive task, which is not driven by input in the same way as a narrative,
then there is greater negotiability as to what might be said, with the result that difficul-
ties can be avoided and strengths exploited.
This list of possibilities has been briefly enumerated so that we can make a link to
Wang's (this volume) study. Her supported on-line planning condition linked strategic
planning (and opportunity for Conceptualiser work linked to Formulator retrieval and
rehearsal) with an opportunity to speak where unpressured conditions enabled what
had been prepared for to be retrieved and utilised. Here, within interaction, we have
opportunity to plan, during interaction when one's interlocutor is speaking, or oppor-
tunity to steal (similarly while one's interlocutor is speaking) and then i­mmediately
Limited attentional capacity, second language performance, and task-based pedagogy 243

an occasion to use what has been prepared for during this rest period from speaking.
Given the focus injected into the task towards a focus on form (through the post-task
condition) plus the useful ‘planning to performance’ conditions, it is perhaps not so
surprising that interactive tasks are a good locus for experimental effects to be found.
These, following the above analysis, can often involve both complexity and accuracy,
but not often both for the very same participant.

Second language performance: Positive and negative influences

We have now reviewed the studies which form the heart of this volume. The survey has
been extensive, not least because the range of variables which have been studied has
also been extensive. Accordingly, Table 2 shows, in summary form, the range of find-
ings from the studies. Setting them out in this way can then be a prelude to a reflection
on the nature of second language performance and the ways it can be supported, but
equally the ways that difficulties can be caused.

Table 2.  Summary of influences on second language performance


Effects Interpretation

Planning
Familiarity Associated with greater More familiar topics enable more specialist
lexical sophistication. vocabulary to be accessed.
Little effect on other
performance areas.
Conventional Greater structural Ideas make the transition from planning
pre-task planning complexity and fluency. to performance most generally and most
Few effects on accuracy. dependably. Dangers of excessive ambition.
Supported on-line Greater structural Good Conceptualiser engagement, and
planning complexity and greater then good Formulator conditions for use of
accuracy. rehearsal and retrieval from planning.
Repetition Strong effects on First performance (a) enables ideas and
complexity, accuracy, and language to be made more salient, and (b)
fluency. triggers ‘deep’ lemma activation which is still
available for subsequent performance.
Structure Raises accuracy and Clarifies what Conceptualiser needs to do
complexity, especially Releases attention for Formulator
under There-and-then Enables ‘restarts’ after serial processing.
condition.
Processing Accuracy and complexity Less input pressure enables more focus on
benefit when processing form, as does the opportunity to choose how
pressure is reduced, to narrate the story, with freedom from input
through There-and-then dependence.
tasks.

(Continued)
244 Peter Skehan

Table 2.  Summary of influences on second language performance (Continued)

Effects Interpretation
Selective Attention
Supported on-line Raises accuracy and Less pressured conditions are vital because
planning complexity. the planning has prepared the ground, and
the retrieval conditions exploit this planning.
Post-task conditions Raise accuracy, and also Pedagogic norms are emphasised through
lexical and structural anticipation of the post-task, and attention,
complexity, the latter even though under some pressure, is
especially with an directed towards form, especially accuracy.
interactive task.

Skehan (2009a), revised in Skehan, Bei, Li and Wang (2012), attempts to charac-
terise influences on second language spoken performance through two interlocking
systems. First, influences are organised according to Levelt’s stages of speech produc-
tion (Conceptualisation, Formulation-lexical, Formulation-morphosyntactic, Articu-
lation), and second, task and task condition influences are grouped as leading (a) to
complexification, (b) to pressured performance, (c) to eased performance, and (d) to
focussed/monitored performance. This same approach underlies Table 2. The table
attempts to organise what we have learned about influences on task performance,
largely following a Tradeoff account. The discussion which follows recapitulates the
evidence and argument from several publications (Skehan 2009a, 2009b; Skehan et al.
2012), but emphasises what is new, especially what derives from the chapters in the
present volume.
It is helpful to restate the basics of the Levelt model. Conceptualisation is con-
cerned with the ideas to be expressed, and delivers what is termed the ‘pre-verbal
message’. This is the starting point for Formulator operations, involving retrieval
from the (second language) mental lexicon, the building of morphosyntax, and the
preparation of phonological representations. Finally, the Articulator takes the out-
put of the Formulator and produces actual phonological realisations to capture what
the speaker is trying to say. Each component in the model is meant to function in
modular fashion, so that all three components are working simultaneously, but on
different things. Importantly, of course, this process is ongoing, as speaking contin-
ues, so that Conceptualisation continues to drive forward Formulator and Articula-
tor operations.
A major aspect of Conceptualiser operations, especially for the second language
case, is that it has both a general and also an ongoing-specific aspect. If, for example,
there is planning, the speaker effectively tries to load the Conceptualiser with mate-
rial which will continue to have an impact later in performance. The Conceptualiser,
in other words, has a ‘slow burn’ impact on communication that is not immediate.
Limited attentional capacity, second language performance, and task-based pedagogy 245

On other occasions, and this is obviously the norm, cycles of operation mean that
Conceptualiser operations at Time 1 are passed on to the Formulator at Time 2 (and
to the Articulator at Time 3) while new material will be occupying the Conceptual-
iser at Time 2, and so on. In this case, the ideal scenario is that the pre-verbal mes-
sage’s demands of the Conceptualiser are met by a rich mental lexicon, and speaking
modules proceed in parallel. As we have seen, this is often not the case with second
language speakers, especially those below advanced levels of proficiency. For them,
speaking is often a process of rescue, as the ideas they would like to express have to be
modified or expressed much more slowly.
However, there is a third manner in which the Conceptualiser can have an impact
on performance which is mid-way between the two just outlined. This occurs when
the Conceptualiser, through planning or through quick-thinking, is able to exploit
macrostructure in what is being said. Conceptualiser operations are partly concerned
with retaining the general structure, and the speaker’s place in it, and partly with the
ongoing detail of current speech. In this case, there is considerable potential for Con-
ceptualiser operations to span several time periods if we are thinking about the macro
planning role that it may discharge.
Against this background, we can discuss the findings in this volume as they impact
upon the second language speaker’s balance of parallel and serial speech performance.
It would seem that the following influences promote a parallel mode of functioning:

–– doing tasks which are structured, with this impacting on Formulator operations,
as there can be focus on what is being said at a particular moment because the
speaker does not have to wrestle with wider organisational issues
–– doing structured tasks in which the speaker is ‘pushed down’ to serial processing,
but where the task structure enables parallel functioning to be regained, since a
fresh starting point can be identified through the clarity of task structure
–– preparedness, which can promote parallel processing variously
{{ through retrieval and rehearsal operations which are recalled during the actual
performance, and which then ease Conceptualiser and Formulator operations
{{ through supported online planning, which combines effective use of planning
with unpressured retrieval conditions while speaking
{{ familiarity, through greater access to relevant lemmas and the information
that they contain
{{ immediate repetition, which activates all aspects of performance, and which
specifically triggers lemma access to the greatest extent possible, thereby
advantaging Conceptualiser, Formulator, and Articulator
–– unpressured performance conditions, where there is not a constant (and possibly
rapid) flow of new input (included here would be There-and-then time perspec-
tive tasks)
246 Peter Skehan

–– mediation in some way which introduces some level of organisation to what is


being said
–– the opportunity to negotiate what is going to be said, rather than being forced to
express whatever the input contains

Conversely, of course, there are conditions which make it more likely that serial pro-
cessing will be engaged in. At the risk of repetition, with points which simply reverse
those covered above:

–– ineffective preparedness
{{ where the speaker has been overly ambitious in the planning which is
done, with the result that the speaker tries to take on language which is too
demanding
{{ where the speaker has tended to focus on material (e.g. specific form, which
tends to fade and then not be usable in actual performance)
–– unstructured tasks, in which there is little clear overall structure that the speaker
can use for guidance, or as the basis for retrieving parallel processing after it has
become unsustainable
–– heavier processing pressure, such as quantity or speed of input, typical, in fact, of
Here-and-now conditions

This long section has surveyed the findings from the different research studies in the
book, and shown that portraying performance in terms of complexity, accuracy, lexis,
and fluency is still viable and useful. It has also brought out what progress has been
made through the different chapters. Finally it has attempted to relate these findings to
the way second language speakers are supported or frustrated in achieving the sort of
parallel processing that is the norm for first language speakers. We turn next though
to application, and how the sort of research which has been described might have an
impact within the classroom.

Pedagogy

There are two parts to the Pedagogy section. The first explores issues operative at the
within-lesson level and tries to relate the research-based discussions from the rest
of the book to decisions which have to be made in this context. The second section
outlines some wider principles for the use of tasks over more extended pedagogic
sequences. However, note that it is not the intent of this chapter or book to provide a
detailed discussion of issues of task sequencing (Robinson 2007) or of how a series of
tasks can be linked, within or across lessons, as in a scheme of work (Van Den Branden
2006), or of how project work could be a wider framework within which tasks could
Limited attentional capacity, second language performance, and task-based pedagogy 247

operate (Skehan 1998, 2013). The focus here is on how the kinds of tasks utilized in the
research reported in this volume, and the findings from that research, might provide
one basis for informing task-based pedagogy, though certainly not the only basis.

Tasks within lessons


The emphasis in this chapter so far has very much been on performance, on the task
and variables which influence it, on the dimensions which capture it, and on the theo-
ries which might account for it. What then, can be said about pedagogy? This is indeed
a difficult question, since considerable extrapolation is required from these earlier sec-
tions. But it is argued here that we have a responsibility to try to tease out what rel-
evance such research has, even if this only means to understand its limitations. So this
final section of the final chapter will confront the ‘pedagogy problem’, and try to be
even-handed in its approach. It will offer an account of pedagogy where task-based
approaches have a major contribution to make. It will also argue that there are areas of
pedagogy where a task-oriented approach has less to say. But it will, wherever possible,
try to ground any claims that are made on research evidence, and try to make links
with what we currently know about second language acquisition.
To that end, we can have in mind a view of pedagogy in terms of the following
stages:

–– Pre-task activities, where these might be planning or a range of other activities


which prepare learners to do tasks more effectively.
–– During-task activities, where this can mean choosing particular tasks (on the
basis of criteria of some sort) and then implementing such tasks under different
choices; a variation here (Willis 1996) would be to re-do a task, within the task
cycle, in such a way that there is opportunity for reflection or even teacher input
before the task is re-done.
–– Post-task activities, where these can be brief, as when, for example, a post-activity
such as transcription is involved, or more extensive, when some focussed work may
be done which develops something which has come up within task performance.

One additional feature of a task based approach is important. There are assumptions
here about the role of the teacher and the pedagogic activities s/he orchestrates. It
is assumed, for example, that the teacher is able, at the pre-task stage, to devise and
organise activities that are relevant to task completion other than explicit presenta-
tion and teaching. In addition, at the during task stage, it is assumed that the teacher
will not be intrusive, but will nonetheless be very alert and in some way paying atten-
tion to the language which is used, and even possibly findings ways of recording it
without interfering in the way tasks are completed. Finally, at the post task stage, it
is assumed the teacher will have some knowledge of what has happened while the
248 Peter Skehan

task was taking place and can draw on this knowledge effectively when any focussed
language work is carried out. The discussion which follows will presuppose such a
(fairly obvious) set of teaching possibilities and teacher behaviour and will link differ-
ent stages to ways in which tasks can be used more effectively. This is obviously quite
restricted in treatment and a good as well as broader account of task-based teaching
can be found in Norris (2009).
The framework for this discussion is a series of stages which can be proposed for
second language acquisition (Skehan 2002). The stages are intended to capture how
new language develops, and then how progressively greater control is achieved over
that language. The sequence implied is meant to apply to any particular element in
an emerging interlanguage system, but it is assumed that different elements of the
language being learned will be at different points on this sequence. The sections which
follow will clarify each of these stages. They are:

–– noticing
–– hypothesising
–– complexifying/extending
–– restructuring/integrating
–– repertoire creation, availability, accessibility
–– achieving supported control, avoiding error
–– automatizing
–– lexicalising

We can discuss each of these in turn. The importance of noticing has been recognised
through the work of Schmidt (1990), particularly for noticing in input, and Swain
(1985, 1995) for noticing in one’s own output. Schmidt (1990) argued that noticing is
a necessary precursor to subsequent acquisition – that which will be acquired has first
to be noticed. He emphasised the way input may lead to noticing, but that if condi-
tions can be created where noticing is more likely to occur, then there are greater pos-
sibilities for intake (Corder 1981) and processing. Swain, in contrast, was concerned
with the idea of ‘noticing the gap’ where, through communication, a speaker becomes
aware of a deficiency, and only then may do something to address this deficiency.
Clearly, for each of these possibilities, noticing is only a starting point, but it is a very
important starting point. Two additional points are worth bringing out in that regard.
First, to repeat: noticing is a necessary but not a sufficient condition. More needs to
happen, particularly in developing and consolidating what has been noticed (and see
below for more discussion of this). Second, noticing meshes rather neatly with notions
of developmental readiness (Pienemann 2003). If one assumes, following much sec-
ond language acquisition research, that there are sequences of development, then it is
important not simply to notice, but also to notice the right thing, as it were, in terms
Limited attentional capacity, second language performance, and task-based pedagogy 249

of development. In this way, the learner is more likely to be able to make progress with
what has been noticed, as opposed to something coming into awareness which then
leaves awareness just as quickly.
A benign view of second language acquisition would be that interaction contains
all that is necessary for development to proceed. I am assuming that this is not the
case – a cornerstone of the proposals being made here is that something more needs
to ­happen. In that light, what is important is that noticing can be built on, and nur-
tured (Skehan 2013). The noticing has to come from the learner, but the teacher can
attempt to trigger and/or elicit and certainly respond to such noticings, and return
to them, with the broad aims of developing and consolidating them. In the stages
indicated above, noticing could easily occur at the pre-task stage, for example, when
planning is taking place or when pre-task input, such as text, is being provided. This
perhaps would be more likely to be a noticing-the-hole in projected output for the
task-to-come. It could also occur at the actual task stage, as input is received from
an interlocutor, input perhaps which is particularly salient because it is important in
task fulfillment, and so the form-function mapping of particular input will be clearer.
In any case, at either of these stages, pre-task or task, noticing could easily occur. We
return then to the role of the teacher. It is important that the noticing does not occur
and then disappear – teacher activity can be good at reminding learners about their
own insights, and then working with these insights.
Similar considerations apply with hypothesising. Once again, it is entirely likely
that hypothesising will take place at the pre-task or task stages. Learners may want
to say something (or they hear something) and realise that this prompts reflection
on interlanguage structure. Once again the motive is the language made salient by
the need to do the task. For example, they may realise that they can extrapolate from
some particular item of language because they see how it may be connected to a wider
rule. Context, as with noticing, is the key, since the language is related to what they
are trying to achieve in doing the task, but hypothesising is potentially more power-
ful than noticing. It indicates a greater breadth and depth regarding the target lan-
guage. And the key here is even more clearly the post-task stage. Of course, during
task preparation the learner may formulate a hypothesis and do so very well, so that
little more needs to be said, but it is more likely that there is a tentative or even unnec-
essarily ­circumscribed nature to the hypothesis. For these reasons, teacher-focus on
this hypothesis afterwards is crucial. Given that the language involved has been made
salient, and given that there is every chance of readiness, since it was the learner who
formulated the hypothesis, the moment is ripe for teacher follow-up. In other words,
in these circumstances, where the language has been made salient by the learner doing
a task, it may now be appropriate for the teacher to be explicit (where being explicit
earlier risked flirting with the irrelevant). The teacher in other words can now rein-
force the hypothesis, extend it, link it with other parts of language, or even correct a
250 Peter Skehan

mistaken hypothesis. Naturally the teacher will have to be judicious in judgments that
are made – one learner’s hypothesis risks being another learner’s boredom or confu-
sion. But assuming the teacher can make good judgements here, the post-task stage,
once again, is vital for ensuring that a good insight, a perceptive hypothesis, is not
abandoned but built upon.
So far, with noticing and hypothesising, the use of tasks has been essentially as a
vehicle so that certain processes occur, and then these processes are exploited at the
post-task stage. At this stage, the teacher can actually be a teacher! In fact, we continue
this pattern (although it will change soon!) with the next couple of stages. Learning a
language is a complex undertaking. Languages are complex systems and sub-systems
and so making inroads into such systems is not easy. Noticing and hypothesising are
good, but only go so far. They are also likely to be limited in scope. If what has been
noticed or hypothesised about is small in scope and self-contained, then perhaps little
more is involved in real development, but often (think of the development of tense
systems, or modality) what is noticed fits into a larger whole. So while the noticing is
essential, what is even more important is that the outcome of that noticing is extended
and connected with other parts of the developing interlanguage system. In other
words, following noticing, there may be a need to complexify, and to see that what is
new bears a relationship to other aspects of the language being learned.
This analysis, though, does not cover all types of development. Sometimes prog-
ress means understanding that previous understanding was partial, and that a larger
system is involved, which pushes the learner to restructure and reorganise. The past
tense in English would be a good example, where at some point the coexistence of
regular and irregular past has to be organised into a more complex system than the
separate item-based or rule-based systems that were previously dominant. In other
words, there is a need to take two steps back to go three steps forward. In such
cases restructuring a developing system, or integrating what was regarded as a self-­
contained and independent system into some other larger system may be a fairer way
to capture what is going on in development. Once again, the pre-task and task phases
may provide the insights which are important, particularly if we still think in terms of
readiness. But it is likely to be the post-task phase which is most effective. Then lan-
guage which has been made salient during earlier phases (provided that some record
is available of that language) can come into focus and enable the teacher to help learn-
ers deal with what was uncertain and only partially understood. Once again one has
to emphasise the importance of this being the agenda announced by the learner so
that the teacher, in helping restructuring and integration to occur, is ‘counterpunch-
ing’ to the input that is relevant to the learner. The importance of the post-task phase
cannot be overstated for these developments to occur. Equally, the central way in
which learners can recall the insights that emerged in earlier preparation or com-
munication is vital. They are what drive the usefulness of teacher contributions at the
Limited attentional capacity, second language performance, and task-based pedagogy 251

post-task stage. This is where the teacher can contribute expertise about language,
and consolidate and clarify so that learners have some confidence in the learning that
has taken place (Willis & W ­ illis 2007).
To this point the reader may be thinking that this is an odd presentation of what
happens in task-based approaches to instruction. The focus has been on using tasks,
certainly, and preparing for these tasks, but then the real ‘action’ seems to come at the
post-task stage. The tasks have been important as vehicles to enable useful language to
emerge, but then the significant work is deferred until later. The reason for this is the
problem of new language, sometimes erroneously regarded as a deficiency in a task-
based approach (Swan 2005). What the previous discussion brings out is that there are
ways in which such new language can be brought into focus, something which it seems
has to be made clear for critics of a task-based approach. The other side of this is the
vital importance that the methodology outlined above has the central feature that what
is ‘announced’ as the focus for such language work is material that makes sense to the
learner and which the learner is ready for. The problem in instruction (task-based or
otherwise) is not new language in itself, but which new language. The view taken here
is that it is important that it is the learner, not the syllabus designer or materials writer,
who is influencing what will be done. It is considered that this is crucial, and consis-
tent with contemporary second language acquisition. That the treatment comes a little
later than the need was ‘announced’ is not the issue (although, of course, the teacher
may also respond to learners mid-task, if that is appropriate, and not disruptive or too
extensive). The central point is that the language concerned makes sense given the
learners’ current stage of development (Skehan 2007).
Now we can move on, and in so doing, bring conventional approaches to task
performance more into focus. What we have done so far is look at the language which
emerges from completing tasks, and how that language can be made less transitory
and instead contribute to an evolving and complexifying interlanguage system. How-
ever, now we are assuming that some new language has been noticed, hypotheses have
been formulated, and complexification, extension, and integration have taken place,
wherever they are appropriate. In other words, the learner is clearly aware about fea-
tures of the target language which he or she was not before.
Essentially, the next stage consists of exploring how a degree of control can be
achieved with this new language. How, that is, can language which has been wres-
tled with, possibly laboriously, be converted into language which can be readily used,
appropriately, and with reasonable speed and lack of error? The first stage in acquiring
greater control is to be able to use such new language under supportive conditions
(and possibly not totally accurately at first). In other words, it is assumed that when
some new language is apprehended and linked to previous interlanguage, there is no
magic way in which this language is suddenly available for correct use in real time in
a range of situations. It has to be nurtured and control developed gradually. It is here
252 Peter Skehan

that much of the previous discussion on tasks is relevant. We have seen (and this is
captured in Table 2) that a whole range of influences enhance levels of accuracy and
fluency. In effect, these are the conditions which are needed to make the development
of greater control a reality. So, for example:

–– opportunity for supported on-line planning


–– familiar information
–– opportunity to repeat tasks
–– post-task activity, especially with revision

are all very important here. By choosing tasks which maximise accuracy and fluency,
and task conditions likewise, the learner is being supported to achieve greater levels of
control. This can assist first stages in making the transition from halting speech pro-
duction to the capacity to use language in real-time. In effect we are dealing here, more
generally, with either creating tasks and conditions for more attentional resources to
be available for the speaker, so that greater accuracy, for example, can be achieved; or
for tasks and conditions to push learners to higher performance in particular areas,
again highlighting accuracy; or for a situation where attention is ‘nudged’ in particular
directions. So knowledge of research into second language production is relevant to
helping learners to follow desirable pedagogic directions.
An important point needs restating here. It is clear that the use of tasks in this way
draws on the importance of implicit learning and even of practice, since the learner
is being given (supportive) opportunities to gain control over language. We are now
beyond the stages where new language has been noticed, complexified, integrated, and
instead are concerned with making this newly-acquired knowledge implicit. A pro-
ponent of a presentation-practice-production (3Ps) approach might then claim that
this view of tasks is no different from the role ascribed to them by task critics such as
Swan (2005) or Bruton (2002), or even task sympathisers such as Littlewood (2004).
The key point, though, is the issue of what language is being used, and that in turn
connects with the issue of pre-selection. A 3Ps approach is characterised by selections
being made by the teacher/materials writer, and then the presentation phase is a phase
working on something selected by someone other than the learner. A task approach
is one where the language which was earlier selected for treatment was selected by
the learner or emerged from learner performance. The use of task-informed criteria
here to promote control is consistent with this view that the selection comes from the
learner. There is no pre-selection of forms for task performance – that is the learner’s
choice. The decisions linked to task selection and task implementation are intended
to create conditions to support control of the language which is chosen by the learner.
In fact, developing this point, we can return to the usefulness of the post-task
stage. Where the language that is being focussed on has emerged from the learner,
there is no reason, if a teacher deems this appropriate, for the post-task stage not to
Limited attentional capacity, second language performance, and task-based pedagogy 253

include practice activities. So far we have regarded this stage as one where noticing,
hypothesising, complexifying, and restructuring generate a fairly cognitive view of
language itself, of its patterns and of the emerging rule-governed system, but devel-
oping language skill, as we all know, involved more than insight and understanding.
It also involves performance, and if a teacher decides that some aspect of language
is emerging, but could benefit from more traditional practice activities, then there is
no reason not to use them at this later stage in a teaching sequence. The point, a bit
laboured by now, is only that what is being practised is a response to learner need, not
syllabus prescription.
Continuing this analysis of tasks in terms of the development of control, the next
two stages are essentially extensions of what we have already seen. Automatising, fol-
lowing Anderson (2004), consists of speeding up performance while eliminating error.
Supported control, the previous stage, is likely to be characterised by slow perfor-
mance, and the intrusion of errors. Automatisation does not really involve much that
is different but it does lead to a greater degree of confidence in performance, and even
robustness in face of contextual difficulties. With tasks, a similar analysis operates. A
range of influences are relevant in creating the conditions in which automatisation is
more likely to occur, and in some ways, these are an extension of what was mentioned
with supported control. But another factor which is important is, in a sense, the reverse
argument. Choosing tasks and task conditions to nurture automatisation is one thing,
but it does not serve learners if they only develop the capacity to use language in sup-
portive conditions. So another goal, where automatisation is concerned, is to choose
tasks and task conditions to put pressure on learners so that they feel more comfort-
able functioning in the wider range of circumstances they will encounter in the real
world. So automatisation here is a speed factor, but also a generalisation challenge,
which can only be attempted when some degree of automatisation has been achieved.
The final stage which is given here is lexicalisation. This stage is proposed (­Skehan
1998) to reflect a dual-mode system in which on the one hand we can use rule-based
language produced quickly as highly automatised, or on the other, the products of such
rule-based language can be lexicalised and then produced as exemplars or chunks.
Such a mode enables not simply speed of processing but also the advantage that there
are not many computational demands, so that attention is, to some extent, is freed up
while performance is ongoing (Skehan 2013).
Clearly using tasks is compatible with fostering fluency on the basis of lexicalisa-
tion. Using tasks which support Formulator operations, for example, will help in any
process of lexicalisation that might occur. But in all truth, it is likely that it is ask-
ing too much of tasks to expect them to contribute significantly to any such process.
Of course they will do much more than many other teaching methodologies, but the
amount of communication that is necessary for any process of lexicalisation to occur is
probably too great for any task-based approach to deliver. There simply is not enough
254 Peter Skehan

time for things to develop in this way. Lexicalisation is a desirable goal, but one that
probably can only be achieved by long and extensive exposure to the target language
in question. Task-based syllabuses developed to cover several years may achieve this,
although such a claim is currently speculative. Shorter-term task use would struggle to
achieve wide-ranging lexicalization.
The sequence which has just been described starts with the new, with something
that is perhaps not understood completely and is used haltingly and sometimes incor-
rectly, to a point where the formerly new language is now well-integrated into a devel-
oping system and can be used, in real-time fluently and correctly, and even without
undue processing effort. But there is another aspect of the sequence which we have
temporarily left out and now needs further consideration. This is the issue of saliency
or repertoire creation, what in French can be referred to as disponibilité. The previous
discussion has assumed there is some aspect of the language system and its choice
for use is self-evident – if something is known, it will be used. But such an approach
misses a very important point about language learning – one may know a great deal
of language that one does not use. So in addition to trying to teach new things, a goal
of teaching has to be to increase the access that the learner has to what is known, but
whose relevance and usefulness may not be appreciated. In other words, if learners
have found methods of solving communicative problems which are not pretty, or help-
ful for development, but are nonetheless effective, they may learn new aspects of the
target language, but not use them. They may plateau at a certain, unnecessary level
because they can get by using older methods of solving problems. So the teaching chal-
lenge is not simply to introduce new forms effectively, but also to get those new forms
to supplant older language or at least to become part of a communicative repertoire.
For this goal, a task-based approach is very well suited. Tasks, especially tasks
which are reflected upon afterwards, can support learners to develop such a repertoire,
and for them to see how what has been learned has communicative utility. In this case,
the range of variables which have been shown to influence performance can be related
to the promotion of accessibility. The emphasis here will be on Formulator operations,
rather than Conceptualisation, so that either attention is made more available when the
surface structure of language is being put in place, or there is a focus on accuracy to
some degree (e.g. through post-task activities, or through monitoring). These can make
it more likely that the newer forms will not be there for a rainy day, so to speak, but have
sufficient salience that they can become usable even in more difficult circumstances.

Principles for using a task-based approach

The last section has tried to clarify the pedagogic contributions that a task-based
approach can uniquely make. The section, though, was driven by the sequence of what
Limited attentional capacity, second language performance, and task-based pedagogy 255

happens during acquisition. In addition to such an account, it is also useful to have


a set of principles for the use of tasks over a more extensive timescale, ranging over
several lessons, or even a period as long as one term. In Skehan (1998), I put forward
five principles for a task based approach. The five principles were:

1. Choose a range of target language elements1


2. Choose tasks which meet Loschky and Bley Vroman’s (1993) utility criterion
3. Select and sequence tasks to achieve balanced goal development
4. Maximise the chances of a focus on form through attention manipulation
5. Use cycles of accountability

What this set of principles tried to address is the tension between two statements:
Second language acquisition demonstrates that internal factors have a strong influence
on patterns of development, such that learners do not necessarily learn what teachers
teach
vs.
Some degree of system and completeness in what is being learned is preferable

The principles tried to strike a balance between these two statements. Unrestrained
applications of a task-based approach based on relatively brief speaking tasks would
risk over-valuing the first statement at the expense of the second. Applications of tra-
ditional approaches would risk over-valuing the second at the expense of the first. So,
if one regards the first two principles above as somewhat preliminary, the third and
the fourth attempt to nudge learners towards a focus-on-form, and the fifth, final, and
very important principle suggests that teachers have an important role in monitoring
the development of their students and designing pedagogic activities which deal with
the lacunae in learning, and orient the input (e.g. through pre-task work, task selec-
tion) towards areas which have not been developed.
But there is vagueness in these principles, and I would like to modify these pro-
posals slightly. First, I would now add to the third and fourth principles a set of sub-
principles. These are:

–– complexifying
–– pressuring
–– easing
–– focussing
–– monitoring

.  This proposal is not driven by any precept based on learners’ functional needs (such as Long &
Crookes 1992). It could accommodate such an approach, but in fact offers greater freedom to the
teacher or course-designer regarding the basis for task choice.
256 Peter Skehan

In other words, to make the general principles more accessible, I would suggest using
the sorts of outcomes captured in Table 2, based as this table is on a range of empiri-
cal results, to make more specific the sorts of things that could promote balanced goal
development, and a strong focus on form. We have learned quite a lot from research
as to how a general focus on form can be promoted. So the principles are not quite so
abstract now as they were when first proposed in 1998, and the claims follow from a
range of research results.
Second, I would also like to add a new principle, and ideally place it as a new fifth
principle (pushing the old last principle, use cycles of accountability) down to sixth
position. The new principle would be:

5. Use the post-task phase to nurture language made salient by the task, through:

–– explanation
–– extension
–– integration
–– practice and consolidation

As we have seen in earlier discussion, the post-task phase is vital as the place to capi-
talise on the language which has been made salient by the task. The language which
emerges in the task is the language which is relevant to learners. But the operations
on that language orchestrated by the teacher can enable the sixth principle, the use of
cycles of accountability, to function more effectively. Because it is here that the teacher
can select from the range of language made salient that particular language which it is
most propitious to work on, safe in the knowledge that it will be learner-led language.
This may be developmental language, or it may be language which needs further con-
solidation and practice. It could even be new language, in the sense that a task may
have created a need to mean, and then the teacher can supply that need in a focussed
manner. This is quite a challenge for the teacher. Learners differ; experiences differ.
As a result, there may be a range of candidate language elements to pick up on at the
post-task stage, not all of which can receive focus. It is reliant on the teacher’s profes-
sionalism and training which of these to work with, which to defer until possibly later,
and which to ignore.
We can now represent the set of principles in a more complete, comprehensive
form:

1. Choose a range of target structures


2. Choose tasks which meet Loschky and Bley Vroman’s utility criterion
3. Select and sequence tasks to achieve balanced goal development through
–– complexifying
–– pressuring
Limited attentional capacity, second language performance, and task-based pedagogy 257

–– easing
–– focussing
–– monitoring
4. Maximise the chances of a focus on form through attention manipulation through
–– complexifying
–– pressuring
–– easing
–– focussing
–– monitoring
5. Use the post-task phase to nurture language made salient by the task, through:
1. explanation
2. extension
3. integration
4. practice and consolidation
6. Use cycles of accountability

So far, we have taken what could be considered to be a micro stance towards pedagogy.
Sub-principles for 3 and 4 concern relatively small-scale tasks, and the task cycle that
is envisaged here would be completed with one or two lessons (and could be broadly
similar to the methodology proposed by Willis & Willis 2007). But teaching extends
over more than just a short time span, obviously, and so, if pedagogic planning is to be
effective, it needs to have means of organising these longer stretches of time.
Project work is one such method of linking a series of tasks in ways that retains
the focus on meaning that tasks provide, but at the same time is susceptible to lon-
ger stretches of planned teaching. Projects, and series of projects, can be designed to
occupy long stretches of teaching. But if that is done, the post-task work which has
been described so far needs to be conceptualised slightly differently, since it is here
that the sixth principle becomes important. ‘Micro’ post-task work takes what has
emerged from a task or group of tasks, and responds to the needs and opportunities
which emerge (Principle 5). In a sense, the teacher’s decision is to examine what is
available, what has become salient through the task, and from the range of possibilities,
choose those which would sensibly be worked on. If, though, one has more extensive
task based performances to work with, which extend over time, then there is the need
to keep records, explore what has been achieved over longer timespans by particular
learners, and make decisions accordingly, decisions which can be collaboratively nego-
tiated and made with students. In other words, the notion of using cycles of account-
ability, where responsibility is shared between learners and teachers, becomes more
important. It can become clearer, with reflective post-task work of this sort, where there
are still gaps and what needs to be focussed on in the future. The broad parameters of
learners not necessarily learning what teachers teach still apply, but the reflection can
258 Peter Skehan

give insights as to what tasks might best be chosen and how they might be exploited. In
this way, the need to ensure some degree of systematicity is enhanced very considerably,
and we have a bridge between micro and macro perspectives on tasks.

References

Anderson, J.R. (2004). Cognitive psychology and its implications (6th ed.). New York, NY: Worth.
Bruton, A. (2002). From tasking purposes to purposing tasks. English Language Teaching Journal,
56, 280–288.
Bygate, M. (2001). Effects of task repetition on the structure and control of oral language. In M. Bygate,
P. Skehan, & M. Swain (Eds.), Researching pedagogic tasks (pp. 23–48). London: Longman.
Bygate, M. (2006). Areas of research that influence L2 speaking instruction. In E. Uso-Juan &
A.  Martinez-Flor (Eds.), Current trends in the development and teaching of the four language
skills (pp. 159–186). Berlin: Mouton de Gruyter.
Bygate M., & Samuda V. (2009). Creating pressure in task pedagogy: The joint roles of field, purpose,
and engagement within the interactional approach. In A. Mackey & C. Polio (Eds.), Multiple
perspectives on interaction (pp. 90–116). New York, NY: Routledge.
Bygate, M., Skehan, P., & Swain, M. (Eds.) (2001). Researching pedagogic tasks. London: Longman.
Corder, S. Pit (1981). Error analysis and interlanguage. Oxford: OUP.
Crookes, G. (1989). Planning and interlanguage variation. Studies in Second Language Acquisition,
11, 367–383.
Dornyei, Z. (2005). The psychology of the language learner: Individual differences in second language
acquisition. Mahwah, NJ: Lawrence Erlbaum Associates.
Ellis, R. (1987). Interlanguage variability in narrative discourse: Style shifting in the use of the past
tense. Studies in Second Language Acquisition, 9, 12–20.
Ellis, R. (2005). Planning and task-based performance: Theory and research. In R. Ellis (Ed.), Plan-
ning and task performance in a second language (pp. 3–34). Amsterdam: John Benjamins.
Ellis, R. (2009). The differential effects of three types of task planning on the fluency, complexity, and
accuracy in L2 oral production. Applied Linguistics, 30(4), 474–509.
Foster, P., & Skehan, P. (1996). The influence of planning on performance in task-based learning.
Studies in Second Language Acquisition, 18, 299–324.
Hoey, M. (1983). On the surface of discourse. London: George Allen and Unwin.
Kintsch, W. (1994). The psychology of discourse processing. In M.A. Gernsbacher (Ed.), Handbook
of psycholinguistics (pp. 721–740). San Diego CA: Academic Press.
Kormos, J. (1999). Monitoring and self-repair. Language Learning, 49, 303–342.
Kormos, J. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence
­Erlbaum Associates.
Levelt, W.J. (1989). Speaking: From intention to articulation. Cambridge: CUP.
Levelt, W.J. (1999). Language production: A blueprint of the speaker. In C. Brown & P. Hagoort
(Eds.), Neurocognition of language (pp. 83–122). Oxford: OUP.
Li, Q. (2010). Focus on form in task based language teaching: exploring the effects of post-task activities
and task practice on learners’ oral performance. Unpublished Ph.D. thesis. Chinese University
of Hong Kong.
Littlewood, W. (2004). The task-based approach: Some problems and suggestions. English Language
Teaching Journal, 58(4), 319–326.
Limited attentional capacity, second language performance, and task-based pedagogy 259

Long, M.H., & Crookes, G. (1992). Three approaches to task-based syllabus design. TESOL Quar-
terly, 26, 27–55.
Loschky, L., & Bley-Vroman, R. (1993). Grammar and task-based methodology. In G. Crookes &
S. Gass (Eds.), Tasks and language learning: Integrating theory and practice. Clevedon: Multilin-
gual Matters.
McDonough, K., & Trofimovich, P. (2009). Using priming methods in second language research.
­London: Routledge.
Norris, J. (2009). Task-based teaching and testing. In M.H.Long & C.Doughty (Eds.), Handbook of
language teaching (pp. 578–594). Oxford: Blackwell.
O'Malley, J.M. & Chamot, A.U. (1990). Learning strategies in second language acquisition. Cambridge:
Cambridge University Press.
Ortega, L. (2005). What do learners plan? Learner-driven attention to form during pre-task planning.
In R. Ellis (Ed.), Planning and task performance in a second language (pp. 77–109). Amsterdam:
John Benjamins.
Pienemann, M. (2003). Language processing capacity. In C. Doughty & M. H. Long (Eds.), The hand-
book of second language acquisition (pp. 679–714). Oxford: Blackwell.
Pinter, A. (2005). Task repetition with a 10-year-old. In C. Edwards & J. Willis (Eds.), Teachers explor-
ing tasks in English language teaching (pp. 113–126). Basingstoke: Palgrave Macmillan.
Robinson, P. (2001). Task complexity, cognitive resources, and syllabus design: A triadic framework
for examining task influences on SLA. In P. Robinson (Ed.), Cognition and second language
instruction (pp. 287–318). Cambridge: CUP.
Robinson, P. (2011). Second language task complexity, the Cognition Hypothesis, language learn-
ing, and performance. In P. Robinson P. (Ed.), Second language task complexity: Researching
the Cognition Hypothesis of language learning and performance (pp. 3–38). Amsterdam: John
Benjamins.
Robinson, P., & Gilabert, R. (2007). Task complexity, the Cognition Hypothesis, and second language
learning and performance. International Review of Applied Linguistics, 45, 161–176.
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11,
17–46.
Skehan, P. (1986). Cluster analysis and the identification of learner types. In V. Cook (Ed.), Experi-
mental approaches to second language acquisition (pp. 81–94). Oxford: Pergamon.
Skehan, P. (1989). Individual differences in second language learning. London: Edward Arnold.
Skehan, P. (1998). A cognitive approach to language learning. Oxford: OUP.
Skehan, P. (2001). Tasks and language performance. In M. Bygate, P. Skehan, & Swain M. (Eds.),
Researching pedagogic tasks: Second language learning, teaching, and testing (pp. 167–185).
­London: Longman.
Skehan, P. (2007). Task research and language teaching: Reciprocal relationships. In S. Fotos &
H. Nassaji (Eds.), Form-focused instruction and teacher education: Studies in honour of Rod Ellis
(pp. 55–69). Oxford: OUP.
Skehan, P. (2009a). Modelling second language performance: Integrating complexity, accuracy,
­fluency and lexis. Applied Linguistics, 30(4), 510–532.
Skehan, P. (2009b). Models of speaking and the assessment of second language proficiency. In
A. Benati (Ed.), Issues in second language proficiency (pp. 202–215). London: Continuum.
Skehan, P. (2013). Nurturing noticing. In J. Bergleitner & S. Fotos (Eds.), Festschrift in honour of
Richard Schmidt. Honolulu, HI: National Foreign Language Resource Center.
Skehan, P., Bei, X., Li, Q., & Wang Z. (2012). The task is not enough: Processing approaches to task-
based performance. Language Teaching Research, 16(2), 170–187.
260 Peter Skehan

Skehan, P.,& Foster, P. (1997). Task type and task processing conditions as influences on foreign
­language performance. Language Teaching Research, 1(3), 185–211.
Skehan, P., & Foster, P. (1999). The influence of task structure and processing conditions on narrative
retellings. Language Learning, 49(1), 93–120.
Swain, M. (1985). Communicative competence: Some roles of comprehensible input and compre-
hensible output in its development. In S. Gass & C. Madden (Eds.), Input in second language
acquisition. Rowley, MA: Newbury House.
Swain, M. (1995). Three functions of output in second language learning. In G. Cook & B. Seidlhofer
(Eds.), Principle and practice in applied linguistics (pp. 245–256). Oxford: OUP.
Swan, M. (2005). Legislating by hypothesis: The case of task-based instruction. Applied Linguistics,
26, 376–401.
Tannen, D. (1989). Talking voices: Repetition, dialogue, and imagery in conversational discourse.
­Cambridge: CUP.
Tavakoli, P., & Skehan, P. (2005). Strategic planning, task structure, and performance testing. In
R. Ellis (Ed.), Planning and task performance in a second language (pp. 239–276). Amsterdam:
John Benjamins.
Wang, Z. (2009). Modelling speech production and performance: Evidence from five types of plan-
ning and two task structures. Unpublished Ph.D. thesis. Chinese University of Hong Kong.
Willis, J. (1996). A framework for task-based learning. London: Longman.
Willis, D., & Willis, J. (2007). Doing task-based teaching. Oxford: OUP.
Winter, E. (1976). Fundamentals of information structure: A pilot manual for further development
according to student need. Hatfield, Herts: The Hatfield Polytechnic Linguistics Group, School
of Humanities.
Author Biodata

BUI Hiu Yuet, Gavin obtained his Ph.D. in applied linguistics from The Chinese
University of Hong Kong. Currently he is Assistant Professor at the English Depart-
ment of Hang Seng Management College in Hong Kong where he teaches linguistics
and applied linguistics courses with some occasional addition of EAP/ESP classes.
Dr.  Bui’s research interests include task-based language teaching, psycholinguistics,
and second language acquisition.

LI Qian, Christina, obtained her Ph.D. in applied linguistics from the Chinese
­University of Hong Kong. Currently, she is an assistant research professor in English
at Guangdong University of Foreign Studies, China. Her interests include task-based
language teaching and research, the acquisition of formulaic sequences by L2 speakers
and bilingual lexicography. Her most recent articles appeared on Language Teaching
Research (2012) (coauthored with Skehan, Bei, Wang) and Foreign Language Teaching
and Research (2013).

PANG Soi Meng, Francine, obtained her Ph.D. in applied linguistics from the Chinese
University of Hong Kong. She is currently Associate Professor at Macao Polytechnic
Institute, and before that she was Assistant Professor and Postdoctoral Fellow at the
Chinese University of Hong Kong and the University of Macao. Dr. Pang has lectured
in applied linguistics, psycholinguistics and Business English. Dr. Pang’s research
interests include second language acquisition, second language reading, and second
language task planning behaviour.

SHUM Sabrina obtained her MA in applied linguistics at South China University


of Technology, Guangzhou, China. She worked as a research assistant for Professor
­Skehan in a research project which is the basis for one of the chapters in this volume.
She is currently an Assistant Lecturer in Cantonese at the Yale-China Chinese Lan-
guage Centre, The Chinese University of Hong Kong. Her current research interests
include Chinese grammar and teaching Chinese as Foreign Language.

Peter SKEHAN is a Professorial Research Fellow at St. Mary’s University College,


Twickenham. He received his Ph.D. from Birkbeck College, University of London. His
major interests are in second language acquisition, especially task-based performance,
and language aptitude. He supervised the Ph.Ds of contributors to this book, as well
as directed the Hong Kong RGC research projects that are the basis for three of the
chapters. He has also been a Visiting Professor at the University of Auckland.
262 Investigating a Processing Perspective on Task Performance

WANG Zhan (Jan) is a postdoctoral researcher in the Learning Research and Devel-
opment Center (LRDC), University of Pittsburgh. She works on projects related to
fostering second language fluency and first language reading development, funded by
the NSF at the Pittsburgh Science of Learning Center (PSLC). She received her Ph.D.
in Applied Linguistics from the Chinese University of Hong Kong.
Index

A C content-based instruction  89
accuracy  ix, 2–4, 7, 10, 12–18, causal structure  195 content familiarity  212, 237
34–37, 41–42, 44–53, 63–65, 68, CHAT  15–16, 21, 42, 101, 138, control  ix, 2–3, 33–35, 37–40,
71–72, 76–80, 82–90, 99–100, 166, 196–197 101, 147, 181, 202, 248, 251–253
102, 107–111, 116–121, 131–133, CHILDES  15, 72 controlled processing  49
138, 140–150, 155–163, 166–178, Chinese University  xi, x, xii, critical period  32
187–194, 197–207, 213–223, 9–10, 211, 261–262 cycles of accountability  255–257
227–228, 231–244, 252, 254 chunks  22, 79, 81–82, 161, 253
accuracy clause length  76–77, 83 CLAN  15, 21, 41–42, 138, D
accuracy versus complexity 166–167, 197 declarative memory  29, 32
effects  96 clause boundary pausing  19, default view of attention  238
analysis-oriented learners  236 113, 118 disponibilité  254
anticipating post-task clause-end pauses  71, 74, 75 dual-mode system  253
transcription  238 cloze test  135 easing  13–14, 35, 52, 157, 178–180,
articulation  10, 27–29, 36–38, coding scheme  11, 95, 97–99, 190, 208, 235, 237, 255, 257
47–49, 79, 221–223, 229, 244 102–104, 116, 125, 215–216 effect size  42–43, 45, 73–74,
articulator  5, 28–30, 34, 218, Cognition Hypothesis  ix, xii, 76–77, 139, 142–143, 201
244–245 3–4, 7–9, 13, 68, 96, 120–121, emerging rule-governed
AS-unit  16, 138, 142–143, 147, 155–161, 163, 174–177, 191, system  253
168–169, 198–199, 221 231–232, 234–236, 241 encapsulated  221
assessment  1, 237 Cognition-Tradeoff debate  212, encoding specificity
attention  xi, 3, 10, 34–35, 48–53, 231 principle  79
82, 96, 126–127, 129–132, cognitive comparison  31, 145, 148 end-of-clause pausing  21, 175,
145–150, 178–179, 189–191, Cohen’s d  42, 72–77, 83, 86, 187, 201, 227, 233
203–204, 206–207, 211–212, 141–144 error correction  148
214, 221–223, 228–231, collaborative dialogue  130 error free clauses  41, 46,
236–244, 252–255, 257 collaborative transcribing  107–108, 110, 142, 166, 168, 171,
attentional limitations  3, 13, 133–134 192, 198, 201
156–157, 176 communicative language error gravity  18, 193, 197
authenticity  218 teaching (CLT)  1, 32, 130 errors per 100 words  17–18,
automatic processing  29, 31 complexity  ix, x, 2–7, 9–10, 76–77, 138, 141, 192–193
automatisation  21, 175, 181, 253 12–16, 32–37, 41–42, 44–50, exemplars  253
automatising  253 63–65, 68, 71–72, 77–78, 80–88, exemplar-based system  79
avoiding error  206, 215, 90, 96, 102–103, 111, 116–121, extended pedagogic
241–242, 248 131–132, 140–144, 146–150, sequences  246
155–163, 166–179, 181, 189–194,
B 197–199, 201–208, 211–223, F
background information  156, 227–228, 230–232, 234–244, 246 factor analysis  167, 169
190 complexifying  9, 14, 157, 178, false starts  20, 71, 73, 76,
beginning-middle-end 208, 248, 251, 253, 255–257 168–170, 172–176
structure  196, 227 conceptualisation  10, 99, 107, familiarity  5–7, 14, 51, 63, 65–71,
breakdown  19–20, 41, 71, 73–76, 157, 179–180, 189, 213, 221, 223, 73–90, 104, 212, 214, 217–218,
80, 83, 85–87, 132, 167–168, 172, 228, 244, 254 222, 237, 243, 245
175, 192, 197, 205, 229–230 Conceptualiser  5, 79, 95, feedback  2, 7, 14, 40, 130, 132,
breakdown fluency  19, 71, 107, 175–176, 178–179, 190, 137, 147–148
73–76, 80, 83, 85–87, 167, 175, 206–208, 215, 217, 220–222, filled pauses  19–21, 71, 197
192, 197 224, 226, 229–230, 242–245 flow  2, 18, 20, 28, 160, 197, 204,
British National Corpus  22 conjoint influence  13, 235 224, 229, 232, 235
264 Index

flow in performance  224 input domination  M


fluency  ix, 3–4, 10, 18–21, 27, input-handling  232 macro planning  103–107, 125,
32–37, 41, 44–50, 52–53, 63–65, instructed L2 learning  245
68, 71–76, 78–81, 83–90, 96, intake  248 macrostructure  81, 159, 175,
102, 107–109, 111–112, 114, interactional processes  1 178–179, 189–190, 192,
117–121, 131–132, 156–162, interactive peer revision  134 203–204, 208, 228, 230,
166–169, 173–176, 178, 192, integrating  248, 250 234, 245
194, 197–199, 201–202, 204, integration  87, 156–157, 181, 236, meaning priority  27, 53
206–207, 213–219, 222–223, 250–251, 256–257 mediated narration  194
227–228, 233, 235–236, 243, interlanguage structure  249 memory demands  3, 159–160,
252–253, 262 interaction  x, 1–2, 75, 78, 83–84, 162, 175, 177, 191, 235
focus-on-form  ix, 3, 8, 51, 146, 89, 129, 144, 146–148, 155, memory-oriented learners  236
150–151, 238, 255 172–176, 181, 205, 242, 249 mental lexicon  4, 9, 23, 28,
focussing  14, 157, 178, 208, 242, intermediate difficulty  237 31–32, 79, 99, 119, 157, 161, 178,
255, 257 214, 217, 225, 229–230, 232–233,
foreground information  189 L 244–245
formality  82 L2 mental lexicon  31 metacognitive planning  104,
form-focussed instruction  L2 proficiency  31, 78, 84 106–107, 117, 127
Formulator  5, 10, 28–30, 34, Lambda  22, 46, 102, 107–108, 115, metacognitive strategies  116
37–38, 78–79, 81, 107, 159, 161, 138, 160–161, 165, 168–169, 171 metatalk  147
175–176, 178, 180, 189, 192, lemma retrieval  178, 180, 189 microplanning 
203–204, 207–208, 214–215, length accuracy  18, 193, 200–201 mid-clause pausing  19, 21,
217, 220, 222, 226, 228–230, length of run  20, 73–75, 79, 111–112, 114–115, 117, 119,
242–245, 253–254 107–109, 132, 175 169–170, 172, 174–176
formulation  10, 29–38, 45–53, 65, less frequent vocabulary  165, mid-clause pause  74
78–80, 189, 221–223, 230, 244 171–172 models of speaking  13, 99
fragility of the accuracy levels of proficiency  16, 107, modified output  148
effects  219 225, 245 modular  5, 10, 180, 221, 244
Levelt model  5–6, 9–10, 14, 48, monitoring  27–28, 46, 48–53, 65,
G 99, 107, 116, 157, 178, 180, 187, 80, 82–83, 97, 99, 107, 116, 189,
guided planning  51 208, 215, 220, 223, 229, 235, 207–208, 215–216, 228, 238,
guided planners  51 241, 244 241, 254–255, 257
Levelt speech production model  monitoring strategies  97
H 33 Mor  196–197
here-and-now  8–9, 13, 40, 157, lexical complexity  68, 82, 150, multivariate analysis of variance 
159–163, 165–166, 169–170, 214, 239
173–181, 184, 190–191, 226, 228, lexical density  21–23, 37 N
232, 235, 246 lexical difficulty  13, 116, 163, 172, narrative  11–12, 15, 36, 38–39,
Hong Kong Research Grants 174–176 51, 95, 97–102, 108–109, 111,
Council  9 lexical diversity  21–23, 41–42, 135–144, 149, 156–157, 164–165,
hypothesising  248–250, 253 44, 46, 138, 140–142, 171 173, 179, 187, 189–190, 194,
lexical and grammar planning  203, 206, 215, 225–228, 230,
I 104–105, 107, 116, 126 232–235, 241–242
implicit learning  252 lexicalisation  253–254 native speakers  7, 19, 81, 108,
inauthenticity  218 lexical planning codes  216 114, 165, 192, 197, 204
incomplete lemma access  218 lexical retrieval  97, 107, 120, naturalistic L2 learning  129
individual transcription  134, 240 176, 192 negotiation of meaning  2, 130
information integration  157, lexical sophistication  21–23, nominal phrases  192
181, 236 37, 46, 82, 102, 108, 115–116, non-negotiable  234–235
information organisation  119–120, 142, 144, 149, 168–169, non-negotiability  234
189–190 171, 173, 214, 217, 243 non-native speakers  19, 81, 165,
inner speech plan  28, 52 limited attentional capacity  7, 211 192, 197, 204
Index 265

notice the gap  32 planning-as-familiarity  214 processing  ix, x, xi, xii, 1–3,
noticing  129, 132, 145–146, planning-as-organisation  221 5, 8, 10, 13–14, 27–32, 37, 39,
248–250, 253 planning-as-time  214 48–49, 51–52, 64, 68, 79–82,
noticing the hole  146 planning-while-speaking  191 107, 119, 145, 155, 157, 160–163,
noun phrase complexity  82–84 PLex  22, 165 171, 175, 177–180, 187, 190,
nudged  236, 252 post  xi, 3, 5, 8–9, 12, 51, 96, 195–196, 198–202, 205–208,
129, 131–134, 136–139, 141–148, 211–212, 215, 217–218, 220–237,
O 150–151, 156, 238–244, 247, 242–243, 245–246, 248,
on-line planning  8, 10–11, 14, 249–252, 254, 256–257 253–254
27, 33, 35–37, 39–40, 42, 45–48, post-task activities  5, 8, 51, 84, processing approach  xi, 68, 242
50–53, 63, 65, 79–80, 87, 96, 129, 131–133, 137, 150, 156, 239, processing capacity  64, 79, 82
118, 159, 176, 191, 219–220, 222, 247, 254 processing conditions  8, 10, 13,
231, 238, 242–244, 252 post-task focus stage  32, 162, 175, 178, 187, 190, 195,
operating principles  121 post-task manipulation  12 199–200, 202, 205, 207–208,
opportunity to negotiate  246 post-task phase  3, 9, 14, 132, 250, 215, 223, 226, 231–232
organisational structure  204, 221 256–257 processing limitations  3
over-ambition  95, 111, 219, 224 post-task stage  129, 131, 136, processing pressure(s) 
overt speech plan  28, 52 144–146, 151, 249–252, 256 proficiency range  224
post-task transcribing project work  246, 257
P condition  129, 138 propositional demands  234
pair-based transcription  239–240 post-task transcription  12, pruned words  72–73, 168
pair transcription  134 133–134, 138, 144, 148, 150, pseudo-filled pauses  20–21
pair transcribing  137–138, 140, 238–239 pseudo-filled pausing 
142–144, 146–147, 149–150 practice  32, 66, 136, 146, 165, psycholinguistic processes  4–5,
parallel (mode of) processing  252–253, 256–257 21, 157, 176, 180
partial lemma access  practice activities  253
pausing  18–21, 73, 102, 107, prefabricated expressions  81 R
109, 111–115, 117–119, 168–172, preparedness  5, 7–8, 11, 14, 65, readiness  11, 63–68, 80–82,
174–176, 187, 189, 196–197, 201, 89, 191, 212–213, 217–218, 220, 84–90, 212–213, 217, 220, 222,
204, 207, 227, 233 223, 245–246 248–250
pause location  192 pre-selection  252 reasoning demands  157–158, 231
pedagogic norms  244 presentation-practice- re-entry points  230
pedagogic principles  14 production  252 reformulation  41, 44–45, 71, 73,
pedagogy  x, 1, 4, 13–14, 27, 52, pre-task influence  212 101, 133, 166, 168, 197–198, 201,
88, 129, 131–132, 149, 151, 155, pre-task planning  3, 7, 10, 33, 203–205
206, 208, 211, 218, 246–247, 257 35–36, 49–51, 64–65, 70, 75–76, rehearsal  33, 36, 52, 63–68, 86,
phonation time  20, 73, 180 80–82, 130, 191, 214, 221–222, 89, 97, 107, 116–117, 120, 127,
phonological plans  215 238, 243 159, 212, 216–218, 221, 223, 240,
pickup points  221 pre-verbal message  28, 49, 242–243, 245
planning  xi, x, 3, 5, 7–14, 52, 78–79, 107, 157, 230, rehearsal strategies  97
27, 33–40, 42–53, 60–61, 244–245 repair  51, 71
63–71, 73–90, 95–107, 109, 111, pre-watching  33–36, 39–40, 47, repair fluency  20, 73, 76, 78,
114–122, 124–127, 130, 136, 156, 49–50 83, 85–86, 166–167, 175, 192,
158–159, 176, 178, 189, 191–192, pressuring  14, 157, 178, 180, 208, 197–198
205–206, 211–224, 228, 220, 255–257 repertoire creation  248, 254
231–233, 237–240, 242–247, prime  223 repetition  5, 7, 10–11, 20, 27,
249, 252, 257, 261 primed  78, 222 34, 36–40, 42–44, 46–48, 50,
planning efficiency  220 priming  217, 223 52–53, 61, 65–67, 73, 84, 86, 89,
planning time  11, 34–36, 39–40, problem of new language  251 101, 156, 166–168, 203, 214–215,
45, 50, 65, 73, 75, 81, 83–85, 87, problem-solution structure  164, 217–218, 222–223, 240, 243,
89, 98, 100–101, 111, 118–120, 187–190, 196, 200, 203, 207, 245–246
124, 127, 158–159, 214–215, 225, 227, 236 replacement  20, 73, 167–168
219–221, 223, 228, 231, 242 procedural memory  29, 32 resource deficits  30–31
266 Index

resource directedness  7, 231 212–215, 217–219, 221–222, 238, tempo-naming  39


resource directing  7, 231 240, 242 temporal aspects of speaking  79
resource-dispersing  7, 8, structural complexity  68, 81, test fairness  68, 88
157–159, 177, 231, 232 109, 155, 159, 167, 169, 175–176, test-task  240
response deadline  39 189, 213, 236, 242–244 there-and-then  8–9, 13, 155,
restructuring  ix, 147, 248, 250, structural priming  157–166, 169–170, 173–179, 181,
253 structured narratives  177, 187, 184, 190–191, 194, 202, 207,
retrieval depth  218 201, 203 226–228, 232–235, 243, 245
retrieval strategies  97 student-initiated transcribing  133 time perspective  8–9, 13, 96,
retrospective interviews  11, 95, subordination  16, 41–42, 44–46, 155, 157, 159–163, 167, 169–170,
97–99, 101–104, 215 77, 102, 107–108, 111–112, 117, 172–173, 175–176, 179, 181,
Revised Hierarchical Model  31 119–120, 143, 168–169, 171, 173, 190–191, 231–233, 235, 237, 245
revising  133–134, 137–138, 140, 148 175, 178–179, 189–190, 192, 198, time pressure  5, 8, 27, 30–38, 40,
revision after transcribing  129, 201, 203–204, 206–208, 228 44–48, 51, 53, 67, 176, 179, 191,
144, 148–149 supported on-line planning  176, 194, 203, 206–207, 227
risk-taking  2, 147 220, 242–244, 252 topic familiarity  63, 65–71,
role of the teacher  247, 249 supported processing conditions  73–87, 89–90
rule-based language  253 syllables per minute  20 total silence  73
rule-based system  2, 79 syllabus  4, 6, 251, 253 trade-off  39, 53, 82, 84, 120, 149,
syntactic encoding  157 156–160, 162, 175–178
S Trade-off Hypothesis  156–158,
scale of structure  188, 227 T 160, 162, 175, 177
schema  66–68, 188, 213 task-based syllabuses  254 transcribing  51, 129, 132–134,
schematic familiarity  66–67, 86, task characteristics  xi, 2, 6–7, 9, 136–150
89, 212 12, 84, 155–156, 236 transcribing-and-revising  134
script  188 task complexity  x, 3–7, 9, 13, 121, triadic componential
second language pedagogy  52, 155, 157–158, 160, 163, 176–177, framework  157
129, 132 191, 212, 228, 230–232, 236, 241 type-token ratio  21, 46
selective attention  31, 51, task conditions  1–3, 5, 7, 23,
211–212, 236, 238, 244 36, 38, 40, 64–65, 84, 96, 132, U
self-monitoring  28, 80 155–157, 176, 181, 205, 236–237, unfamiliar tasks  70, 73, 75,
self-repair  51 252–253 82, 88
self-reported planning task cycle  131, 137, 247, 257 unguided planners  51–52
behaviours  95, 106, 109, 120 task difficulty  5–6, 96, 157, 237 unguided planning  51
self-revision  task external readiness  66, 89 unmediated narration  194
sequences of development  248 task familiarity  66–67, 86, 212 unpressured performance
serial processing  221, 224, 229, task input  234, 249 conditions  245
233–234, 237, 243, 245–246 task internal readiness  63 utility criterion  255–256
silent pauses  19 task phases  250
sociocultural  242 task processing  5, 8, 231 V
speech fluency  35–36, 44–47, TaskProfile  16–18, 21, 42, 101, vocabulary difficulty  155, 165,
49–50, 52 166–167, 197 167, 172–174, 233
speech monitoring  27, 48, 50–53 task readiness  63–64, 66, 87 VocD  21, 42, 138
speech production  x, 10, 27–29, task repetition  27, 36–37, 52,
31–34, 36–39, 47–52, 68, 88, 65–67, 84, 86, 89 W
95, 107, 161, 178, 189–190, task sequencing  88, 246 within-task planning  33, 64–67,
206, 221–222, 229–230, 242, task structure  x, 6, 9, 13, 111, 80, 212
244, 252 118, 155, 157, 159, 161–163, 165, words per AS unit  72, 77–78,
speech rate  20, 35–36, 48, 51, 71, 167, 177, 187, 200–201, 212, 223, 81–83, 85, 138, 141–143, 168
73–75, 79, 168 227–228, 231–232, 245 words per clause  72, 77, 81–82,
speed fluency  166–167, 169 task types  ix, 5–6, 66, 135–136, 192, 198, 201–202, 206–208
speed of input  234, 246 142–144, 156 words per minute  41, 68, 71, 168
strategic planning  27, 33, 35–36, teacher behaviour  248 working memory  3–4, 30, 33,
38–40, 42–47, 50, 52–53, 61, teacher-initiated 80–81, 156, 160, 177, 189, 211,
63–70, 73–78, 80–89, 96, 192, transcribing  133 230–231, 236, 241

You might also like