Professional Documents
Culture Documents
Introduction
research 1
[1.4] Synthetic or holistic vs analytic research
It begins with some general notions about language research and the types of research
according to different parameters, such as the following:
It is especially aimed at beginner researchers in this field and tries to help them in the
design of their research. An initial considerably shorter version in Spanish can be
found in Bueno González (1997).
In order to achieve the previous objectives, we will employ the following resources:
- The information provided in this teaching unit.
- One written activity (Activity 1), which will be completed by using the
information on the teaching unit and will be submitted to the platform.
- One activity (Activity 2), which will be debated on the debate forum.
- A final online test, which can be self-corrected.
INTRODUCTION
Research has to be focused, first of all, as a natural process, as part of natural human
activity: "we all carry out activities that have the basic characteristics and elements of
research ... we seek answers to questions about phenomena that occur in our daily lives
..." (Seliger and Shohamy, 1989:6). In other words, after many guesses (or hypotheses)
we come to know something we did not know before. In this respect, Seliger and
Shohamy (1989:7) establish what we can call the basic components of any research:
In this respect, Seliger and Shohamy (1989:13-16) distinguish four types of knowledge:
Nunan (1992:3) provides a useful and clear working definition of "research": “...
research is a systematic process of inquiry consisting of three elements or components:
(1) a question, problem, or hypothesis, (2) data, (3) analysis and interpretation of
data."
General guidelines on what research is and what it is not, together with philosophical
and methodological underpinnings of research can be found in Pennock-Speck
(2015:11-14).
Regarding the requisites for research to be “scientific”, common sense and intuition
can be the starting point. However, something else is needed. Freedman (1982) thinks
that research is valid if it is controlled (i.e. the results are due to the method employed
and not to other factors; the different variables are observed and controlled). Some
other conditions have to be added:
Validity means that the experiment measures or investigates what the researcher
intends to investigate. We can distinguish between external or face validity (having to Con formato: Fuente: Cursiva
do with the formal aspects of the research as well as with the extent to which the results
can be generalized from samples to populations), internal or content validity (related
to the interpretability of research) and construct validity (if the research process
reflects the constructs or the rationale underlying it).
For a research study to be valid and reliable the first requisite is that it is controlled,
that is to say, that the different variables which may bias the result are under control.
The way in which the whole experiment is designed is crucial, together with the
processes of data collection and analysis. The detail in which data are collected and
analyzed, the presentation of results, and the organization of the whole research also
contribute.
(Bueno González, 2015: 86).
A very practical way to achieve validity and reliability is by means of data
triangulation or confronting information from three or more sources (cf. Mackey and
Gass, 2005:181-182). If all these requisites are met, we can obtain what is known as
scientific research, which, according to Seliger and Shohamy (1989: 9-13), fulfills the
following requirements:
- It is organized, structured, methodical, disciplined and systematically
conducted.
Now we move to the main purpose of this unit: to present the different types of
research. We will take Nunan's (1991: 251-252 and 1992: 1-10) and Seliger and
Shohamy's (1989: 17-20) reviews as a basis. In his review Nunan refers to the following
sources: Reichart and Cook (1979), Chaudron (1988), Grotjahn (1987), van Lier
(1988), Brown (1988) and Larsen-Freeman and Long (1991). Supported by this
theoretical background, we can establish the various types of research, according to
different parameters, as stated ab0ve (Overview of the unit).
This first distinction concerns the general framework of the research. In this respect,
a three-fold classification has to be made.
The term applied research comes from the fact that this type of investigation literally
applies the product of basic research to a specific problem. Some examples of applied
research studies can be the processes by which learners acquire the knowledge
described by the theoretical researcher, when they are acquiring that knowledge in a
second language context; or the application of literary theories to specific literature
works or authors; or any research study based on literary criticism or linguistic
analysis of particular texts.
Practical research is a self-explanatory term and it is based on the premises of the two
previous types of research, by making them practical, e.g., by providing pedagogical
principles experimented with the classroom or by testing hypotheses (action or
classroom research). In our context it is centered on the classroom, thus investigating
planning and curricular design, methodological techniques, evaluation,
interdisciplinarity, cross-curricular issues, attention to diversity and teaching
materials. This is the reason why it is also called classroom or action research.
Traditionally studies dealing with disciplines such as Error Analysis, Contrastive
Analysis or Interlanguage theories fall into this category. Research projects which have
either communicative skills (listening, speaking, reading, writing, and interaction) or
linguistic components (grammar, vocabulary, pronunciation) can also be termed as
practical studies, for example, the use of graded readers in class and their effects in
students’ language proficiency, or the discussion and implementation of different
methods and approaches in class, such as Task-Based Learning, Project Work, the
Communicative Approach, the use of ICTs, the Flipped Classroom, etc.
Concerning this classification, a few issues have to be taken into account: the
borderlines are not often clear, the relationship between them should be bidirectional,
and not all research is meant to be applied or to have practical uses. As a matter of fact,
more often than not the types are not mutually exclusive but complement each other.
Most classroom-centered studies are a mixture of applied and practical research and
need a theoretical support.
CLIL research (the focus of this Master’s degree) is a clear example of this healthy
mixture. Taking the theoretical background as a taken-for-granted premise, most
studies are in both the applied and the practical fields.
Primary research is called in this way because it extracts information from the
primary sources of information (for example, dealing with students who are learning
a language, the materials they produce, teachers’ beliefs and conceptions; or research
based on the original literary works, not on critical studies about them). It presents the
advantage of being closer to the primary source of information and, dealing with
classroom research, a further distinction can be made:
It goes without saying that both types of research, primary and secondary, are
complementary. Collecting and analyzing data from both primary and secondary
sources is a type of data triangulation, which undoubtedly favors investigation. CLIL
research is again a fruitful example of this desirable combination.
In this case we refer to the method used for data collection. Again, a clear dichotomy
can be established between non-experimental and experimental or quasi-
experimental research.
Experimental research bases its data on projects rooted in the classroom, either in
natural or somehow artificial conditions. It collects data under controlled conditions.
It keeps conditions as comparable as possible, so that possible changes or results can
be attributable reliably to changes in variables.
Concerning the approach, the distinction is between synthetic (or holistic) and analytic
research.
Synthetic or holistic research refers to that kind of study which allows us to view the
separate parts as a coherent whole, holistically, as a composite of factors which might
not be easily or validly analyzable into separate parts. A couple of examples can be a
research project carried out in order to improve Teaching English as a Foreign
Language (TEFL) methodology in general by the inclusion of a new teaching and
learning approach such as CLIL; or linguistic and literary studies, focusing on a topic
in a general and all-embracing way.
In this dichotomy, we are concerned with the purpose of the research, which allows us
to distinguish between heuristic (or inductive) and deductive research.
As for the form of the data, a customary distinction is that between qualitative and
quantitative research.
Quantitative research is also called "hard" research and its main features are that it is
controlled, objective, generalizable, and factual. Quantitative data are generally
analyzed by means of descriptive statistics. Some of the most common descriptive
statistical procedures are: frequencies, central tendencies and variabilities:
In this type of research, the data are collected through observations, interviews,
diaries, or any other qualitative procedure, by means of recordings or written reports
(detailed information appears in Bueno González, 2015: 75-81). Then the researcher
has to identify the most relevant segments of the information according to a previous
scheme. It may be the case that some categories emerge from the data, without having
to apply a fixed taxonomy. Otherwise, the researcher does the opposite: (s)he applies
a predetermined classification.
The two main techniques that can be identified in analyzing qualitative data (Bueno
González, 2015: 81-82) are the following:
a) Deriving a set of categories for dealing with text segments from the text itself
(inductive procedure).
b) Applying a system of categories or predetermined classification to the data
(deductive procedure).
According to Madrid and Bueno (2005: 662), these are the main features that
characterize qualitative research analysis:
It should be clear from the very beginning that there is no intrinsic superiority in using
a quantitative or a qualitative type of research. Obviously, this will determine the way
of collecting the data and, especially, of analyzing them. In all the cases you should
take special care in ensuring the principles underlying the research, the way in which
those principles are put into practice and the conditions of validity and reliability of
the research. Some suggestions are provided:
· If you opt for a statistical treatment, rely on an expert if you are not.
· When collecting the data you have to bear in mind how you are going to
analyze them.
Although both qualitative and qualitative analysis can be used with practically any type
of research, it is true that qualitative or interpretive analysis (in the form of comments
and, more often than not, helped by percentages) is usually associated with ethnographic
research (see Bueno González, 2013: 31-33) and with the so-called “soft” data. In spite of
offering highly useful information about classroom processes, interaction patterns, and
invaluable information about the teaching-learning process, qualitative analysis has
often been criticized as unreliable, particularly because of subjectivity and possible bias.
Both types of data can be combined, thus providing a desirable data collection
triangulation.
This dichotomy is closely related to the previous section, as regards the method of
analysis of qualitative and quantitative research.
Interpretive research refers to a generally subjective form of analysis based on
interpretation (hence its name). In this respect, it is usually associated with the
analysis of qualitative data.
By contrast, statistical research is necessary when quantitative data are collected and
it is more objective and systematic. Detailed information about basic statistical
techniques can be found in Bueno González (2015: 82-85).
The variable involved now is the time of collection. Depending on when and for how
long the study is carried out, we can distinguish between longitudinal and cross-
sectional research.
Longitudinal research, also called diachronic, develops over a period of time (several
terms or academic years), which allows for the researcher to see the evolution of
subjects concerning particular research issues, or to evaluate the changes or the
effectiveness of a program, or the impact of an experience. It usually involves single
learners (case studies) or small groups of students (group studies). Some difficulties
may arise from the fact that you cannot ensure that y0u teach the same groups for
more than one year.
On the other hand, cross-sectional research (or synchronic research) takes place at a
single point in time, that is to say, data are collected at a particular moment with a
specific cross-section of students, teachers, materials or evaluation tools (generally a
large number of subjects). Since collection time is limited, this allows the researcher
to work with a higher number of subjects.
It is evident that the types of research dealt with in this unit are not reciprocally
exclusive. As a matter of fact, some combinations are particularly favored: primary or
theoretical research is associated with secondary sources of information (what has
been published about a particularly issue, information not taken from students
themselves, critical studies on original literary works but not the works themselves);
qualitative data clearly favor interpretive analysis, while the same can be said about
quantitative data and statistical analysis; longitudinal research favors case studies, to
name just a few obvious combinations.
It is also true that by mixing and matching them we can obtain several possible
research paradigms, thus allowing triangulation (a more than advisable procedure to
cater for validity and reliability of the study), by combining different information
sources (both primary and secondary) or different procedures for data collection
(qualitative and quantitative) or analysis (interpretive and statistical) or sources of
information (students, teachers, and parents). These mixed types of research are
noticeably recommendable.
Last but not least, it is highly advisable for researchers to define their investigation
according to these parameters in the presentation of any research study. In fact, this
is essential information which has to be included in the introductory section.
ACTIVITY 1
(To be uploaded onto the virtual platform
as a written assignment)
For each feature you identify, please, explain why you consider
this characterizes the kind of research, and, whenever possible,
justify it with elements from the research design of the article.
ACTIVITY 2
(To be discussed with the whole group on the Subject
Forum)
Alcaraz Sintes, A. 2015. “Citing and referencing”. In M.L. Pérez Cañado & B.
Pennock-Speck (eds.). Writing and Presenting a Dissertation on
Linguistics, Applied Linguistics and Culture Studies for Undergraduates
and Graduates in Spain. Valencia: Universitat de València, 107-129.
Mackey, A. and S.M. Gass (2005). Second Language Research: Methodology and
Design. New Jersey and London: Lawrence Erlbaum Associates,
Publishers.
Pérez Cañado, M.L. & B. Pennock-Speck (eds.). 2015. Writing and Presenting a
Dissertation on Linguistics, Applied Linguistics and Culture Studies for
Undergraduates and Graduates in Spain. València: Universitat de València.
Seliger, H.W. and E. Shohamy 1989. Second Language Research Methods. Oxford:
Oxford University Press.
van Lier, L. (1988). The Classroom and the Language Learner. London:
Longman.
Further readings
A useful reference for teachers and researchers who have had no previous
training in statistics. It offers skills and procedures to understand and
critically read statistical research applied to language learning. Explanation
is offered about basic statistical terms, the structure and layout of statistical
reports, statistical logics, and how to decipher tables and graphs. Chapters 1
and 2 are particularly useful to cover general aspects of research.
This seminal book presents the main research methods in a deep and reader-
friendly manner, with a two-fold purpose: to provide graduates, teacher
trainers and researchers with mechanisms to analyze research studies
critically, and to present tools for them to carry out their own research. It
includes an exhaustive description of methods and instruments, both
quantitative and qualitative. Particularly useful highlights are the following:
the final tasks at the end of each chapter; the last chapter, “Doing research”,
in which inspiring guidelines are provided to carry out a research project,
from the choice of the topic and the formulation of research questions and
hypotheses to the final presentation, through literature review and data
collection and analysis; and a useful glossary.
Pérez Cañado, M.L. & B. Pennock-Speck (eds.). 2015. Writing and Presenting a
Dissertation on Linguistics, Applied Linguistics and Culture Studies for
Undergraduates and Graduates in Spain. Valencia: Universitat de València.
This book has duly become a classic for second language research due to the
depth and exhaustiveness in which its authors present the concept and types
of research methods and paradigms, as well as the stages in a research study,
namely the preparatory stage (formulation of questions and hypotheses),
contextualization (literature review and state-of-the-art editing), data
gathering and analysis, and final presentation. The clarity and the detailed
methodological procedures in the presentation of every issue must be
highlighted.