Professional Documents
Culture Documents
Research Reports
'
Writing Psychology Research Reports
Writing Psychology
Research Reports
Fourth edition
Boom
Foreword
4 Research Descriptions 59
4.1 The structure of a research article 59
4.2 Writing descriptions of scientific research 61
4.3 Steps for writing a research description 65
4.4 Writing a scientific summary 66
4.5 Writing related research descriptions 68
5 Writing a Literature Review 69
5.1 The structure of a literature review 69
5.2 Elements of a literature review 70
5.3 Checklist/evaluation framework 80
Writing Psychology Research Reports
merits of the first two argument types. Your exposition will combine empirical research in an effective manner. Descriptions of this kind
these three types of arguments in such a way as to create an argumen- form the crux of a literature review, and are also included (albeit more
tative structure leading inevitably to your personal conclusion. It will succinctly) in the introduction and sometimes also in the discussion
be scientifically sound if all the available key facts and interpretations sections of empirical research reports. This chapter also provides
on the subject have been considered and your positioning and evalua- instructions on how to create a scientific summary that can be used
tion of them is logically correct. as preparation for writing both a literature review and an empirical
research report. Chapter 5 looks at writing the full literature review
itself. In a very condensed form, the literature review is also part of
1.2 What is an empirical research report? the introduction to an empirical research report. Chapter 6 outlines
exactly how to create such a research report. Appendix B presents a
An empirical research report is an informative text (an exposition) sample research report.
presenting new facts pertaining to a particular question. The intro-
duction to this type of report will always include a succinct summary
of information pertinent to the relevant field of research. The three 1.4 Criteria applicable to all reports
types of arguments listed in Section 1.1 will apply here too; however,
in this case they must reason coherently and convincingly towards the There are some criteria that apply universally to all reports. They are
conclusion that a key question remains unanswered - a question that given here at the very beginning, so that they are not obscured by the
you have investigated by making certain observations. The report will discussion of the other elements. These general criteria are as follows:
describe exactly how you did so, and what the results of the investiga- Accuracy
tion were. Next, you will interpret the results, outline their relevance The content of the report must be correct. Both literature reviews
to the field of research you described in the introduction and provide a and empirical research reports must present information taken
commentary on the results. The exposition will be scientifically sound correctly from the articles under review; in an empirical research
if a) the literature review provides a succinct but thorough summary report, the experimental results reported must also correspond
of the field of research; b) the research design is sound and the data accurately with the results obtained. Accuracy also means that
obtained has been analysed correctly; and c) the interpretation of the information contradicting your position cannot be omitted.
results is indeed supported by the facts. Clarity
The report must be easy to understand. A literature review must
give the reader (who is not familiar with the original publications)
1.3 The content of this book a clear understanding of what was studied and how, as well as the
researchers' conclusions. The same applies to empirical research
This book examines the various components of both types of reports, reports, but with the additional requirement that a reader must be
and is therefore a manual for writing both literature reviews and able to reproduce the study being reported on.
scientific reports of empirical research. This first chapter sets out a Structure
number of general criteria that apply to written reports. In order to The report must be structured clearly and logically, with the var-
write an academic text on a particular topic, you must create a cohe- ious sections linked in a cohesive manner. An effective title, a
sive written exposition that combines words into sentences, sentences standardised layout and informative sub-headings are part of an
into paragraphs, paragraphs into sections and sections into a com- effective structure.
plete academic text. The rest of this book provides tips and instruc- Language
tions relating to all of the above levels. Chapter 2 offers a number of The report must be written in good English, with correct use of
general recommendations for the structure, style and layout of aca- spelling, grammar and division of paragraphs. The style of the
demic texts. Chapter 3 describes how to choose the topic of a literature report must also be objective and impartial, and present as much
review, how to search for scholarly literature on a particular ques- information as possible using the fewest words.
tion and how to plan your review. Chapter 4 looks at how to describe
.. Writing Psychology Research Reports
References
The report must correctly cite the publications on which it is based,
and include a list of references in the proper format.
Layout
The layout of the report must be in accordance with the rules of the
American Psychological Association (APA).
Originality
You must write the report yourself. Copying or paraphrasing
others' work (or your own prior work) without citing the source
is not permitted.
The science of psychology is based on the knowledge set out in aca-
demic publications. In practice, much of this knowledge is published
in English. Anybody wishing to write for inclusion in an English-
language psychology journal must follow the guidelines as set out by
the American Psychological Association (APA). Most psychologists in
the Netherlands follow the same guidelines in their Dutch publica-
tions (for an example, see the monthly journal of the Dutch Associa-
tion of Psychologists (NIP), De Psycholoog). The APA has compiled a
comprehensive manual for those submitting manuscripts to journals,
called the Publication Manual (American Psychological Association
[APA], 2010). Many of the guidelines in this book are based on this
manual. Reports must also use correct English - extensive advice on
this topic can be found in The elements of style (Strunk & White, 2000)
and Grammatically correct (Stilman, 2010). Wherever these books go
against the Publication Manual, the rules in the Publication Manual
take precedence.
This chapter deals with the following topics (in order): the structure of
an academic text, academic writing style, style guidelines, references
and citations, the list of references and academic text layout.
2.1.1 Sections and paragraphs 2.1.2 Organising a text into sections and paragraphs
2.3 Style and spelling guidelines The children who did not participate were cheering.
Scientific texts are made up of sentences that read smoothly, and in (Only in the second sentence were there children who did participate.)
which all words are spelled correctly. Thorough editing is therefore
important when writing your own reports. Poor use of language will Complex prepositions
probably result in the reader disregarding the report altogether. Good Always avoid convoluted use of language, such as unnecessary prepo-
reference works for correct use of language are The elements of style sitional phrases. These expressions usually consist of three words, feel
by Strunk and White (2000) and Grammatically correct by Stilman rather 'forced' and can generally be replaced by a single word. With
(2010), which clearly explain many aspects of how to use correct regard to can nearly always be replaced by regarding or concerning. By
English using many concrete examples. means of can be expressed by using or through. Chapter 2 in Strunk
Academic texts must also comply with many guidelines that are based and White (2000) provides more such examples, along with a wealth
on the APA Manual (APA, 2010). This section deals only briefly with of useful tips regarding clarity, accuracy, succinctness and appealing
the above, but the pointers below should help avoid frustration among writing.
your supervisors and/or external assessors.
Writing Psychology Research Reports 2 Academic Writing -
Only when describing aspects of the study for which you yourself were 2.4 References and quotations
responsible should you use Tor 'we', e.g.:
References to other texts or sources of information are very common
we implemented this mechanism in a connectionist model, in stylistic elements specific to academic texts. In a literature review,
which ... To our surprise, our results in the second experiment almost all of the information presented will have come from other
suggested ... sources you have studied, and research reports also contain much
information from external sources. In most cases, the information
Use parallel grammatical constructions will be paraphrased, i.e. re-written in your own words. In rare cases,
Parts of sentences that serve the same purpose should be formulated in reports will contain direct quotations. Whatever the case, the reader
the same way. Although this may seem dull, it does make the text eas- must always know exactly where the information under discussion
ier to follow. Writing academically mostly means writing clearly, and (not only research results, but also ideas and lines of reasoning) has
parallel constructions are indispensable in this regard. So, instead of: come from. This is what the in-text references and the associated ref-
erence list are for. References form the basis of the scientific litera-
The participants saw upper-case letters in the experimental ture; they ensure that all claims made by the author can be verified
condition, and were shown lower-case letters in the control by others. Nor should we forget the adage 'credit where credit is due';
condition. you should never present other people's ideas as though they were
your own.
use: Presentation of your own ideas (e.g. in the form of a new line of
reasoning, criticism, conclusion or evaluation) is made clear to the
The participants saw upper-case letters in the experimental reader by a lack of any reference. Although the difference may seem
condition and lower-case letters in the control condition. subtle, it is very important. It must be absolutely clear to the reader
when you are speaking your own mind and when you are paraphras-
Also use parallel constructions in corresponding paragraphs. ing or quoting others directly. Doing the latter without references
For example: is plagiarism.
Two attribute types are defined: internal attributes and external 2.4.1 Referencing sources
attributes. The key aspect of an internal attribute is ...
In view of the above, a report must therefore indicate all sources of
The key aspect of an external attribute is ... information as precisely as possible. References are used for this pur-
pose. Appendix C contains an extensive overview of various types of
Do not use synonyms references, the most important of which are touched on briefly below.
Decide on specific terminology, and stick with it. Once you have In psychology, in-text references always consist of the name(s) of
decided to refer to the difference between men and women as sex, the author(s) and the year of publication. This also applies to online
do not start calling it gender later on. sources: the URL (Internet address) should be given in the list of refer-
ences, not in the running text.
Effective use of comparisons There are two options for in-text references:
Always explicitly name both parts of a comparison. So, replace
'participants in the experimental condition had higher scores' with Put the author in the running text, and the year of publication in
'participants in the experimental condition had higher scores than the parentheses:
participants in the control condition'. Always do this, even if there
are only two conditions. Rachlin and Green (2008) studied animal behaviour ...
Writing Psychology Research Reports 2 Academic Writing -
Put both the name(s) and the year in parentheses: If there is no author information whatsoever (e.g. as is sometimes the
case with online sources), use the title of the work in both the in-text
In a recent study (Rachlin & Green, 2008) on animal behaviour ... reference and the list of references. When included in parentheses, the
title may be shortened to the first word or words. Where no publica-
Note: if the names are part of the running text, insert the full word tion year is known, use n.d. (abbreviated form of 'no date'). Only if
and between them; if the names are in parentheses, use the & symbol. the author's name is explicitly mentioned as Anonymous in the origi-
In-text references never give authors' first names or initials, unless nal, you may use it as the author when referencing, e.g. (Anonymous,
two first authors in the literature list have the same surname, which 2006). Do think carefully about how much store you wish to set by
could cause confusion. completely anonymous sources.
Referencing publications by three or more authors Referencing publications that you have not read yourself
Publications by three or more authors can be referenced in an abbre- Only reference sources you have actually read. If you come across a
viated form, by giving the name of the first author followed by et al. reference to a publication that you would also like to reference, the
(short for: et alii, which is Latin for and others) and the year. When best thing to do is to look it up and read it yourself. If this is genu-
referencing publications by three to five authors, list all the names the inely impossible, reference the source via the publication that you have
first time, and abbreviate subsequent references. Sample first reference: actually read. This will prevent you from taking on interpretations by
others that are potentially debatable or incorrect. For example:
Janssen, Peters and Lopez (1987) discovered that ...
Freud (1900, cited in Ryckman, 1985) assumed that ...
Subsequent references: According to Strickland (1989), Rotter sees a lot of similarity
between the concepts locus of control and learned helplessness ...
Janssen et al. (1987) reported another noteworthy result.
The above examples show that you have genuinely read Ryckman and
The second reference to a study within the same paragraph may also Strickland, but that you have not verified their claims regarding Freud
omit the year, provided no ambiguity results. So: or Rotter yourself. Note: because you have not used the indirectly
referenced publication as your own source, you may not include it in
Janssen et al. (1987) discovered ... Janssen et al. also found ... the list of references.
Referencing publications by unspecified or unknown authors Although you should keep direct quotations to a minimum, they can
Works whose authors are unknown (which is often the case with pub- sometimes serve to strengthen your arguments. References to direct
lications by large organisations) are referenced using the initial words quotations must always include a page number. If you have already
of the entry in the list of references, along with the year of publication. referenced the publication leading up to the quotation, simply giving
For example: the page number is enough. Quotations less than forty words in length
can be included in the running text without any special formatting,
In-text reference: other than double quotation marks. Use an ellipsis ( ... ) to indicate any
(World Health Organization, 1999) omissions in the quotation, which must otherwise be taken verbatim
Entry in reference list: from the source (including any errors in spelling or grammar). If you
World Health Organization (1999). Report on the ...
Writing Psychology Research Reports 2 Academic Writing -
wish to add your own clarifying remarks, do so using square brackets. There are two very important considerations when creating a reference
An example of a short quotation with comments by the author: list: the first is how to list each individual entry, and the second is the
order of entries.
As noted by Rescorla (1987), "The likelihood of making a response
[by pressing the lever] was substantially lowered if its reinforcer
was subsequently devalued" (p. 121). 2.5.1 The components of a reference list
Quotations of forty words or longer must be made typographically Reference lists can include various items. The four most common
distinct from the surrounding text through indentation. In these items are journal articles, books, chapters from edited books (each
cases, quotation marks are not used. The page number is given after written by a different author or group of authors) and references to
the full stop at the end of the quotation. For example: online publications. This section gives the rules for citing a journal
article, followed by those for books, chapters from edited books and
As noted by Rescorla (1987): online articles. Further examples are given in Appendix C.
The likelihood of making a response was substantially lowered Here is a sample entry for a journal article:
if its reinforcer was subsequently devalued. The fact that these
data were collected during extinction, when neither reinforcer Mellers, B. A. (2000). Choice and the relative
was presented, implies that the animal had previously pleasure of consequences. Psychological Bulletin,
associated a particular reinforcer with a particular response. 126, 910-924. https://doi.org/10.1037/0033
(p. 121) -2909.126.6.910
If the name of the publication has not been mentioned leading up to The applicable guidelines are as follows:
the quotation, the reference should look as follows:
Authors' names
A prominent researcher described the phenomenon thus: "The Put the author's initials after their surname, with a full stop after
likelihood of making a response was substantially lowered if its each initial.
reinforcer was subsequently devalued" (Rescorla, 1987, p. 121). Give the surnames and initials of all authors in the same order as
they appear at the top of the article.
Try to keep direct quotations to a minimum. Your writing will gen- Where there are two or more initials, each must be separated by
erally benefit from using your own words, as you can maintain the a space.
same style throughout. Besides, your exposition will ultimately almost If there is more than one author, use an ampersand (&) before the
always depend more on the import of the arguments rather than on final author's surname.
their precise formulation in the texts you have studied. If there are more than seven authors, put a comma after the name
of the sixth author, then a space, then an ellipsis ( ... ), then another
space and finally the surname and initials of the final author.
2.5 Reference list Use commas to separate the authors' names.
All in-text references must be included in the reference list. The ref- Publication date
erence list provides all of the information that someone else will need Put the year of publication in parentheses, followed by a full stop.
to locate the sources. Correct citation of the sources used is precision
work, and it is important to get it right from the get-go. Correct ref- Title of the article
erencing forms the linchpin of academic writing, and even tiny errors Capitalise only the first word in the title/subtitle.
can make sources impossible to find. Search engines, for example, may Proper nouns in titles/subtitles must be capitalised.
not be able to locate a source if the author's name (or even an initial) Capitalise the first word after a colon.
is spelled incorrectly. Finish off the title with a full stop.
Writing Psychology Research Reports 2 Academic Writing -
Information on the journal in which the article was In all other cases, the entry finishes with the page numbers.
published
Give the full title of the journal using Title Case (major words and The same general scheme is applied to all other entries. Use the exam-
words of four letters or more are capitalized). ples below as templates for references to books or chapters from an
Write the title in italics. edited book.
Put a comma after the title.
Give the year of publication: the volume number. Referencing a book
Put the volume number in italics. Here, the book title is printed in italics, followed by a full stop. Next,
Place a comma after the volume number. list the place of publication and the publisher's name, separated by a
Only give the issue number for journals whose page numbering is colon.
not continuous across the various issues in a volume; most jour-
nals use continuous numbering, and in these cases an issue num- Robinson, D. N. (1992). Social discourse and moral
ber is not required. judgment. San Diego, CA: Academic Press.
Give the first and last page numbers of an article, separated by an
en dash ('-', created in Word by pressing Ctr! and the minus key Referencing a chapter from an edited book
together). The abbreviation 'Ed.' or 'Eds.' refers to the editor(s) of the book.
End with a full stop.
O'Neil, J. M., & Egan, J. (1992). Men's and women's
Digital object identifiers gender role journeys: Metaphor for healing,
Most items have what is called a digital object identifier, or DOI. transition, and transformation. In B. R. Wainrib
As of March 2017, the following DOI citation format is recom- (Ed.), Gender issues across the life cycle
mended (McAdoo, 2017): (pp. 107-123). New York: Springer.
https://doi.org/identifier
Do not place a full stop at the end of the DOI. Older DOI citation Referencing electronic sources
methods are DOI:identifier and http://dx.doi.org/identifier, both Electronic sources are those whose information is taken exclusively
of which also exclude the final full stop. from the Internet. In most cases, these will be journal articles. Those
A DOI makes articles very easy to locate: simply type it into Goog- that have a DOI will use the standard format; if an article has no DOI,
le search or use the DOI resolver at crossref org. The recommended but you did access it online, give the URL of the journal's home page.
way to cite a DOI is a direct URL (i.e. an online link) to the article. These types of references are generally structured as follows:
If an article has no DOI, but you did access it online, give the
URL of the journal's home page (see example below). There is nev- Author, A. A., Author, B. B., & Author, C. C. (year).
er a full stop after a URL; line-break the entry as necessary after Title of the article. Title of the journal, volume
a double-slash (Il) or before any other punctuation marks (e.g, a number, page numbers. Retrieved from http://xxxxx
single slash, full stop or hyphen); never add a hyphen or full stop,
to the end or anywhere else. If the article did not appear in a journal, the entry is structured as
follows:
Sillick, T. J., & Schutte, N. S. (2006). Emotional
intelligence and self-esteem mediate between Author, A. A. (year). Title of the article. Retrieved
perceived early parental love and adult happiness. from http://xxxxx
£-Journal of Applied Psychology, 2(2), 38-48.
Retrieved from: http://ojs.lib.swin.edu.au/index
.php/ejap/index
Writing Psychology Research Reports 2 Academic Writing -
2.6 Formatting Principal words are capitalised, grammatical connectors (e.g. the, and,
in, with, for) are not. If subsections are to be used, a second level of
Any scholarly article submitted to an academic publication must be headings will apply. Subsection headings are formatted as follows:
formatted according to the guidelines in the APA Manual. This sec-
tion covers some of the more important rules. Bold, Left-aligned Heading in Title Case
Font size, spacing, alignment, breaks These two tiers are often sufficient, but if a third level is required, it
Apply generous left and right margins (the word processor's default appears as follows:
settings are good), select a standard 12-point font (e.g. Times New
Roman) and use double-spacing (except in tables and diagrams). Bold, indented heading in sentence case, ending with
The text should be left aligned; do not justify the right margin. Do a full stop.
not manually break words at the end of a line, simply because, if your
report is published in a journal, the words that appear at the end of the In this case, the text continues on after the full stop (although it is no
line in your manuscript will most probably appear somewhere else in longer bold, of course).
the final publication.
Writing Psychology Research Reports 2 Academic Writing -
Research reports (see also Chapter 6 and Appendix B) use this format- Variables
ting as follows. A report on a single study uses the following format: All empirical research reports must define the variables used in the
study. The following applies to the definition of variables. Only use
Method meaningful, complete descriptions in the text. Never use abbreviations
Participants or the codes applied to the statistical processing. If lack of space in a
The participants were ... table (e.g. a correlation matrix) makes abbreviations necessary, define
them in a footnote.
Reports on multiple studies are structured as follows:
Capitalisation
Experiment 1 Variables are sometimes capitalised, and sometimes they are not.
Method The APA Manual says the following: Variables are generally not capital-
Participants. The participants were ... ised, unless they are combined with a multiplication symbol. So:
Paragraphs are used to give further structure to the various sections The gender and age variables
of the report. New paragraphs (except in the abstract) are indicated The Gender x Age interaction
by indenting with a tab. Conclude a paragraph with a hard return. A 2 x 2 (Gender x Age) research design
Paragraphs also always contain multiple sentences, so never create a
paragraph consisting of only one sentence. General references to tests are not capitalised. For example:
The APA Manual lists the following important exceptions to this rule. The MMPI Depression Scale is a scale with ...
Use digits for numbers lower than 10:
for measurements: a dose of 4 mg, lasting 6 seconds, a 4-cm strip; Statistical symbols
for items in a series: Experiment 2, Table 4, Figure 7; Put a space on both sides of all operators (=, <, >, +, -, etc.). Statistical
in calculations: multiplied by 4, fewer than 8% of the trials, a 1:3 symbols (e.g. F, p, t, N, M, SD) must always be in italics, except for
ratio; Greek letters. Some examples are given below of how to present the
for numbers indicating date, time, age, sums of money or scores: at study results and analysis.
4 o'clock, on 4 March 2000, the average age was 9 years, a score of
5 on a 7-point scale, each participant received 5 euros, In the study (N = 234) there were various ...
for statistical information: t(9) = 1.3; F(3, 8) = 3.4. The effect of group size was significant, t(28) = 2.26, p = .032, d = 0.82,
the large group produced more ideas than the small group.
Never start a sentence with digits; numbers at the start of a sentence M = 8.16; SD= 2.11
are always expressed in words. x'(S, N = 85) = 7.19, p = .21
11/= .89
Writing Psychology Research Reports 2 Academic Writing -
When referring to the number of participants in a subsample, do not know why the figure or table has been included. Your text must there-
use a capital letter, e.g.: fore explicitly state what you want the reader to focus on in the table,
e.g.:
The group that scored highly on the test (n = 34) was ...
The two conditions differed in the preliminary measurement, but
A 95% confidence interval for an average (M) is given as follows: not in the subsequent measurement, as shown in Figure 2.
M = 635.7 ms, 95% Cl [625.6, 645.8] Figures must be captioned with 'Figure x.' (in italics, where x is the
figure number, followed by a full stop) below the figure. Continue
The percentage symbol is only used in combination with digits; other- the caption in normal script with a brief description of the figure.
wise, write out the word 'percentage' in full: Any abbreviations used in the figure must be explained in the cap-
tion. For the figure itself, use a sans-serif font (such as Arial, Futura
The percentage of women was ... or Helvetica). If the figure is a graph, both axes must be labelled (see
The sample was 55% female ... Appendix B for an example).
Non-statistical subscripts are not given in italics, but statistical sub- When including tables, the running text must also explain what it is
scripts are, e.g.: the reader should see in the table, e.g.:
Only after completing the above steps can you actually commence
writing, during which time revisions will always be necessary based
on your own or others' remarks.
This section looks at the first step in writing a literature review: choos-
ing a topic. Some students can easily come up with a list of topics they
would like to write a literature review on, while others have more
trouble. Some suggestions are given below to help you get started on
making a choice.
A good way to start is to browse through the books you have already
studied up to now - this will at least give you an idea of where your
Writing Psychology Research Reports 3 How to Write a Literature Review -
interest lies. If you are particularly interested in social psychology, you themselves (such as intelligence or a person's tendency to seek the
may want to consider choosing a topic from that field. As a follow-up cause for events within themselves or in the outside world). One pos-
step, you could look through a social psychology handbook. The added sible example of a question is: 'Are the types of attribution made by a
advantage of this approach is that you can already gain an idea of the person influenced by their ability to exert control over their environ-
research that has been conducted on a particular topic by looking ment?' In correlational research, X and Y are generally both aspects of
through the list of references in the handbook. human behaviour (such as reaction speed and memory performance)
A second strategy is to select a topic that interests you, but which you or personal characteristics (such as intelligence and extroversion).
have not yet delved into. Psychology covers a broad range of topics, One possible example of a question here is: 'Does a person's social sta-
and writing a literature review can enable you to learn more about a tus correlate to their attribution style?' Box 3.1 gives several additional
topic that is not in the limelight of modern psychology. The risk is that examples of provisional questions.
you may not find any or sufficient suitable literature. Section 3.3 talks
about what to do in this situation. A major advantage to formulating a question this way is that you
Lastly, talking to your fellow students or a lecturer can also help already have at least two terms you can use to search for literature.
you choose a topic. The lecturers have all written multiple literature The following section looks at selecting search terms and searching
reviews and can tell you about how they came to choose their topics. for literature.
Perhaps the most important thing is that you find the topic interesting,
engaging and/or challenging, so you feel motivated to work on writing
the review (and hopefully enjoy it!). Examples of a provisional research question
A problem statement can be viewed as an initial indication of the ques- personality characteristic is determined by the environment.
tion you aim to answer, and gives a broad, general idea of how you On the topic of Memory development, potential questions might be:
intend to approach the topic. For example: if you choose to write a lit- 'What are the short and long-term effects of targeted training on
erature review on attribution, your problem statement could focus on short-term memory development?' (environmental determinant),
the question of how certain types of attributes (e.g. internal or exter- or: 'What is the relationship between general intelligence and
nal) originate. A problem statement like this must then be further long-term memory development?' (intra personal determinant).
honed into a provisional question - this is a necessary step to allow
you to search for literature in a targeted fashion. Your question will Box 3.1
usually require adjustment, sometimes even to a significant extent,
once you have located a few articles.
In most cases, you can formulate your provisional research question in 3.3 Searching for literature
one of two ways. In experimental research, the question will take the
form of: 'What is the influence ofX on Y?' In correlative research, this Scientific literature consists primarily of journal articles, chapters in
becomes: 'Is there a relationship between X and Y?' In experimental edited books or even entire books dedicated to a certain subject. There
research, Y represents an aspect of human behaviour (e.g. extrover- are various ways to find suitable literature.
sion, independence, memory performance, reaction speed, depression
or a type of attribution). X represents the possible variables that deter- Working from a suitable starting publication
mine (or are related to) this behaviour, and can include environmen- A good way to start is to look in textbooks to see whether your cho-
tal variables (such as others' behaviour) and aspects of the individual sen question is covered anywhere. If so, the book will almost always
Writing Psychology Research Reports 3 How to Write a Literature Review -
include references to articles or books (or book chapters). The full ref- Search terms
erences can be found in the reference list in the back of the textbook. Searching digital databases for publications on your topic requires
If they look promising, you can find the publications in question by search terms. For your initial foray, use the principal words from your
searching through digital databases, either by using several words research question. Always use English search terms, as both the data-
from the title or by searching directly using the authors' names. Once bases you will be searching and the psychology literature are nearly all
you have found what you are looking for, you can use this as the basis in English. Examples of suitable search terms are personality develop-
for the rest of your search (see 'You find too little literature' under ment, extraversion, short-term memory or intelligence. When formu-
Section 3.3.1). lating search terms, it is helpful to make use of the thesaurus function
(if the search engine has one). The thesaurus contains a hierarchical
Using search terms system of key words that describe every publication.
If you have no publication to use as a starting point, one option is to Search terms can be combined with Boolean operators, such as AND,
search a range of digital databases. PsycINFO is the best place to start: OR and NOT. A search using AND will only produce results that
it is a major database including all articles, books and book chap- include both search terms; OR will give publications that include
ters from the psychology research literature that are of any impor- at least one of the search terms. Use NOT to exclude certain terms;
tance. Base your search terms on your question and enter them into publications that contain these terms will not be shown.
a search engine (OvidSP) that specialises in searching databases such
as PsycINFO. Based on the titles you find and the accompanying The initial foray
abstracts, you can then evaluate whether these publications are suita- After typing your terms into the search engine, you usually initiate the
ble for inclusion in your literature review. This process is described in search by pressing a button labelled Search. The first relevant informa-
more detail in Section 3.4, along with how to use the Web of Science tion you find will usually be titles (along with the author's name, the
and PiCarta search systems. name of the journal/publisher and the year of publication). Titles pro-
vide little information on the content of a publication, but enough to
make an initial assessment. If the title seems relevant to your literature
3.3. 7 Overview of the search process review, the abstract (a brief summary) is usually only a mouse-click
away. Reading the abstract will give you a much better idea of whether
An effective literature search process is a very active one. It does not the publication is useful for your literature review. Your final task is to
simply involve passively entering search terms and seeing what turns locate the full text of the publication. For recent articles, this usually
up - effective searching is driven by what you find during the search only requires a few mouse clicks. If you wish to include an article in
process itself. The search process effectively allows you to start writ- your literature review, you must always have access to the full text.
ing your detailed plan (see Section 3.5). Taking careful note of titles
and abstracts will quickly give you an idea of the different variables More searching
at play in your research question. You will encounter a wide range of An effective combination of search terms will probably furnish one
research methods, groups of participants and theoretical perspectives, or more titles that are relevant to your question. You may find exactly
for example. This information will help you to structure your litera- the right amount; however, this is unlikely. There are multiple possible
ture review (e.g. by including separate sections on research regarding scenarios at this point.
children and regarding adults). These ideas for structuring your liter- You find too many suitable results. In this case, you must narrow
ature overview can be actively applied during the search process, by down and refine your search. There are various ways to do so:
formulating your search terms so as to effectively cover the relevant Add more terms to your search; this will limit the number of
sub-areas. This will quickly reveal whether your structural concept is results to the publications suitable for your specific question.
tenable, or whether you should discard it. The latter may be the case if Continue searching based on a publication that you find par-
there is too little literature available in a certain specialist field. ticularly interesting. In this case, proceed as described below
(as though you have too few results, but at least one that is
extremely suitable for your question).
Writing Psychology Research Reports 3 How to Write a Literature Review -
You find too little literature. of the book. This is usually enough to get a good idea of how the book
First of all, you can try using different search terms. If the term is structured. Books often include a summary or a first chapter giving
speaking produces no results, the terms language production, a brief outline of the chapters to follow. This is a good basis for decid-
formulation, articulation, sentence production or word genera- ing whether it is suitable, and seeing which chapters/sections might
tion might do better. Be creative, as most authors do the same! be useful. The reference lists in such books are also a good source of
If possible, also use the search engine's thesaurus to find suita- additional information and/or further useful sources.
ble search terms. Lastly, the impact factors of articles can give an idea of how important
If you have found at least one publication that seems suita- the article is. In scientific practice, articles are only useful if they are
ble for your question, use the terms listed therein (or related read by many others and incorporated into their research. This last
terms) as new search terms. aspect can be measured in the form of impact factors, which are higher
Some search engines (e.g. Web of Science, see Section 3.4.2) the more other researchers reference articles published in the jour-
can also use a certain publication as the starting point for nal. Nearly all psychology and other journals have an impact factor.
searching backwards or forwards in time. Search backwards The scientific journals Nature and Science are widely read, for exam-
in time by closely examining the publication's reference list; it ple, and their impact factor is high (around 40). Journals such as the
is very likely that it will contain relevant articles on the same Journal of Psychologists and Counsellors in Schools have a low impact
topic. Search forwards in time by retrieving all articles that factor (around 0.1). Impact factors are recalculated each year, and can
appeared later and contain a reference to the original article. be accessed at all university libraries. They can also be found within
This will be very likely to produce relevant results. online university environments by searching the Internet for InCites
Terms used in the articles found in this manner can also serve Journal Citation Reports.
as inspiration for new search terms.
Lastly, many search engines allow you to search for articles
that resemble the starting publication. 3.4 Overview of search engines
You find no publications whatsoever that are relevant to your ques-
tion. In this scenario, you must broaden the scope of your question All universities provide access to a wide range of digital databases, all
and conduct a new search accordingly. of which contain information on millions of scientific publications.
The information on a single publication is called a record. Each record
consists of several elements, called fields. For example, there are fields
3.3.2 Evaluating the results for the name(s) of the author(s), for the title, for the publisher, for
keywords, for the publication year, occasionally for the abstract and
When evaluating the suitability of an article, book or book chapter, the list of references, etc.
start by establishing whether the content relates to your problem state- This section discusses the various search options as follows:
ment or provisional question. To do so, look at the title and subtitle searching for journal articles and chapters from edited books in
(if there is one), then read the summary (or abstract) that is often also PsycINFO;
included in many databases. A quick way to tell whether an article is searching by reference in Web of Science;
useful is to read the abstract to identify the dependent and independ- searching in Google Scholar;
ent variables and their operationalisation, and potentially also the searching for books in PiCarta.
theoretical framework and the types of participants. This will allow
you to see at a glance whether the article in question is relevant to Nowadays, more and more search results can be viewed straight away
your question and the rest of the literature you found. online; if not, the search engine will provide the necessary informa-
Evaluating the suitability of a book (or part thereof) is somewhat tion to find a printed copy. Bringing up entire publications online does
similar. As with articles, you can most likely look at the title and/or require searching from a university computer, however. It is some-
author(s) to see whether the work is suitable or not, and scanning of times also possible from other locations, but external computers must
the table of contents will give you a general overview of the contents have a VPN connection to the university network. Ask the library for
more information.
Writing Psychology Research Reports 3 How to Write a Literature Review -
3.4. 7 Searching for publications in PsyclNFO and click Continue (at the top of the screen). A list of titles will then
appear, which you can browse through. If one of the results looks
To find journal articles and chapters from edited books on your topic, interesting, view the abstract by clicking the Abstract button. Reading
PsycINFO is generally the best place to start. It contains records and the abstract will allow you to assess whether the publication will be
articles from around 1500 academic psychology journals, along with useful for your literature review.
chapters from edited books. All important publications in the world
of psychology are contained in it. Only in special cases can it also Saving suitable results
be worthwhile searching elsewhere (e.g. medical databases, such as If you think a result might be useful, mark it by checking the box
MEDLINE or PubMed). PsycINFO provides an abstract for all refer- beside it. There are buttons immediately above and below the list that
enced articles, enabling you to evaluate straight away whether an arti- allow you to show the checked records (Keep selected), print them,
cle is relevant to your question. PsycINFO can be accessed from the e-mail them (to yourself) or save them in a file (Export).
online library of any university in the Netherlands.
Opening PsycINFO will take you to Ovid - this is the search engine, Searching with different keywords
and PsycINFO is the collection of databases that can be searched using (If necessary, first click Search at the top of the Ovid screen, e.g. if you
Ovid. have been using the thesaurus).
If you cannot use the thesaurus (or if you do not want to), you can also
Searching with the thesaurus simply enter different search terms. Click in the Search panel under
All PsycINFO records include a 'keywords' field. In PsycINFO, they the Basic Search tab and type your search terms into the empty field.
are called subject headings. All keywords used are part of a hierar- You can even just enter your research question (in English) into the
chical system of keywords - the thesaurus - which you can apply to field. Then click Search, and a list of results will appear on the screen.
your search. By searching with the words in the thesaurus, you can
take advantage of the work by many librarians who have allocated key- Combining search terms
words to each publication. Publications found in this way will never If your question combines two or more concepts, you will usually be
contain your keyword by chance, but will be of genuine relevance. looking for a combination of two or more search terms. There are var-
Search for effective keywords in the thesaurus as follows: click the ious ways to do this. In Basic Search, the search terms can be entered
Search option under the Search Tools tab, then click Thesaurus (to the in the same field; in Advanced Search, they must be separated by the
left of the search field). Type in your search term and click Search. If word and. If you have already done several searches and you wish to
your word does not appear in the thesaurus, you will be presented with combine the results, you do not need to enter the search terms again.
the thesaurus entries that are alphabetically close to where your word Instead, the collected results can be combined by selecting the relevant
would be. If your keyword is in the thesaurus, you will see an overview searches in the Search History panel (at the top) and then clicking the
of more general, more specific and/or related words in the thesaurus. And button. Note: Basic Search results are filtered for relevance using
Clicking on one of these words will take you to another part of the an algorithm created by the software provider. If you want to view
thesaurus. You can also see straight away how many publications are all of the records containing a certain search term, use the Advanced
associated with each keyword. Search, as these results are not filtered.
Starting with the term 'behaviour', you can click through to the Refining searches
related term 'behaviour therapy', then to the more specific term There are more options available in PsycINFO for refining searches
'systematic desensitization therapy' then to the related term even further:
'relaxation therapy' and then to 'muscle relaxation'. If you are looking for a certain publication, or all publications by
a certain author, use the Find Citation tab.
Continue in this fashion until you find a keyword that describes your Searches can be limited (e.g. to publications from certain years, to
topic, then find publications in PsycINFO containing the keyword in participants from certain populations, etc.) under the Advanced
one of the subject headings as follows: check the box beside the term Search tab, by clicking Limits and Additional Limits.
Writing Psychology Research Reports 3 How to Write a Literature Review 11111
Limit searches to certain fields (such as the title) under the Search Other fields can also be added and combined with the results from the
Fields tab. first field by using the operators AND, OR and NOT. Clicking Search
Search Fields can also be used to find out what happened to the ide- will bring up a list of articles that match your search terms. Use Refine
as in the article after it was published. To search for publications Results (on the left) to limit the results. Of course, you can also change
that refer to a single publication that you have already identified, your search terms. If an article seems interesting, you can read more
enter the full title of the publication into the search field and select about it by clicking its title. This will bring up a screen containing
cv: Cited Reference Title. Then click Search and the search results information such as the abstract and all sources to which the article
will appear at the bottom of the screen. The Filter by option will refers. If it looks usable, you can add it to a list by selecting it and click-
appear left of the results; if you click it, and then click Subjects, the ing Add to Marked List, just above the description of the search results.
relevant publications will be sorted by keyword (subject headings). The list of articles created in this manner can be viewed by opening
Search by author. This is worthwhile if you have found a use- the Marked List tab (top right), where it can also be emailed (e.g. to
ful publication and want to find more publications by the same yourself), printed or saved in various file formats.
author; do so via the Advanced Search, by selecting the Author
option. Enter the author's surname and click Search; this will take Searching for related articles
you to a screen where you can select the correct author. Then click To find out about the background to the ideas in a specific article, or
Search for Selected Terms (right above the tabs). to find out how the ideas spread after publication, use the right-hand
Search different spellings of the same term under Advanced Search column in the article's information window.
by using 'or' instead of 'and', or use what is called a wild card: To find out the history of the ideas discussed in the article, search
behavio", backward in time for all publications referenced by it. To do so, click
Explore these and other options yourself in PsycINFO. More infor- on the number above the words Cited References. To see how the ideas
mation on PsycINFO is available under the 'help' button at the top put forward in the article were used after its publication, search for-
of the Ovid screen. ward in time for all articles (published later) that include the given
article as a reference by clicking the number above Times Cited.
Lastly, Web of Knowledge can also provide a list of articles that cite
3.4.2 Searching in Web of Science the same publications as your starting article. This can furnish a list of
other researchers who have published work on the same subject (but
One of Web of Science's main features is that all the information in it is who may not have referenced each other). This is a quick way to gain an
interconnected, much like the threads in a spider's web. Once you have overview of your topic. Web of Science can also search for related arti-
found an article that is central to your topic, Web of Science provides cles if you click below Cited References on View Related Records. This
an easy way to ascertain the background to the ideas presented, and will show a list of all Web of Science articles that have at least one ref-
the path they took after publication. erence in common with your starting article. Thankfully, the articles
Just like PsycINFO, Web of Science uses search terms to find various containing the most reference overlap are shown at the top of the list.
types of literature, with the added advantage that it includes more
journals than PsycINFO. Especially in fringe areas (e.g. where psy-
chology meets biology/medicine), Web of Science can produce many 3.4.3 Searching with Google Scholar
more results than PsycINFO. Web of Science is both a database and a
search engine. The search function uses the reference lists of articles Google Scholar (https://scholar.google.nl/ or https://scholar.google
in the database. .com/) is a search engine for scientific literature, based on the well-
known Google Search. It is a very intuitive system. The standard open-
General searches ing screen accepts not only content terms, but also other terms, such
Enter your search terms in the field in the opening screen. You can also as authors' names or journal titles. In addition to the standard search
specify where you want Web of Science to search. The default setting field, there is also an Advanced search option in the top left. Clicking it
is Topic, but this can be altered (e.g. to Author or Publication Name). will display more options for refining your search, such as specifying
Writing Psychology Research Reports 3 How to Write a Literature Review -
whether search terms must appear in a certain publication, or exclud- Once you have entered your search terms, click zoeken (search) and
ing results that contain certain terms. a numbered list of entries will appear. The symbol to the left of the
After clicking Search, a list of search results (titles) will appear, show- number will tell you whether it is a book, a journal article, a video,
ing the authors underneath. These results are ordered by relevance, a website or something else. To view more information, click on the
according to the Google algorithm. Clicking on a title will take you entry title. Doing so will bring up a full bibliographic reference.
to the abstract, if available, or sometimes even the entire publication.
If you have searched via the university network, a direct link to the Keywords
relevant publication may appear beside the title. The books in PiCarta can easily be found using either Dutch or Eng-
A number of links are given below the title description: To find out lish search terms - using English will generally produce more results
how the ideas put forward in the article were used after publication, than using Dutch. Search by keyword as follows: in the middle drop-
click the Cited by link. There are also links to related articles (useful down menu (in the second line), select trefwoord (keyword), enter your
for getting a quick overview on a certain topic) and to all versions of term and click zoeken (search).
the publication that Google Scholar found online.
One drawback of working with Google Scholar is the difficulty in Searching for a specific book
conducting a systematic search - you will never know, for example, Search for a specific book (e.g. an edited book you have found in
whether you have found everything that is available, or how the results PsycINFO) by putting the whole title in double quotation marks
are ordered/prioritised. You will also see a lot of irrelevant results, as and selecting the titelwoorden (title words) option from the centre
Google Scholar searches the entire Internet, not just scientific data- drop-down menu in the second line of Pi Carta.
bases. One major advantage of Google Scholar is that you can use your
knowledge of the Internet to get started straight away.
3.5 Writing a plan
3.4.4 Searching for books: PiCarta Once your literature search is complete (or nearly complete), you can
start to draft the structure of your literature review. Writing a plan
PiCarta is the best place to start searching for books on your topic. is a very important step in this process. Writing a good plan is a lot
Among other things, it is the combined catalogue of books in many of work, and most people underestimate the time required. This is
Dutch libraries, including all university libraries. It also includes because nearly all beginning writers find it hard to get an overview of
a large collection of journal article entries, but it is better to use and keep track of a relatively large number of publications.
PsycINFO for journal articles, as it includes the abstracts, which A well-written text always has a narrative that runs throughout.
PiCarta does not, nor does PiCarta specialise in psychology. In addi- Writing a good plan fixes this narrative in place, and is therefore an
tion to journal articles, PiCarta also includes audio-visual materials, important step in writing a literature review. Read below on how to
websites and other resources. write a plan, and to see what it might look like once finished.
Before you start the answer will follow from a logical series of steps, each of which
Before writing your plan, you must thoroughly study the literature can be seen as the answer to a 'sub-question'. This will allow you to
you have found. Your perspective on the literature will determine how divide your review into sections, each of which answers a particular
you structure the review, and you cannot form a perspective without sub-question. The progressive unravelling of the research question
having read the literature. To this end, determine for each publication into sub-questions thus forms the narrative.
which section of the research being reported on is relevant to your A second possibility is that the answer to the question is not clear-cut.
research question. In articles that describe multiple studies, only one In this case, given the results of your analysis of the literature, you can
will be truly relevant in most cases (and the others were only per- seek to explain why there is no unequivocal answer. To do so, analyse
formed either to exclude different interpretations of the results, or to which aspects are integral to answering your research question. Does a
add further detail that you do not need). certain theory work well for adults, but not for children, for example? If
Write a brief summary of the research question that is relevant to you, this seems to be the case, two sections in the main body could discuss
along with the method, the results and their interpretation by the the effects of the therapy on adults and children. The best result will
authors. be achieved by constructing an over-arching hypothesis that is sup-
Then, to all of these elements, add your own evaluation. Assess the ported by all of the literature you have found. You may be able to state
relevance of the authors' research question to your own. Some authors what the difference is between adults and children that accounts for
state their research question explicitly; in other cases, you may need to the difference in therapy effectiveness - this is an important insight,
read between the lines to some extent to discern what it was they were and could form the narrative that runs through your literature review.
investigating. Once you have identified the authors' research question, A third possibility is that the research question cannot be answered
you can assess how important it is to your own. Also look at whether because the various studies contradict each other. The obvious strat-
the study was conducted properly (e.g. look at their operationalisa- egy here is to group studies with similar results together into sections.
tien, and whether the research design was sound). Check whether the Here too, however, it is your job to try to formulate an over-arching
analyses are correct, whether the authors' interpretation of the results hypothesis. Why do the results contradict each other? If you can
was impartial, and whether the results could be interpreted differently. show, for example, that the variation can be attributed to differences
Evaluations of this kind are not easy, and require you to think scien- in research methods or operationalisation, this offers a nice narrative
tifically about what you have read. They are also challenging because for your review.
they allow you to put all your knowledge about psychology, methodol- Lastly, you might find that your question and selected literature are
ogy and statistics into practice. More importantly, evaluations of this not such a good match after all. You may discover that you are missing
kind are absolutely necessary in order to take the next step: planning crucial information that is necessary to answer your research ques-
your review. tion. In this case, you can go in search of new literature to fill the gap.
You may also discover that you cannot answer your original research
Planning your review question at all - no need to panic, since you can always simply adjust
Only once you have thoroughly studied all the publications can you your research question afterwards. As long as there is a narrative that
start thinking about how to structure your literature review. This is ties all of your publications together, you can always rework it into a
the most difficult part of the entire writing process, in which you must new research question. There are various places to look to find a nar-
combine all of your analyses and evaluations of the various publica- rative: for example, you can compare the various studies' theoretical
tions, and find a narrative that ties them all together. perspectives, operationalisations, research designs, analyses, results
It is often easiest to start with the end. Ask yourself what the answer or the way the results were interpreted. The theoretical narratives are
is to your research question, based on your analysis of the literature. usually the ones that readers find most interesting.
Next, think about how you arrived at this conclusion. At this point,
there are generally four possible scenarios.
The first is that the answer to your research question can more or less
be determined directly through the analysis of your publications. If so,
scrutinise precisely how you arrived at your answer - in most cases,
Writing Psychology Research Reports 3 How to Write a Literature Review -
themselves and the authors' interpretation thereof can be used as Justification of the study question (i.e. relevance)
arguments. The third type comes from your own scientific evaluation within the problem area:
study question;
of the first two types of arguments. The final literature review must justification of the strategy chosen to answer the
combine all of these arguments into a coherent, convincing whole. question, leading into the structure of the literature
Your plan must contain the entire argumentative structure of the final review.
literature review, and indicate how the structure works both within Body (section by section; Section title (sub-topic)
and between sections. As shown in the example, a plan will begin with the number of sections
Introductory paragraph that includes the sub-topic
a working title for the literature review. Next comes an introduction will depend on the num-
ber of sub-topics) Description of the first study, stating:
outlining both the topics to be discussed in the following sections and
why you are including/describing it;
the question being investigated. Each section in the main body must what the researchers did and what the results were;
indicate the sub-topic under discussion (often aided by a sub-ques- your evaluation of the study (what the results mean
tion), what information you are presenting as an argument, which for your exposition);
howt his study relates to the rest of your exposition.
articles the information was taken from and the section conclusion you
draw based on this information. You can also indicate exactly how Description of second (and possibly third, fourth, etc.)
these sections are linked (transitions). In your conclusion, state what study
the answer to the main question will be, supported by the various sec- Section conclusion:
tion conclusions. You should also include any points of criticism you substantiated answer to the sub-question;
link back to the theory;
wish to address, and the associated consequences for the conclusion transition to next section.
(in the form of concrete suggestions and recommendations for further
Conclusion and discussion Answer to the main question:
study). Note: before writing your plan, you should do a lot of work; use supported using section conclusions.
the order as described in Section 3.5.1.
Points for discussion:
See below for a checklist of the plan structure; Box 3.2 contains a sam- interpretation of the given answer (linking back to
ple plan for a review on the subject of violent computer games and theory);
aggression. It is recommended to read through the example, to get an evaluation of the given answer;
idea of what your own plan might look like. recommended further research.
Broader context
Plan outline Reference list Complete and in alphabetical order
Use the following outline to write a plan. The elements in the right-
hand column are what you need to include, and all information
sources must be cited.
Writing Psychology Research Reports 3 How to Write a Literature Review -
What does this mean? The results seem to indicate that playing Section conclusion
violent computer games leads to aggressive behaviour, but the Prior research has shown not only a correlation between playing
study could not establish any causal relationship. It could be that violent computer games and aggressive behaviour, but also that
people who are naturally more aggressive simply enjoy playing there is a causal relationship. Just like violent TV programmes,
violent computer games. It is also possible that an entirely separate, violent computer games have been shown to elicit aggressive
third variable produces the correlation, such as built-up frustrations behaviour. This relationship has been shown among both young
due to social isolation. adults and children aged 4- 14, and can be explained by the
Where to from here?These questions can be answered by studies observational learning theory.
using an experimental design.
Transition
Second study Now that a causal relationship between violent computer games
Why raise this study? To introduce an indication that the correlation and aggressive behaviour has been established, the question of
is causal. how this relationship is established remains. One possibility is
What are the details?Colwell and Payne (2000) had a group of very that playing violent computer games influences young people's
young children (aged four to six) watch a violent cartoon and play attitudes to violence, in a positive sense. It is assumed that
a violent computer game. Their behaviour during play was scored attitudes can produce certain behaviours (Ajzen, 1991); a change
for aggressiveness before and after exposure to the violent stimuli. in attitude could therefore lead to a change in behaviour.
The researchers found that aggressive behaviour during play was The next section looks at the influence of violent computer games
higher than the baseline following exposure. on attitudes.
What does this mean? This study points strongly to a causal
relationship; however, there was no control group to establish Sections 2 and 3
whether the manipulation genuinely caused the rise in aggression. The structure of these sections is analogous to those preceding,
The children might just as well be more aggressive after watching therefore they are not shown in this example.
a non-violent cartoon and playing a non-violent computer game,
Conclusions and discussion
e.g. because of a need to release some physical energy after sitting
still for so long.
Response to the question
Where to from here? An experimental study with a control group Supported using section conclusions. It would seem that playing
is needed.
violent computer games does indeed lead to violent behaviour
in young people. The causal relation has been demonstrated in
Third and fourth studies
young adults aged 18 - 23, and there are strong indications that it
Why raise these studies? To demonstrate that the correlation is
also exists for younger children.
causal.
After playing violent computer games, young males also display
What are the details? Anderson and Dill (2000) and Bartholow and
more aggression than young females.
Anderson (2002) conducted studies on young adults aged 18- 23.
The participants were divided randomly into two groups, and played
Discussion
either a violent or a non-violent computer game.
Interpretation (including links to theory). The established causal
Afterwards, the participants were given a competitive task to
relationship between violent computer games and aggressive
complete, and aggressive behaviour was observed. The results
behaviour can be explained by Bandura's (1969) observational
showed that playing a violent computer game led to more
learning theory and operant conditioning (plus generalisation).
aggressive behaviour.
The behavioural change could be facilitated by changing
What does this mean?The correlation has been demonstrated in two attitudes. There is evidence that playing violent computer games
studies involving young adults; it would now appear to be causal.
leads to the development of a more positive attitude towards
Where to from here? Draw section conclusions.
W ritin g Psych o lo g y Re search Re p o rts 3 How to Write a Literature Review -
vio lent behavio ur in yo un g peo p le. The ro le of these attitud es in Reference list
exp lain ing behavio ur can be un d erstoo d thro ug h Ajzen's (19 91) Ajzen, I. (1991). The theory of planned behavior. Organizational
theory of planned behaviour. Behavior and Human Decision Processes, 50, 179-211. https://doi
The observed difference between boys and girls in the size of .org/10.1016/0749-5978(91 )90020-T
the effect is commensurate with an evolutionary explanation of Anderson, C.A., & Dill, K. E. (2000). Video games and aggressive
behaviour. thoughts, feelings, and behavior in the laboratory and in life.
Evaluation. Although this literature review has presented evidence Journal of Personality and Social Psychology, 78, 772-790.
in favour of the proposition that playing violent computer games https://doi .org/10.1037/0022-3514. 78.4. 772
leads to more aggressive behaviour, the associated measurements Bandura, A. (1969). Principles of behavior modification. New York, NY:
were always taken immediately after playing the computer games. Holt, Rinehart & Winston.
It is not known whether the effect is long-lasting. Bartholow, 8. D., & Anderson, C.A. (2002). Effects of violent
Furthermore, the number of studies incorporated into this video games on aggressive behavior: Potential sex differences.
literature review is limited, necessitating a cautious interpretation Journal of Experimental Psychology, 38, 283-290.
of the results. https://doi.org/10.1006/jesp.2001.1502
The research under discussion has shown that attitudes towards Bushman, 8. J., & Anderson, C.A. (2002). Violent video games and
the use of violence are influenced by playing violent computer hostile expectations: A test of the general aggression model.
games. While changed attitudes could be the cause of altered Personality and Social Psychology Bulletin, 28, 1679-1686.
behaviour, it is equally possible that changed attitudes are the https://doi.org/10.1177/014616702237649
consequence. Colwell, J., & Payne, J. (2000). Negative correlates of computer
Although there is an evolutionary explanation for the difference in game play in adolescents. British Journal of Psychology, 91,
effect size between girls and boys, a cultural explanation cannot 295-310. https://doi.org/10.1348/000712600161844
be excluded - perhaps the correlations in girls and boys are of Funk, J. 8., Buchman, D.D., Jenks, J., & Bechtoldt, H. (2003). Playing
different strengths because they have been raised differently. violent video games, desensitization, and moral evaluation
Lastly, it is not precisely clear exactly what constitutes a 'violent in children. Journal of Applied Developmental Psychology, 24,
computer game'. This is clear in extreme cases, but what about, 413-436. https://doi.org/10.1016/50193-3973(03)00073-X
for example, a violent Tom & Jerry game? Gray, P (2011). Psychology (6th ed.). New York, NY: Worth Publishers.
Further research. Nowadays, there are games on the market that Huesmann, L. R., Moise-Titus, J., Podolski, C. L., & Eron, L. D. (2003).
are much more realistic, and have a higher degree of interactivity. Longitudinal relations between children's exposure to TV
Further studies might reveal that the effects of playing these violence and their aggressive and violent behavior in young
games are even stronger. adulthood: 1977-1992. Developmental Psychology, 39, 201-221.
https://doi.org/10.1037/0012-1649.39.2.201
Broader context Silvern, 5. 8., & Williamson, P. A. (1987). The effects of video game
Because playing violent computer games seems to lead to play on young children's aggression, fantasy, and prosocial
more aggressive behaviour in the short term, schools might behavior. Journal of Applied Developmental Psychology, 8,
want to think about potentially banning or monitoring their 453-462. https://doi.org/10.1016/0193-3973(87)90033-5
use. The same applies to parents, and potentially also to
the government.
Box 3.2
Scientists who have collected empirical data usually report on their
research in the form of articles or chapters in books. Reports of this
type are the primary sources for writing both a literature review and
the introduction of a research report. It is therefore extremely impor-
tant to learn how to effectively describe research reported by others.
Th is section will focus on research descriptions, and address the fol-
lowing points: the structure of a research article (empirical research
report); the context and the content of a research description, a possi-
ble approach to writing a research description and practical advice for
writing multiple related descriptions.
Box4.1
The first section of a research article outlines the question under One characteristic aspect of research articles is the tightly interwoven
investigation, the theories on the topic and what is already known character of the various sections. The research design outlined under
from prior research. This is followed by a description of the research the methods section is directly related to the research question(s) pre-
undertaken: first the research design, and then the results. Lastly, the sented in the introduction. The results section presents the results of
researcher will link the results back to the original research question: the research described in the methods section. The discussion brings
what answer can be given, based on the results? together the research question presented in the introduction and the
Research articles have a fixed structure that is directly related to the research results from the results section.
content, and always include at least four sections: the introduction, The fixed structure (but see box 4.2) enables readers to arrive at an
method, results and discussion. assessment of the reported research fairly quickly, as it is clear from
The introduction starts by outlining the problem area and works the outset where certain information can be found. There is therefore
towards the research question under investigation. A summary of no need to read an entire research article to get an idea of the value
the existing theories and prior research is given. of the publication. Reading the end of the introduction and the start
The methods section explains the research design: who participat- of the discussion is often enough to form a first impression, as this is
ed, what they did, the materials used, the measurements taken, the where the authors describe what they did, what the results were and
procedure of the research and how the results were scored. how they interpreted them. Of course, you must still read the entire
The results section describes the outcome of the research. In exper- article to decide whether their interpretation is justified.
imental designs, this is usually the average scores (or percentag-
es, as in the Loftus & Palmer article) attained by the participants
under the various conditions. In correlational research, the cor- 4.2 Writing descriptions of scientific research
relations between the measurements of the various variables are
given. The results section also includes data on the statistical tests Your research descriptions will always include information from
performed, showing how the differences between the averages scientific publications. Because such publications are very informa-
obtained under certain conditions (or the identified correlations) tion-dense, it is impossible to include all of it. To describe the research,
were statistically analysed, and whether the differences are signif- you should therefore include only the information from the article that
icant. is necessary in order to answer your own question. This section offers
The discussion starts by answering the research question based some helpful advice on how to separate the information, and draws
on the results. Other topics may also be raised, such as alternative a distinction between the context of a research description and the
explanations of the results, criticism of the research and sugges- description itself. The context is often something you must construct
tions for future research. yourself; other times, you can take it from others' work. The research
description will always be taken from other sources.
Begin with a brief description of the methods applied, including who Palmer (1974). In the second, both the introductory and transitional
the participants were, what activities they were asked to perform, contexts are the author's own ideas. Of course, the description of the
what the experimental conditions were and how their behaviour was research itself will always originate from others, so be sure to correctly
measured. The connection between the introductory context and the reference the relevant publication at least once in the running text
research must be explicit. The reader should receive enough informa- (see Section 2.4).
tion about the method in order to understand how the research can
help answer the research question from the introductory context. The
method description must also prepare the reader for the presentation 4.2.1 Example research descriptions
of the results in the research description so it should only describe the
measurements and the conditions mentioned in the results. The most Box 4.3 contains four finished examples of research descriptions,
important thing here is to be consistent - there is no point in saying based on the article given in Box 4.1:
that the participants completed a questionnaire and then leaving out The elements of a study that you describe will depend entirely on your
the results. purpose, and the flow of your argument will determine the context
Next, describe the results. Only give those that are directly related for each description. Box 4.3 includes two brief examples of contexts.
to your own question, and only give the results of the measurements The level of detail in your description will also depend entirely on
described in the research method. Check whether you have reported your exposition. For each of the contexts given in Box 4.3, one brief
results for all of the conditions and measurements mentioned in the and one extended research description is given. If you write a liter-
method description. To give the reader an idea of the size of an effect, ature review, you usually reserve detailed descriptions for the most
it can be useful to quantify some of the results (averages, percentages, important studies in your exposition, and keep descriptions brief for
correlation coefficients). Never give the reported statistical testing the studies mentioned in the introduction. Brief descriptions are also
results, however (F-values, t-values, p-values, etc.). There is no point suitable for research reports of studies you have conducted yourself
in listing the results of measurements that are not described under (see Chapter 6).
the methods.
formulation greatly influenced the answers: participants from the videos was known, and the results showed little correlation
the contacted group gave far lower estimates of the car's speed between the actual speeds and the estimates.
than those from the smashed group (32 and 41 mph, respectively).
The estimates from the hit, bumped and collided groups were Transitional context [new paragraph]
between these two values (34, 38 and 39 mph respectively). Not only are people bad at estimating the driving speed of cars,
they also have great trouble with ...
Or: brief description [no new paragraph!]
They played videos of car crashes to people. The results showed Box 4.3
that people who were asked how fast the cars 'smashed' into each
other gave much higher answers than those who were asked how
fast the cars were going when they 'contacted' each other. 4.3 Steps for writing a research description
Transitional context [new paragraph] Useful steps when writing a research description are as follows:
This study showed that the formulation of a question can greatly Study the relevant part of your plan (see Chapter 3). When pre-
influence the given answers. Loftus and Palmer (1974) gave two paring your plan, you will have written a short summary of the
possible explanations for this effect: one potential mechanism at study you are about to describe. This summary will contain the
play could be ... research question that is relevant to you, along with the method,
the results and their interpretation by the authors, along with your
Context 2 evaluation of the above. Study this brief summary. If necessary,
Introductory context read the article again as many times as necessary until you have a
When observing moving cars, people have great difficulty full understanding of the study in question.
estimating their speed. This was demonstrated in a study by Write the introductory context. Do this by neatly reworking the
Loftus and Palmer (1974). relevant section of your plan (see Chapter 3) into a text that reads
well.
Extended description [no new paragraph!]
Now write the actual description of the research, this time based
In the study, 45 students watched 7 videos of cars colliding. After
on your brief summary, not on the article. This will ensure that
each video, the participants estimated the speed the cars were
the description is coherent and can be understood by an outsider.
travelling at when they hit each other. The aim of the study was
Look up any necessary details in the article while writing, and fol-
to investigate whether the formulation of the question affected
low the structure outlined in Section 4.2.
the estimations given of the speed. This proved to be the case, Integrate the description into the whole by writing a transitional
however they also made another striking observation. In four of
context. This content will also be taken from your plan (see Chap-
the videos used, the cars' precise collision speed was known, as ter 3).
the footage had been created especially for use in an awareness Write at least two drafts. Do a rough draft first, concentrating only
campaign. Two of the collisions were at 40 mph, the other two on the content: what information should be introduced where?
were at 30 and 20 mph. The average estimates by the participants Devote little (or no) attention to the formulation at this stage. For
for these videos were 40, 36, 36 and 38 mph, respectively, revealing your second (and third, and fourth) draft, flesh out the rough draft
that people were very bad at estimating the cars' true speed. into a final version, concentrating on flowing sentences, correct
language, smooth transitions and cohesion between the internal
Or: brief description [no new paragraph!]
sections of the research description, and the surrounding context.
The participants were shown videos of car collisions, and in each
case were asked to estimate the speed the cars were travelling
at when they collided. The precise speed of the cars in some of
Writing Psychology Research Reports 4 Research Descriptions ..
4.4 Writing a scientific summary Lastly, create a list of the references used in the summary, including at
the very least a reference to the article you have summarised. Be sure
Many scientific articles summarise the results of multiple experi- to cite your references correctly (see Chapter 2 and Appendix C).
ments. The easiest way to practise writing extended research descrip-
tions with an introductory context and a transitional context is to
write summaries of such articles. The reported experiments are always 4.4.1 Steps for writing a summary
closely interconnected, making it relatively easy to write the introduc-
tory and transitional contexts. Useful steps when writing a summary are as follows:
When summarising an article in full, simply adopt the same struc- Re-read the article as many times as necessary until you have a full
ture as the article itself. Describe research questions, methods, results understanding of the study in question.
and conclusions in direct sequence, as one continuous narrative with- Outline the structure of each experiment, giving at least a brief
out sub-headings. Take the information from the article itself. One description of the participants, the dependent and independent
required element in the summary that is not or only rarely taken from variables, how they were operationalised, the presupposed causal/
the article is the very first sentence of the introduction, which refers other relationships between them, the procedure applied and the
to the broader context of the research. The same context should be results obtained.
used at the end of the summary, in a concluding sentence/paragraph. Then put the article aside and write the summary using your out-
These introductory and concluding sentences serve to contextualise line - this will ensure that the summary is coherent and can be
the study within a broader framework, see box 4.4. understood by an outsider. Look up any necessary details in the
article while writing,
Write at least two drafts. Do a rough draft first, concentrating only
Contextualisation on the content: what information should be introduced where?
Devote little (or no) attention to the formulation at this stage. For
Appendix A offers a sample summary of an article by Loftus your second (and third, and fourth) draft, flesh out the rough draft
and Palmer (1974). It shows how the opening sentence and into a final version, concentrating on flowing sentences, correct
final paragraph place their research within a broader context - language, smooth transitions and cohesion between the sections
a context that was not taken directly from the article itself. of the summary.
Box 4.5
Writing Psychology Research Reports
When writing the actual review, clear cohesion can be created in all
5 Writing a Literature Review ..
Section 5.2 addresses these elements in greater detail. 5.2.2 Table of Contents
what the key findings and conclusions were. Finish with a statement The above example provides a clear justification for choosing a particu-
about the implications of your conclusions. The abstract must make lar question by referring to a certain theory (by Rotter, in this case).
sense to readers without reading the report. Note: an abstract of a What is missing is an explanation of the specific concept, i.e. locus of
scientific paper is not the same as a research description of an empiri- control. This concept is so specific that one cannot expect all readers
cal study (described in Chapter 4). An abstract is always independent, to be familiar with it. The author also writes that much research has
while a research description is always part of a larger work. been conducted on the theory, but does not go into any further detail.
A brief discussion of prior research would have been appropriate here,
providing a background to the question at hand, which will then carry
5.2.4 Introductory section more weight when it is introduced afterwards.
As is the case in a research description, your specific question is the
The purpose of the opening section is to introduce the problem state- key element in a literature review. For every section of a report, you
ment and clarify what the report is about. The introduction cor- must be able to justify why that section is important to answering your
responds to the upper half of the hourglass model. The title of the specific question. A specific question will usually be about the link
introduction is usually the same as (or derived from) the report title between two or more variables, e.g. how one variable (the independent
(calling the opening section Introduction adds no relevant informa- variable) affects another (the dependent variable). The question from
tion that the reader does not already have, as all reports start with the example above illustrates one such case. Questions of this type
an introduction). According to the APA guidelines, a scientific arti- generally take the form of: 'How does X affect Y?' Alternatively, the
cle should always start by repeating the title, with the opening text question might concern the relationship between two variables, with-
directly below. out attempting to establish causality (correlational research). Such
The opening section always contains an introduction to the topic, e.g. questions can be formulated thus: 'Is there a link between .. .' or 'How
by using a concrete example or anecdote. The aim of the introduc- are X and Y related?' The text of the introduction will generally not
tion is to entice the reader to study the remainder of the text. Start pose the question directly. It is better to include the question in the
broadly, and narrow down the topic bit by bit. If necessary, provide an running text. Some examples: 'This literature review will focus on the
explanation of some key concepts (see Section 2.3.1) and describe prior question of how X affects .. .' or: 'The relationship between ... and ... is
research. Ultimately, you must formulate a specific research question, unclear; this literature review seeks to provide some answers.'
along with a justification for why you are investigating this question in The introductory section concludes with a summary of how the content
particular. An example: is structured. This part of the introduction informs the reader of the
structure to come, and why this structure has been chosen. The main
Ever since Freud, psychologists have come to accept the notion body will usually cover several sub-topics, and you must give reasons
that early experiences have a major influence on personality for why each separate sub-topic is included and how it plays a role in
development in humans. A child's experience of family life is, answering the question. For example:
without a doubt, the most influential in this respect. It is a generally
accepted theory that the way a child is treated by other family The concept of locus of control will first be discussed in light of
members - and by the parents in particular - is instrumental in Rotter's Social Learning Theory. Furthermore, a brief explanation
forming their adult personality. will be given of how a person's locus of control can influence their
This review looks at the influence of child-rearing behaviour behaviour. This is followed by an overview of the research into the
by parents on the development of an individual's personality. influence of upbringing on the development of locus of control.
Because personality is such a broad field, this review will focus on Specifically, the review will examine whether recent research
a single aspect - locus of control - as this is the central concept in supports Ryckman's (1985) conclusion that a warm, supportive,
the theory by Rotter (1984). Much research has been conducted non-authoritarian and consistent parenting style fosters an internal
on this topic. It is supposed that locus of control significantly locus of control.
influences a person's quality of life, and the research investigates
how parenting style affects the emergence of locus of control in
children.
Writing Psychology Research Reports 5 Writing a Literature Review ..
Be sure to limit the structural description of the report to relevant Each section will have roughly the same structure as the entire report,
information. There is little point, for example, in stating that the final and will consist of the following parts:
section contains a conclusion offering an answer to the question. Such a title;
a conclusion is a fixed element of all literature reviews, and this com- an introduction;
ment is therefore superfluous. research descriptions;
Following the hourglass model, the upper part is now complete, and section conclusions.
we are ready to move on to the more substantial, narrow main body.
These components will be identifiable in all well-written papers. The
last three do not need to be explicitly separated from each other by
5.2.5 Main body (detailed information) sub-headings or similar - the transitions between paragraphs will
make things sufficiently clear to the reader. Each of the parts listed
The main body is the largest section of the review, it corresponds to the above will be covered briefly below.
narrow middle section of the hourglass. It presents all of the detailed
information. The body discusses a selection of the descriptions and Title (section heading)
evaluations of the various studies you have examined. However, the Well-chosen section titles make the structure of a text explicit, and
body is not a chronological or alphabetical summary of the results of should make it very clear to the reader what the section is about.
the various studies. Instead, you must use the structure outlined in Section titles also appear in the table of contents, where they serve a
your plan (see Chapter 3.5), which will ultimately lead to answers to similar purpose.
the specific research question given in the introduction. The structure An example of an incorrect section title that says nothing about the
you choose for the main body must demonstrate that you truly under- content is: The Experiment by Martin and Kuiper (1993). An exam-
stand the material covered. ple of a title that does inform the reader would be: Physical Stress
A well-structured review will present the sub-topics in a logical Responses and Humour.
sequence. Each sub-topic will generally have its own subsection,
although studies on similar topics should be covered in the same sec- Introduction
tion. In such sections, group the studies together that reach the same Each section begins with an introductory paragraph, which explains
conclusion, and contrast them against any other studies that draw why the sub-topic is important in answering the question and also
different conclusions. Use linking sentences to create a clear line of serves as the link between the various sections. Formulating a
argument, and to mark off the various subsections. These linking (or sub-question (which covers part of the main question) gives a sec-
transitional) sentences are extremely important, and will be covered tion its own purpose and informs the reader of the material covered
in more detail at the end of this section. therein. Introductions to long sections may conclude with a brief
description of how the section is structured.
Each section deals with a certain sub-topic of the research question,
and must only include information relevant to providing an answer to Research descriptions in context
your question. Each section must also describe all studies that are rel- Each section in the main body includes the part of your exposition
evant to that particular sub-topic. Do not give each article its own sub- that relates to the specific sub-question dealt with in that section. You
section - as the integration of information from the various sources is must argue for why you discuss each particular study, and how the
precisely what is important (see Chapter 3). The most important thing results contribute to your answer to the sub-question. The ultimate
in writing an effective research description is to properly select the line of reasoning will include the three types of arguments mentioned
information you wish to convey, and then to carefully consider what in Chapter 3.5.2. Your empirical arguments will take the form of
information is not necessary (see Chapter 4). For example, if you are research descriptions of the studies under discussion (see Chapter 4).
using an article that outlines three experiments, but only the first one You may also include arguments consisting of the interpretation of the
is relevant to your question, only talk about the first experiment and studies by others, or those derived from your own evaluation of the
leave the other two aside. first two types. Combining these three types of arguments positions
Writing Psychology Research Reports 5 Writing a Literature Review ..
the research descriptions within the context of your analysis. Take the question relates to how the orientation develops, and whether
context from your plan (see Chapter 3.5) and provide structure using parenting styles influence the emergence of an internal or external
linking words. orientation. These questions are examined in the next section.
Linking words The example below shows how a study that was just discussed can
Linking words are used to convey how the various arguments are be related back to the main question (on the emergence of aggressive
interrelated. They are sometimes also called 'signal words', because behaviour, in this case) and how two studies can be compared (reveal-
they make it clear to the reader how arguments should be combined ing a contradiction, followed by an explanation).
together. For example, arguments that lead to the same conclusion
can be grouped together using words such as: and, also, just like, in Although the methodology of the study by Johnson and
addition or firstly, secondly, thirdly. If they indicate cause and effect, Johnson (1992) is not entirely exempt from criticism (as discussed
use words such as given that, because, due to, since, therefore, hence above), the results do seem to indicate that social context directly
or which means. To qualify a statement, use if, unless, provided that influences levels of aggressive behaviour. This conclusion is at odds
or although. Introduce contrasts with expressions such as however, with that of Lopez and Strickland (1989), who surmised that the
unlike, whereas, while or but. Announce conclusions using words such agents' personalities are actually more influential than the social
as hence, we can therefore conclude or in conclusion. context. This contradiction could be explained by the fact that
there are various types of aggressive behaviour, each with their
Section conclusions own determinants. This possibility is examined in greater detail in
Finish off a section with a section conclusion that provides a well the section below.
thought-out response to the sub-question. Do so by summarising the
key results and conclusions at a theoretical level, giving possible expla- Section conclusions may sometimes incorporate those of previous sec-
nations for (potentially contradictory) results and describing your tions, in order to integrate the various sub-questions. No hard-and-
final conclusion based on the information you have discussed. This fast rules can be given, as the possibilities will depend entirely on the
part can also include general criticism of the studies discussed, e.g. by literature under discussion.
providing alternative explanations for the observed results. The crit-
icism may be your own or have been offered by others; whatever the Linking sentences and transitions
case, be sure to always indicate whose criticism it is. Critical remarks A well-structured review will draw together the various sections of the
by others should always be accompanied by a reference to the source. text with the aid of linking sentences, both within and between sec-
Your own criticism is marked not by using the word T (which should tions. If one section discusses multiple studies, for example, they must
be avoided if possible), but by the absence of any reference. Be sure eventually be brought together somehow. This approach integrates the
to maintain a clear distinction between descriptions of research and content of the information being presented, shaping the review into
criticism of research. a cohesive whole.
Your section conclusions should therefore provide an explicit and In general, the various sections of a text can be integrated by using
comprehensive answer to the sub-question being addressed. Once this linking sentences along with linking words and conjunctions (how-
is done, transition into your next section. The following is an example ever, by contrast, also, therefore, in addition.just like, moreover, unlike).
of a concluding paragraph: The link between two studies could be created as shown below (the
'above study' in the first sentence integrates the content from the pre-
From the studies described above, we can infer that locus vious paragraph):
of control influences many aspects of human behaviour. In
general, behaviour associated with an internal orientation is According to Anderson (1973), the above study did not
seen as more positive than behaviour associated with external show conclusively that the association between response and
orientation, although there are some exceptions. Because locus reinforcement is instrumental in producing the response. His
of control influences behaviour so greatly, another important reasoning was as follows: both the response and the reinforcement
Writing Psychology Research Reports 5 Writing a Literature Review
occur after the presentation of a stimulus. The possibility can 5.2.6 Conclusions and discussion
therefore not be excluded that the association between stimulus
and reinforcement is more important than the association between Your literature review will finish with a section called Conclusions
response and reinforcement. To investigate this possibility, he and discussion. Unlike a title such as Introduction, this title does tell
designed an experiment in which laboratory animals were ... the reader about the content, since it is not always immediately clear
exactly when the final section of a report begins.
Such links must also be content-based, however, and not merely tex- Here, the first order of business is to answer the specific question
tual. The above example achieves this by bringing up Anderson's stated in the introduction, to the extent that this is possible based on
criticism of prior research. Your or others' criticism and conclusions the available information. Next, provide support for this conclusion
often provide useful material for transitioning between parts of the by repeating the section conclusions. Do not simply copy and paste
text. There is therefore no need to reserve criticism for the end of the them one after the other into this section, but be sure to produce a
text (the conclusion/discussion section), especially where detailed crit- smooth-flowing text that makes sense. Here, too, effective linking
icism is concerned. This can often also be put to good use immediately words/sentences are necessary. A sample opening to a brief conclusion
following the description of the research itself. might be:
Examples of conclusion-based transitions are given below. After dis-
cussing the relevant information from the Brown and McNeal study The studies discussed above reveal that humour can indeed
(1966), some material transitions might be: help in dealing with stress. Humour has been shown not to be
a coping mechanism in and of itself, but rather a combination
Contrary to the results reported by Brown and McNeal (1966), of two other mechanisms, namely cognitive reappraisal and
Meyer and Bock (1992) did report the influence of ... [description of distraction. People who use humour to cope with stress are less
Meyer & Bock study]. likely to perceive potentially stressful situations as threatening.
These contradictory results could be explained by ... Instead, they view them as challenges, which mitigates the
negative emotions experienced. Making jokes, hearing humorous
or remarks and watching funny videos are also ways to seek
distraction, which people welcome in times of stress.
Like Brown and McNeal (1966), Meyer and Bock (1992) observed
the influence of. .. Their research methodology was more robust, After answering the question and summarising the section conclu-
however, and their procedure made use of ... sions, the main conclusion must be discussed. This discussion is an
explicit evaluation of your own conclusions that examines possible
In these examples, the terms contrary to and like take care of the tex- critical or other remarks concerning the conclusions themselves, the
tual transitions. However, this is not enough by itself. In the first case, studies discussed or the topic in general. This may involve general crit-
a possible cause for the divergence in the study results must also be icism of the way the researchers approached the overall question at
given. Mentioning this explicitly in the text integrates the actual con- hand, or highlighting aspects of the question that received too little
tent of the studies. In the second example, if Meyer and Bock had done attention. Lastly, you may offer alternative perspectives to the research
precisely the same thing as Brown and McNeal, the end of the descrip- presented.
tion would have been complete by adding the following in parentheses: This section must also look at aspects of the question that remain
(see also Meyer & Bock, 1992). The extra information on the procedure unanswered, as well as accompanying recommendations for further
adds substance to the transition, creating genuine integration. research. Be sure to make them sufficiently concrete; do not leave them
The proper integration of information will produce a well-structured vague and nebulous (e.g. 'further research is necessary'). If the ques-
text. It is harder than the above examples might lead one to believe, tion and conclusions permit, this is also the right place for concrete
however, and is one of many academic skills that can typically only be practical recommendations. Lastly, give an indication of any broader
learned through extensive practice. significance the research may have for the theory or practice (social
relevance) in the problem area outlined in the introduction. Because
Writing Psychology Research Reports 5 Writing a Literature Review ..
of the broad, general ending, this section of the report corresponds Checklist/assessment framework
to the bottom part of the hourglass model. Do not let it peter out into General Do the title page, table of contents and abstract give a
nothing, however: finish strongly, with a firm take-home message for good overall idea of the content?
readers. Use the following questions as a guide.
Title page
Does the title convey the content of the report?
5.2.7 Reference list Is the title in English?
Does the title page contain your name and any
other necessary information (student ID number,
All scientific reports must finish with a list of references to the sources group number, supervisor's name and word count)?
used. Proper referencing is an absolute must, for four reasons. Firstly,
it is one of the pillars of science: it makes lines of reasoning verifia- Table of contents
Does the table of contents clearly reflect the struc-
ble, makes advances in knowledge explicit and enables meta-analysis.
ture of your exposition?
Secondly, 'credit where credit is due' is applicable in the world of sci- Does it correspond to how the text is divided into
ence as well. Thirdly, it fends off any accusations of plagiarism. Lastly, sections?
the effectiveness of search engines is dependent on correct referenc-
Abstract
ing. All of the above reasons make proper referencing (and reference Does the abstract make sense independently of the
listing) incredibly important in reports. Psychologists almost always report?
use the guidelines prescribed by the APA (see Section 2.5 and Appen- Does it state the question?
Does it provide a clear answer to the question?
dix C). Is it within the 120-word limit?
Main body/sections Is each section a self-contained unit that attempts to Conclusion Does the conclusion of the report clearly state the
find an answer to the question (or a sub-question)? findings of the literature review?
Is there a clear answer to the question formulated in
Introduction the introduction to the report?
Does the title convey the section content? Have the conclusions from the previous sections
Are there transitions between the sections, and are been incorporated into the main conclusion?
they substantiated? Is the conclusion free of any new information that
Does each section start by stating the relevance to has not already been presented?
the main question and the previous section? Are links established between section conclusions,
Is it clear which sub-question is being addressed? leading to an original perspective?
Discussion Are any aspects of the conclusion called into
Section body
question?
Does each research description give the reader a
Are these questions addressed concretely?
thorough understanding of the study?
Are there any general criticisms raised regarding
Are the important elements listed (research ques-
the research or the topic under discussion?
tion, method, results, the researchers' conclusion)?
Are any alternative perspectives discussed
Is there any critical analysis of the study?
(if applicable)?
Is the research integrated with other information?
Is clarification given for anything that is unclear?
Is it clear how the studies relate to one another?
Are concrete recommendations given for further
Are the transitions between the research descrip-
research?
tions substantiated?
Is there clear relevance (e.g. the scientific/social
Are concepts explained properly and consistently,
implications of the conclusions)?
and in greater detail where necessary?
Are unnecessary tangents avoided, and is infor- Is there a broad ending and conclusion to the
mation selected that is relevant to answering the report?
question? References and reference Do the in-text references meet APA guidelines?
Are links established between various research list Is the reference list in accordance with the APA
results, both within and between sections? guidelines?
Does each section show logical consistency, both as Is every in-text reference included in the reference
a whole and in parts? list?
Is there an effective division into paragraphs that Are all list entries referred to in the text?
reflects the steps in the exposition?
Structure Does the report form a cohesive whole, and is the
Section conclusion narrative clearly structured for the reader?
Does each section include a clear conclusion? Do the sections form cohesive steps that progress
Have the key research results been incorporated? logically from question to answer?
Does the conclusion follow logically from the Do the sections transition effectively?
previously-discussed material? Is information that is assumed to be known in a later
Does the section conclusion clearly relate back to section actually given in a previous section?
the research question? Can the conclusions of the various sections be
Are links established between the sets of research unified?
results and/or the study conclusions, giving rise to Does the structure of the report match the outline
an original perspective? given in the introduction?
Are explanations given for any contradictory
research results?
Writing Psychology Research Reports
Checklist/assessment framework
l
before embarking on their own endeavours.
Writing Psychology Research Reports 6 Writing a Research Report ..
I 88
should be written last. Although it is the first item discussed below, the reader will be aware that the article starts with an introduction).
the abstract is the proverbial 'icing on the cake', and is only added once Section 4.2.1 gives some tips on choosing a good title.
everything else is finished. Introductions usually begin by defining the problem area, followed by
a description of the research question covered by your report. The ini-
tial phrases will introduce the problem area:
6.2 Abstract
People with untreatable psychological or other conditions often
The abstract outlines the essence of the study and helps the reader to seek relief in alternative medicine. One such alternative treatment
decide whether to continue reading or not. The maximum length is offered is magnotherapy.
120 words.
Use one or two sentences to describe each section of the report (intro- Next, formulate your research question. For example:
duction, method, results, discussion). Dive straight into the subject
and avoid long sentences. Do not go into excessive theoretical detail, This study investigates the efficacy of a specific type of
and describe the method using only the population (type and number magnotherapy ...
of participants), measurement instruments and the procedure. Report
only the most important results from the study and briefly outline The research question is followed by a brief overview of the relevant
their significance. Write the abstract in the past tense. literature, demonstrating both your knowledge of the field and the rel-
evance of your question. As part of this overview, discuss relevant the-
ories and prior research on the question at hand. An important point
The Abstract is that the research descriptions in a research report should be much
more concise and succinct than those in a literature review.
The abstract is an extremely concise description of: The introduction must expressly combine the results of various stud-
the research question; ies, preferably using the available theories within the field of research.
the method (participants, instruments, procedure); This process (which requires much thought) is called 'integration'. The
the results; discussion of prior research and the relevant theories in a research
the conclusions. report will also often include explicit criticism, as motivation for the
research being reported on. This critical discussion (also known as
Box 6.2 the 'evaluation of the available knowledge') can also be used to clar-
ify which question (or questions) thus far remain unanswered, or why
your study will increase the available knowledge in the field. This is
6.3 Introduction how you justify your research.
The description of prior research and theory will lead the reader to
The purpose of the introduction is to offer a coherent and convinc- your research question and to a brief description of your hypotheses.
ing argument for why your study is important. Because it will be read For example:
by your fellow researchers, the introduction must also convince the
reader that you know what you are talking about - which is only pos- The above would seem to disprove the efficacy of magnotherapy
sible, of course, if you actually do. This is why the first stage in the in and of itself. Nevertheless, wearing a pivoted magnet could have
research process described above is so important: to plan an effective a beneficial effect on people's mental well-being, perhaps due to a
introduction, knowledge of the current state of research in the field is belief in its effectiveness.
essential.
When fleshing out your plan, first think of an appealing title for your The example shows that the word hypothesis need not be explicitly
report. The title of the report is repeated as the heading of the intro- stated; hypotheses can be included as part of the running text.
duction (the title of the introduction is not the word Introduction, as
Writing Psychology Research Reports 6 Writing a Research Report
At the end of the introduction, discuss the design of your own study otherwise lack clarity. In complicated research especially, adding extra
and what results you expect. While these expectations can be for- subsections can be useful to give readers fast access to certain infor-
mulated as explicit predictions, this is certainly not always the case. mation. These might have headings such as research plan, equipment,
In the sample article, the author juxtaposes two theories and states research design or analyses.
exactly what the expected results are (see Appendix B). Studies in
which the author firmly establishes the expectations and the manner
in which they will be tested in advance are called 'confirmatory stud- 6.4. l Participants
ies'. Research is often more exploratory in nature, however, and the
researchers have no rigid expectations. In this case, the possible out- The subsection on participants will describe at least how many partic-
comes must be evident in the research design. Both types of research ipants were involved, the population they belonged to (e.g. first-year
- confirmatory and exploratory - can also co-exist in a single study, psychology students), whether they were rewarded and, if so, how. If
and the report in Appendix Bis one such example. applicable, this is also the place to describe which participant char-
acteristics (e.g. native language) were used to construct the research
conditions or groups. The characteristics of the various groups may
The Introduction also be compared here, e.g. if you are assuming that the groups being
studied conform to certain variables at the outset (such as IQ score).
The introduction will include: Other relevant information can also be included, such as the ratio
an outline of the problem area and the research question; of men to women, the average age of the participants, how they were
a justification of the research question; recruited for the study and so on. Not all details are required in this
theory (or theories) and other research relevant to the problem; section, only those that are important in order to interpret the results,
any criticism of prior theory and research; which will depend entirely on the research you have carried out.
the hypotheses in the running text, or a description of the
explorations;
a brief description of the research design; 6.4.2 Materials
the expected/possible outcomes.
The subsection on materials describes all of the resources used in
Box 6.3 the course of the study. These may include questionnaires measur-
ing the participants' characteristics; texts that they read; the stimuli
presented; tests used to measure participants' performance; questions
6.4 Method asked during interviews, etc. Give details, such as how the materi-
als were created, the number of items in questionnaires or tests, the
The methods section describes the sample population, the materials equipment used to present the stimuli, how the answers were scored
used and the procedure in enough detail so as to allow the results to be and the minimum/maximum possible scores. In the case of independ-
properly interpreted, and to enable other researchers to replicate the ent variables, it must always be clear how the levels are defined. The
experiment. None of the detail should be superfluous, however (see different conditions in an experimental procedure must therefore be
Section 2.2). described exactly. When describing dependent variables, it is custom-
The methods section must be divided into subsections, usually par- ary to include sample items, e.g. an item from the questionnaire used.
ticipants, materials and procedure (see Appendix B). The rest of this If an existing measurement instrument is used in the study, give some
section will deal with how to write these three subsections, as they are basic details and refer to information published on the instrument
nearly always included. In practice, some articles will structure the elsewhere.
methods section slightly differently, usually because the exposition
requires a somewhat different route, or because the subsections would
Writing Psychology Research Reports 6 Writing a Research Report -
I 92
The procedure section describes how the research was conducted: the The results section usually starts by stating exactly what operations
instructions given to the participants, the tasks they carried out, the were performed to produce the data for the analyses. Here you report
order in which they did so, how much time it took, etc. If applicable, the possible dropout of participants (e.g. because they failed to fol-
this is also where the different treatment conditions are described, low the instructions correctly) so that it is clear which participants'
assuming this has not already been done in the 'materials' section. If data contributed to the final results. You also report any loss of par-
randomisation has been applied (e.g. participants to groups or stimuli ticipant data, and the reasons why (e.g. incorrectly completed ques-
to positions in a list), if the influence of sequences has been neutralised tionnaires). Also state whether you have removed any outliers (e.g. in
(counterbalancing) or if certain stimuli have been grouped (blocked) studies measuring reaction times), and the criteria used to do so (see
together, this is the place to explain exactly how you have done this. also Appendix B). You may also describe how you dealt with any miss-
In experiments where participants must respond repeatedly to pre- ing information, or with errors made by the participants.
sented stimuli, it is often useful to give an example of the presentation
of a full stimulus and of how the associated response is recorded. Be
detailed enough to allow another researcher to reproduce the exper- 6.5.2 Manipulation checks and background information
iment exactly, but do not include any irrelevant details (e.g. the exact
dimensions of the laboratory space). The next item for discussion, if applicable, is whether or not the exper-
imental manipulations were successful. For example, if an exit inter-
view was held to check whether the manipulation was successful, the
The Methods Section interview data can be included here.
Next, if necessary, present some descriptive statistics, such as the reli-
The methods section gives a detailed description of the study,
ability of the tests used (if these were known before the experiment,
including at least the following information: they will have been included in the methods section) or the factor
participants (type, number, reward); structure of the tests. If the experimental design conditions differed
materials (dependent and independent variables); only in the order in which the participants performed the tasks (coun-
procedure (how the study was conducted). terbalancing), any order effects can also be listed here. If this is not
the case, state that the results of equivalent conditions were grouped
Box 6.4 together in the ensuing analysis.
The results section presents the research results and the statistical pro- Now comes the core of the results section, the data that answers the
cessing performed on them, without discussing their implications in research questions. Depending on the type of research (experimental
too much detail. The suggested sequence as indicated below is one way or correlative), this data will often consist of the means and standard
to present the data, however this is not fixed for all reports. Choose deviations of the dependent variable(s), or the correlations (or the data
the order most suitable for your study. However, you should always based thereon) that have been identified.
begin with the results that are potentially relevant to answering your The research results and the analysis results must be clearly distinct
research question (such as the spread of participants across groups, from one another. The research results are the average scores and
manipulation checks and the reliability of measurement instruments). standard deviations of the dependent variable(s) or the correlations
The results section usually does not include any subsections, but this between variables. The statistical analyses will provide the analysis
will depend on the scope of the study. results, e.g. the values of various analysis variables (F, z, t, etc.) and the
associated p-values.
I
I
94 Writing Psychology Research Reports 6 Writing a Research Report •1
Research results An example:
The research results are nearly always presented in one or more tables
or figures. As a rule of thumb, if there are three or fewer sets of results, An independent samples t-test showed that, on average, women
present them in the running text. A table is usually required for 3 - scored higher on the word-completion task than men, t(22) = 4.38,
20 result sets. For greater quantities, a figure can be useful. The most p < .001, d =1.80. This result supports the notion that ...
important element is the effectiveness of the presentation. For exam-
ple, a figure is very useful for showing how various results are related An example from Appendix B:
(see Figure 1 in Appendix B).
In experimental research, tables are normally used to present the An analysis of variance (A NOVA) was performed on the AMWT
mean scores of the dependent variable(s) under the various experi- scores with one between-participants variable condition
mental conditions. For each mean in the table, include the associated (magnetisation vs. placebo) and one within-participants variable
standard deviation (see Tables 1 and 2 in Appendix B). To increase the treatment (before vs. after). As predicted, the effect of treatment
effectiveness of the presentation, an 'Effect' column has been included was significant, F(l, 408) = 1037.1, p < .001, ri/ = .72, the mental
in Tables 1 and 2 of Appendix B. This may or may not be necessary in well-being was higher post-treatment than pre-treatment.
your case, depending on your specific situation. The effect of condition was not significant, F(l, 408) = 0.073, p = .79,
In correlational research, the correlations are presented in table form. ri/ < .001, it did not matter whether participants had actually
The results of a factor analysis (the example below shows a principal undergone magnotherapy or not. Lastly, the Treatment x Condition
component analysis) could be presented as follows: interaction was not significant, F(l, 408) = 0.53, p = .47, n,' = .001.
Table 1 shows that the effect of treatment was comparable for
A total of three principal components with a value higher than 1 both conditions.
were extracted, representing 45% of the shared variance.
In a variance analysis of two or more factors, you must first interpret
Next, the report will usually include a rotated components matrix. Put the significant interactions. If there are significant interactions, the
the items (variables) in the lines and add the component values on the main effects may be meaningless.
bottom line. The columns are the components with factor loadings, For example (see Appendix B):
and the last column includes the item (variable) communalities. The
factor loadings are given to two decimal places, and the table must Analysis of variance (ANOVA) was performed on these averages
include any minus signs. It must be possible to read and interpret with one between-participants variable belief (believers vs. non-
tables independently. The title and notes accompanying the table must believers) and one within-participants variable treatment (before
include enough information so that the data can be understood with- vs. after). The effect of belief was significant, F(l, 109) = 11.97,
out the surrounding text (see Section 2.6 for detailed instructions on p = .001, n,' = .099. The effect of treatment was also significant,
tables and figures). F(l, 109) = 0.53, p = .001, ri/ = .89. However, the key finding was that
the two variables (belief and treatment) showed an interaction,
Analyses results F(l, 109) = 961.8, p < .001, ri/ = .898. Inspection ofTable 2 shows
For each of the key analysis results, the text must include six items: that this interaction can be fully explained by the fact that the
the analysis method used, the value of the test statistic, the associated treatment only showed a positive result for the believers, and not
p-value, an indication of the effect size (e.g. Cohen's d) or a confidence for the non-believers.
interval, and a verbal description of the research result. You must also
indicate whether the result was commensurate with your hypotheses The effect of belief (averaged across pre and post-treatment measure-
or predictions. When describing significant results, your description ments) and of treatment (averaged across believers and non-believ-
must clearly indicate the polarity of the difference (plus or minus). ers) was significant, and described as such. The main effects were not
interpreted, however, nor are they relevant: only the interaction is of
interest, as believers demonstrate healing effects while non-believers
do not.
I
I 96 Writing Psychology Research Reports 6 Writing a Research Report .. I
I
In large-scale analysis of variance, it is preferable to include the results Distinction between confirmatory (planned) analyses and
of analysis in a table so as not to affect the readability of the text. In exploratory analyses
such cases, refer to the table. The key results must still be discussed in Although both confirmatory and exploratory research (see box 6.1) is
the text, but you can leave out the statistical information. valuable, it is important to maintain a clear distinction between them
There are also alternatives to traditional null hypothesis testing. When when writing reports. If both research types appear in the same study,
conducting Bayesian analysis on the data (see https://jasp-stats.org), one way to highlight the difference is to group all analyses for one type
report the Bayes factor and what it means. For example: under a heading (see Section 2.6) that specifies the type in question.
State the question intended to be answered by exploratory analyses at
A Bayesian version of the independent samples t-test was the end of the results section, along with the relevant results. Only dis-
conducted. The Bayes factor BF,0 = 0.0129 gave strong evidence cuss exploratory research results that are relevant to the overall report
for the null hypothesis. In more precise terms, the factor (i.e. only those that you will return to later in the discussion). This
indicated that the probability of the data under the null hypothesis point is illustrated in the sample report in Appendix B.
was l/BF10 = 77.7 times greater than under the alternative
hypothesis.
Results
6.5.1 Other information The results section must contain information on:
any excluded participants/data;
State the exact p-values (see Section 2.6). Only if the SPSS output gives data pre-processing;
a p-value of .000 is this reported as p < .001. Note that you should any manipulation checks, or checks on data or instruments
report one-way p-values when conducting one-way tests, and two-way used;
p-values for two-way tests. Of course, the testing information must the research results;
also be described for results that contradict the research predictions the analysis results;
made. any exploratory analyses.
A journal article
6.6.3 Broader implications of the results and conclusion
Spetch, M. L., & Wilkie, D. M. (1983). Subjective
One way to offer a broader perspective on the research question at shortening: A model of pigeons' memory for event
the end of the discussion is to point out the theoretical significance duration. Journal of Experimental Psychology:
of the study. Do not exaggerate, however. Usually, some attention is Animal Behavior Processes, 9, 14-30. https://
devoted to the generalisability of the research results, or the external doi.org/10.1037/0097-7403.9.l.14
validity. For laboratory studies, the question can be addressed of how
representative the study is of the world external to the laboratory. Be A book
aware that this question is by no means always relevant. Researchers
are often interested in general principles, which is why they turned to De Groot, A. M. B. (2011). Language and cognition in
the laboratory in the first place - it is the only way to exert control on bilinguals and multilinguals: An introduction.
other variables. New York-Hove: Psychology Press.
Lastly, this is a good place to discuss the practical significance of the
results, and to make recommendations. This may or may not be appro- A chapter in an edited book
priate, depending on the research question. After this, wind up your
discussion. Finish on a strong note, such as a concise summary of the Hartley, J. T., Harker, J. 0., & Walsh, D. A. (1980).
question and the most important conclusion. Contemporary issues and new directions in adult
development of learning and memory. In L. W.
Poon (Ed.), Aging in the 1980s: Psychological
The Discussion Section issues (pp. 239-252). Washington, D.C.: American
Psychological Association.
The discussion section contains:
an extremely succinct recap of the key results; A source that you have not consulted directly, but which was
an answer to the research question; referenced in another source
a discussion of the theoretical impact of the results in relation For example: a reference in the running text to Freud (1916) who was
to the literature from the introduction, alternative explanations cited in Ryckman (1985). Only include the Ryckman source in the
for the results obtained, research limitations, generalisability literature list.
and any concrete suggestions for further research;
a take-home message.
Box 6.6
Writing Psychology Research Reports 6 Writing a Research Report ..Il
Method participants:
Appendices include all information that is necessary to make the - number, population, reward, allocation
research report complete, but which is too bulky to include in the text to groups (if applicable) and any other
information relevant to the rest of the report
directly (e.g. a full copy of the stimulus materials). Appendices are not (gender, age, etc.);
usually part of APA articles. materials;
independent variables, manipulation:
- number of conditions;
- description of the stimuli administered to
6.9 Checklist/evaluation framework the participants;
- clear description of the differences between
Use the framework below to check whether your report meets the conditions;
independent variables, measurement:
requirements set by the instructions covered in this book. The frame- - description of the measurement
work covers a full empirical research report. instruments;
(The order in which the points are given is important, but the discus- - answer options/scale and scoring;
- scoring range: minimum and maximum
sion section can be a little freer. The full report follows the hourglass
scores, and their meaning;
model.) - sample test item;
procedure:
- description of the entire participant process,
Checklist/assessment framework
such as instructions, tasks, order of stimuli
Title page title that conveys the content of the report; (fixed/random), design, spatial aspects,
title in English; duration/temporal aspects, debriefing;
your name and any other necessary infor- - original headings may be added in the case
mation (student ID number, group number, of complex research (e.g. research design).
supervisor's name and word count). first include the results that may influence
Results
Abstract The abstract makes sense to readers without the remainder of the research results (only if
reading the report. applicable);
The question is stated. participants:
The method and results are given. - eliminated participants: number and reason;
The answer to the question is given. - biographical details (that were not given in
The word count is below 120. the method because they were not collect-
ed in advance);
Introduction theoretical framework: indication of the data:
research field; - removal of outliers (number and reason);
general research question; design verification:
justification of the research by discussing - manipulation checks;
other relevant research, relevant theories - standardisation checks;
and criticism thereof; - exit interviews;
explanation of concepts (as necessary); quality of new measurement instruments:
hypotheses or a description of the explorations; - reliability, validity: factor analyses,
brief description of one's own research; correlations with other operationalisations
expectations or possible outcomes. or criteria;
research results:
- tabulated N, means, SDs;
- tables: referenced in-text, numbered,
informative title, abbreviations and symbols
defined, and (if asterisks(*) are used to
represent significance) note the significance
levels (alpha) in a footnote and indicate
which scores differ from each other. NB: spell
'Table' with a capital letter in the running
l
text;
,
I
104 Writing Psychology Research Reports 6 Writing a Research Report .. Il
l
Il
Appendix A
Example Scientific Summary
Author's name
l
.. Writing Psychology Research Reports Appendix A Example Scientific Summary .. I
Suggestive Questions and Eyewitness Accounts From these results, Loftus and Palmer (1974) concluded that the
form of the question influences not only the responses given by the
The justice system has a special interest in whether suggestive participants, but has a broader effect on how the memory of the event
questions can influence the accounts given by eyewitnesses. is stored. They surmised that the participants used the formulation
Psychologists have attempted to answer this question using of the question as a kind of 'label' that they subsequently 'stuck' onto
controlled experimental research. One such study was conducted the event. The memory of the event is then brought in line with the
by Loftus and Palmer (1974), who investigated the accuracy with label, and is potentially altered in the process.
which we can recall complex events. In particular, their investigation In any case, it is clear from this research that the memories
looked at whether the formulation of a question about a complex and reports of eyewitnesses can be influenced by the formulation of
event influenced the answer to the question or even the mnemonic questions regarding the events. This is important to remember for
representation of the event. everybody working with eyewitness accounts, in areas such as the
They reported two experiments: in the first, they had justice system.
45 participants watch short videos of automobile collisions. After
each video, the test subjects were asked to estimate how fast the Reference list
cars were moving at the time of the collision. The participants were
divided into five groups and members of each group were asked the Loftus, E. F., & Palmer, J.C. (1974). Reconstruction of automobile
question in a different way, using a different word to describe how destruction: An example of the interaction between language
the cars 'crashed': smashed, collided, bumped, hit or contacted. The and memory. Journal of Verbal Learning and Verbal Behavior, 13,
formulation of the question had a significant impact on the speed 585-589. https://doi.org/ 10.1016/s0022-537 l (74)80011-3
estimates. The words smashed, collided and bumped produced average
estimates of 40.8, 39.3 and 38.1 mph respectively, while the average Personal evaluation
for hit was 34.0, and for contacted only 31.8 mph.
Loftus and Palmer (1974) concluded that the manner in which These experiments are examples of well-designed research.
a question is asked can influence the participants' perceptions. The participants were assigned to the conditions randomly, and the
They gave two possible interpretations for this. Firstly, it could be treatments they received were all identical apart from the verbs used
that the formulation of the question affected the answer given by the in the questions.
participants, but not necessarily what they truly think. Alternatively, Loftus and Palmer (1974) offer a particular explanation for their
the question might influence the participants' entire memory of the results, i.e. that the memory of an event is composed of two types
event. of information: information from the perception of the event and
This latter possibility was investigated in a second experiment. information received afterwards. They claim that, after some time,
The same collision video was shown to 150 participants, 50 of it becomes impossible to tell these two apart. This is a post-research
whom were then asked the speed question using the word smashed, explanation, and is therefore somewhat speculative, requiring
50 of whom using the word hit and 50 of whom were not asked a investigation by a future study.
question at all. One week later, the participants completed a 10-item
questionnaire about the video. One question asked whether they
remembered seeing broken glass, even though this was not the case
in the video. Of the participants in the smashed condition, 16 stated
that they remembered seeing broken glass, compared to seven in the
hit condition and six in the control condition. The difference between
the smashed and hit conditions persisted even when individuals were
compared who had given the same speed estimates.
l
I
Appendix B
Example Research Report
F. Alsvanouds'
University of Harderwijk
Abstract
According to the Magnetic Field Research Medical Center a small electric discharge results from touching an electrostatically
(2006), magnotherapy effectively treats a variety of psychological neutral object, such as a metal door handle). In their day-to-day lives,
conditions and symptoms such as nervousness, anxiety, depression, however, humans do not carry electric charge, as they are constantly
forgetfulness and low self-esteem. Although the magnet in contact with the earth, which is neutral by definition. Given that
manufacturers claim otherwise (Santanera, 2005), there is no known humans are neither magnetic nor electrically charged, there is no
solid scientific evidence proving the effectiveness of magnotherapy objective means whatsoever to determine which side of a magnet
in alleviating these types of psychological presentations. This study should be used in this type of therapy, let alone suppose that a
investigated the effectiveness of a specific form of magnotherapy magnet could compensate for 'excess energy'. The above would seem
using a randomised, placebo-controlled design. Establishing to disprove the efficacy of magnotherapy in and of itself.
effectiveness is important, as the treatment - if effective - could offer Nevertheless, wearing a pivoted magnet could have a beneficial
a less expensive alternative to conventional psychotherapies. effect on people's mental well-being, perhaps due to a belief in its
Evidence for the effectiveness of magnotherapy consists effectiveness. In a study by Alsvanouds (2004), for example, an
mainly of written testimonials from clients who claim to have experimenter dressed as a doctor told participants that wearing a
experienced improvements under the treatment (Magnetic Field magnetic pendant could have a beneficial effect on mental well-being.
Research Medical Center, 2006). However, improvement among a They were asked to wear the pendant for a week and to report on
group of magnotherapy patients is not conclusive evidence about its their mental well-being before and after doing so. In reality, however,
effectiveness. It is entirely possible that the benefit perceived by these the pendant they were given was not magnetic. Nevertheless, the
patients was due to their belief in the effectiveness of the treatment, study showed that wearing a non-magnetic pendant for a week still
and that the magnotherapy itself was ineffective. This phenomenon had a beneficial effect on mental well-being.
is called the placebo effect, and has been well researched in medicine The present study looked at (a) whether the effectiveness
and other areas (e.g., Beecher, 1955; Evans, 1974). of magnotherapy could be established, and (b) whether this
A good reason to assume that the effects of magnotherapy effectiveness did not depend merely on the participants' expectations.
can, in fact, be attributed to clients' expectations and not to the In the study, a group of participants actually underwent
effectiveness of the treatment itself can be derived from the supposed magnotherapy for a week, while another group was treated with
mechanism underlying the therapy's effectiveness. According to a placebo. Based on the available knowledge on magnetism, the
the Magnetic Field Research Medical Center (2006), magnotherapy expectation was that magnetisation would not have any beneficial
can compensate for an excess or lack of positive or negative energy effect on mental well-being. However, based on research in which
by positioning the negative or positive pole of a magnet close to the a positive effect on mental well-being was observed from wearing
body. In Santanera's magnotherapy (2005), the correct magnetic a placebo pendant (Alsvanouds, 2004), a treatment effect was still
pole is automatically selected by the motion of the body, as the anticipated, albeit under the supposition that the effect in both
magnet he developed (the Biostabil 2000) was suspended in a pivoted groups could be ascribed exclusively to the participants' expectations.
mechanism. In such a case, the beneficial effects would be of the same magnitude
The explanation of how the device works proves to contain for both groups.
a misunderstanding regarding magnetism on the one hand and Lastly, the study examined whether the participants' beliefs
electrical current on the other. Although it is true that magnets can regarding the effectiveness of the magnotherapy influenced the
be attracted or repelled by other magnets, this fact has no bearing effectiveness of the treatment. For this reason, the participants were
on the potential effectiveness of magnotherapy. The reason for this asked about their confidence in the treatment. It was hypothesised
is that the human body is not magnetic; if it were, any object made that the individuals who believed in magnotherapy would
of iron would stick to it. Nor is the human body ever subject to demonstrate beneficial effects, while those who did not believe
an electrical charge, with the single exception of static electricity would not.
(e.g. when, after putting on or taking off a synthetic item of clothing,
r
111111111 W""'' Psychology Research Reports Appendix B Example Research Report -
Method on mental well-being. They were also told that the pendant was
magnetic, and that magnetism could have a positive effect on
Participants mental well-being. For both groups, the experimenter was an adult
Four hundred and fifty first-year psychology students from female who introduced herself as a doctor, wearing a white coat
the University of Harderwijk took part in the study. Half of the and a stethoscope. The participants were asked to wear the pendant
participants were randomly assigned to the magnetisation treatment constantly for one week, except during sleep. The participants
group, and the other half to the placebo group. They received €25 for completed the AMWT shortly before receiving their pendant, and
their participation. did so again one week afterwards. On this second occasion, they were
also asked whether they had actually worn the pendant as instructed,
Materials and about their belief in the effectiveness of magnotherapy. Lastly,
The magnotherapy was administered via a neck chain to they were informed of the true purpose of the study, and were given
which a magnetic pendant was attached. For the purposes of this the opportunity to ask any questions.
study, 225 such pendants were purchased from the retail market
(brand name Biostabil 2000). The pendant contains a strong magnet Results
(1200 Gauss) attached to a neck chain via a pivot mechanism. For the Of the 450 participants, 20 reported that they had not worn the
treatment in the control condition, the tech lab at the University of pendant every day (9 from the magnetic condition and 11 from the
Harderwijk Faculty of Natural Sciences manufactured 225 replicas placebo condition). The data from these participants were excluded
of the neck chain and pendant. Aside from being non-magnetic, the from further processing.
replicas were indistinguishable from the genuine product. Another 26 participants failed to complete the AMWT either
Mental well-being was measured using the Amsterdam Mental accurately or in full, 13 of whom were from the magnetic condition
Well-being Test (AMWT) developed by Tulp, Rozendaal and Veren and 7 of whom were from the placebo condition (6 participants
(2001). The test includes 20 items that can be answered using a completed the AMWT incorrectly both before and after the
7-point Likert scale ranging from O (never) to 6 (every day). Sample treatment). The data from these participants was also excluded from
questions include: 'I feel unsettled', 'I feel dejected', 'I am somewhat further processing.
afraid'. Following correction, the maximum possible score on the The remaining data (from 204 participants from the magnetic
AMWT is 120, which corresponds to an extremely high level of condition and 206 participants from the placebo condition) was used
mental well-being. The minimum possible score on the AMWT is 0, for analysis. The means and associated standard deviations of the
which corresponds to extremely poor mental well-being. AMWT results before and after treatment were calculated for each
Belief in the effectiveness of magnetisation therapy was condition, see Table 1.
measured by asking the following question: 'Do you believe that
magnotherapy is an effective treatment?' The possible responses were Table 1
yes, no and maybe. Average Scores on Mental Well-Being and Standard Deviations
(in Parentheses) Before and After Treatment in the Magnotherapy
Procedure and Placebo Conditions
During the Bachelor of Psychology orientation week, all first-
year students were divided into two groups by randomly choosing Condition Before After Treatment effect
two students at a time and assigning the first to the magnetisation Magnetisation 79.3 (10.0) 85.9 (10.8) 6.6
condition and the second to the placebo condition. Participants Placebo 79.7 (9.5) 86.0 (10.0) 6.3
in the magnetisation condition received the Biostabil 2000, and Note: Treatment effect= score after - score before.
participants in the placebo condition were given the non-magnetic
reproduction. Participants in both conditions were told that they
were participating in a study into the influence of magnetism
1111111 Wmmg Psychology Rese a,ch Repoc<s Appendix B Example Research Report -
I Confirmatory analyses significant, t(49) = -0.79, p = .435, d = O.ll, there was no statistical
An analysis of variance (ANOVA) was performed on the difference between the average scores before and after treatment. 2
AMWT scores, with one between-participants variable condition This result is in line with the prediction that no treatment effect
(magnetisation vs. placebo) and one within-participants variable would appear among those who did not believe in its effectiveness.
treatment (before vs. after). As predicted, the effect of treatment was
significant, F(l, 408) = 1037.1, p < .001, 11/ = .72, the mental well- Exploratory analyses
being was higher post-treatment than pre-treatment. The effect of A large number of participants answered maybe regarding
condition was not significant, F(l, 408) = 0.073, p = .79, 11/ < .001, their belief in the effectiveness of magnotherapy. These participants
it did not matter whether participants had actually undergone were allocated to the 'maybe' group (n = 299). In order to compare
magnotherapy or not. Lastly, the Treatment x Condition interaction the treatment effect of this group to that of the other two groups,
was not significant, F(l, 408) = 0.53, p = .47, 11/ = .001. Table 1 shows a treatment-effect score was calculated for all members of the three
that the effect of treatment was comparable for both conditions. groups (believers, non-believers, and maybes). Based on these
Next, the participants were divided into two groups according scores, the average treatment effect for each of the three groups was
to their response to the question of whether they believed in the calculated. These average scores are presented in Figure 1.
effectiveness of magnotherapy. Participants who answered no were
allocated to the 'non-believers' group (n = 50), participants who Bonferroni-corrected independent t-tests showed that the
answered yes were allocated to the 'believers' group (n = 61). Each average treatment effects were different in each group. The average
group's average AMWT score and associated standard deviation was treatment effect for non-believers was smaller than for believers,
calculated both before and after treatment, see Table 2. t(109) = -31.01, p < .OOI, d = 5.83, and smaller than for the maybes
t(55.79) = -16.48, p < .001, d = 2.87 (the degrees of freedom in
Table 2 the latter test have been adjusted, because Levene's test revealed
Average Scores on Mental Well-Being and Standard Deviations differences in variance between groups, F = 13.7, p < .OOI). The
(in Parentheses) of Believers and Non-believers Before and After average treatment effect for believers was greater than for the maybes,
Treatment t(358) = 29.54, p < .OOI, d = 3.94. Figure 1 shows that the degree to
which participants believed in the effectiveness of the treatment
Grouping Before After Treatment effect
seems to have been the key determinant for the size of the treatment
Believers 80.1 (9.4) 93.6 (9.8) 13.5 effect.
Non-believers 80.5(10.5) 80.2 (10.2) -0.3
Note: Treatment effect = score after - score before.
l
111111 w,;,;,g Psychology Re search Reports Appendix B Example Research Report -
Nowadays, many publications have what is called a 'digital object In-text citations
identifier', or DOI. If your source has one, it must also be given in the
reference list. A publication will often list its own DOI; if it does not, Mellers (2000)
you must look up yourself whether one exists, e.g. by searching for (Mellers, 2000)
the publication in PsychINFO. Click on the title of a publication (or
click Complete Reference, to the right of the title) to bring up a range Two authors, page numbering per issue
of details about the publication, including the DOI. Another option is Reference list entries
to search Crossref (https://www.crossref.org), under the 'Search Meta-
data' tab. Klimoski, R., & Palmer, S. (1993). The ADA and the
As of March 2017, the recommendation has been to include DOis in hiring process in organizations. Consulting
the reference list as links (https://doi.org/identifier). Some websites Psychology Journal: Practice and Research, 45(2),
and articles may still use the older forms (DOI:identifier or http:// 10-36. https://doi.org/10.1037/1061-4087.45.2.10
dx.doi.org/identifier). These can be converted to the new format; the
identifier itself will remain the same. Do not place full stops after a Some journals number each issue individually, i.e. every issue
DOI or break them with a hyphen; any breaks must occur before a starts on page 1. In such cases, add the issue number (no italics) in
punctuation item, such as a slash or a hyphen (but after a double slash). parentheses after the volume number.
Examples are given below of in-text citations and reference-list entries In-text citations
for (a) journal articles, (b) books/book chapters, (c) dictionaries and
encyclopaedias, (d) newspaper articles and (e) electronic sources. Klimoski and Palmer (2000)
(Klimoski & Palmer, 2000)
A Journal articles
Sample references to journal articles ('journals' are academic, Three to five authors
peer-reviewed periodicals aimed primarily at the scientific commu-
nity) Reference list entries
One author, page numbering per volume Borman, W. C., Hanson, M. A., Oppler, S. H., Pulakos,
Reference list entries E. D., & White, L. A. (1993). Role of early
supervisory experience in supervisor performance.
Mellers, B. A. (2000). Choice and the relative Journal of Applied Psychology, 78, 443-449.
pleasure of consequences. Psychological Bulletin, https://doi.org/10.1037/0021-9010.78.3.443
12~ 910-924. https://doi.org/10.1037/0033
-2909.126.6.910 In-text, first citation:
Most journals use continuous page numbering throughout a vol- Borman, Hanson, Oppler, Pulakos, and White (1993)
ume (if the first issue finishes on p. 212, the second will begin on (Borman, Hanson, Oppler, Pulakos, & White, 1993)
p. 213).
If necessary, line breaks may be inserted into DO Is before a slash In-text, second and subsequent citations:
(/), a hyphen(-) or a full stop (but after a double slash); do not add
another full stop after the DOI. Borman et al. (1993)
(Borman et al., 1993)
r
-- Wmiog Psychology Research Reports Appendix C APA Reference List Guidelines -
List the first six authors, then a comma followed by an ellipsis ( ... ), Book, third edition, Jr. in the name
then the last author. Reference list entries
In-text, always: Mitchell, T. R., & Larson, J. R., Jr. (1987). People in
organizations: An introduction to organizational
Wolchik et al. (2000) behavior (3rd ed.). New York: McGraw-Hill.
(Wolchik et al., 2000)
If you have consulted the online edition of a book and it has a DOI,
In press list the DOI instead of the publisher and city of publication.
Reference list entries If you have consulted the online edition of a book and it has no
DOI, list the relevant URL instead of the publisher and city of
Zuckerman, M., & Kieffer, S. C. (in press). Race publication.
differences in face-ism: Does facial prominence
imply dominance? Journal of Personality and
Social Psychology.
-- w,1<109 Psychology Research Reports Appendix C APA Reference List Guidelines -
In-text citations If you have used the online edition, give the DOI instead of the
publisher.
Mitchell and Larson (1987)
(Mitchell & Larson, 1987) American Psychiatric Association. (2013). Diagnostic
and statistical manual of mental disorders (5th
Book, author is an institute, published by same institute ed.). https://doi.org/10.1176/appi.books.9780890425596
Reference list entries
Some sections of the manual have their own DOI
Australian Bureau of Statistics. (1991). Estimated
resident population by age and sex in statistical American Psychiatric Association. (2013). Anxiety
local areas, New South Wales, June 1990 Disorders Appendix I. In Diagnostic and
(No. 3209.1). Canberra, Australian Capital statistical manual of mental disorders (5th ed.).
Territory: Author. https://doi.org/10.1176/appi.books.9780890425596
.dsm05
If the author and publisher are identical, use the word Author as
the publisher's name. In-text, first citation:
Article or chapter in an edited book, two editors Geerts and Heestermans (1984)
Reference list entries (Geerts & Heestermans, 1984)
Newspaper articles without author Because Wikipedia content can change at any time, you must
Reference list entries reference the date on which you consulted the article.
New drug appears to sharply cut risk of death from In-text citations
heart failure. (1993, 15 July). The Washington
Post, p. Al2. ("Willem Albert Wagenaar", n.d.)
Alphabetise based on the first principal word in the title (ignore References to online encyclopaedia entries
words like 'a' and 'the'). Reference list entries
E Referencing electronic sources The title of the entry moves to where the author's name usually is.
GVU's 8th WWW user survey. (n.d.). Retrieved from Newspaper articles (electronic versions)
http://www.cc.gatech.edu/gvu/use_surveys Reference list entries
/survey-1997-10/
Brod~ J. E. (2007, December 11). Mental reserves keep
If no author is known, start the reference with the title of the brain agile. The New York Times. Retrieved from
document. If no publication date is known, use the abbreviated http://www. nytirnes. corn
form of'no date' (n.d.).
Give the URL of the newspaper's home page if it is possible to
In-text citations search for the article there. This will avoid Internet links that do
not work.
GVU's 8th WWW User Survey (n.d.)
(GVU's 8th WWW User Survey, n.d.) In-text citations
(https://jasp-stats.org)
Writing Psychology Research Reports
Geurts (2018)
Appendix C APA Reference List Guidelines
-
Author, A. B. (year, day month). Title of the document (Geurts, 2018)
you are referencing [Document type]. Retrieved from
http: //xxxxx Streaming video (e.g. YouTube)
Reference list entries
If necessary, URLs can be line-broken before a slash(/), a hyphen(-)
or a full stop (but after a double slash). PBS (2010, 7 January). The human spark I So human,
so chimp I Chimps vs. kids I PBS [Video file].
Examples of three types of Internet sources are given below. Retrieved from https://www.youtube.com
/watch?v=RK8rKKp-vPO
Blog post
Reference list entries Write the titles of movies or YouTube video's in italics.
A B
11 1111
9 789024 425402