Professional Documents
Culture Documents
Contents
Introduction 22
Accessing Documents 22
Ethical Issues 24
Sampling and Selection 27
Issues to Consider when Researching Documents 29
How to Read Documents 32
Keeping Records 34
Conclusion 35
Introduction
Having decided to use documents in – or perhaps as the basis for – your
research, the issues concerned with how to find, and then how to read, the
documents you want or need have to be considered. While the answers to
these issues may, at first glance, seem simple or self-evident, this is often
not the case, so some careful thought and planning may be called for.
This chapter offers a guide to and through the issues involved in finding and
reading documents. The main sections of the chapter focus on:
Accessing Documents
Where and how you can access documents for research depends to a large
degree on the nature of the documents themselves, but also to an extent on
your own status. Are they academic documents, official documents,
institutional documents or personal documents? Are they available only in
physical form or online? Are they published or unpublished, public or
private, contemporary or historical?
Here, much has changed in recent years, however, with the rise of social
networking and the growing tendency for (particularly young) people to
place a lot of information – often openly and freely accessible – about
themselves, their relationships and their lives online. Though such
information may be publicly available, it does raise particular ethical issues,
which are considered in the next section.
If you are not searching for something specific, however, you will need to
take care with the search terms or keywords that you use. Thus, using any
of the three examples just given as a search term would likely yield
thousands of hits, which could take you a good deal of time to work through
before you found something of particular interest. So, it is important to
make the search terms as specific as possible, or to use the and/or functions
(also known as Boolean operators) or date restrictions to limit the number
of results.
It is also helpful to use more than one search engine; they all have a
different coverage, so, if you use only one, you may miss some key
material. Academic search engines can also provide other useful
information, such as how often a particular document has been cited, and by
whom, which can help in narrowing down your focus or in deciding where
to start. More highly cited documents are likely to have been particularly
influential in thinking and research on the topic concerned.
It is important to highlight here one of the key issues – indeed, perhaps the
key issue – with contemporary documentary analysis based on online
searching; namely, the sheer volume of material (i.e. documents) that may
be identified as being of relevance (see also the discussion of literature
reviews, systematic analyses and meta-analyses in Chapters 6 and 7). In this
situation, documentary researchers have to employ means of limiting – for
example, by date, language, citations, combinations of keywords – at least
initially, the numbers of documents they access.
Ethical Issues
It might be thought that, as documents already exist and have merely been
accessed by the researcher, there are no (outstanding) ethical issues to
consider in using them as research materials. Such ethical issues as there
were – informed consent, anonymity, transparency, the right to withdraw,
copyright, and so forth – will have been addressed and, one might presume,
solved by those responsible for putting together the document. It is not
always, however, as straightforward as that.
It is possible, for example, that the document’s author(s) may not have
acted in a rigorously ethical fashion. This issue is perhaps likely to be more
pertinent for older documents, to which contemporary ethical standards will
not have been applied (though, of course, those involved are less likely to
still be alive). But it is also, as we shall discuss, highly pertinent for many
contemporary, and often freely and easily available, documents.
Similar kinds of issues or concerns may arise when other kinds of personal
material – for example, diaries, letters, blogs, social media entries – are the
focus for research. The authors may have placed their material in a publicly
accessible forum, but the researcher still needs to carefully consider the
ethical implications of using the material for research purposes. Will, for
example, the author be identifiable, and, if so, will the presentation or
publication of the research cast them in an unfavourable light, or possibly
cause them distress? This is also the case with historical material, where the
author may be long dead, but surviving relatives or descendants may be
affected.
That your analysis of a document might place its author in an unfavourable
light does not mean, though, that you should not carry out and publish the
analysis; research, after all, has an important role in ‘speaking truth to
power’. What is important is your awareness of the issues involved, and the
way in which you contextualise and present your analysis.
To give a fuller idea of the kinds of ethical issues that may be involved in
researching documents, particularly those found online, Box 3.1 quotes
from the Ethical Guidelines for Educational Research produced by the
British Educational Research Association (BERA), a learned society. There
are, of course, many learned societies and professional bodies across the
world that produce their own ethical guidelines, and the reader would be
well advised to consult those most directly relevant to them. The BERA
guidelines are quoted here simply as an example.
In many cases the producers of publicly accessible data may not have considered the
fact that it might be used for research purposes, and it should not be assumed that
such data is available for researchers to use without consent … Seeking consent
would not normally be expected for data that have been produced expressly for
public use. There is no consensus, however, as to whether those in online
communities perceive their data to be either public or private, even when copyrights
are waived. Therefore, consent is an issue to be addressed with regard to each and
any online data-source, with consideration given to the presumed intent of the
creators of online content, the extent to which it identifies individuals or institutions,
and the sensitivity of the data…
When working with secondary or documentary data, the sensitivity of the data, who
created it, the intended audience of its creators, its original purpose and its intended
uses in the research are all important considerations. If secondary data concerning
participants are to be reused, ownership of the datasets should be determined, and
the owners consulted to ascertain whether they can give consent on behalf of the
participants…
It is accepted that, sometimes, gaining consent from all concerned in public spaces
(face-to-face or virtual, past or present) will not be feasible; however, attempts to
make contact should be documented. In the event of a secondary source being
untraceable, researchers should be able to evidence their attempts to gain consent.
(BERA 2018, pp. 7, 10–12)
It is good practice, therefore, when you write up your research, to spell out
how you chose the documents you analysed, and why you chose those
documents rather than any others that might have been available or
considered. This is so even when you are only analysing a single document
– presumably because it is of such interest or significance – otherwise, why
else would you be paying it so much attention? You should explain why it is
of interest or significance, and thereby justify your choice.
The older approach (i.e. up until a few decades ago) would have involved
identifying a few items to start with (from a reading list, a library catalogue,
or from the advice of others), and then working backwards (through the
references) and outwards (looking at books on the same library shelves
and/or articles published in the same journals) to find other material. Each
item would then be examined briefly to determine its relevance, and then
either discarded or put aside for a closer reading later.
The modern approach would involve using one or more search engines (see
the discussion in the previous section) and keywords to produce lists of
possibly relevant material, then working through these to remove items that
obviously aren’t relevant, and then accessing the remaining books, reports
or articles (online or in hard copy) to review them further. It would be
strange, nowadays, not to use an approach along these lines, even if you had
started your search in the more traditional fashion.
So, if you have carried out a literature review, you should be able to state:
To illustrate these processes, Box 3.2 details two examples of sampling and
selection strategies as applied to documentary research. One involved the
use of a single, subject-specific database, while the other searched several,
more generic databases. The first example took a random stratified
approach, where relevant items were identified randomly until examples
relating to all possible variable values had been identified. The second
example took a more comprehensive approach, seeking to identify –
through the use of keyword search terms and other strategies – all published
studies that met the inclusion criteria.
1. To select the documents for analysis, a random stratified sample was drawn from the
ICN [International Council of Nurses] database of nurse legislation. All legislation (n =
173 jurisdictions) was first coded according to the key dimensions of interest (geographic
region of the world, GNI [gross national income] category, legal tradition, model of nurse
regulation and administrative approach). Each variable of interest had a number of
possible values, for example, legal tradition included civil, common and Islamic law.
Accordingly, a series of Excel files, one for each of the variables of interest and sorted by
the respective possible values, was created. These were then used to select, by use of the
random function included as part of the Microsoft Excel 2010 package, legislation for
inclusion in the analysis. Because every law was coded against all variables then, as soon
as a law was selected to fulfil one of the variables of interest, this would have an impact
on all other variables. Hence, the sequence of selection was determined on the basis of the
least represented value in the variables of interest. Random selection continued until there
was at least one example of each value for the variables of interest. (Benton et al. 2015, p.
209)
2. Coaching studies using a systematic observation method were searched using a 3-phase
approach. Phase 1 involved searching the EBSCO HOST database. Specific databases
searched were Academic Search Complete, Educational Research Complete, ERIC,
PsycArticles, PsycBooks, PsycInfo and SPORTdiscus with FullText. Original search
terms … were systematic observation AND coaching AND behaviour. Closely related
terms and those used in studies that were known to have used a systematic method, such
as coach and athlete and learning were also included in searches to ensure all relevant
articles that met the inclusion criteria were identified. Database searches stopped once a
saturation point had been reached, which was when no new articles were found. Phase 2
expanded the search beyond the databases to involve other studies that met the inclusion
criterion: post 1997, empirical, peer-reviewed study, written in English, the participants of
the study were coaches, and a category-based, systematic observation instrument to
observe coaching behaviour directed towards players. This extended search was achieved
by reading the reference lists of articles identified in phase 1, as well as emailing
researchers who were known to conduct coaching research using a systematic observation
method. Finally, colleagues directed the authors to any other studies that had not been
identified through any other means. (Cope, Partington and Harvey 2017, pp. 2042–2043)
In other words, as for other forms of social research, the sampling and
selection approach adopted for documentary research should be both
transparent and identify a sufficient quantity, range and variety of relevant
sources to enable a convincing analysis to be carried out.
Having accessed and selected the documents you wish to analyse, there are
then a series of related issues which you need to bear in mind as you
analyse them. Box 3.3 offers three perspectives on this from other authors.
1. Who wrote the document? What is known about the personal and professional
biography of the author?
2. When was the document written? What other events were occurring at that time?
3. What prompted the writing of this document? Were there social, political,
economic or historical reasons that may have influenced the writer and the
contents?
4. What audience was this written for? Does this document set a particular agenda?
5. What are the contents, the language and terms used and the key message(s)? What
is the ideological position of the author?
6. What are the omissions? Was this deliberate? How do you know?
7. Are there any sources that can be used as a comparison?
8. Is this document reliable? (Fitzgerald 2007, p. 287)
Clearly, there are both similarities and differences between the issues
identified by these authors. Thus, both McCulloch and Richardson and
Fitzgerald identify author and audience as key issues. Fitzgerald’s
identification of reliability could be seen as analogous to Scott’s credibility;
and the former’s message and alternative sources could similarly be viewed
as similar to the latter’s meaning and representativeness. The relations
between the other criteria, issues and questions identified are less clear, in
part because the latter two perspectives are more detailed than Scott’s, in
part because their focus is different.
Other authors have brought up additional issues. Thus, Platt (1981a) offers
the following:
Platt, like Scott, identifies authenticity as a key issue, but then brings in the
issues of truth and inference. Truth could, of course, be seen as an
alternative, blunter expression, more or less equivalent to credibility or
reliability.
In a parallel article, Platt (1981b, p. 53) goes on to note that there are
‘problems to do with the interpretation and presentation of documentary
material, with special reference to questions of justification and proof’. For
Platt, therefore, documentary researchers should operate in a quasi-
legalistic fashion, interrogating their documents as witnesses for what they
have to say about the particular topic or issue in question.
Abbott, Shaw and Elston (2004) provide a similar perspective, in their case
drawn from the study of policy documents relating to the British National
Health Service (NHS), but more broadly applicable as well:
analysis may focus on one or more of three layers of meanings: those
which are overt and explicit in the document; those which reflect the
rhetoric of the policy environment and the government’s intentions;
and, those which reflect the ideology, usually implicit, underpinning
policies at local and/or national level. (p. 259)
In other words, documents may be ‘read’, to use the more usual meaning of
this word, and assessed at a number of different levels.
Finally, Prior (2003) adds a further slant in arguing that ‘a study of the use
of documents can be as telling as a study of content’ (p. 14). This links
clearly to McCulloch and Richardson’s (2000) notion of the influence of a
document. While it may seem particularly pertinent to research into policy
documents (the subject of Chapter 10), such as those on which Abbott et al.
(2004) focused – following the expression of policy through to its
interpretation and application – it is also relevant to other kinds of
document. For example, in the case of academic documents, their citation
rates, and who has cited them in which contexts, may be of particular
relevance.
Clearly, then, there are a whole range of interrelated issues to bear in mind
when researching documents. To re-emphasise, they cannot simply be taken
at face value. As well as gathering as much information as possible about
the context for their production and usage – which the perspectives
provided by McCulloch and Richardson (2000) and Fitzgerald (2007)
chiefly focus upon – the researcher needs to carefully assess the credibility
or reliability of each document. The interpretation of any document relies
upon this and how it is read.
This then raises practical and academic issues. How do you handle the
documents you have for analysis in the limited time you have available?
How can you read them with a reasonable amount of speed and efficiency,
but without missing key points? And how do you ensure that your reading
is sufficiently critical, as criticality is a key issue in research?
As with most things, practice, of course, helps a good deal. As you read
more documents, your reading should become quicker. You will get more
familiar with the ways in which the documents you are researching are
organised, and should be able to get to the key points or aspects you are
focusing on more efficiently. You will have read the different arguments
made, and the references used, in other documents before. And, if you are
focusing on particular authors, you will become increasingly familiar with
the development of their argument over time.
You will almost certainly not have the time to literally read the whole
document – line by line, page by page, from start to finish – if you have a
significant number of documents to study, so you will need to focus on
what is important to you. You can always return to the document,
repeatedly if need be, for further analysis if this later seems necessary (so
keeping a copy of the document, if possible, or a record of it (see next
section) is important, for this and other reasons).
Keeping Records
The importance of keeping records – of the documents you read and
analyse, and of your opinions of them – cannot be stressed too highly,
though it is easy to overlook if you just want to get on with your research. If
you don’t keep good records right from the start of your research, however,
it is bound to knock you back and irritate you later, when it will take you
more time to recover the details.
There are three kinds of records you need to keep, which are closely linked.
First, you need to record the details of each document you study, so that you
can reference it properly, and you (and others who are reading your work)
will be able to access it again easily. If the document has been published,
these details will include, if it is a book or report, the authors, title, date of
publication, publisher and place of publication. If it is an article, they will
include the authors, title, date of publication, journal title, volume, issue and
page numbers. If the publication is online only, details of its online address
need to be recorded, along with the date you accessed it.
Third, you need to record your own opinions of the document. If you have a
copy, these can, of course, be written on the document itself; if not, they can
be added to your notes. You may return to and update these on a number of
occasions as your reading progresses, deepens and widens.
Lastly – and again obviously, but also, surprisingly, often overlooked – you
need to keep your records safely. If they are on a computer, be sure to keep
another copy on at least one separate data-storage device, and to back this
up at least daily.
Conclusion
This chapter has offered lots of practical guidance on how to find and read
documents. Assuming that you have some interest in the documents you are
researching – otherwise, why would you be researching them? – the
processes involved in accessing and reading them should be, at least partly,
a pleasure. It should be evident from reading this chapter, however, that
there is also an element of regularity, repetitiveness, perhaps even tedium,
involved. It is crucial, therefore, that you approach documentary research –
as you would any other kind of research – in a careful and disciplined
fashion.
Key Readings
Fitzgerald, T (2007) Documents and Documentary Analysis: Reading
between the lines. pp. 278–294 in Briggs, A, and Coleman, M (eds)
Research Methods in Educational Leadership and Management. London,
Sage, second edition. A very readable introduction to many of the key
issues.