You are on page 1of 16

Historians’ Use of Digital Archival Collections: The Web,

Historical Scholarship, and Archival Research

Donghee Sinn and Nicholas Soares


Department of Information Studies, University at Albany (State University of New York), 135 Western Avenue,
Albany, NY 12222. E-mail: {dsinn, nsoares}@albany.edu

This article reports a research study about historians’ materials in citations indicates that they were useful and
experiences using digital archival collections for relevant to the topic addressed by the study. Such informa-
research articles that they published in the American
tion shows the direct relationship between source materials
Historical Review. We contacted these authors to ask
about their research processes, with regard to digital and historical inquiries for specific projects on which histo-
archival collections, and their perceptions of the useful- rians work. However, the citation information stops short of
ness of digital archival collections to historical research. revealing the prior paths historians took to learn about each
This study presents a realistic portrayal of the “uses” source or explaining why they decided to use a particular
and “impacts” of digital primary sources from the per-
source for their specific projects. Consequently, researchers
spectives of historians who use digital collections for
their research projects. The findings from this study have employed various methods, such as experiments, inter-
indicate that digital archival collections are important views, and surveys, to understand how historians learn
source materials for historical studies for various about, identify, locate, and use primary materials and how
reasons. However, the amount of authority digital mate- these information activities are related to historical research
rials possess as historical resources was disputed.
processes. As a result, a significant amount of knowledge
Many historians preferred documents in their original
form, but historians’ preferences began to change as has accumulated about the views that historians have in
they increasingly consulted digital formats. As the web general about their research processes in archives, their
has developed into an important research platform, his- searching and browsing behaviors with primary resources,
torians have adopted different research patterns, one of and certain archival systems’ levels of usefulness. To date,
which is using random web searches to find digital
little research has been done to examine, in an empirical
primary sources. Historians’ understandings of the
“use” of digital archival collections revealed a spectrum manner, the complete paths historians follow from finding
of activities including finding, understanding, interpret- and identifying archival materials to making final decisions
ing, and citing digital information. Historians in this about using them in their particular research projects. More
study worked concurrently on multiple studies or on a studies are needed to understand the whole picture of how
larger project for a book, and each of their searches for
historians use primary materials for learning, critical think-
digital collections had the potential to provide them with
useful results for several research studies. ing, building arguments, and promoting knowledge during
their particular research projects.
There are even fewer studies devoted to historians’ uses
Introduction of digital archival collections with their specific experiences
Over the years, the archival community has tried to learn for their research. Since the 1990s, many projects to digitize
how society’s documentary heritage is being used. Histori- primary materials have been undertaken to provide easier
ans have often been consulted in archival user-studies access to historical resources. As an enormous amount of
because, besides being one of archives’ major user-groups, money and manpower has been put forth for such projects,
their work is largely based on primary resources. Historians’ there is significant interest about how such digital collec-
uses of primary resources can be easily verified by viewing tions are being used. Again, researchers have reviewed cita-
citations in their publications. The appearance of certain tions to monitor the use of digital archival collections so that
they could obtain a realistic understanding about the impact
they are having. Graham (2002) reported that among the 128
Received April 16, 2013; revised August 1, 2013; accepted August 1, 2013
articles she surveyed only six (4.6%) used electronic
© 2014 ASIS&T • Published online 21 April 2014 in Wiley Online Library resources. The portion of digital collections was only four
(wileyonlinelibrary.com). DOI: 10.1002/asi.23091 (8.7%) among all electronic resources (46 items) used in

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 65(9):1794–1809, 2014
these six articles. This usage pattern has gradually increased The web experience has had a significant impact on
in recent years, as about half of the articles in the American research processes, and the general expectation of historians
Historical Review (AHR) from 2009 and 2010 contain cita- about the information-seeking process now seems consider-
tions to digital archival collections (Sinn, 2012). Citation ably different from what it was before. There have been
studies provide firm evidence of the use of digital archival studies attempting to understand how historians use archival
collections. However, studies employing various approaches resources and how using these resources have affected his-
are necessary to investigate deeper layers of the evidence torians’ research patterns, especially in the digital environ-
and to map out the broader landscape surrounding the usage ment. In this literature review, the findings of previous
of such information. archival use/user-studies are examined in three contexts:
This study contributes to the general understanding of studies from a material (institution/system)-centered
historians’ use of digital archival collections by empirically approach, studies from a patron-centered approach, and
examining how historians conduct historical projects with studies from a research product-centered approach.
digital collections. It investigates historians’ concrete expe-
riences of becoming aware of the existence of a particular
Material (Institution/System)-Centered Use/User Studies
digital collection, finding and searching for materials
within the collection, and deciding to use digital materials Some studies have been conducted to understand the
in their research studies that they published in the use of archival materials from material or institutional
American Historical Review. We expect that learning from standpoints. These focus on identifying the users of certain
historians’ particular experiences with certain digital col- materials and systems, the frequency of material use in
lections for their particular research studies will reveal certain institutions, the increased accessibility of materials
certain aspects of the process in which historians work after digitization (i.e., the promotion of hidden or unpopu-
with digital archival collections that they may not have lar materials on the web), or the ways in which the uses of
remembered immediately when asked to comment in a materials are promoted by usability and system interfaces.
general sense about their research activities. We contacted The focus is on materials, institutions, or systems that
historians who cited digital archival collections in articles provide access to materials, and it evaluates both the use of
within the American Historical Review. Using an open- systems and the users of systems.
ended questionnaire, we asked historians about their spe- In previous years, many archival user-studies belonged
cific behaviors and perceptions using digital archival to this category, and these studies provide good informa-
collections during their particular studies. Through this tion about the types of archival users an institution or a
research, we believe we have gained an in-depth and real- collection has and how these users tend to use primary
istic understanding about historians’ research patterns in materials from a traditional setting or an information
relation to digital archival collections. system setting (Blais & Enns, 1993; Cherry & Duff, 2002;
Gordon, 1992; Górny & Mazurek, 2012). Some research-
ers analyze the ease of use and challenges of archival
Literature Review
information systems, such as finding aids, MARC, EAD,
Digital technology and resources have changed the aca- and access systems. As archival systems have incorporated
demic landscape of the history field, although the change has advanced technologies and newer standards, researchers
been slow (Burton, 2005, pp. 206–208). In a history confer- have delved more into the users’ understanding and usage
ence, Cohen (2010) stated that as “searchers and sifters of of such systems; the usability of a system, its functional-
evidence,” historians have gained a powerful tool to aid them ities, the effectiveness of its searching and retrieval func-
in these tasks in the form of web search engines such as tions, the learning curves faced by its users, and users’
Google. The digital platform for historical resources has willingness to accept a system are a few of the topics that
altered how historians interact with primary materials. His- have emerged although the subjects of these studies have
torians spend less time in archives and more time online, and not always been historians (Altman & Nemmers, 2001;
historians’ time in archives is spent more for “informally Czeck, 1998; Daniels & Yakel, 2010; Meissner, 1997;
digitizing materials for later review” than for sitting and Prom, 2004; Scheir, 2005; Spindler & Pearce-Moses,
analyzing the materials (Rutner & Schonfeld, 2012, p. 8). 1993; Yakel, 2004). The findability of archival materials on
These changes, however, are not new, as the web has become the web has been increasingly of interest to researchers as
an important platform over the years to search for primary as the web has become an important venue for information
well as secondary resources for research (Tibbo, 2003). The seeking (Feeney, 1999; Tibbo & Meho, 2001). Studies
changes to how scholars read and write about history are have been conducted to identify online users of archives
evident, especially with the emergence of new technologies and to examine the behaviors of anonymous users within
and digital cultures from Web 2.0 (Rosenzweig, 2006). The archival access systems (Assadi, Beauvisage, Lupovici, &
term digital history does not just mean the utilization of Cloarec, 2003; Hill, 2004; Prom, 2011). The advantages
technology for researching and teaching but also implicitly and concerns that digital technologies have brought, such
signifies the consideration of new methods to frame new as increased access to resources through the web, chal-
types of research questions (Weller, 2013). lenges that a new format has created for users and

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1795
DOI: 10.1002/asi
archivists, and specific information-seeking behaviors of sources or to having been altered (whether accidentally or
searching and browsing have been studied as well (Hirtle, intentionally), and these risks are major reasons that his-
2002). torians are wary of digital images (Maidment, 2013). This
prudence may stem from the general characteristics of the
history field. Burton notes that mainstream academic his-
Patron-Centered Use/User Studies
torical journals only began to accept digital contents as a
A corpus of literature devotes itself to understanding part of their publication in 2000, and further states, “a
archival research from users’ own perspectives, including large problem faced in history is that work done in digital
those of historians. Many studies have surveyed how histo- forms is not rewarded in the same ways as work done in
rians behave and interact with source materials, aiming to more traditional forms of history” (2005, p. 216).
learn about specific information-seeking activities as well as In recent years, historical publications have shown a
the purposes and impacts of archival research. Unfortu- gradual increase in the citations of digital resources (Dalton
nately, many of these studies dealt with the pre-internet & Charnigo, 2004; Duff et al., 2004b; Graham, 2002;
world. There is still little research on how historians search Sherriff, 2010; Sinn, 2012). Studies focusing on historians’
for digital primary materials. Researchers are calling for research activities in the digital environment have identified
studies about historians’ information needs, search strate- that they keep their own library of notes and copies of
gies, and work patterns in the digital environment because documents, either physical or digital, to collect and organize
such information behaviors and research patterns are differ- information while conducting research (Elena et al., 2010;
ent than those used during the pre-Internet world (Elena, Rutner & Schonfeld, 2012). This tendency of historians to
Katifori, Vassilakis, Lepouras, & Halatsis, 2010). deliberately acquire the digital formats of original materials
There have been some studies on historians’ use of elec- shows that historians take advantage of digital reproduction
tronic retrieval tools, such as online finding aids and web technologies and view them as important. Digital copying of
searches (Anderson, 2004; Southwell, 2002; Tibbo, 2003). primary materials has different kinds of advantages for
As identified in these studies, the electronic methods of research, and it is a shift in research practices “with as-yet
distributing and finding resources are critical for historians largely unrecognized implications for the work of historical
to conduct their research. The percentage of users who research and its support” (Rutner & Schonfeld, 2012, p. 11).
found manuscripts in a repository through web searches was Studies find that historians use informal channels, such as
15.2% in 2000 (Southwell, 2002). A 2003 report shows a their colleagues, as well as formal sources, such as archivists
large increase in historians’ reliance on the internet; 44% of and citations in publications, to look for relevant informa-
surveyed historians used search engines and 63% visited tion (Conway, 1986; Maher, 1986; Stevens, 1977). Histori-
repository websites for archival research (Tibbo, 2003). ans show similar information behaviors with digital
Some other general findings concerning archival research in collections. One difference in historians’ behaviors when
the digital environment show that historians do not use using the web environment was their tendency to work on
digital resources only for research. Teaching and curricular their archival research independently. Schaffner (2009,
are also important purposes historians have in mind when p. 5) states that “goals to disclose descriptions online and to
using digital archival collections (Anderson, 2009). Regard- digitize primary resources have made special collections
less of their purposes, archival users prefer to discover more visible and roles of archivists and librarians less
primary sources “at the network level, not at the institutional visible.” This situation forces archivists to create improved
level,” and this exposure of primary sources online may descriptions of archival holdings and to develop better dis-
increase the chances of users’ discovering hidden collec- covery tools in order to justify their existence. However,
tions (Schaffner, 2009, p. 5). More and more historians have Rutner and Schonfeld (2012) present some evidence that
found the potential of the electronic forms of retrieval tools serious archival users of the digital world still rely on
helpful in their search for primary materials (Duff, Craig, & archivists.
Cherry, 2004a). Elena et al. (2010) identify some specific behaviors of
Researchers have also investigated historians’ research historians seeking digital primary resources. They report
patterns and attitudes in relation to digital resources. His- that historians break down information queries into small
torians generally believe the digital sources are less reli- segments and try to search for them one by one. Historians
able than traditional print sources (Elena et al., 2010). show general information behaviors that researchers in
Maxwell (2010) asserts that historians always prefer origi- other fields also have, such as using synonymous terms
nal documents instead of digital artifacts and wish to use derived from original keywords, combining these terms to
digital technology as a way of duplicating original docu- make various queries, and then iterating their searches.
ments to promote use rather than as a way of replacing When compared with historians’ behaviors with original
them. Weller (2013) argues that the original format carries documents, however, historians’ searches for digital
specific meanings and particular experiences and conse- resources are characterized as less active; historians used
quently that changing a document’s format changes the fewer keywords, fewer combinations of keywords, and
interpretation of historical source materials. Digital images fewer terms that derived from or related to original key-
are susceptible to having lost meaning intrinsic to primary words when using digital collections. Historians seem to

1796 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014
DOI: 10.1002/asi
have less confidence with digital archives than traditional constituency for a specific topic or area of study. While not
archives, and Elena et al. (2010) postulate that this may focusing particularly on digital resources, such studies have
be due to the limited functionalities of digital archival infor- helped identify the position and role of archival materials
mation retrieval systems combined with users’ undeveloped within various topics in historical studies. These topics
technological skill levels. Researchers also assert that tradi- include history of science (Elliot, 1981), social history
tional archival representation methods (provenance-based or (Miller, 1986), women’s history (Beattie, 1989), English
organization-based) have been little help for historians who history (Jones, Chapman, & Woods, 1972), local history
search in digital archives (Elena et al., 2010; Katifori et al., (Brubaker, 2005; Hitchcock, 1989), and history in general
2008). (Lowe, 2003; McAnally, 1951; Sherriff, 2010). Often, find-
Maxwell (2010) relates, from a historian’s perspective, ings from these studies are used in discussions about the
that he prefers to see digitally scanned images of original relationships between archival practices, actual use,
documents rather than html text versions because digital appraisal, acquisition, and historical scholarship as a way to
images provide an experience similar to that of original suggest predictable patterns between material usage and the
documents. The digital interface is also an important factor archival practices of appraisal and collection building.
and should be user friendly so that users are able to browse To identify the most influential format(s) and the value of
and zoom in on digital images with minimal clicks. Brows- a certain type of material among other materials, some
ing is a method preferred to keyword searching. Inconve- attempts were made to compare the various formats of
nient interfaces and slow page loadings may make users give resources, including electronic formats, being used in pub-
up potentially useful online resources (Maxwell, 2010). lications. Graham (2002), reporting on historians’ use of
Historians and other archival researchers do not regularly electronic resources, found that a large number of historians
use archival utilities such as ArchivesUSA, OCLC (and pre- believed that digitization projects have a positive impact on
viously RLIN), or NUCMC (Hamburger, 2004; Maher, their research, but approximately half of them did not
1986; Southwell, 2002; Tibbo, 2003; Yakel, 2002). In cases believe that a digital copy is equivalent to the original. Of
when users use information systems for primary resources, historians, she states that “the majority agreed they would
findings in previous studies repeatedly present the evidence cite the print version even if an electronic surrogate were
of historians’ preferences for subject searches (Duff & available” (Graham, 2002). She explains this result in part
Johnson, 2002; Duff & Stoyanova, 1998; NWDA, 2008; by the fact that the contextual information of the original
Pugh, 1982). More specifically, historians prefer keyword document is lost by digitization. The finding of historians’
searching for known items, and their keyword search terms preference for print resources is consistent with that of pre-
tend to include names, places, titles, and discipline-specific vious studies and also shows the discrepancy between the
terms (Tibbo, 1993). Historians consider searches for names perception historians have of digital resources and their
the easiest method for collections (Duff & Johnson, 2002). actual citation behaviors.
Keyword searching is an important search strategy not only Dalton and Charnigo (2004) identify some of the most
for historians but also for humanities scholars in general frequently used electronic databases, reference databases,
(Palmer, Teffeau, & Pirmann, 2009). Historians prefer that and source databases that provide digital primary resources.
their subject search results be directly linked to collections Popular websites that historians visited include various
(Duff & Johnson, 2002) and also that subject searches guide types of sites and services, but the single most frequently
them to other relevant collections and catalogs (NWDA, visited site was the Library of Congress’s American
2008). Historians conduct subject searches with unstruc- Memory Collection. One of the barriers that historians expe-
tured keywords, but they use a structured term systems for rienced in using online databases was the sketchy coverage
browsing (NWDA, 2008; Prom, 2004). of full-text or digital content in electronic databases. Dalton
and Charnigo (2004, p. 414) found that historians identified
foreign language materials as a problem not because they
Product-Centered Use/User Studies
did not read such languages, but mainly because they were
Material/institutional approaches and patron-based often “absent from collections, absent from databases, and
approaches have studied in detail who archival users are and difficult to use” in electronic systems.
how they search for primary resources. Some further studies Conway (2010) takes a different approach to identifying
focus on what users do with archival collections and how the use of digital resources. He focuses on the expert users
users’ archival research is impacted by their use of archival and their use of digital photographic archives for their own
collections. These studies take into account the final prod- purposes. Although his research does not focus only on
ucts of archival research such as the archival references historians’ uses of digital sources for academic purposes, it
being used in historical publications. Such studies have does help show the multiple advantages that digital photo-
provided a good understanding about the actual usages, graphic resources provide in the users’ final products of
rather than the perceptions, of certain materials and books, websites, and databases (Conway, 2010). Conway
about their value or usefulness to particular purposes of (2010) found that whether users preferred digital formats or
archival research. A sizable amount of these studies employ the original photographs depended on various reasons; these
traditional citation analysis to understand an academic included users’ familiarity with the original sources, specific

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1797
DOI: 10.1002/asi
advantages of using the originals (such as details or aesthetic 2) How and why did historians decide to use digital archival
qualities), technical limitations of exploring the details of collection materials among other sources (i.e., for what
digital images, and the users’ views about which methods of qualities did historians see in the digital archival collec-
research are most authoritative. The users Conway inter- tions for their particular projects)?
3) What other factors have affected historians’ uses of
viewed showed positive attitudes about digitized photo-
digital archival collections?
graphs and valued them highly for their purposes. Their trust
in digital photographs as authentic source materials came
from their respect for the digitizing institution, the Library We contacted historians who were identified from the
of Congress, and their own expertise and knowledge of previous study as using digital archival collections in their
digital collections that enable them to compare, contrast, and AHR articles to ask about their specific experiences with the
compile other resources to verify the values of digitized digital collections they used. We identified a total of 87
photographs (Conway, 2010). authors responsible for contributing to 84 articles in the
Sinn’s (2012) study, which analyzes references in issues of the AHR published between 2001 (v. 106 n. 1) and
history journal articles from 2001 to 2010, presents the 2010 (v. 115 n. 5), from the previous study. Additionally, we
general patterns of digital archival collection usage. The reviewed eight later issues of the journal, from 2011 (v. 116
impact of digital archival collections when compared with n.1) to 2012 (v. 115 n. 3), which were available at the time of
other source materials is not significant when judging by research, to identify further authors and articles that refer-
the frequency of citations, and the predominating source ence to digital archival collections. As a result, a total of 102
materials that historians use are secondary materials. authors of 99 articles were identified from a total of 58
However, the appearance of digital archival collections in issues between 2001 and 2012.
citations and figures increases over time, and the past few The research period from 2001 to 2012 is an important
years have witnessed about half of the articles include cita- phase in terms of observing the use of digital archival proj-
tions and/or figures of digital archival collections. Sinn ects. The early digital projects started in 1990s, and since
reasons that the field of history and the conservative char- then there have been a great many digital projects imple-
acteristics of the American Historical Review (the aca- mented. Large amounts of grant money have been distrib-
demic journal she used) may have influenced the citation uted to the digital projects by many funding agencies, and
patterns in its publications. Historians seem to be gradually there has been much discussion regarding how to assess the
changing their notion of authoritative source materials to digital projects and how they have been used (Saracevic,
cite for historical research and expanding it to include 2000). Digital resources intended for use by historians have
digital formats of primary resources. This phenomenon is been accumulating for more than a decade. Thus, the study
also identifiable from the pattern of historians initially pre- period of the past decade is a critical point to see how digital
ferring digital collections created by trusted entities. His- resources have been used for historical inquiries. In this
torians use digital collections by authentic institutions, study, digital archival collections are defined as materials in
such as the Library of Congress and higher education insti- archival nature that are digitized or created in digital format.
tutions, earlier in the analyzing period, and their use of Typical primary sources that are converted in a digital form
digital collections created by individuals or small nonprofit (such as American Memory project by the Library of Con-
organizations occurs later. gress) are included as well as born digital ones (such as the
BBC’s WWII Peoples’ War project).
Methods The authors created an online survey with open-ended
questions. The questions asked historians about various
This is a follow-up to a study published by one of the aspects of their uses of digital archival collections, that is,
authors described above (Sinn, 2012). In the previous study, methods of identification, reasons to include them in
the impact of digital archival collections for historical publications, the relationship between historical research
research was addressed by reference analysis. The impact patterns and digital archival research, and other questions
was measured by evaluating the degrees of intensity (i.e., about the use of digital archival materials. The invitation to
depth: how frequently was a certain type of collection used the online survey was sent to these historians via email. The
in a history article) and extensity (i.e., width: how many invitation was deliberately written to include each histori-
articles include references to digital archival collections) of an’s publication title and referenced digital archival collec-
usages. Popular digital collections and their characteristics tion(s), and the survey questions were developed to ask
were also identified by the study. The current study was historians’ specific experiences with their particular digital
developed based on general knowledge obtained in the pre- collections. This was to guide the respondents to focus on
vious study about usage patterns of digital archival collec- their experiences with particular collections, rather than
tions in the AHR’s academic articles. Our study considers general perceptions about using digital resources. The data
the following research questions: were collected in November and December 2012.
There was a problem related to the citation style of the
1) What process did historians undertake to find digital AHR. This journal uses the Chicago Manual of Style, which
resources? does not have any specific citation format for digital archival

1798 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014
DOI: 10.1002/asi
collections. The citation patterns of digital resources vary by TABLE 1. Methods to learn about digital archival collections.
author, which makes it unclear at times if a source came How did you learn about the existence of the
from the digital collection or from the original collection. digital archival collections that you used for your
When in doubt, the citation was checked in digital collec- publication(s) in American Historical Review?
tions, but there may be some cases that authors used original (Respondents could select multiple answers.) Response count
primary materials rather than digital materials. Thus, we Found from web searches 13
created another survey for those who had not used any Heard from a colleague 10
digital archival collections. In fact, there were eight histori- Heard from a librarian/archivist/museum curator 8
ans who responded to the survey as not using any digital Learned from a conference 4
archival collections. Twenty-one historians participated in I’m involved with the digital project 3
News articles or professional journals 3
the survey as users of digital archival collections and pro- Learned from a citation in a publication 3
vided lengthy accounts about their experiences, which were Others: previous knowledge 2
reviewed and analyzed with NVivo (a qualitative data analy-
sis program). The survey questions are presented in the
Appendix.
One of the limitations of the study was the size of the
information, identified in previous studies. Among them,
research sample and its response rate. Of the 102 historians
another significant method appeared: web searches. A large
we contacted, only 21 replied, a response rate of 20.6%.
number of respondents (13) mentioned web searches as their
With such a low response rate, response bias is likely.
specific method for learning about digital archival collec-
Because the survey did not include questions regarding their
tions. This is an increase from Tibbo’s study in 2003, which
affiliations or anything else about their identities, we cannot
reported 44% of historians using web searches to find
know how well the sample represents the whole population.
primary collections. The web has been an important method
The historians’ self-identification of their research fields in
for finding both primary materials and their digital formats.
the survey was the only way to gauge the sample’ represen-
Table 1 shows the methods historians used to find out about
tativeness. In another study, the topics of AHR articles that
the digital archival collections that they used for their
cite digital archival collections were identified through
articles.
content analysis of abstracts and keywords (Sinn, 2013).
The paths that historians took to locate specific materials
When comparing these two sets of topic information (“self-
within a digital archival collection include methods similar
identified research fields” and “abstracts and keywords”),
to the ones they used to find the existence of digital collec-
we found similar coverage in topics. Six self-identified fields
tions. The most prominent method historians used to locate
were revealed in 17 responses: European-5, North
specific items was information retrieval from random web
American-4, African-3, Atlantic-2, Asian-2, and Latin
searches. Among 21 respondents, nine mentioned web
American-1. The previous study reports a breakdown of
searches in this way. Some particularly mentioned they tried
articles: European-36, North American-27, Asian-7,
using the web in hopes of finding useful items to cite. For
Eurasian-7, Latin American-7, African-6, Atlantic-3,
example, Respondent 16 said:
Mediterranean-2, Middle Eastern-1, and Pacific Region-1.
The comparison is not between the same objects (one for
I was looking for nineteenth-century maps of the Indian Ocean
research fields of respondents and the other for topics of region which I could use in publication (i.e., copyright free), I
articles) and thus these two data sets do not exactly match. found the University of Texas Perry-Castañeda Library Map
However, the basic variety and coverage appear to be Collection excellent and easy to use. I was not previously aware
roughly similar. Therefore, even though the sample in this of the collection, so found it with a simple web search. (Respon-
study is small, we assume it is broadly representative. dent 16)
The historians we contacted are those who published at
least one article in AHR during the 12-year period. As the Others said Google was their starting point, as can be
study period is broad, it may be that those who published seen in Respondent 20’s statement that “I usually just
their work earlier in the decade may not accurately recall Google a subject I want to know about and go from there.”
their usage of digital collections. Thus, this may result in no Google has become one of the major platforms used to look
responses or less specific responses to what they really went for information by historians, including our respondents.
through. There was no way to compensate for this, and it Using Google, they encounter useful digital materials
poses another study limitation. through random web searches. Given this phenomenon,
perhaps digital project developers need to pay more atten-
tion to how their digitized items will appear through web
Findings and Discussion searches. It may be advantageous for digital project devel-
opers to make digital collection databases indexable by
Historians’ Paths to Digital Archival Collections
search engines (perhaps each entry of the database could be
The paths historians took to find digital collections indexable, rather than the whole collection of the database
were similar to the paths historians took to seek general itself). As some researchers have found, many users of

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1799
DOI: 10.1002/asi
archives are brought to databases directly from web searches Unfortunately, from these respondents’ comments it is
(Hill, 2004; Prom, 2011). The pages to which users are first unclear whether the collections were a part of a library’s
linked are not necessarily the home page of a digital project digital collections or a database to which the library
or the cover page of a collection. Fragmented information in subscribed.
each page of digital items could be reengineered to better Respondents once again mentioned typical methods of
serve those who do not have much contextual information information-seeking identified in previous studies (i.e., the
about the whole collection. This phenomenon of search use of their colleagues and the citations of publications) as a
engines being research tools requires further attention. way to find specific digital archival materials. Respondent 5
Search engines do not grant access to all resources available pointed out that knowing his colleague contributed to a
on the web, and neither is everything available on the web. digital collection gave him respect for the collection’s cre-
The cutting-edge technology and new digital culture in his- dentials. He said of his discovery, “Constitutions Online, I
torical research may have increased historians’ expectations found doing an online search; the fact that a colleague is one
to be able to conduct complete research online and with of the contributors gave me additional confidence in using
digital technologies (Jordanova, 2006). However, something it.” This may signify that, for historians, the credentials of
that is not searched by search engines could still exist, and digital collections also come from the confirmation of peer
there is always more information available in the physical researchers. In fact, some digital projects have been imple-
world than in the digital world (Sandle, 2013). In this sense, mented with the collaboration of historians and other field
information professionals need not only to promote digital experts in various phases during the process, including
content but also to educate users about the advantages and selection, metadata creation, evaluation, and so on. If
risks of researching with online tools and the potential ben- involvement of peers added value to digital collections, it is
efits of using hidden or physical collections. an important aspect that cannot be overlooked by digital
Many researchers conduct studies based on prior work, project developers. When considering possible collabora-
and historians appear to be no exception. Historians’ previ- tions, digital project developers can work with a collection’s
ous knowledge, and especially their knowledge about target audience.
primary sources, proved to be a great asset for their current Historians also showed very active behaviors in pursuing
studies. Several historians said they already knew about the information. Two historians said their information came
digital collection they used and were aware of the potential from the personnel of providing institutions. Respondent 17
that useful items would exist in the digital collection used a “contact us” link in cases of Getty Images and Corbis
(Respondents 5, 15, and 18). In some cases, they knew about database. It is interesting to note that, in addition to using
the institution and its holdings but did not particularly both footnotes and institutional websites during his research,
realize a known institution had valuable digital collections Respondent 19 also used a social network application (aca-
until checking it for possible materials. Respondent 11 demia.edu). This reflects the growing influence of the Web
described how he1 conducted “a search through the websites 2.0 environment.
of institutions I knew to be relevant whether or not I knew
that they had digitalized their collections.” Many historians
said they did not remember precisely how they became Experiences With Digital Collections
acquainted with the particular sources they used in their
When historians were asked about their experiences
current AHR publication, and one respondent particularly
with the digital collections they used, they gave various
mentioned:
responses. Some said searching and browsing experiences
were extremely easy, simple, and straightforward. Others
Some are sources I’ve worked with for a longtime. For example,
the Portal de Archivos Españoles (PARES) allows you to search
answered that they were tedious and time consuming and that
for documents in multiple Spanish archives, with a subset of they wished to find good resources serendipitously with less
those available in digital format. I learned about that source years effort. Because many different digital archival collections
ago while doing research in Spanish archives. (Respondent 5) were discussed in this study, the reporting of differing expe-
riences may be natural. Some historians mentioned that their
Four historians mentioned libraries as one of the venues experiences were not too difficult because they had prior
in which they looked for digital archival materials. Digital experience using digital collections. Respondent 11 said he
items were found by searches in libraries’ databases or web- “had a great deal of previous knowledge concerning archival
sites. Respondent 4 described how he collected digital items, and museum holdings, which greatly facilitated the process.”
stating, “Most are collected alphabetically or by field in Other historians hinted at a learning curve; one respondent
online library databases.” Respondent 5 also mentioned a described the following:
digital source (America’s Historical Newspapers) provided
by his institution. The Transatlantic Slave Trade Database is not an “intuitive”
research tool. One has to have some previous historical knowl-
edge to really make it do useful/interesting work. Moreover, one
1
All respondents are referred to as “he” (without reference to gender) to has to familiarize oneself with the various search fields, which
ensure consistency and anonymity. can take some time. (Respondent 15)

1800 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014
DOI: 10.1002/asi
Not surprisingly, historians shared their negative experi- Respondents also shared many good experiences that
ences enthusiastically. Many mentioned deficiencies in a they had with digital archival collections. Many comments
system’s general usability, such as ineffective searching, about their positive experiences were centered around the
browsing, navigating functionalities, and retrieval/display speed and ease of use involved with searching and browsing.
interfaces. Others were concerned about the poor quality of Many mentioned that digital collections saved them time
digital images (Respondents 1, 5, 18, and 19). A few also and effort; otherwise, they would have had to make a visit to
voiced a fear that digital resources are insufficient and lack a library or an archive for research. Respondent 13 said, “It
diversity (Respondents 5, 6, and 13). The absence of a func- takes about 15 seconds to find them on line, as opposed to
tion to submit reference questions or otherwise interact with the time going to the library, etc., to get them on paper.
an archivist or librarian online was a barrier for some histo- Finding a particular passage is also easy with keyword
rians (Respondents 9, 10, and 19). A further complaint by searching.” Historians also acknowledged that digital collec-
historians was that they wanted to have the text in images tions were much more convenient and made it easier to skim
searchable (Respondents 2 and 5). This is interesting through a large amount of information. Respondent 2
because searchable text is a potential bonus feature of digi- addressed how image collections helped him identify par-
tized archival materials and cannot be found in original ticular illustrations at a glance when he said, “I sometimes
primary sources. Such a complaint seems to demonstrate find material, especially illustrations that I might not have
that historians are buying into the usefulness of digital found otherwise. It is a fast and easy way to browse lots of
resources. The treatment of the individual pages making up images. Because similar kinds of images get grouped
a multiple-paged item as individual files was considered to together, one sometimes stumbles across texts or images that
be particularly inefficient by Respondent 3, who remarked one would not have discovered elsewhere.” Historians men-
that “page by page downloads of digital documents is tioned that intuitive searching and browsing, the ability to
annoying, and generates fragmentary files. No standard create one’s own library, the mechanisms of zooming and
naming conventions.” Historians further commented about flipping pages, and some features available for advanced
incorrect or scarce descriptions in cataloging, as well as the browsing and discovery in systems were particularly useful
lack of contextual information surrounding individual items. functions. Respondent 5 recounted the following:
Respondent 5 commented on inconsistent functionalities in
PARES, which is a system consisting of an aggregated data- One can do a keyword search and find something useful. Then
base with multiple collections and sources: on the suspicion that the bundle might have more material, one
can change the search method (what they call a dynamic search)
PARES which is great, does not have a uniform system for and browse the contents of the whole legajo [files]. Amazing.
doing searches by archival reference, so that each archive (Respondent 5)
included in the database uses it’s [sic] own “grammar.”
(Respondent 5)
Just as with the difficulties mentioned, many benefits that
Another mentioned difficulty was the hardship historians digital collections have brought to historians were connected
had to undergo to receive permission to publish digital to digital technologies. On the positive side, digital technolo-
sources in an article (Respondent 11). A well-developed gies allowed historians fast and easy access to primary
system was also a target for complaint by some respondents resources. The content of digital collections is an important
when it served a range of users with different levels of matter for historians, but their impressions of an archival
knowledge spanning from novice to expert. The complaint collection’s ease of use seemed to be shaped by the system
was that a sophisticated system may be less useful than less and technologies to a certain extent. Thus, despite the tech-
complex systems to nonexpert users. Respondent 15 com- nological difficulties, the good content of digital archival
mented on a complex database that “it’s invaluable for collections is sufficient for historians to make use of them.
researchers like me, but less so for my undergraduates or However, the general perceptions of usefulness and ease of
regular folks just trying to access basic information on the use come from technological capability. Both good content
slave trade.” and technological efficiency appear critical determinants of
Most of the difficulties that historians articulated were historians’ willingness to use digital archives.
technological and included difficulties regarding searching,
browsing, and downloading rather than archival and concep-
The Values of Digital Archival Collections
tual difficulties, which would have been inherent to archival
descriptions. It was also interesting to see how historians The advantages digital archival materials provided intel-
shared challenges they experienced while using popular lectually were highly respected by historians. Of 21 respon-
digital archival collections. Slave Voyages: Trans-Atlantic dents, 20 agreed that digital materials provided a good
Slave Trade Database, for example, was mentioned by his- source of relevant content to their particular article topics.
torians discussing difficulties, but it is the most popularly The value of digital materials as an enrichment tool for their
used database for its topic (Sinn, 2012). This seems to indi- argument and/or interpretation was the next most popular
cate that the benefits of good content outweigh the difficul- answer, being mentioned by 10 respondents. The rareness
ties a system may have. and uniqueness of digital items were also considered worth

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1801
DOI: 10.1002/asi
mentioning by nine respondents. Seven historians answered Another reason historians preferred original sources was
that they used digital collections for the uniqueness of an because their physicality sometimes embodies the qualities
image, and not just for textual information. Two other that made them special. Respondent 9 preferred the “origi-
historians used figures from digital collections for their nal in cases where some quality of the original makes it
artistic value. Other respondents pointed out that another special.” Respondent 6 spent time “Looking for marginalia
benefit of digital archival resources is that they illustrate a in particular copies,” so original documents were important
certain event or broader social activity that the authors to his work. A historian commented that the citation format
described in their articles. Respondent 12 used images for the primary materials was easier to use was another
in this way, explaining how “the images I used in my reason he avoided citing digital materials when possible
article were illustrative. They allowed readers to visualize (Respondent 5). Some historians mentioned they used a
events I was describing, adding texture and nuance to my digital copy as a supplementary source. Respondent 16 said,
argument.” “The search for digital collections was never my priority —
Respondent 15’s use of digital materials was somewhat in many ways I began with the more traditional print and
different. He said, “The piece of data used for the AHR piece manuscript archives,” but he added searching for digital
was a quantitative piece useful in illustrating broader social/ collections “was a supplemental step at each stage.” Simi-
cultural trends I described in the article.” larly, Respondent 13 stated, “In this particular case, I used it
As previous studies have discovered, historians’ first to supplement the source or the literature I already had
preference for source materials is those in their original found.”
forms. When comparing the values of digital content to the Digital formats were useful to historians for several
original physical items, historians had mixed feelings about reasons. Some historians articulated that digital archival
the value of digital sources. Some did not accept the digital materials allow them to easily access and check content and
primary sources as the same as the original artifacts, even quotations after they had already looked at its original form.
though they accepted that the former facilitated their histori- One of the respondents explained that, “Many of the mate-
cal research by providing valuable information quickly and rials I used I had consulted in research libraries in their
easily. Respondents 18’s and 2’s comments below represent original form. I use digital archival collections primarily to
this viewpoint: check quotations, to review sections of the book I might not
have noticed before, to reread” (Respondent 2).
No, digital copies are NEVER [emphasis original] the same, but There were also historians who thought digital content
they are very, very useful. I have been involved in creating was as critical as traditional primary sources for their par-
digital archives at my home institution. They allow much ticular research. Several mentioned that they searched for
broader access, but in teaching I often ask students to work both digital sources routinely during their research processes just
with digital copies and originals and have then describe the the same as they did for primary materials in their original
advantages and disadvantages of each. It is important that we
forms (Respondents 1, 15, 16, and 19). Respondent 19 in
not think of digitization as a substitute for original materials.
particular said, “I use digital sources at the same time that I
These need to be preserved and remain accessible for research
(by students as well as scholars, where appropriate). (Respon- use more traditional hard copy sources, so they are com-
dent 18) pletely integrated into my research.” Respondent 7 even said
of digital materials, “If possible, I accessed them on line or
I think that digital copies are invaluable scholarly resources, but had material scanned by the archive. When that wasn’t an
I definitely do not see digital copies as substituting for originals. option, I went to the archive.” Meanwhile, Respondent 21
Too much valuable information would be lost if we had only declared, “Some of the original documents available digi-
digitized versions. (Respondent 2) tally are transformative for research on foreign policy.” Also
praising the invaluable potential of digital resources,
The respondents pointed out several reasons why histo- Respondent 3 believes “DNSA [Digital National Security
rians would choose the original format to cite in publications Archive] is especially important for their advocacy in
when a digital copy is available. Historians said they would getting the material in the first place.”
cite the original primary materials because they believed the As stated previously, historians showed diverse responses
original items are more authoritative than digital copies. toward digital materials for their research. In our survey, we
Respondent 2, for example, stated that original forms of asked the respondent to rate their level of skill with digital
primary resources were “authoritative for many scholars,” technology. The question was intended to correlate technical
and Respondent 4 put forth them as “the accepted edition of skills and use of digital collections. However, no particular
primary source material, including the scholarly apparatus: pattern was identified. Several historians who reported high
footnotes, glossaries, and so forth.” Traditional historical technology skill said something negative about digital col-
training puts special value on original materials. Respondent lections, whereas respondents from a low technology skilled
12 directly supported this conclusion that, “As a historian, I group spoke in favor of them. Our survey did not have any
am trained always to prefer the source closest to the origi- demographic questions, so there is no clear evidence
nal.” Respondent 18 similarly admitted, “I almost always whether such differences relate demographic factors (e.g.,
cite originals if they exist.” age, gender, schools and training, other social elements,

1802 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014
DOI: 10.1002/asi
etc.). As Riley (2013) previously pointed out the new gen- types of primary materials that historians wished to see
eration of historians who enter the history scholarship in digitized in larger numbers include German history, South
recent years may have different perceptions about authori- Asian studies, African studies, local newspapers and maps,
tative archival and library research due to the abundant infor- and 19th- and early-20th-century medical journals. Histori-
mation in digital forms through easy web services. In future ans had some interesting comments about their wishes for
research, digital historical scholarship can be studied more digital projects, such as “I wish every archive and every
rigorously from such perspectives of who these historians newspaper, magazine, and book ever published were avail-
are and what training/perceptions they have for the new able online” (Respondent 15) and “I would like to see more
types of historical studies. routine conversion of older microfilm collections when not
Many historians perceived digital collections as a whole superseded” (Respondent 3).
to be influential beyond their immediate usefulness to the It is notable that many historians wanted more diverse
articles that they wrote. A majority of respondents (19 of 20) coverage than was currently available would be included in
who were asked, “Did the digital archival collections you digital archival collections, including those who worried
searched provide good content and valuable resources col- about the disadvantages of not being able to investigate
lectively in general (beyond the cited digital item)?” original artifacts where they are housed. The suspicion that
responded to it very positively. It seems that although histo- digital copies may not the same as the originals seemed to be
rians may view particular citations in publications as changing. This change is also hinted at in Rutner and
“supplementary” in the sense that they provide easy access Schonfeld’s (2012) study, as they reported some historians
to historians and readers, the existence of digital materials in they interviewed completed research projects by working
general greatly assisted historians during their planning and with only the digital forms of primary sources. Among the
studying of a topic. Respondent 16 recognized the potential barriers of using digital archival collections, languages were
of digital archival collections when he wrote, “The digital not included by respondents. In fact, many digital collections
archival collection in question provided an excellent range in a foreign language or multilingual, or maintained by
of sources, useful to my work beyond the immediate needs foreign institutions, were referenced in these articles of AHR
of my AHR article.” (Sinn, 2013). Historians wished to see materials in wider
The reason why historians chose digital formats to cite in geographical and temporal coverage be digitized. The
publications when they had the option of choosing between absence of foreign language materials and nontextual
digital and original formats was clear when it came to pro- materials in digital collections of contemporary academic
viding “ease of access.” The accessibility was important not resources has already been acknowledged by previous
only for historians to locate important primary materials research (Rutner & Schonfeld, 2012). In this sense, interna-
with the least effort, but also for readers to identify and tional collaboration could also be encouraged, especially for
check the sources that the historians used. The authenticity those materials that are accessible only through particular
of historical research could be proved to some extent if institutions. The active announcement of existing resources
historians provided an easy method for others to check their that are available abroad would also be helpful to historians.
sources. Historians, therefore, saw the major benefit of Librarians and archivists could work at creating subject
digital collections to be their accessibility, and this was seen guides for digital resources from multiple repositories in this
as improving the presentation of their research. Respondent respect.
17 added that citations of digital materials provide “acces- As acknowledged, the impact of digital archival collec-
sibility for readers wanting to check the sources.” According tions on historical research has been significant. Historians
to Respondent 3, digital archival collections “allow for thought digital archival collections were invaluable sources
readers to confirm your sources and hence your arguments.” for their research. Some historians even showed changed
In this sense, digital archival collections seemed to offer a information behavior patterns and began to search for digi-
newer method to allow readers to check the quality of pub- tally available sources and original primary materials
lications while, somewhat ironically, historians were person- simultaneously. The changes in historians’ information
ally suspicious of a digital source’s authority compared to behavior patterns are not limited to the digitally available
the authority of an original document. primary resources, but occur alongside the general cultural
When historians needed materials, they showed very changes brought about by the web. As the web culture and
active behaviors in acquiring them whether they were digital newer research trends of historians affect their work pat-
or not. If digital copies were not available in high-quality terns with digital collections, it is important that informa-
images, historians made the effort to acquire those with tion professionals consider the broad trend changes when
good quality directly from repositories. They also contacted designing and implementing digital projects. By doing so,
librarians and archivists or service personnel in the company digital archivists will best serve their users by facilitating
that provided resources to seek for help. Historians did not their involvement with the digital information that digital
mind paying a reasonable fee for the service or for the copies archives provide.
of images that they obtained. Respondents agreed with the prevailing academic
All 21 respondents said they would look for digital archi- approach within the history field that authoritative informa-
val collections for their future studies. Some of the areas and tion for historical research is materials in their original

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1803
DOI: 10.1002/asi
forms. this widely held view of historians obviously corre- problem thus sort of emerged from the sources which I’d con-
sponds with the results of previous studies (Rutner & sulted for other reasons. (Respondent 13)
Schonfeld, 2012). Considering that many historians wanted
to have more diverse resources available in digital formats Historians talked about how materials they found during
despite having used digital collections as supplementary other projects were useful for their AHR articles. One of
support for their AHR articles, it is safe to conclude that these historians said, “The AHR essay used parts of two
historians harbor two differing perceptions about digital book projects for which I have made very extensive use of
archival collections: when using them for acquiring knowl- digital collections. I didn’t need more archives for this
edge, digital collections are essential, but when citing essay” (Respondent 11).
sources for a publication, digital collections are supplemen- In the particular research process historians used for their
tary. The usefulness of digital collections has two dimen- AHR articles, they showed a wide spectrum of involvement
sions: one involves using digital collections and the content with digital archival collection. Some used digital collec-
of digital items for their own knowledge-building (which is tions from the preliminary stage, whereas for others the use
easily done through the digital platform), and the other of digital collections came later. Respondent 1 “used some
involves using digital collections to allow readers to conve- digital texts during primary research. Later, having written
niently check what they cited (which is a way to show that my article, I went searching for images to assist with pre-
their research is academically accountable). sentation.” Respondent 12’s circumstances led him to search
for images after writing the article because, as he describes,
“I researched and wrote the article before I knew that it was
possible to include images. As a result my research for
Research Patterns and Information Behavior
images did not interact with the earlier data collection or
Some historians stated that they found additional digital analysis and interpretation.” Respondent 17 also looked for
archival collections during their research process but did not digital resources in the late stages of his work “after the
use them in their particular article of AHR. Respondent 9 research had been done and the writing was in its final
claimed, “the Leo Baeck Institute in New York has fantastic stages.”
digital materials. I will include these in future publications.” Peter Uva (1977) used a five-stage process to describe
Respondent 16 said of digital materials that there are historical work: (a) problem selection (including prelimi-
“Plenty — I will be including them in other publications. nary work and hypotheses), (b) detailed planning of data
These include digitized documents on the websites of collection, (c) data collection, (d) analysis and interpretation
the UK’s National Archives and the National Archives of of data, and (e) presentation of findings. When asked about
Singapore.” Historians discovered potentially useful digital the use of digital archival materials according to these
collections in the process of research, even though they may stages, many historians mentioned multiple stages of histori-
not be necessarily relevant to their current project. In other cal research, and they consulted digital collections in all of
words, searching and finding digital archival collections the stages as a whole. There were certain stages that histo-
occurred across research projects, not separately and inde- rians referenced more than others. Respondents identified
pendently by project. The information historians find about steps 3 through 5 as being the most central to their digital
digital collections could become “prior knowledge” when archival research. Five historians mentioned steps 1 and 2 as
the time comes for them to begin their next projects. the stages they looked for digital collections, whereas steps
Random web searches allow historians seeking information 3, 4, and 5 were mentioned by 11, 8, and 10 historians,
to stumble across potentially useful digital sources for mul- respectively, as a phase that involves the use of digital
tiple projects simultaneously. collections.
Similarly, historians responded to work on multiple proj- Some stated that they did not even think primary sources
ects at the same time or on a larger project from which they counted as data for (an objective of) a historical study.
would publish a book or multiple essays. Thus, finding rel- Instead, they thought that the process of understanding and
evant digital archival collections was not isolated by an interpreting primary sources was the historical research
immediate information need for a certain project. The infor- process itself. Identifying research problems and finding
mation seeking was more likely associated with a complex primary sources (whether digital or physical) are not sepa-
research process. When historians looked for digital infor- rable processes to historians who believe identifying and
mation they were apt to be open to viewing any potential studying primary sources is the process of refining research
information that they could utilize broadly or for other proj- questions. Respondents expressed how their research pro-
ects. Respondent 13’s article seemed to emerge in this way; cesses were interwoven with consulting digital collections,
he explains how in the following: as follows:

This article emerged from research I was doing for a book, and In all five. . . . Historical research is not quite this linear—it
was an attempt to sketch out the broad outlines of the historical loops back and forth from primary sources (I don’t think
problem once I was immersed in the archives. A need to pull of these materials as “data”) to interpretive strategies. (Respon-
back, in a sense, to make sense of what I was finding. The dent 18)

1804 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014
DOI: 10.1002/asi
Because many historians stated that they consulted TABLE 2. Factors that influence the use of digital archival collections.
digital collections from the phase of the problem selection to Would there be any additional factors that may affect
data collection, to data analysis (interpretation) and presen- your use of digital archival collections? (Respondents Response
tation (writing), their perception of the “use” of digital archi- could select multiple answers.) count
val collections seemed to be related to consulting and The institution that provides digital contents (if digital 14
understanding the sources, rather than simply finding or collections are provided from authoritative
locating them. The involvement of a digital collection in institutions, such as higher education institutions and
historians’ research may be interpreted in a variety of ways. well-established museums, or by individuals or
The phrase, “use of digital collections” may mean “looking small private organizations)
Formats of digital contents (if they are html text or 13
for possible materials” to some, but “finding the relevant high quality digital images)
intellectual content in materials,” “understanding and inter- Characteristics of a journal that you consider to 8
preting of primary digital materials,” or “presenting materi- publish (conservative or liberal in accepting
als in the paper” to others. What historians mean by “use of unconventional materials)
a digital collection” may be different from what information Using a different research method (not using primary 1
sources)
scientists understand by the phrase. When they study the Others: 4
usage patterns of information, information professionals “The issue of reproduction rights and costs is a huge
often focus on how users find, search for, locate, and access issue for images, digital and otherwise.”
materials. Future studies should clarify which aspect of “I prefer scanned images as a general rule.”
“use” they intend to analyze. “Some archives are ONLY [emphasis original]
accessible via institutional subscribers (e.g. State
Many respondents stated that their research did not Papers Online and the Cecil Papers).”
follow the five stages that Uva described. Instead, they said “I would use digital content only from authoritative
their research process was not top-down and was rather sources—which are highly regarded in the field.”
multidirectional, and that they repeated some stages.
Respondent 13 called it “much more haphazard,” Respon-
dent 2 said it is “not sequentially distinct,” Respondent 16
warned that it is “not necessarily systematic or easily broken
down,” and Respondent 3 voiced that it is “less top-down
and more evolving.” The respondents considered the stages not yet as geographically representative as it might be.”
in the research process to be indistinguishable and non- Respondent 5 complained about the “poor digital quality of
chronological, therefore preventing digital archival collec- images—on things like America’s Historical Newspapers”
tions being connected to any of Uva’s particular stages. where “Character recognition doesn’t work.” Respondent 4
stated, “generally, the process of digitizing seems to be done
Factors Affecting the Use of Digital Archival Collections by hourly employees, whereas the process of editing and
publishing primary sources was the work of teams of
The presentation of citations can be influenced by many scholars. Very different.”
factors, such as the customs of an academic field, external As discussed above, historians are traditionally trained to
factors related to specific requirements in publishing jour- use original primary sources as the method for conducting
nals, or the formats and authenticity required for internal historical research. Thus, the field’s norms regarding
factors by digital resources. Table 2 presents the influencing primary materials seemed to affect which sources historians
factors for historians’ use of digital archival collections. cited. Respondent 16 described this as a “prejudice among
As Table 2 shows, the most influential questions histori- more conservative scholars against using digital collections”
ans asked themselves when considering whether or not to but this view “might be changing.” Respondent 4 agreed
use digital collections were who created the collection and that,
how authentic it was. Historians seemed to consider the
digital resources from an authoritative institution more reli- Yes—in general, my field prefers to cite a range of commonly
able and authentic as historical source materials than those found print sources for primary sources. Online databases of
from lesser-known entities. Respondent 18 described his those are more useful for teaching as a result. It’s possible that
routine of only using “digital archives which are fully docu- over time, fewer of us will refer back to the definitive scholarly
mented. I need to know where things come from.” editions of early texts and manuscripts. (Respondent 4)
The characteristics of digital collections themselves were
another important factor. The content, scope (whether the Respondent 17 added that using original sources implies
materials represent all areas of a given topic), format more work has been done because it “demonstrates that the
(whether the materials are in text format such as html or an historian has been on-the-spot—which generally implies a
aggregated database), and quality (whether the materials deeper knowledge of the country, culture, history.” Never-
were high-quality digital images) of the collections were theless, some historians mentioned that digital archival col-
also important matters to historians. Respondent 18 noted lections could have the same value as originals, as described
that “the Quilt Index often has poor quality images and is below:

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1805
DOI: 10.1002/asi
Truly excellent digital copies made by authoritative procedures them to their students and colleagues. Respondent 16 com-
seem to me as good as, and sometimes better than, originals. mented he had become more and more of a convert when it
(Respondent 6) comes to the usefulness of digital archival collections, stating
“I am increasingly of the view that digital archival collections
Historians, no matter whether they prefer original forms are hugely important to historians. I encourage my students to
of primary materials or digital collections, are similarly con- use them as much as possible.” Respondent 1 even believed
cerned about the disadvantages that accompany doing that digital collections “are the future. In relation to search-
research exclusively with digital content. Digital content able newspaper and periodical data bases, I am now able to do
cannot provide field experience, which is considered a part kinds of research I would not previously have contemplated
of the authoritative historical research method. Respondent because of the time & effort required.” Respondent 20 went
15 explained this as follows: “the downside is that ‘field’ so far as to say, “obviously, digital collections are now
experience may be lost. Seeing, smelling, touching the docu- essential to all serious historical research,” as his comments
ments, objects, and places that our historical subjects knew may indicate that digital collections as not only the future, but
provides crucial insights that digital documents cannot.” The the present for academic researchers.
inability of digital collections to provide field experience is
a limitation that may further prevent some historians from
Nonusers of Digital Archival Collections
interacting with digitized primary sources. Despite this,
digitized archives still have the potential to reach a far Since we suspected certain citations may have come from
greater number of scholars than original materials stored the originals because of the inconsistent citation format for
away in traditional archival collections. Another historian digital resources in the journal, we created a few questions
shared a similar thought, stating: for those who did not use digital collections. The invitation
to the online survey included two links, one leading to the
Digital copies are tremendously important but they do not survey for digital collection users and the other leading to
replace the originals. They obviously enable access by a far the survey for nonusers. Eight historians participated in the
larger community of scholars and can greatly reduce the costs nonuser survey. Of the possible reasons why they did not use
of research (by reducing or eliminating travel costs). Informa-
digital archival collections, the one selected by seven histo-
tion is, however, inevitably lost. Handling originals gives one a
rians was that there were no digital archival collections
“sense” of a document that is irreplaceable. (Respondent 11)
available for their particular research topics. Two said they
used online catalogs and/or finding aids, but that the actual
Respondent 14 stated some additional advantages and dis-
content of materials was not digitized. Another respondent
advantages associated with digital collections:
commented that, “I used the online catalogues of the British
a) Same in 2-dimensions—the document is the same either way. Library before going there to use the documents, which are
b) No chance to interact with others at the archive; no only available there.” As mentioned earlier, we checked
e-community in the digital archive. c) I am disabled (mobility cited materials in their digital collections when we won-
problems) so it’s great to be able to access the material from my dered if the citations referred to digital sources, and we
study. (Respondent 14) confirmed that the cited materials are available in a digital
collection. One explanation for nonusers’ claims that no
Historians use informal channels to find information: digital materials existed may be that such digital collections
they find interacting with other researchers in archives and were developed after the articles were published. However,
talking to archivist (creating an anecdotal research commu- the paradox may also indicate historians’ lack of awareness
nity) useful in exploring additional information and sources. about the existing digital sources. Another historian men-
In the digital environment, such a community is not easily tioned that he found some digital archival collections related
available, which can be another disadvantage of digital to his research topic and used them during the research, but
content. These examples show that the general norms to those materials were not appropraite to include in citations.
conduct research studies, to write research findings, and to This historian chose to cite the original form of primary
present citations and references in academia were important sources when the digital copy was available.
elements that determined historians’ usage patterns of For their future studies, seven historians said they
digital archival collections. would use and cite digital archival collections if there was
While they had varying perceptions about the value of anything available on their topics. The one remaining
digital collections, many respondents recognized the changes selected the answer that “I am not aware of the availability
in historical research patterns. Respondent 11 also stated that of digital primary resources and would like to learn more
“Digital copies of archival collections are invaluable sources about them.” This respondent added a comment that “I use
for historians; they are revolutionizing our profession. . . . I a lot of 19th century printed Urdu materials that are not
now consider searching for digital archives and images a digitized but some are and I’ve downloaded a few books
necessary and obvious part of the research process.” Then digitized from Indian collections.” This historian utilized
historians noticed that they not only found such materials to digital collections and still wished to learn about more
be significant to their research, but that they also promoted digitally available sources.

1806 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014
DOI: 10.1002/asi
Conclusion Conway, P. (2010). Modes of seeing: Digitized photographic archives and
the experienced users. The American Archivist, 73, 425–462.
This study attempted to draw a picture about the general Czeck, R.L.H. (1998). Archival MARC records and finding aids in the
paths historians took to find and locate digital archival col- context of end-user subject access to archival collections. The American
lections and to discover from an empirical standpoint the Archivist, 61, 426–440.
Dalton, M.S., & Charnigo, L. (2004). Historians and their information
impacts of such collections on historians’ studies. It sur- sources. College & Research Libraries, 65(5), 400–425.
veyed the historians’ utilization of digital archival collec- Daniels, M.G., & Yakel, E. (2010). See and you may find: Successful
tions for projects, which finally were published by the search in online finding aid systems. The American Archivist, 73, 535–
American Historical Review. The findings of the study shed 568.
light on the digital collection use, such as the reasons why Duff, W.M., Craig, B., & Cherry, J.M. (2004a). Finding and using archival
resources: A cross-Canada survey of historians studying Canadian
historians considered using and not using them, while also history. Archivaria, 58, 51–80.
revealing some benefits and barriers historians experienced Duff, W.M., Craig, B., & Cherry, J.M. (2004b). Historians’ use of archival
when using digital materials. This study found that histori- sources: Promises and pitfalls of the digital age. The Public Historian,
ans showed the same general research behaviors when 26(2), 7–22.
seeking and using a digital archival collection that they used, Duff, W.M., & Johnson, C.A. (2002). Accidentally found on purpose:
Information-seeking behavior of historians in archives. The Library
according to previous studies, when seeking and using origi- Quarterly, 72(4), 472–496.
nal materials. However, this study also found that there Duff, W.M., & Stoyanova, P. (1998). Transforming the crazy quilt:
appeared to be a shift in historians’ treatment of digital Archival displays from the users point of view. Archivaria, 45, 44–
archives and their perceptions regarding the value of digital 79.
contents. The shift has been gradual, but historians who Elena, T., Katifori, A., Vassilakis, C., Lepouras, G., & Halatsis, C. (2010).
Historical research in archives: User methodology and supporting tools.
initially considered primary source materials worthier than Journal of Digital Library, 11, 25–36.
materials from digital archives were beginning to see digital Elliot, C.A. (1981). Citation patterns and documentation. The American
archival sources as invaluable to their work, even if original Archivist, 44(2), 131–142.
primary source materials constitute the ideal. The change is Feeney, K. (1999). Retrieval of archival finding aids using world-wide-web
also related to the different kinds of values that digital forms search engines. The American Archivist, 62, 206–228.
Gordon, A.D. (1992). Using the nation’s documentary heritage: The report
provide, such as easy browsing, search functionalities and of the Historical Documents Study. Washington, DC: National Historical
speedy accessibility. These newly identified behaviors and Publications and Records Commission.
perceptions of historians who use digital archives and their Górny, M., & Mazurek, J. (2012). Key users of Polish digital libraries.
materials can be used to help information scientists and Electronic Library, 30(4), 543–556.
archivists cater to their users’ needs, and also provide the Graham, S. (2002). Historians and electronic resources: Patterns and use.
Journal of the Association for History and Computing, 5(2). Retrieved
groundwork for future studies. from http://hdl.handle.net/2027/spo.3310410.0005.201
Hamburger, S. (2004). How researchers search for manuscript and archival
collections. Journal of Archival Organization, 2(1/2), 79–102.
References
Hill, A. (2004). Serving the invisible researcher: Meeting the needs of
Altman, B., & Nemmers, J.R. (2001). The usability of on-line archival online users. Journal of the Society of Archivists, 25(2), 139–148.
resources: The Polaris Project Finding Aid. The American Archivist, 61, Hirtle, P. (2002). The impact of digitization on special collections in librar-
121–131. ies. Library and the Cultural Record, 37(1), 42–52.
Anderson, I.G. (2004). Are you being served? Historians and the search for Hitchcock, E.R. (1989). Materials used in the research of state history: A
primary sources. Archivaria, 58, 81–129. citation analysis of the 1986 Tennessee Historical Quarterly. Collection
Anderson, J.E. (2009). Using professional forums to assess historians’ Building, 10(1/2), 52–54.
e-resource needs. Collection Building, 28(1), 4–8. Jones, C., Chapman, M., & Woods, P.C. (1972). The characteristics
Assadi, H., Beauvisage, T., Lupovici, C., & Cloarec, T. (2003). Users and of the literature used by historians. Journal of Librarianship, 137–
uses of online digital libraries in France. Bibliothèque Nationale de 156.
France. Retrieved from http://www.bnf.fr/documents/bibusages Jordanova, L. (2006). History in practice. London: Hodder Arnold.
_ecdl2003.pdf Katifori, A., Elena, T., Vassilakis, C., & Halatsis, C. (2008). Supporting
Beattie, D.L. (1989). An archival user study: Researchers in the field of research in historical archives: Historical information visualization and
women’s history. Archivaria, 29, 33–50. modeling requirements. In Proceedings of the 12th International Con-
Blais, G., & Enns, D. (1993). From paper archives to people archives: ference Information Visualization IV 08 (pp. 32–37). London.
Public programming in the management of archives. In T. Nesmith (Ed.), Lowe, M.S. (2003). Reference analysis of the American Historical Review.
Canadian archival studies and rediscovery of provenance (pp. 443–459). Collection Building, 22(1), 13–20.
Metuchen, NJ: Scarecrow. Maher, W.J. (1986). The use of user studies. Midwestern Archivist, 11(1),
Brubaker, J. (2005). Primary materials used by Illinois state history 15–26.
researchers. Illinois Libraries, 85(3), 4–8. Maidment, B. (2013). Writing history with the digital image: A cautious
Burton, O.V. (2005). American digital history. Social Science Computer celebration. In T. Weller (Ed.), History in the digital age (pp. 111–126).
Review, 23, 206–220. New York: Routledge.
Cherry, J.M., & Duff, W.M. (2002). Studying digital library users over time: Maxwell, A. (2010). Digital archives and history research: feedback from
a follow-up survey of Early Canadiana Online. Information Research, an end-user. Library Review, 59(1), 24–39.
7(2). Retrieved from http://informationr.net/ir/7-2/paper123.html McAnally, A.M. (1951). Characteristics of materials used in research in
Cohen, D. (2010). Is Google Good for History? Retrieved from http:// United States History (Unpublished Ph.D. dissertation). Chicago: Uni-
www.dancohen.org/2010/01/07/is-google-good-for-history versity of Chicago.
Conway, P. (1986). Research in presidential libraries: A user survey. Mid- Meissner, D. (1997). First things first: Reengineering finding aids for
western Archivist, 11(1), 33–56. implementation of EAD. The American Archivist, 60(4), 372–387.

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1807
DOI: 10.1002/asi
Miller, F. (1986). Use, appraisal, and research: A case study of social Appendix
history. The American Archivist, 49, 371–392.
NWDA. (2008). Executive summary: Usability test #5. Northwest Digital Questions for authors who used digital
Archives (NWDA). Retrieved from http://www.orbiscascade.org/index/ archival collections
usability-design-working-group-reports
Palmer, C.L., Teffeau, L.C., & Pirmann, C.M. (2009). Scholarly informa-
1. How did you learn about the existence of the digital archival
tion practices in the online environment: Themes from the literature and
implications for library service development. Report commissioned by
collections that you used for your publication(s) in American
OCLC Research. Retrieved from http://www.oclc.org/content/dam/ Historical Review?
research/publications/library/2009/2009-02.pdf a) Advertisement messages (email, other announcement
Prom, C.J. (2004). User interactions with electronic finding aids in a con- messages, etc.)
trolled setting. The American Archivist, 67(2), 234–268. b) News articles or professional magazines
Prom, C.J. (2011). Using web analytics to improve online access to archival c) Learned from a conference (presentations, vendor booths)
resources. The American Archivist, 74, 158–184. d) Heard from a colleague
Pugh, M.J. (1982). The illusion of omniscience: Subject access and the e) Heard from a librarian/archivist/museum curator
reference archivist. The American Archivist, 45(1), 33–44. f) Learned from a citation in a publication
Riley, C.L. (2013). Beyond Ctrl-c, Ctrl-v: Teaching and learning history in
g) I’m involved with the digital project
the digital age. In T. Weller (Ed.), History in the digital age (pp. 149–
169). New York: Routledge.
h) Found from Web searches
Rosenzweig, R. (2006). Can history be open source? Wikipedia and i) Other. Please specify:
the future of the past. The Journal of American History, 93(1), 2. Once you knew about the existence of digital archival
117–146. collections, how was your experience locating them? Please
Rutner, J., & Schonfeld, R.C. (2012). Supporting the changing research place special emphasis on sharing details about your path
practices of historians: Final report from ITHAKA S+R. (i.e., the process you underwent) to find each digital archival
Sandle, M. (2013). Studying the past in the digital age: from tourist to collection?
explorer. In T. Weller (Ed.), History in the digital age (pp. 130–148). 3. How were your specific experiences searching and retrieving
New York: Routledge. digital archival collections? Was it easy, effortful, or accidental
Saracevic, T. (2000). Digital library evaluation: Toward evolution of con-
to find the digital material(s)?
cepts. Library Trends, 49(3), 350–369.
Schaffner, J. (2009). The metadata is the interface: Better description for
4. What were the reasons why you included the particular digital
better discovery of archives and special collections, synthesized from archival item(s) in your publication(s) in American Historical
user studies. Report produced by OCLC Research. Retrieved from http:// Review? Please select all that apply.
www.oclc.org/programs/publications/reports/2009-06.pdf a) The content of the item(s): relevant to your topic
Scheir, W. (2005). First entry: Report on a qualitative exploratory study of b) Rare and unique information: available in the item(s),
novice user experience with online finding aids. Journal of Archival making it worth including
Organization, 3(4), 49–85. c) Enrichment tools: a good example (evidence) for a specific
Sherriff, G. (2010). Information use in history research: A citation argument (interpretation)
analysis of master’s level theses. Portal: Libraries and the Academy, d) Uniqueness as an image
10(2).
e) Artistic value for figures
Sinn, D. (2012). Impact of digital archival collections on historical
research. Journal of American Society for Information Science and
f) Supplemental value for other sources materials
Technology, 63(8), 1521–1537. g) Easy access to the digital format than physical materials for
Sinn, D. (2013). The use context of digital archival collections: Mapping you and for readers
with historical research topics and the content of digital archival collec- h) Other. Please specify:
tions. Preservation, Digital Technology, & Culture, 42(2), 73–86. 5. Did the digital archival collections you searched provide
Southwell, K.L. (2002). How researchers learn of manuscript resources at good content and valuable resources collectively in general
the Western History Collections. Archival Issues, 26(2), 91–109. (beyond the cited digital item)? How helpful was their selec-
Spindler, R.P., & Pearce-Moses, R. (1993). Does AMC mean “archives tion of materials was for your particular study published in
made confusin”? Patron understanding of USMARC AMC catalog the American Historical Review?
records. The American Archivist, 56(2), 330–341.
6. How did you find it helpful to browse individual digital
Stevens, M. (1977). The historian and archival finding aids. Georgia
Archives, 5, 64–74.
items? Did the digital archival collections provide enough
Tibbo, H.R. (1993). Abstracting information retrieval and the humanities: information about the digital items?Peter Uva used a five-
Providing access to historical literature. Chicago: American Library stage process to describe historical work: (1) problem
Association. selection (including preliminary work and hypotheses);
Tibbo, H.R. (2003). Primarily history in America: How U.S. historians (2) detailed planning of data collection; (3) data collection;
search for primary materials at the dawn of the digital age. The American (4) analysis and interpretation of data; and (5) presentation of
Archivist, 66, 9–50. findings (Uva, P.A. 1977. “Information Gathering Habits of
Tibbo, H.R., & Meho, L.I. (2001). Finding finding aids on the world wide Academic Historians: Report of the Pilot Study.” Syracuse,
web. The American Archivist, 64, 61–77. NY: State University of New York, Upstate Medical Center,
Uva, P. (1977). Information gathering habits of academic historians: Report
p. 16). With Uva’s process in mind, please share with us
of the pilot study. Syracuse, NY: Upstate Medical Center, State
University of New York, Syracuse.
about your research procedure for your publication(s) in the
Weller, T. (Ed.). (2013). History in the digital age. New York: Routledge. American Historical Review in relation to searching digital
Yakel, E. (2002). Listening to users. Archival Issues, 26(2), 53–68. archival materials.
Yakel, E. (2004). Encoded archival description: Are finding aids boundary 7. Where did your search for digital archival collections appear
spanners or barriers for users? Journal of Archival Organization, 2(1/2), in these stages? And how the search for digital archival col-
63–77. lections interrelate with each step of research process?

1808 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014
DOI: 10.1002/asi
8. If the research process of your study was different from the 17. Do you consider yourself a skilled digital technology user?
Uva’s description, please share with us your research process a) Yes
and where in this process you sought to use the digital archival b) Probably
collections? c) Neutral
9. Were there any difficulties that you experienced in using d) Not really
digital archival collections? You can use specific examples of e) No
your digital materials.
a) Poor quality of digital images
b) Lack of contextual information of an individual digital item Questions for authors who did not use digital
c) Poor system design for searching and browsing (not user- archival collection
friendly system, little functionalities of browsing and
navigating, etc.) 1. Please share with us the reason why you did not include digital
d) Poor system interface for retrieval and display archival collections for your publication(s) in American Histori-
e) Diverse resources unavailable cal Review. Please select all that apply.
f) Foreign languages in the content were hard to a) There were no digital archival collections available for my
understand particular research topic when I was working on it.
g) Hard to pursue further inquiries beyond the seeing the b) I found some digital archival collections related to my
digital copies of materials (no human experts available, research topic and used them during my research, but they
getting reference services was hard, etc.) were not strongly relevant to include as citations in the
h) Other. Please specify: publication(s).
i) Comments (your specific examples): c) There may have been digital archival collections available at
10. In general, would there be any additional factors that may that time, but I didn’t have time to look for them.
affect your use of digital archival collections? d) There may have been digital archival collections available at
a) Characteristics of a journal that you consider to publish that time, but I didn’t know where and how I search for them
(conservative or liberal in accepting unconventional and/or didn’t have time to learn such skills.
materials) e) My institution provides only a small number of proprietary
b) The institution that provides digital contents (if digital col- digital collections, so the digital materials that I could utilize
lections are provided from authoritative institutions, such were limited.
as higher education institutions and well-established f) I searched for possible digital archival collection on the web
museums, or by individuals or small private organizations) (using web search engines), but I was not able to find any.
c) Using a different research method (not using primary g) I used online catalogs (or online archival finding aids) but
sources much) the actual content of materials was not readily available
d) Formats of digital contents (if they are html text or high digitally.
quality digital images) h) I was not aware of digital primary resources and did not
e) Other. Please specify: think of looking up such materials during my research.
11. In general, how do you see the value of the digital copies of i) Since digital archival collections are not desirable for
archival collections as historical source materials? Do you authentic historical research (because they are not original),
consider digital archival collections the same as the originals if I did not look for them.
the digital copies are created by authoritative procedures? Any j) I found some digital primary resources related to my
opinions on this issue? research topic, but I sought the original document (or arti-
12. When do you have an option to choose either digital materials or fact) for citations, not the digital copy of them.
physical materials (e.g., in case that you have seen both types of k) Other. Please specify:
a material), which one would you cite in your publication? 2. Please select how it is likely or unlikely for you to involve
a) Digital copy. Reason? ____________________________ digital archival collections in your future studies.
b) Original item. Reason? ___________________________ a) I will use and cite digital archival collections if there is
c) Would be different depending on ____________________ anything relevant for my research topic.
13. Were there other digital archival collections you found during b) I will use digital archival collections during the research
your research process but did not include in your publica- process, but I’ll cite only the original item in the publications.
tion(s)? Why? c) I will always look for original items because I can’t be
14. Are there any historical resources you wish to have access certain about the value of digital copies against originals for
digitally online? What are they and why do you see the impor- an authentic historical research study.
tance to have them readily available on the Web? d) I wasn’t aware of the availability of digital primary
15. Would you look for digital archival collections for future resources, and I would like to learn more about them.
research studies? e) I find it difficult to use digital technology to do historical
a) Yes research and this may hinder me from actively utilizing
b) No digital primary resources.
c) Other. Please specify: f) Other. Please specify:
16. How do you define your specific research field within History? 3. How do you define your specialized field within History?

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—September 2014 1809
DOI: 10.1002/asi

You might also like