Professional Documents
Culture Documents
net/publication/301607623
CITATIONS READS
3 455
4 authors, including:
Some of the authors of this publication are also working on these related projects:
REFERENCE MANAGEMENT SOFTWARE (RMS) IN AN ACADEMIC ENVIRONMENT: A SURVEY AT A RESEARCH UNIVERSITY IN MALAYSIA View project
All content following this page was uploaded by Mohammad Osmani on 01 July 2016.
ABSTRACT
Reference Management Software is used by researchers in academics to manage the bibliographic citations
they encounter in their research. With these tools, scholars keep track of the scientific literature they read,
and to facilitate the editing of the scientific papers they write. This study presents the results of a
quantitative survey performed at a research university in Malaysia. The aims of the survey were to observe
how much these softwares are used by the scientific community, to see which softwares are most known
and used, and to find out the reasons and the approaches behind their usage. Manually questionnaire was
distributed to the Master and PhD students at all faculties in Jun 2014. The data collected were analysed
through a constant comparative analysis, and the following categories were drawn: a basic practical
approach to the instrument, the heavy impact of the time factor, the force of habit in scholars, economic
issues, the importance of training and literacy, and the role that the library can have in this stage.
Describing the present situation, the study gives final directions to the libraries to better perform effective
tasks about the matter. This study presented here is the first survey of the actual distribution and usage of
Reference Management Software in a research university in Malaysia. This picture can give an important
glance to Reference Management Software as one of the elements in the academic digital libraries.
Keywords: Reference Management Softwares, Citation Managers, Academic Libraries, Virtual
Collaboration, RMS.
135
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
way a RMS can also become a virtual research offered by the software packages; on the other side,
environment, or a platform for a collaborator [1, 2]. we find papers about library initiatives of training
Recent products inherit the features already adopted and promotion. These two main threads are
in virtual web collaboration networks, such as confirmed by McMinn [5]. Since RMS is practical
academic social bookmarking [3, 4]. tools used in real-case contexts, it is worth to look
Thinking about the role of the RMS in a large at them from the perspective of the users' behaviors
academic institution like the one described above, and their relationship with other digital research
two questions naturally come to mind; (1) What tools. Finally, being this research about the usage of
level of awareness about RMS exists in the RMS, previous similar studies are reviewed.
members of this research university? (2) What are Given this, the present review will be divided
the major trends in the usage of the RMS among into these five areas;
the scholars?
This whole study moves directly from these two 2.1 Technical Aspects
questions. The aims of the study are: (a) To explore
and understand the measurements about the actual The simple technical analysis of the products is
awareness and usage of RMS. (b) To understand very common. A good overlook on the available
the context in which scholars operate when dealing softwares is the Wikipedia entry “Comparison of
with citations and literature management. (c) To reference management software” which is a
provide evidence-based information upon which complete and up-to date list. Specific comparative
libraries can base their strategies about services, studies of features were performed by [6, 7, 8]. The
assistance, and training. column “Internet Resources” of the Public Services
To achieve these aims, the followings objectives Quarterly 6, 2010 [9] offers a range of short
are set to: (1) Verify how much users are informed reviews of different packages: Mendele [10],
about the potentials of RMS. (2) Verify whether Zotero [11], EndNote [12], CiteULike [13],
RMS are used or not, and to what extent. (3) RefWorks [12]. The same approach is provided by
Establish which softwares are the most known and [14, 15].
the most used. (4) Consider and understand the Beside these articles we also find several papers
users' behaviour in dealing with citations. (5) Ask focusing on single packages [16, 17]. This is not
the scholars about the reasons which influence their surprising for new softwares appearing on the
use. market: attention and analysis of the novelty is
normal, and new articles are to be expected as long
2. LITERATURE REVIEW as old softwares develop into new products.
To prepare the ground for a survey about 2.2 Virtual Collaboration
Reference Manager Software at university level, we Another extremely interesting trend that is
consulted all the literature about RMS and citation slowly gaining space in the literature is the
management in academics. We started from some connection between the personal citation
of the main bibliographic databases specialized in management, its opening to the virtual
library and information science: LISA (Library and collaboration and its impact on scientometrics. In a
Information Science Abstracts), and the Library more general perspective which considers a wide
Science journals published by Emerald. We range of digital tools useful to support the scholar's
performed several searches using keywords such as activity, in their article about the approach to digital
Reference Management Software, Citation libraries by researchers, Hull, Pettifer and Kell
Management, and Bibliographic Management; consider RMS as instruments that could enhance
sometimes it was useful to use the name of software both personalization, social networking and
products: EndNote, Zotero, Mendeley, and collaboration, integration and accessibility [18].
RefWorks. We extended the research to more
generic search tools like Google Scholar, ISI Web 2.3 Researchers Behavior
of Knowledge and the Mendeley Database. The A study of RMS cannot ignore the researchers'
database search brought up some articles; simple habits and behaviour. Therefore citation
promotional documents or tutorial guides were not management is often considered in the perspective
considered. of the whole scholar's research process [19, 20],
Literature about RMS focuses mostly on two often compared to other digital tools.
main themes: on one side we find description, Haglund and Olsson [21] find dramatic
comparison and technical analysis of the features evidences among Swedish researchers: “Their
136
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
137
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
138
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
139
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
role of the library. Some don't consider the library product, and asked the university to make it
as a potential support in the matter: “I heard about available. Anyway, this enhanced the presence of a
these tools from other colleagues; I recommend it legal copy of the product in every lab, so the new
to advertise all RMS to be known for others, researchers in need for a RMS often found it
especially in field of Engineering; Practice and self- already available at hand.
teaching are better than any courses”. In at least
five cases, the respondents consider themselves
already skilled enough: “It is easy to use, and no
need to attend workshop”.
4. DATA ANALYSIS
Figure-7. Support Received By The Library
The first objectives were actually achieved by
the questionnaire: to verify how much users are
Table-1. Details of any Support Received by the Library informed about the potentials of RMS; to verify
whether RMS are used or not, and to what extent;
- Libraries provided copies of the to establish which softwares are the most known
EndNote softwares with information, 26 and the most used.
Yes
support, and training sessions.
- Attended a short course on how to use
Awareness is relatively high in terms of
(110) quantity (i.e., the majority of people know about
Mendeley software provided by the
faculties. 12 RMS) but low in terms of quality: very few are the
- Never asked or heard about any known softwares, and low is the relationship
18
initiatives. between knowledge and usage. RMS is used by the
No
- It is easy to use, and no need to attend 83% of users. The questionnaire clearly declares
workshop.
5
(106) EndNote and Mendeley as the most used softwares,
- Heard about these tools from other and a very low range of alternatives: BibTeX,
colleagues. 4
Papers, and Reference Manager, all of them with
incomparable low numbers. For these initial goals,
When asked if they ever suggested the tool to which served the aim of measuring the distribution
others (Figure-8), the majority replied “Yes” (81% of RMS, the numbers basically speak for
against 19%). A minor percentage of the people themselves. The remaining objectives were: to
who follow a research project, even on a master understand users' behavior; to find out the reasons
thesis level, underline the importance of managing behind the use. They were achieved through the
such a tool by suggesting its usage to others. questionnaire, which also helped to understand the
The choice itself of the software is never reasons and put them in the context. The following
problematic: software is chosen because already categories, or concepts, can be drawn from the data
used or suggested by other colleagues or because presented above:
it's dominant in the community. The technological
context is also a key factor: according to the 4.1 Basic Practical Approach
operating systems and word processor used, the For the researchers involved in this survey,
most compliant software is adopted. It is interesting RMS are tools, and nothing more. They are used
in this matter to note how EndNote was often when needed (when writing a paper which requires
already used: that initiative was suggested and a reasonable number of references), they are used in
promoted by professors who already knew the their basic functions, and they need to work fine.
140
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
They are a tool do a job better, so they are not used something new on his own. When this happens, it
for the sake of using them, or for the pleasure, or generally leads to frustrating and unsuccessful
for curiosity. This explains the approach expressed experiences.
in the questionnaire, which shows a very basic need This is shown by the fact that a very low range
underlining its usage. The small set of most used of softwares is actually used, compared the
softwares is a clue for this, too: at this level of softwares known. Finally, the fact that the
mastery of the tool, all the softwares look all the University acquired and distributed licenses of
same; therefore scholars stick to what is already EndNote made the faculties stick with this software
well known and tested. without worrying about other alternatives. Now that
This also emerges about the technological issue: the licenses are not purchased anymore, it will be
participants in the survey don't show interest in the interesting to see how scholars will change their
technological implications of the tool, as long as it approach.
works. This leads to be closed against additional
extended features, or to paradigm changes: the 4.4 Economic issues
ignorance about the world of virtual science and Economic issues are always important, even
networking collaboration explains how little today when selecting software. Especially in these last
scholars are aware of the opportunities provided to years when findings are being cut year by year,
scientists by the web environment. scholars are careful about the way money is spent.
Everything that can save money is welcome: this
4.2 Time Factor applies to softwares as well. The cheaper solution is
Time is a crucial factor in everything. This is preferred. Yet this seems true more on the
strictly correlated to the previous category. No intentions than in the practice: only 13% of the
scholar is willing to spend his time on something participants in the questionnaire actually indicate it
different than his work. Experimentation and as a reason of choice. The habit of already-in-use
curiosity are used for the scientific activity, not for tools is stronger than the need to move on better
writing its results. Therefore, everything additional instruments. Often the economic constraint is not
in the process must speed their work and save time, strong enough to push people to experiment
not the opposite. This applies to all the aspects: alternatives.
choice of a software and discovery, deep
knowledge of its functionalities, training and 4.5 Training and literacy
learning sessions. Some respondents recognize that they need
It is worth noticing that citation management is more information about RMS. Others seem to be
something often deeply rooted in the research confident about their current knowledge, but then
process: yet it is often perceived as an element of they reveal how many useful opportunities they
minor importance, ready to be sacrificed towards don't know. If we compare the answer to the
other needs (such as looking for findings). questionnaire, which says that 49% never received
Overwhelmed with more urgent needs, the or asked any support, which show how basic is the
refinement of technological skills in the research general knowledge of the tools and their
process affects citation management in a very small functionalities, it is clear how impact has the lack
part. It is also true; on the other hand, a more proper of specific training. Even if not stated explicitly,
training on RMS could help saving time. there is need for training and literacy. Results
clearly show how low the awareness is because
4.3 Habit scholars don't know RMS at all and don't have time
A general laziness, or force of habit, prevents to go deeper and improve their skills beyond the
change. Softwares are used for a long time before self-taught basics.
they get changed to new, better performing, There are no common practices in the training
solutions. Even when researchers feel a push for to RMS: even if everyone's story can look the same
change, or they feel unsatisfied with their current (I use it because suggested by a colleague” or “I use
product, the issue is postponed. This attitude it because everybody else in the lab uses it) every
prevents scholars to discover new products or new scholar has his own path to it. The usage of a RMS
features. When a RMS is used, generally it's is more part of a “tacit knowledge” present in the
because a former experience by some colleagues research environment, rather than a conscious part
proves it useful. If the tool is suggested, then a of the set of skills and methods of a researcher. It is
scholar begins to test it and use it; if not, it is very remarkable how every concept examined so far –
unlikely that someone is willing to experiment shallow knowledge, time constraints, and economic
141
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
awareness – can be considered within a set of the keeper of resources anymore, but also the
aimed training initiatives. keeper of bibliographic tools. RMS require a lot of
Given this, a strong condition arises: any kind time and skills that researcher seldom have; a
of training must be tailored to the actual needs. This professional expert in these tools could help the
is heavily connected to the above concepts “Basic scholars guiding them across the wide range of
practical approach” and to the “Time factor”. If packages, across the basic functions, focusing on
RMS serves the purpose of facilitating the research problem-solving activities. This could be an
process and saving time, any training on it must not extremely cost- benefit effective initiative. This
go in the opposite direction. consideration confirms what is said in the literature.
East already noted the relationship between
4.6 Library Role bibliographic support and reference management
From the data collected, it is clear that training. He recognizes the well-established role of
librarians, as information experts, must have a more the library in training researchers in searching
active role in RMS support. But this role must electronic databases and downloading retrieved
consider in the more general context of the library references. From here it was only a short step to
impact in a community. The survey shows that beginning to train researchers in the management of
library staff skills are mostly not perceived, those references [24]. Every library, though,
therefore scholars are alone when they face exists in a specific context, which is not the
reference management issues. This creates a same everywhere. East [24] notes that in many
separation between the library and the academics institutions the library has come to be seen as the
instead of bringing a mutual dependence. If the main Centre of expertise in matters related to
library assumes the role of information assistants personal bibliographic software. This has not
and technology experts, it can introduce their happened completely yet at this research university,
members to better solutions, improving their but the survey suggests that it should, and that a
workflow and saving them the burden of testing loud call for a new commitment is given.
unknown products; it can propose and support This could apply also to students, as a part of
standards of use; it can provide training so that the information literacy strategy, but the survey doesn't
knowledge and skills are equal; it can inform about provide clear evidence on how important is for
updates or new solutions. It can be the link between students to receive this sort of training. This
the world of technological information solutions – confirms what was already noted by Duong [27],
such as RMS – and researchers' needs. Since most undergraduate science courses do not
require writing-intensive research papers, many
5. CONCLUSION departments have not seen the relevance of IL
instruction.
From the data discussed above, it is possible to
draw some final considerations, trying to connect 6. FURTHER STUDIES
the data results with the aims of the research. RMS
is considerably used across scientists, even though The present research shows important limits,
on a simple level. There is no unique approach to a both in the methodology as in the findings.
tool such as a RMS; they are used mostly as a Methodological limits due to practical constraints
personal tool, so its usage is tailored to the single were predicted at the beginning of the studies. This
person. They are nothing more than tools to survey, the first of this type at least in Malaysia,
facilitate the preparation of a final publication. gives an important picture of the distribution and
RMS is used in their basic functions, without much usage of RMS in a big academic environment. The
consideration of the interesting feature. In the same findings shown above give room for more areas of
way, virtual collaboration is a concept and praxis inquiry.
still far from the habits of the University. It would be extremely interesting to perform a
Collaboration itself is very important, essential part similar survey to other universities, and compare
of the research job some say, but technology is the results finding patterns, similarities and
not perceived as something helpful with that. differences among them to reach a nationwide
Recently, web and social oriented software like overview of the phenomenon.
Zotero or Mendeley stepped on to the stage It would be useful to perform a similar survey
providing new ways to manage scientific literature. which includes the HSS disciplines, and give
There is a lot of room for the library to be active scientific evidence to the original assumption that
in this process. Responses let emerge needs such as: these academic fields are unaware of RMS.
information, training, and guidance. Library is not
142
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
Finally, it should be worth to analyze the results [11] V. Arellano, “A Case for Zotero: http://www.
from the user context point of view, considering zotero. org,” Public Serv. Q., vol. 6, no. 4, pp.
factors such as age more deeply than the present 364–366, 2010.
research. Many of the concepts identified and [12] C. Reichardt, “EndNote X3: http://www.
discussed above can gain interest if looked endnote. com,” Public Serv. Q., vol. 6, no. 4,
considering the age factor: technological issues pp. 367–368, 2010.
such as networking, open-source philosophy, [13] A. McMullen, “CiteULike: http://www.
openness to novelty and interest in training can citeulike. org,” Public Serv. Q., vol. 6, no. 4, pp.
affect very differently people of different age. Also, 368–369, 2010.
having proved that habit is a strong factor,
[14] A. Butros and S. Taylor, “Managing
searching for patterns of behavior among different
information: evaluating and selecting citation
age ranges could lead to important understanding
management software, a look at EndNote,
on how the phenomenon is likely to change in the
RefWorks, Mendeley and Zotero,” in Netting
next future
knowledge: two hemispheres/one world:
REFRENCES: proceedings of the 36th IAMSLIC Annual
Conference, 2010, pp. 17–21.
[1] N. Bos, A. Zimmerman, J. Olson, J. Yew, J. [15] M. K. Hensley, “Citation Management
Yerkie, E. Dahl, and G. Olson, “From shared Software: features and futures,” Ref. User Serv.
databases to communities of practice: A Q., pp. 204–208, 2011.
taxonomy of collaboratories,” J. Comput. [16] J. Reiswig, “Mendeley,” J. Med. Libr. Assoc.
Commun., vol. 12, no. 2, pp. 652–672, 2007. JMLA, vol. 98, no. 2, p. 193, 2010.
[2] J. Wusteman, B. Eden, A. Voss, and R. Procter, [17] E. Francese, “Reference Management Software
“Virtual research environments in scholarly work as digital libraries: a survey at the University of
and communications,” Libr. Hi Tech, vol. 27, no. Torino,” 2012.
2, pp. 174–190, 2009. [18] D. Hull, S. R. Pettifer, and D. B. Kell,
[3] H. Alhoori and R. Furuta, “Understanding the “Defrosting the digital library: bibliographic
dynamic scholarly research needs and behavior tools for the next generation web,” PLoS
as applied to social reference management,” in Comput Biol, vol. 4, no. 10, p. e1000204, 2008.
Research and Advanced Technology for Digital [19] X. Niu, B. M. Hemminger, C. Lown, S. Adams,
Libraries, Springer, 2011, pp. 169–178. C. Brown, A. Level, M. McLure, A. Powers, M.
[4] I. Fourie, “Personal information management R. Tennant, and T. Cataldo, “National study of
(PIM), reference management and mind maps: information seeking behavior of academic
the way to creative librarians?,” Libr. Hi Tech, researchers in the United States,” J. Am. Soc.
vol. 29, no. 4, pp. 764–771, 2011. Inf. Sci. Technol., vol. 61, no. 5, pp. 869–890,
[5] H. Stephen McMinn, “Library support of 2010.
bibliographic management tools: a review,” Ref. [20] C. Ollé and Á. Borrego, “A qualitative study of
Serv. Rev., vol. 39, no. 2, pp. 278–302, 2011. the impact of electronic journals on scholarly
[6] F. DellʼOrso, “Bibliography Management information behavior,” Libr. Inf. Sci. Res., vol.
Software: Analysis and Comparison of some 32, no. 3, pp. 221–228, 2010.
packages. Retrieved October 26, 2010.” . [21] L. Haglund and P. Olsson, “The impact on
[7] R. Gilmour and L. Cobus-Kuo, “Reference university libraries of changes in information
Management Software: A Comparative Analysis behavior among academic researchers: a
of Four Products.,” Issues Sci. Technol. multiple case study,” J. Acad. Librariansh., vol.
Librariansh., 2011. 34, no. 1, pp. 52–59, 2008.
[8] Y. Zhang, “Comparison of select reference [22] D. Childress, “Citation tools in academic
management tools,” Med. Ref. Serv. Q., vol. 31, libraries: Best practices for reference and
no. 1, pp. 45–60, 2012. instruction,” Ref. User Serv. Q., vol. 51, no. 2,
[9] N. A. Cooke, “Internet Resources,” Public Serv. pp. 143–152, 2011.
Q., vol. 6, no. 4, pp. 360–372, 2010. [23] S. Siegler and B. Simboli, “EndNote at Lehigh,”
[10] A. Medaille, “Mendeley: www. mendeley. Issues Sci. Technol. Librariansh., vol. 34, p.
com,” Public Serv. Q., vol. 6, no. 4, pp. 360– 149, 2002.
362, 2010.
143
Journal of Theoretical and Applied Information Technology
10th June 2016. Vol.88. No.1
© 2005 - 2016 JATIT & LLS. All rights reserved.
144