You are on page 1of 43

Impact factor

journals as per as
per journal
citation
report SNIP, SJR, Dr. S.Ghosh
IPP, CiteScore Associate Professor
Department of Library &
Information Science, University of
North Bengal, West Bengal 734013
Publish or perish" is an aphorism
describing the pressure to publish academic
work in order to succeed in an academic
Publish or career. ... The pressure to publish has been
Perish? cited as a cause of poor work being
submitted to academic journals.

@sghoshnbu 08/18/2022 2
 The culture of “publish or perish” is clearly
pervasive and appears to be here to stay. Calls
for instant distribution and transparency of
The Harsh both authorship and peer review may help to
address problems with research quality, but
Consequences as long as researchers are threatened by the
publication venue of their research, the
of “Publish or system will remain fundamentally broken.

Perish”

@sghoshnbu 08/18/2022 3
Perspectives of impact

ACADEMIC IMPACT SOCIETAL IMPACT

+
Download counts
Page views
Journal Impact Factor Mentions in news reports
Citation counts Mentions in social media
Mentions in blogs
Reference manager readers
… etc.

Alternative metrics
Traditional
Traditional metrics
metrics
“altmetrics”

More article-centric, as opposed to


journal-centric.
Traditional Based on

What are Bibliometrics citation counts

metrics
Emerging Based on
Altmetrics online tools
Quantification of research
impact

Multidimensional Array of
Why is Stakeholders

metrics?
Calculations of fuzzy
concepts and associative
activities
Scholars have combined standard research metrics,
like scholarly output and citation counts, into
formulas to measure and assess author and journal
impact in new ways. Some of these metrics include:
What are the
different  Journal Impact Factor
 h-index
metrics?  g-index
 Eigenfactor score
 Altmetric

@sghoshnbu 08/18/2022 7
Article Impact - citation count and analysis using Web of Science
and Google Scholar

Journal Impact - journal data and standard measures for journals

Ways of Author Impact - common measures of author impact (h-index) and

Measuring
other metrics scholars might encounter

Impact
Altmetrics - what are altmetrics? Altmetric badges and altmetrics
tools

Book and Book Chapter Impact - book citation counts, library


holdings, book reviews and other qualitative indicators

Maximize Impact - unique researcher identifiers and profiles,


academic communities, and other strategies to maximize impact

@sghoshnbu 08/18/2022 8
Journal-level metrics

al-level metrics
 Metrics have become a fact of life in many - if not all - fields of research and scholarship. In an age of information
abundance (often termed ‘information overload’), having a shorthand for the signals for where in the ocean of
published literature to focus our limited attention has become increasingly important.
 Research metrics are sometimes controversial, especially when in popular usage they become proxies for
multidimensional concepts such as research quality or impact. Each metric may offer a different emphasis based on
its underlying data source, method of calculation, or context of use. For this reason, Elsevier promotes the responsible
use of research metrics encapsulated in two “golden rules”. Those are: always use
both qualitative and quantitative input for decisions (i.e. expert opinion alongside metrics), and always use more than
one research metric as the quantitative input. This second rule acknowledges that performance cannot be expressed
by any single metric, as well as the fact that all metrics have specific strengths and weaknesses. Therefore, using
multiple complementary metrics can help to provide a more complete picture and reflect different aspects of research
productivity and impact in the final assessment.

@sghoshnbu 08/18/2022 9
Journal Citation Reports™ (JCR)

Journal Citation Reports™ (JCR) provides you with the transparent, publisher-neutral data and statistics you need to make confident
decisions in today’s evolving scholarly publishing landscape, whether you’re submitting your first manuscript or managing a portfolio of
thousands of publications.
Quickly understand a journal’s role within and influence upon the global research community by exploring a rich array of citation
metrics, including the Journal Impact Factor™ (JIF), alongside descriptive data about a journal’s open access content and contributing
authors.
Web of Science does not depend on the Journal Impact Factor alone in assessing the usefulness of a journal, and neither should anyone
else. The Journal Impact Factor should not be used without careful attention to the many phenomena that influence citation rates – for
example, the average number of references cited in the average article. The Journal Impact Factor should be used with informed peer
review. In the case of academic evaluation for tenure, it is sometimes inappropriate to use the impact of the source journal to estimate the
expected frequency of a recently published article. Again, the Journal Impact Factor should be used with informed peer review. Citation
frequencies for individual articles are quite varied. 
Journal Citation Reports now includes more article-level data to provide a clearer understanding of the reciprocal relationship between
the article and the journal. This level of transparency allows you to not only see the data, but also see through the data to a more nuanced
consideration of journal value.

@sghoshnbu 08/18/2022 10
Journal Impact Factor (JIF)

 Journal Impact Factor (JIF) is calculated by Clarivate Analytics as the average of the sum
of the citations received each year to a journal’s previous two years of publications
(linked to the journal, but not necessarily to specific publications) divided by the sum of
“citable” publications in the previous two years. Owing to the way in which citations are
counted in the numerator and the subjectivity of what constitutes a “citable item” in the
denominator, JIF has received sustained criticism for many years for its lack of
transparency and reproducibility and the potential for manipulation of the metric.
Available for only 11,785 journals (Science Citation Index Expanded plus Social
Sciences Citation Index, per December 2019), JIF is based on an extract of Clarivate’s
Web of Science database and includes citations that could not be linked to specific
articles in the journal, so-called unlinked citations.
@sghoshnbu 08/18/2022 11
Metrics in a nutshell(Impact Factor)

    Use a two-year period to divide the  


Impact Factor   number of times articles were cited by  
the number of articles that were
  published  
  Example:  
Journal Citation 200 = the number of times articles Impact factor reflects only on
Reports published in 2008 and 2009 were cited by how many citations on a
indexed journals during 2010. specific journal there are (on
average). A journal with a high
73 = the total number of "citable items" impact factor has articles that
published in 2008 and 2009. are cited often.
200/73 = 2.73
2010 impact factor

@sghoshnbu 08/18/2022 12
Traditional metrics for journals Software

 Impact Factor and Citation Counts, created to measure


 Journals and journal articles
 Scholarly (journal) impact
 Initially created for librarians, then largely adopted by STEM

Image from Journal Citation Reports (library database)


Source Normalized Impact per Paper (SNIP)

Source Normalized Impact per Paper (SNIP) is a sophisticated metric that


intrinsically accounts for field-specific differences in citation practices. It
does so by comparing each journal’s citations per publication with the
citation potential of its field, defined as the set of publications citing that
journal. SNIP therefore measures contextual citation impact and enables
direct comparison of journals in different subject fields, since the value of a
single citation is greater for journals in fields where citations are less likely,
and vice versa. SNIP is calculated annually from Scopus data and is freely
available alongside CiteScore and SJR at www.scopus.com/sources. Unlike
the well-known journal impact factor, SNIP corrects for differences in
citation practices between scientific fields, thereby allowing for more
accurate between-field comparisons of citation impact. Centre for Science
and Technology Studies(CWTS) Journal Indicators also provides stability
intervals that indicate the reliability of the SNIP value of a journal.  SNIP
was created by Professor Henk F. Moed at Centre for Science and
Technology Studies (CWTS), University of Leiden.
@sghoshnbu 08/18/2022 14
CiteScore metrics

CiteScore metrics are a suite of indicators calculated from data in Scopus, the world’s leading abstract and citation
database of peer-reviewed literature. CiteScore itself is an average of the sum of the citations received in a given year to
publications published in the previous three years divided by the sum of publications in the same previous three years.
CiteScore is calculated for the current year on a monthly basis until it is fixed as a permanent value in May the following
year, permitting a real-time view on how the metric builds as citations accrue. Once fixed, the other CiteScore metrics
are also computed and contextualise this score with rankings and other indicators to allow comparison.
CiteScore metrics are:
Current: A monthly CiteScore Tracker keeps you up-to-date about latest progression towards the next annual value, which makes next
CiteScore more predictable.
Comprehensive: Based on Scopus, the leading scientific citation database.
Clear: Values are transparent and reproducible to individual articles in Scopus.
The scores and underlying data for more than 25,000 active journals, book series and conference proceedings are freely
available at www.scopus.com/sources or via a widget (available on each source page on Scopus.com) or the Scopus API.

@sghoshnbu 08/18/2022 15
SCImago Journal Rank (SJR)

 SCImago Journal Rank (SJR) is based on the concept of a transfer of prestige


between journals via their citation links. Drawing on a similar approach to the
Google PageRank algorithm - which assumes that important websites are linked
to from other important websites - SJR weights each incoming citation to a
journal by the SJR of the citing journal, with a citation from a high-SJR source
counting for more than a citation from a low-SJR source. Like CiteScore, SJR
accounts for journal size by averaging across recent publications and is calculated
annually. SJR is also powered by Scopus data and is freely available alongside
CiteScore at www.scopus.com/sources.

@sghoshnbu 08/18/2022 16
The impact per publication(IPP)

 The impact per publication, calculated as the number of citations given in the
present year to publications in the past three years divided by the total number of
publications in the past three years. IPP is fairly similar to the well-known journal
impact factor. Like the journal impact factor, IPP does not correct for differences
in citation practices between scientific fields. IPP was previously known as RIP
(raw impact per publication).

@sghoshnbu 08/18/2022 17
The Immediacy Index measures how frequently the average article from a
journal is cited within the same year as publication. This number is useful
for evaluating journals that publish cutting-edge research.
Immediacy Index Numerator - Cites to recent items:
The numerator looks at citations in a particular JCR year to a journal's
content from the same year. For example, the 2015 Immediacy Index for
a journal would take into account 2015 citations to the journal's 2015
papers. The numerator includes citations to anything published by the
journal in that year.
Immediacy Index Denominator - Number of recent items:
Immediacy Index The denominator takes into account the number of citable items published
in the journal in 2015. Citable items include articles and reviews. 

@sghoshnbu 08/18/2022 18
Histcite(By Eugene Garfield) See in Action

@sghoshnbu 08/18/2022 19
H-index variant H5-Index
Jorge E. Hirsch Software
Argentine American professor of physics at the 
University of California, San Diego.[1] He is known for inventing the h
-index in 2005

    1) Create a list of all your publications. Put the list in descending order based on  
the number of times it was cited (you can get this information from any of the
     
sources to the left). The first article should have the most citations. Go through
    and number these.  
    2) Look down through the list to figure out at what point the number of times a
  Web of publication has been cited is equal to or larger than the line (or paper) number The h-index focuses more
Science, Google of the publication. specifically on the impact of
h-index
Scholar, Scopus Example: only one scholar instead of
an entire journal. The
Paper Number            # of citations
higher the h-index, the more
1                              13 scholarly output a
researcher has.
2                                7
3                                4
h-index= 3
*please remember that many databases will give you this number; this is only if
you'd like to calculate it manually. You can also often find calculators online.

@sghoshnbu 08/18/2022 20
Egghe, Leo
G-index Hasselt University, Nederlands in 2006 suggested
g-index

      The g-index can be thought of as a


continuation of the h-index. The
      difference is that this index puts
  Given a list of articles ranked in more weight on highly-cited
g-index Harzing's Publish or Perish decreasing order of the number citations. The g-index was created
citations that they received, the because scholars noticed that h-
index ignores the number of
g-index is the largest unique
citations to each individual article
number to the extent that the beyond what is needed to achieve
top g articles received together a certain h-index. This number
is at least g  citations.
2
often complements the h-index
and isn't necessarily a
replacement.

@sghoshnbu 08/18/2022 21
Publish or Perish by Anne-Wil Harzing'

@sghoshnbu 08/18/2022 22
Eigenfactor score
Jevin West Carl T. Bergstrom Ted C. Bergstrom Ben
Althouse
    • The Eigenfactor score is calculated by
eigenfactor.org.
   
• However, their process is very similar to A high Eigenfactor score signals
   
calculating impact factor and they pull that the journal does not self-cite
their data from the JCR as well. and controls the network of that
• The major difference is that the discipline. It's useful to look at
Eigenfactor score deletes references from scholar's h-index as well as the
one article in a journal to another in the Eigenfactor score of the journals
Eigenfactor score Eigenfactor.org same journal. they publish in in order to get a
broad sense of their impact as a
• This eliminates the problem of self-citing.
researcher.
• The Eigenfactor score is also a five-year
calculation.
• More information can be found
through Journal Citation Reports.

@sghoshnbu 08/18/2022 23
The i10-index is used by Google
Scholar and indicates the number of
i10-index publications that have been cited at
least 10 times.

@sghoshnbu 08/18/2022 24
The term "altmetrics" (alternative metrics) is used to
describe approaches to measure the impact of scholarship by
using new social media tools such as bookmarks, links, blog
Altmetrics postings, inclusion in citation management tools, mentions
Jason Priem
The tweet by Jason Priem, which coined the term altmetrics.
and tweets to measure the importance of scholarly output.

Proponents of altmetrics believe that using altmetrics will


help measure the impact of an article in a more
comprehensive and objective way than was done with more
traditional scholarly impact measures such as journal impact
factor. However, there are limits to this approach and
caution should be used to not rely on any one particular
measure in evaluating the importance of scholarship.

@sghoshnbu 08/18/2022 25
“The Umbrella
Classification “alternative metrics”
of Non-Citation • new ways of measuring different, non-traditional forms of
based Metrics” impact.
• “alternative to only using citations”, not
“alternative to citations”.
• complementary to traditional citation-based analysis.

Article-level metrics have come to refer to any


metrics (e.g., including altmetrics) that
surround a scholarly article.
An article-centric approach

 Measure online attention surrounding journal articles (and datasets).

 Collect and deliver article-level metrics to journal publishers.


Article-level [individual work]

Journal-level
Categories
Author-level
of altmetrics
Institutional-level
Where do altmetrics come from?
How do we collect
data for altmetrics?

 Directly from the individual tools SlideShare views

 From publishers (views, download data) PLOS article metrics


 From (some) library databases Web of Science usage
 From scholarly networks ResearchGate metrics
 Through aggregating tools Altmetric metrics
Usage : clicks, downloads, views; Social Media - likes, shares, or tweets;
Captures - bookmarks, favorites, followers; Mentions - blog posts, reviews,
comments, or ratings

Altmetrics are often used to measure the impact of gray literature or


materials that are not formally published, such as posters and working
papers. They can also be used to provide more information about the reach
of published articles and books.
Altmetrics Measures
It is unlikely that altmetrics will supplant traditional metrics as the measure
of research impact. However, altmetrics can demonstrate the reach and
interest in a topic from the public, practitioners, and policy makers

Authors should refrain from judging the impact of a work based on the
altmetrics numbers. Digging into who is saying what about the work may
provide more reliable information about the quality and influence of a
work.

08/18/2022 @sghoshnbu 31
Altmetric Tools

 Altmetrics.org
 Impactstory
 ReaderMeter
 ScienceCard
 PLoS Impact Explorer
 PaperCritic
 Crowdometer

@sghoshnbu 08/18/2022 32
Impact Story

@sghoshnbu 08/18/2022 33
ReaderMeter

@sghoshnbu 08/18/2022 34
ScienceCard

@sghoshnbu 08/18/2022 35
PLoS Impact
Explorer

@sghoshnbu 08/18/2022 36
PaperCritic

@sghoshnbu 08/18/2022 37
Strategies to Create Unique Create Researcher Share Your Research

Maximize Researcher
Identifiers
Profiles Online

Your Impact
Take Steps to
Broaden Your Impact

08/18/2022 @sghoshnbu 38
Add postprints/white papers/drafts of work to your institutional
Add repository, DigitalCommons@EMU, or to a disciplinary repository.

Craft a work's title and abstract carefully. Repeat keywords so the work is
Craft highly relevant in search engines.

Publish in open access journals or pay to have the work available open
Publish in access in a subscription journal.

Take Steps to Link Link your most recent research to your email signature.

Broaden
Discuss Discuss your research findings on a blog or through Twitter.

Your Impact Contribute to Wikipedia, either in a new entry or in the text and
Contribute references of an existing entry.

@sghoshnbu 08/18/2022 39
Google Scholar Profile
A Google Scholar Profile tracks your publications listed in Google Scholar, provides
the number of citations and links to the items citing your work, and calculates your
h-index. (Note: You need to have a Gmail account to track your profile. Once you
are logged in to your Gmail account, click on "My citations" to view and edit your
profile.)
Impactstory
This web-based service collects metrics and displays them with a link that can be
added to CVs. Join free with an ORCID account.

Identity Share Your Research Online


The process of writing for publication often creates several outputs in addition to the

Exploration
final journal article, book, or book chapter. Consider posting slides from
presentations, brief videos of presentations, data sets, or other materials online with
a link to the official publication.
Postprints/White Papers/Drafts of work - DigitalCommons@EMU or
subject/disciplinary repositories.
Presentation Slides - SlideShare or Speaker Deck
Videos - Vimeo or YouTube
Data Sets - Dryad or figshare (figshare can handle other outputs as well)
Code & Software - GitHub

@sghoshnbu 08/18/2022 40
Single
Platform

@sghoshnbu 08/18/2022 41
References

 Ayris, P., López de San Román, A., Maes, K., & Labastida, I. (2018). Open Science and its role in universities : A roadmap for cultural change.
League of European Research Universities.
 Bose, R. (2004). Knowledge management metrics. Industrial Management and Data Systems. https://doi.org/10.1108/02635570410543771
 Commission, E. (2017). Next generation metrics: Responsible metrics and evaluation for open science: European commission Report. Brussels.
 Hicks, D., Wouters, P., Waltman, L., De Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature.
https://doi.org/10.1038/520429a
 Lăzăroiu, G. (2017). What do altmetrics measure? Maybe the broader impact of research on society. Educational Philosophy and Theory.
https://doi.org/10.1080/00131857.2016.1237735
 LibGuides: Introduction to Impact Factor and Other Research Metrics: Home. (n.d.). Retrieved from https://guides.library.illinois.edu/impact
 SAGE Publishing. (2019). The latest thinking about metrics for research
 impact in the social sciences (White paper). Thousand Oaks, CA: Author. doi: 10.4135/wp190522.
 Understanding research metrics. (n.d.). Retrieved May 17, 2020, from https://editorresources.taylorandfrancis.com/understanding-research-
metrics/

@sghoshnbu 08/18/2022 42
Questions & Just shoot…We are here to
listen

Answers
& “Thank You” Slide is not
Made
More

08/18/2022 @sghoshnbu 43

You might also like