Applying scientific thinking

in the service of society

Monitoring & evaluating the usage

of your Open Access journal
Agenda

 General tools
Ina Smith

 Platform specific tools (SciELO SA)

Louise van Heerden

 Journal specific tools (South African Journal of

Science)
Nadine Wubbeling & Linda Fick
General Tools – Ina Smith

 Google Tools

 Piwik

 Publish or Perish

 Crossref

 Open Journal Systems (OJS)

About your Journal
Prepare your journal

 Search engine/harvester friendly – Base URL

http://journals.assaf.org.za/per/oai

 Standardized metadata schema (XML)

 Google Sitemap

 Open source software using open standards

 Integration with other tools e.g. ORCID, Crossref

DOIs, etc.

 Web site vs Journal Management System

Impact Factor

Thomson Reuters JIF against ethics and principles of

OA
relates less and less to citation rates
unrelated to individual article quality in a journal
unrelated to quality of individual scientist publishing
in a given journal
Display of IF information on journal web page
discouraged
1. Corneliussen, S.T. (2016) ‘Bad summer for the journal impact factor’, Physics Today, . doi:
10.1063/PT.5.8183.
2. Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Swaminathan,
S., Taylor, S., Curry, S., de Montreal, U., @@, A., mmcnutt and Nature, S. (2016) ‘A simple proposal
for the publication of journal citation distributions’, New Results, , p. 62109. doi: 10.1101/062109.
3. The demise of the impact factor: The strength of the relationship between citation rates and IF is
down to levels last seen 40 years ago (2012) Available at:
http://blogs.lse.ac.uk/impactofsocialsciences/2012/06/08/demise-impact-factor-relationship-citation-
1970s/ (Accessed: 11 August 2016).
Web of Science

 Guidelines:
http://wokinfo.com/essays/journal-selection-
process/

 Suggest a title:
http://ip-
science.thomsonreuters.com/info/journalsubmission
-front/
Scopus

 Guidelines:
https://www.elsevier.com/solutions/scopus/content
#content-policy-and-selection

 Suggest a title:
http://suggestor.step.scopus.com/suggestTitle/step
1.cfm
Norwegian Registry for Scientific Journals,
Series and Publishers Level 2
 Guidelines:
https://dbh.nsd.uib.no/publiseringskanaler/OmKriter
ier?request_locale=en

 Suggest a title:
https://dbh.nsd.uib.no/publiseringskanaler/OmPros
edyrer?request_locale=en
Google Mail

Register a Gmail account for your journal

https://accounts.google.com/SignUp
Google Analytics
Add the journal to Google Analytics
http://analytics.google.com
Google Analytics
Google Analytics

Embed
code in
every web
page
Create connection between OJS &
Google Analytics
Journal Manager >> System Plugins (General)
Google Analytics Results
Google Analytics
Google Scholar Metrics
List of titles: https://scholar.google.com/citations?view_op=top_venues
Overview:
https://scholar.google.co.za/intl/en/scholar/metrics.html#overview
Register a new web site with Google
https://www.google.com/webmasters/tools/submit-url
Google Scholar Citations Profile
Google Scholar Citations Profile
https://scholar.google.co.za/intl/en/scholar/citations.html
Publish or Perish
Publish or Perish
Overview: http://www.harzing.com/pophelp/journal-
impact.htm
Download: http://www.harzing.com/resources/publish-or-
perish
Piwik
https://piwik.org/
Crossref
http://www.crossref.org/06members/51depositor.html

10.17159/2413-3108/2009/v21i2a296
OJS (Open Journal Systems)

https://www.projectcounter.org/
OJS
Alternative Metrics in OJS
http://pkp-alm.lib.sfu.ca/
Usage of accompanying data sets

http://dataverse.org

https://www.datacite.org/
Platform specific tools – Louise van Heerden
 SciELO SA

• Scientific Electronic Library Online (SciELO)

• SA’s premier open-access database
• Full-text, peer-reviewed journals
• Part of the SciELO Network started in Brazil
• Managed by the Academy of Science of SA (ASSAf)
• Funded by the South African Department of Science
and Technology
• Endorsed by the South African Department of Higher
Education and Training
• www.scielo.org.za
 Statistics

1) SciELO Website

2) SciELO Analytics (Beta version)

 How SciELO defines ‘’access’’

SciELO uses the COUNTER Code of Practice

On the HTML - if a user stays on the page for more

than 10 seconds = 1 access

On the PDF – if a user stays on the page for more than

30 seconds = 1 access

No robot access is counted

 1) SciELO SA Reports
via the SciELO webiste URL

SciELO.org
journals evaluation serial browsing article reports
browsing
Português alphabetic list site usage
Español subject list Publishing statistics
search form author index journal citation
subject index co-authors
help search form
about this site
SciELO news
SciELO team
 Journal citation reports URL

Journal citation reports

• Source data
• Impact factor on a two-year basis
• Impact factor on a three-year basis
• Half-life
• Received citations
• Granted citations
 Journal citation reports URL

Journal citation reports

Published in…. Select date and the journal title

All
2016
2015
2014
2013
2012
2011
2010
 Analytics SciELO SA – per Journal

Metrics of the usage of SAJS

within the SciELO system
Journal title/year No. of No. of No. of granted No. of received Average articles
issues articles citations citations per issue
S. Afr. j. sci 59 791 28782 1288 13.41
2016 5 72 3407 138 14.40
2015 6 89 3862 104 14.83
2014 6 76 2935 139 12.67
2013 6 80 2695 145 13.33
2012 6 70 2695 127 11.67
2011 6 66 2251 127 11.00
2010 6 68 2420 81 11.33
2009 6 81 2586 132 13.50
2008 6 100 2848 182 16.67
2007 6 89 3083 113 14.83
Total 59 791 28782 1288 13.41
 2) SciELO Analytics

Link to SciELO Analytics (currently a beta version)

– Collection level
– Journal level
– Article level (Need DOI numbers for each
document )

As it is still a beta version some of the terminology is

still in Portuguese.
Analytics – SciELO SA Collection
Accesses in October 2016
Global usage
 SciELO SA – most accessed journals
over the last 12 months

Journal html pdf abstracts total

SAMJ: South African 364 115 130 965 40 579 535 659
Medical Journal

Journal of the Southern 208 626 136 169 38 535 383 330
African Institute of
Mining and Metallurgy

South African Journal of 274 044 86 286 14 602 374 932

Education

Water SA 217 427 77 110 26 547 321 084

South African Journal 213 890 80 222 25 467 319 579

of Science
 Most accessed articles

http://analytics.scielo.org/w/accesses/list/articles?collection=sza

Article html pdf abstract total

Teaching practice: a make or 38991 825 73 39889

break phase for student
teachers
The influence of land use on 34687 568 89 35344
water quality and diatom
community structures in urban
and agriculturally stressed
rivers
Identifying risks facing the 29574 961 55 30590
South African tourism industry
Analytics SciELO SA – per Journal
Analytics – per Journal Article
 Summary

1) SciELO Website : Link

2) SciELO Analytics (Beta version) Link

(Remember to right click and select “Translate to English”)
 Analytics - Upcoming

To conclude, we look forward to the following:

• SciELO new interface (look and feel) – The beta

version of the new interface will be released early
December 2016

• Follow-up webinar when the new version is released

Journal specific tools
(South African Journal of Science)

Nadine Wubbeling & Linda Fick

 Tools for increasing &
measuring the reach and
impact of your journal
 1. Social Media
Facebook

https://www.facebook.com/southafricanjournalofscience
 1. Social Media
Twitter

https://twitter.com/SAJS_Official
 Social Media:
In-house analytics tools
 Social Media:
In-house analytics tools
Buffer
Other tools
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8

Twitter:
Retweets: 98
Likes: 24
Clicks: 94
Potential audience: 66 690

Facebook:
Likes: 8
Clicks: 26
Shares: 2
Potential audience: 1060

#FossilCancer

#SedibasWorld
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8
2. Electronic distribution
Media Releases:
Mailchimp
Mailchimp
Multimodal spatial mapping and visualisation of
Dinaledi Chamber and Rising Star Cave
Volume 112, Issue 5/6

Day of publication, 27 May 2016 – 145 visits

Day of highlights email, 31 May 2016 – 115 visits

(84 clicks on Mailchimp)
Plant metabolomics: A new frontier in phytochemical
analysis
Volume 109, Issue 5/6

Day of publication, 13 May 2013 – 13 visits

 3. Collaborate with authors & institutions
• Identify one or two articles to highlight per issue to start with.

Ask the author and institutions to:

 Have the institutions write a media release and send to
their distribution list or through a platform such as
EurekAlert. Have them notify you of this so that you can
keep track of the releases and share on social media.
 Institutions sometimes work with media companies to
publish news articles in traditional media outlets. Ask the
authors if they are willing to work with these companies to
write articles for newspapers or digital platforms.
 Share articles on their own social media pages – make
sure you retweet or share this on your own profiles
http://www.wits.ac.za/news/latest-news/research-news/2016/2016-07/hominin-cancer/
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8

Day of publication, 28 July 2016: 820 visits – 6 news items published

including National Geographic and The Telegraph

Day of highlights email, 29 July 2016: 848 visits – 2 articles on

The Washington Post and News24

1 August 2016 - 2 major news articles including

mention on Fox News
4. Other publishing platforms and indexes
Article-level metrics to measure
your reach and impact
 Google Analytics
https://analytics.google.com/analytics/web
 Google Analytics

Drought, climate change and sustainability of water AUTHORS: in

agriculture: A roadmap towards the NWRS2
Views and Downloads
 Summary
Tool Measure
Social Media Potential Audience, Likes, Clicks, Retweets, shares,
comments. Through in-house analytics tools and
external tools such as Buffer
Electronic Distribution Opens and clicks. Views on your website. Through
tools such as Mailchimp.
Collaboration with Views and downloads on your website.
authors/institutions Interaction of Social Media. Feedback from the
authors and institutions.
Other publishing Citations through the platforms. Metrics such as
platforms and indexes views and downloads.

Keep record of article-level metrics on your website such as views and

downloads. By using tools such as Google Analytics or Altmetric.
Thank you!

 Susan Veldsman
susan@assaf.org.za

 Ina Smith
ina@assaf.org.za

 Louise van Heerden

louise@assaf.org.za

 Nadine Wubbeling
nadine@assaf.org.za

 Linda Fick
linda@assaf.org.za