| 0

SciVal
For Administrators

Alexander van Servellen
Consultant, Research Management (SEA)
Elsevier Singapore
UNIMAP Malaysia
February 23rd, 2016

| 1

Agenda

10:00-11:00 Open Discussion on Needs

11:00-12:00 Setting up SciVal part I

12:00-14:00 Lunch & Informal Discussions

14:00-15:00 Setting up SciVal part II

15:00-15:45 Analysis & Reporting

15:45-16:00 Break

16:00-17:00 Generating Reports

| 2

Open Discussion on Needs

| 3 Typical uses Measure scientific production and benchmark research performance at multiple levels Assess the Monitor research international impact trends of research Map collaboration Identify leading networks and organizations and identify collaboration competitors opportunities Assess the impact of research funding on Identify who is doing the scientific output of what and with whom researchers and in a variety of fields graduate students Source: http://www.science-metrix.com/en/expertise/bibliometrics/know-how .

| 4 Reporting at various levels Research Office Top Management Faculties Research Units .

What is UNIMAP’s process for internal reporting? 5. Do you have the list of researcher names and the corresponding Scopus Author ID’s ready? . Who needs to setup SciVal for a particular school. What kinds of reports are produced currently? 6. Who has never logged into SciVal? 2. Have you been able to set the relevant groups up in SciVal? 7. department or centre of excellence? 3. | 5 Progress in setting up SciVal 1. What will you use SciVal for (as far as you know)? 4.

| 6 Notes .

| 7 Setting Up SciVal .

| 8 My SciVal – Researchers and Groups • Creating Researchers • Creating Groups of researchers (departments etc.) .

| 9 Master List .

| 10 First create a Master List of researcher names .

or school. show them to me. Can you let me know if there are any questions about the master list? . | 11 Who has a master list? Can those of you who have a master list for their department.

| 12 Research with more than one Scopus Author Profile .

| 13 We start with the authors who have more than one Scopus Author ID .

| 14 Go to My SciVal and “Define a new Researcher” .

| 15 Do this only for the authors who have more than one Scopus Author ID!! add the Scopus author ID field twice Fill in the Author IDs of one author .

| 16 SciVal will ask you to confirm both profiles before merging them into one profile in SciVal & Scopus You can save the researcher. or validate the publications first .

. each one is clearly tagged. so that once there are hundreds of researchers in SciVal. | 17 Add a tag to the researcher indicating which department he/she belongs to Here I added a tag.

| 18 Finding individual authors For the authors in the master list who have more than one Scopus Author Profile – Please use the discussed method to add those authors to SciVal. Ask for my help if you need it. .

| 19 Bulk Import Researchers that have one Scopus Author Profile .

not the author name etc. Past just the ID. . | 20 The researchers with one Scopus Author ID can be bulk imported into SciVal You can paste the author IDs belonging to one department in the box.

then you should search for this author manually by name in SciVal. . | 21 SciVal will show you if any Author ID is not found If an author ID is not found.

Remember to tag the researchers. | 22 Create the Department and give it a name. Give the group a name Check this box to create a group for these researchers Tag the researchers .

Ask for my help if you need it. | 23 Bulk uploading authors For the authors in the master list for whom you have found one Scopus Author Profile Please use the discussed method to bulk upload them into SciVal. .

| 24 Notes .

| 25 Finalize the Department .

| 26 Now you have created a department in SciVal. Remember to add the researchers who previously had two Author IDs and were not bulk imported Use edit function to add or remove researchers from this group Open the definition editor .

because he had two Author IDS Drag and drop his name into the group . | 27 Identify the author to be added to the Department Here you can clearly see one author is not yet in the group. It is the one we created manually.

| 28 Save the Group again .

Use the sharing function to give others access to this department . | 29 Now you have created a department in SciVal which you can easily share with other SciVal users.

| 30 Groups can be combined into larger organizational units Drag and drop units to combine .

| 31 Bulk uploading authors Now its time to finalize the department. . Please make sure the department includes all the authors. tags etc. and it has been given correct name.

| 32 Notes .

meet back here at 14:00 . | 33 Lunch  -.

| 34 Setting Up SciVal (continued) .

| 35 My SciVal – Research Areas • Creating Researcher Areas using keywords • Creating Research Areas by grouping entities .

| 36 Create Research Area .

| 37 Use Keywords to define a very specific area of science Useful search tips .

| 38 Refine & Validate Validate that publications are representative of topic .

Areas larger than 5000 publications can take 48 hours . | 39 Prepare your Research Areas in advance.

. Use keywords to create a small Research Area in SciVal. Let me know if you need help. | 40 Create a Research Area Pick a specific topic you are interested in.

| 41 Notes .

| 42 Sharing and ownership .

| 43 Share Departments & Research Areas with others Use the share icon 43 .

| 44 Invite to share using email of registered SciVal user 44 .

. and have shared with others. you are the only one who can edit entities which you created. but have shared with others By default. | 45 Grant editing rights or change ownership of departments you created. or even transfer ownership to someone else. You can grant editing rights to others.

| 46 Sharing Now that you have made Departments and Research Areas in SciVal… Please share one of them with a neighbor. . You could experiment with transferring ownership to them and back again.

| 47 Notes .

| 48 Analysis and Reporting .

countries in filter. one month ago. it allows you to looks at specifically at co- style reports based on a select a time period publication trends. have created. It 3 or 5 year period. and compare country. You can top collaboration partners institutions. one analysis) .e. applied here as a subject overview of one entity at institutions. | 49 Now that you have customized SciVal – you can explore and analyze using SciVal Overview module Benchmarking module is Collaboration module provides dashboard flexible. You anywhere from 1996 to allows you to identify the can analyze countries. any choose from over 17 of an institution or researcher. It gives a can compare researchers Research areas can be comprehensive with departments. a time. as well as researchers and across different types of identify potential research areas you entities (i. group of metrics. you directly collaboration partners.

non-performance variables may be used to advantage in this case Scenario modeling • Non-performance variables may or may not be important depending on scenario • e.g. so that the evaluation is fair Demonstration of excellence • Typically “bottom-up” performed by entity requesting resources • Generally aiming to find a way to showcase strengths compared to peers. | 50 Main purposes of metrics Evaluation of performance • Typically “top-down” performed by an authority • Essential to account for variables that can affect metrics values besides differences in performance. might not need to worry about different citation rates between fields because only looking at one field! . if modelling recruitment in nanoscience.

snowballmetrics. m) Number of Citing Countries Collaboration (geographical) Citation Impact metrics Academic-Corporate Collaboration Citation Count Citations per Publication Cited Publications Usage metrics h-indices (h. www. | 51 20 sets of metrics at your disposal Slice and dice your data from multiple angles to identify your core strengths and weaknesses Productivity metrics Collaboration metrics Scholarly Output Authorship Count h-indices (h. g. m) Views Field-Weighted Citation Impact Views per publication Publications in Top Percentiles Field-Weighed Views Impact Publications in Top Journal Percentiles Disciplinarity metrics Collaboration Impact (geographical) Journal count Academic-Corporate Collaboration Impact Journal category count Snowball Metric. g.com/metrics .

| 52 Notes .

Non-Performance Variables

| 54

When making comparisons, we must take into
consideration “Non-performance variables”

Size

Discipline

Publication-type

Database coverage

Manipulation

Time

In some cases the difference in a metric value between two entities
(authors for example) might not reflect a difference in performance.
Instead the difference can be caused by non-performance variables.

| 55

Publications types receive differing levels of citations

Because some publication types are cited more often than others, we
should not compare different types without applying normalization.

| 56 Citation practices differ between disciplines Because some subject areas are cited more often than others. we should not compare papers from different fields without applying normalization. .

| 57 Size and Time Citation count is directly related to volume Do you think the declining trend is indicative of a decrease in quality or is it caused by a non- performance variable? CPP normalizes for differences in publication volume FWCI normalizes for subject area. document type. and time .

and please explain it to me. Draft a short outline of a report. and what it should include. for what audience. | 58 Reporting Requirements Please think about what kinds of reports you aim to produce. . and how frequently etc.

| 59 Notes .

| 60 Generating Reports .

• Be clear about the questions. | 61 Approach writing a report similarly to writing a scientific paper. scope and methods • Guide the reader through the results of your analysis • Summarize the findings in an executive summary (like an abstract) Practical tips for using SciVal for reporting • Take screenshots of the relevant outputs in SciVal • Export data from SciVal and creating charts in Excel • Writing text which describes and interprets the data • Keeping it simple and get to the point .

| 62 Exporting Data from SciVal .

| 63 Use Screenshots to capture charts .

| 64 Report Template • A good looking report reflects well on your skills as an analyst • It helps to prepare a template such that the report is well structured. .

Think of something you might actually have to produce in future. . The report can be about anything relevant to your job: a journal analysis. department analysis etc. Feel free to ask me for help in working on your report. | 65 Final Assignment Assignment: Group into pairs and together use SciVal to create a report. institutional analysis. The report should be in Power Point format and must include: • Cover page with title and your names job titles and email addresses • Key Findings • Charts visualizations A few groups can volunteer to share their report in 45 minutes from now.

| 66 Notes .

com www.vanservellen@elsevier.elsevier. | 67 Thank you very much Alexander van Servellen a.com/research-intelligence .