Professional Documents
Culture Documents
Picture this:
• A postdoctoral researcher in marine biology
is hired on the basis of her impressive h-index
Magchiel Bijsterbosch (SURF) and citation count;
Alastair Dunning (Delft University of Technology) • A university committee decides which NWO
Darco Jansen (Universiteiten van Nederland, UNL) Gravity proposal to submit, based on a
Max Haring (University of Amsterdam) predictive analytics tool that utilises global
Sarah de Rijcke (Leiden University) trends in grant awards;
Maurice Vanderfeesten (Vrije Universiteit Amsterdam) • A government panel for the Dutch Nationaal
Groeifonds makes its selection based on
February 2022 metrics provided by a commercial company;
• A journal editor publishes controversial
research, hoping to raise the impact factor of
her journal.
1
provide skewed support for particular thematic In order for the academic community to uphold Secondly, we need policy adoption (by
areas? More fundamentally: do such data and scholarly values for metadata infrastructures, governments, funders, academic institutions) and
analytics informed decision-making undermine sustained coordinated strategic action is vital. investments – at scale – in open infrastructures.
critical values such as academic independence A crucial first step is to establish principles that The development of policy and the direction
and communality? Can Mertonian norms for open up research metadata and data analytics, of the necessary investments requires a clear,
science be upheld if leadership decisions and and to ensure the research community effective governance, uniting the research
the integrity of the global academic corpus rely understands what is at stake and agrees on the performing organisations and funders.
on market mechanisms and related – often principles. These principles are outlined below.
opaque – technologies? Adoption of these principles is essential if we The Guiding Principles as formulated in this
are to cope with the increasing commercial document aim to help:
The corpus of science and scholarship is a development across the entire research life 1. guide academic institutions with decisions in
common good, and access to it a universal cycle without transparency or clarity on information management of research in their
right1. As part of this corpus, the infrastructures whether this supports the interests of the organisations;
for research metadata – such as those research community. 2. form a collective frame in which academic
mentioned in the examples above – should institutions jointly formulate policy and steer
serve the community and be designed, used, investments in infrastructure;
and maintained according to scholarly values. 3. provide clear rules of engagement for
collaborations involving publicly funded
Such services and infrastructures should be academic data and metadata.
community-owned, transparent, democratic,
open, inclusive, and enabling. They should
increase opportunity and choice for all
stakeholders, rather than close down options.
They should allow for inclusive innovation
and allow others to build on the work of the
academic community; and give others the
rights to do so rather than restrict rights and
create scarcity. They should enable expansion
of the knowledge commons.2
2
Scope of the Principles A closer look – complimentary
services & network effects
The principles focus on information about While the values enshrined in the Mertonian Research is increasingly data-driven. This not
research; or the metadata that describes norms should also apply to research data, there only holds true for research methods, but also
research outputs in the broadest sense, are additional challenges in embedding these for how research is managed, communicated,
including publications, software and data values that require further thought. Therefore, and evaluated – partly in response to the need
sets. This also includes derived or enriched the research output itself is out of scope of to account for public spending.3 Indeed, the
metadata, i.e. metadata that is created by these principles. area of research intelligence is fuelled by large-
collecting and analysing existing primary Also out of scope are the educational and scale data collection, aggregation and analysis.
metadata (for example: title, abstracts, and administrative tools and services that are now It provides new prospects for assisted decision-
reference lists). The definitions at the end of commonly embedded into university life. making on funding opportunities, publishing
the document give more precise description of As with research data, a broader dialogue is venues and alternative metrics. Such types of
how we have used terms such as metadata. required about the values that the use of these analysis are based on products (such as articles,
services brings (or undermines) to the academic datasets and software) and by-products (such
The principles are not about the data objects environment. But that is far beyond the purpose as metadata about funding and collaborations)
that are created by researchers as part of their of this current document. of research. Of a total of €17.5 billion annual
research (commonly known as research data). investment in Dutch research and development,
30% is funded and 34% performed by public
Different areas of influence Specific examples institutions.4 It is therefore essential that
of commercial companies within each area
Scope of this document
research intelligence undertaken in these
institutions is done in accordance with values
Elsevier publishing contract Other national read and publish deals
Research information central to science and the academy.
Open Knowledge Base And others...
3
Wider context solutions. But are academics still in the driving
seat? Or do they now find themselves in a
and related information services, as well as for This document has emerged in a specific situation in which short-termism and availability
commercial cloud providers offering services to context and at a particular moment in time. of commercial software suites leads to choices
process and store research data. A context that still reflects mechanisms and that are perhaps not aligned with community
options introduced over the past decades. values?
The consequences of these developments Knowledge institutions should scrutinise this
may be positive, resulting in new opportunities context if they are serious about reasserting The present document aims to expand
for research contributions and information core values and about its commitment to open on existing principles (Principles of Open
use. On the other hand, as vital functions of science and scholarship.6 Scholarship; SPARC9, Educopia Values and
the scholarly enterprise become increasingly Principles10; the UK Forum for Responsible
dependent on such services, it is critical that A first iteration of the Guiding Principles was Metrics Guidance for institutions on
knowledge institutions carefully consider drafted under time pressure of agreeing the environment indicators11) in the context of
risks involved in becoming too dependent on Framework Agreement (in December 2019) research metadata. It also aligns with the
specific third parties and their tightly integrated between the Dutch knowledge institutions and commitments made by the Dutch research
solutions. Equally, such third parties must Elsevier. The formal contract was then signed community to reform research practice,
respect and commit to these academic values if in May 2020 bundles open access and services support responsible uses of metrics, and enable
they wish to collaborate. related to research metadata. It lasts until 2024. open research. These commitments have
The first version of the Guiding Principles already been embedded in a range of initiatives
The Guiding Principles for Open Research has partially been embedded in the contract in the NL (e.g. the new Strategy Evaluation
Information are intended as clear rules of and the related governance. In particular, the Protocol12, the shared ambitions in Dutch
engagement for the research community in governance allows the knowledge institutions academia for a modernisation of the system
partnering with third parties, in developing new to demand openness of new research metadata of Recognition and Rewards13 and the Dutch
infrastructures and services related to research services created by Elsevier.7 In addition, ambitions in Open Science14). These specific
intelligence and scholarly communication. They feedback from an open consultation relating principles here do not focus on the responsible
should provide clarity on what we expect, what we to the first version of Guiding Principles were use of research metrics and the need for a new
need, and what can and cannot be done with our incorporated into this document.8 balance between quantitative and qualitative
metadata. goals. But if such metrics are to be used they
Of course innovation often comes from will be based on the principles elaborated
commercial parties. Some companies have below.
worked for decades on building tightly
integrated infrastructures with smooth
interfaces that seemingly offer convenient
4
Principles
GP4.
Enduring access and availability
5
“Within any infrastructure or service for research metadata,
6
“Knowledge institutions must release metadata related to
7
“Algorithms and other techniques and methodology used to
8
“Knowledge institutes and third-party services must facilitate
9
“All stakeholders must agree to work towards common
10
“Knowledge institutions and third parties must engage in open
11
“A suitable governance structure must be established
12
Towards an Implementation of Required actions for the board of
the Guiding Principles knowledge institutions
Data concerning the output and operation This Taskforce first developed a set of guiding In principle, three kinds of actions must be
of scientific research is of vital importance principles (V1.0, March 2020) and handed them made by knowledge institutions:
to research policy and the broader pursuit of over to the negotiating team with Elsevier.34
knowledge. The handling and analysis of data These GP1.0 were implemented in the contract 1. Endorse (or ratify) the Guiding Principles.
related to publications and other scholarly with Elsevier (transformed into collaboration Agree to pro-actively apply these into their
output has a crucial impact on judgements principles) and approved by UNL, NWO and own systems and systems of third parties.
about research success of scientists, institutions NFU early May 2020. During the summer
and countries. Traditionally, this metadata of 2020 the Guiding Principles V1.0 were 2. Set up a nationwide governance structure
related to scholarly communications has opened for public consultation; revisions were overseeing and reporting on this to: ensure
been managed in discrete, unconnected, and incorporated in 2021. The many comments the sustained development of the principles
sometimes closed commercial systems. In this have significantly contributed to this revised and related frameworks; work on innovation
context the board of Association of Universities version of the principles. with commercial parties; reinforcing the
in the Netherlands (previously called VSNU, now position of public institutions.
UNL), The Netherlands Federation of University
Medical Centres (NFU) and The Dutch Research 3. Invest jointly in those systems most essential
Council (NWO) installed an expert taskforce to the functioning of higher education
on Responsible Management of Research and scientific research safeguarding these
Information and Data.33 principles (related for example to the
realisation of an Open Knowledge Base).
13
Recommended governance model
14
as at the international level. The last should Assign the monitoring task A summary of the actions needed for
be considered especially critical in order to It is proposed that this is coordinated by the implementation of the Guiding Principles is
establish sufficient critical mass in a globalised UNL, further assisted by centres of expertise shown on the next page.
market of information services. such as SURF, CWTS etc. Its first task is to take
stock and enumerate structures and contracts
To support the network interactions for research of where it is desirable to apply the principles.
information, we propose the following initial
actions: From the perspective of a participatory,
inclusive governance, thought should also
Set up a development forum be given to including private entities and
For the scope of research information, the representatives of the market, such as is the
NPOS steering board can serve as an initial case in the European Open Science Cloud.
starting point, provided there are strong links to
UNL-SOO, -SSPG and -SBF and the NFU-O&O While the proposed forum could indeed
and -S&F steering boards, to connect research evolve in such a direction, the inclusion of
policy, public accountability, information policy other interests places stronger requirements
and financial implications. on effective conflict resolution mechanisms.
When scaling up to other domains (e.g. To simplify dynamics during the initial stages,
education) or sectors (e.g. universities it is therefore recommended to start with
of applied sciences), the function of a the initial coalition of UNL, NFU and NWO,
development forum may spin off. and gradually expand into other information
domains and areas of the public sector,
Enumerate implementation structures international boundaries, and finally, the private
These refer to the existing structures, e.g. sector. Meanwhile, the existing implementation
contract-specific arrangements, programme structures typically already include a level of
and project boards overseeing the development representation from the supplier side, e.g. the
of infrastructures, and institutional specific governance of the Elsevier Contract.
bodies. This should be an exhaustive list,
in order to provide clarity on scope and
applicability of the Guiding Principles.
15
Short term (<6 mths) Medium term (1-3 yr) Long term (>3 yr)
I. Development Forum • Ratify/endorse the guiding principles • Promote discussion of Guiding • Evaluate shared goals and
in at least the UNL, NWO and NFU Principles and publish revisions accountability
boards. • Explore an effective way to connect • Review effectiveness of governance
• Establish the NPOS as forum to and expand methods for the research model
manage the principles for the Research information domain to other domains • Consider the position of private
Information domain such as research data, education, and entities and/or market parties
• Formulate shared goals and desired clinical data
level of accountability • Explore ways to scale up to other
• Connect and align with related sectors, i.e. research institutes and
national initiatives, e.g. UKN universities of applied sciences.
• Connect and align international
institutions, e.g. EOSC, EUA, LERU,
Science Europe, etc.
• Present collective choice arrangement
on desired scope and applicability in
an implementation agenda
II. Implementation structures • Implement Guiding Principles in • Based on the agenda, review contracts • Ongoing implementation of new
upcoming contracts at institutional renewals and projects for the and updated contracts depending on
level adaptation of Guiding Principles. current effectiveness of governance
• Implement Guiding Principles in • Implement new structures as model
upcoming contracts at collective level recommended by Development Forum
(SURF, UKB publish and read deals,
OKB development)
III. Monitoring Taskforce • Take stock of projects, contracts and • Evaluate contracts, make suggestions
infrastructures that ideally should be for improvement
governed by the guiding principles. • Annual report to forum on progress
of implementation and new
developments
• Public report on progress and
practices.
Table summarising key actions of the three parts of the governance structure.
16
Definitions
Algorithm: a recipe / method / mathematical representation Enriched metadata: Data referring to or about Research Output Research Analytics / Intelligence: Analysis with Research
that demonstrates the workings and mathematical integrity or Primary Metadata that is obtained from an external source Information.
behind the (re)creation of derived metadata. and is added or linked to (enriches) the primary records. Research Information: Information about Research Output; this
Data and Metadata: structured information related to research Keywords: The words “Must”, “Must Not”, “Required”, “Shall”, includes the (primary, enriched and derived) metadata.
output. This can be descriptive data (= metadata), usage “Shall Not”, “Should”, “Should Not”, “Recommended”, “May”, Research Output: articles, research data, software, standards,
data, APC costs, etc. When the term data is used we mean And “Optional” in this document are to be interpreted as protocols, etc. and related metadata (eg.title, abstract,
collections of metadata records related to research output. described in RFC 2119 .35
keywords, references, roles, affiliations, etc)
Derived metadata: metadata that is derived from Primary Knowledge Institutions: Dutch universities, academic medical Stakeholders: Knowledge Institutions, Proxy Institutions and
metadata, adding value to the prime record or aggregation. centres, NWO and KNAW institutes, and other institutes for Third-parties.
(eg. citation graphs, topic clustering, etc.) fundamental and applied research. Third Parties: not-for-profit organisations, commercial
Ecosystem: Scholarly communication and Research Analytics Primary metadata: metadata (eg. title, keywords, abstracts, organisations, knowledge institutions, proxy institutions,
services that are connected in terms of using input data from reference lists, etc) that is born from an intellectual creative individuals, etc who contribute and extract primary and
the output data of another service. process, or facts that are assembled in a distinct structure. derived metadata to the common resource pool.
Acknowledgements
17
References
3 Wilsdon, James et al. (2015). The Metric Tide: Report of 13 https://recognitionrewards.nl/ 29 https://www.edustandaard.nl/
5 Knowledge Exchanges, (2019), Open Scholarship and the need cc0/ 34 https://www.universiteitenvannederland.nl/files/documenten/
7 https://www.universiteitenvannederland.nl/nl_NL/ 25 https://www.w3.org/2005/09/dd-osd.html
nieuwsbericht/nieuwsbericht/552-dutch-research-
Nieuwsberichten/Guiding%20Principles%20on%20
Management%20of%20Research%20Information%20and%20
Data_11May.pdf
9 https://openscholarlyinfrastructure.org/
10 https://educopia.org/wp-content/
uploads/2020/10/20201105_NGLP_PrinciplesValues_
FinalPublication.pdf
18