Professional Documents
Culture Documents
Methodology,
2020
Second Edition
Assessment
Methodology,
2020
Second Edition
Some rights reserved. This work is available under the Creative Commons Attribution-
NonCommercial-ShareAlike 3.0 IGO licence (CC BY-NC-SA 3.0 IGO; https://creativecommons.org/
licenses/by-nc-sa/3.0/igo).
Under the terms of this licence, you may copy, redistribute and adapt the work for non-
commercial purposes, provided the work is appropriately cited, as indicated below. In any use
of this work, there should be no suggestion that WHO endorses any specific organization,
products or services. The use of the WHO logo is not permitted. If you adapt the work, then you
must license your work under the same or equivalent Creative Commons licence. If you create
a translation of this work, you should add the following disclaimer along with the suggested
citation: “This translation was not created by the World Health Organization (WHO). WHO is not
responsible for the content or accuracy of this translation. The original English edition shall be
the binding and authentic edition”.
Any mediation relating to disputes arising under the licence shall be conducted in accordance
with the mediation rules of the World Intellectual Property Organization (http://www.wipo.int/
amc/en/mediation/rules/).
Suggested citation. SCORE for health data technical package: assessment methodology, 2020.
Second edition. Geneva: World Health Organization; 2021. Licence: CC BY-NC-SA 3.0 IGO.
Third-party materials. If you wish to reuse material from this work that is attributed to a third
party, such as tables, figures or images, it is your responsibility to determine whether permission
is needed for that reuse and to obtain permission from the copyright holder. The risk of claims
resulting from infringement of any third-party-owned component in the work rests solely with
the user.
General disclaimers. The designations employed and the presentation of the material in
this publication do not imply the expression of any opinion whatsoever on the part of WHO
concerning the legal status of any country, territory, city or area or of its authorities, or
concerning the delimitation of its frontiers or boundaries. Dotted and dashed lines on maps
represent approximate border lines for which there may not yet be full agreement.
The mention of specific companies or of certain manufacturers’ products does not imply that
they are endorsed or recommended by WHO in preference to others of a similar nature that
are not mentioned. Errors and omissions excepted, the names of proprietary products are
distinguished by initial capital letters.
All reasonable precautions have been taken by WHO to verify the information contained in this
publication. However, the published material is being distributed without warranty of any kind,
either expressed or implied. The responsibility for the interpretation and use of the material lies
with the reader. In no event shall WHO be liable for damages arising from its use.
Contents
Acronyms........................................................................................................................................................... iv
Overview.............................................................................................................................................................. 1
Annexes...............................................................................................................................................................56
Annex 1. SCORE Intervention calculation .............................................................................................................57
Annex 2. SCORE Interventions, elements and indicators................................................................................ 58
Annex 3. SCORE Assessment maturity models for indicators included in scoring................................... 63
iii
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Acronyms
iv
OVERVIEW
VA Verbal Autopsy
v
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Overview
The SCORE for health data package uses five through WHO regional and country offices, and
interventions: Survey populations and health validated, most commonly, by the ministry of
risks; Count births, deaths and causes of death; health. During the review and verification process,
Optimize health service data; Review progress additional data were also submitted by multiple
and performance; Enable data use for policy institutions, including ministries of health,
and action. Each intervention has a set of key national public health institutions, bureaus of
elements, which is accompanied by a set of statistics, ministries of finance, and other bodies
indicators. In total, there are 24 quantitative responsible for specific data areas. Overall,133
and qualitative indicators for assessing SCORE countries validated the data or provided
interventions at various levels. permission to use the data from the desk review.
1
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Scoring example
Below is an example to calculate the country
score for intervention E, “Enable data use for
policy and action”, using a hypothetical scenario.
TABLE N.1
SCORING EXAMPLE FOR INDICATOR “NATIONAL MONITORING
AND EVALUATION (M&E) PLAN IS BASED ON STANDARDS”
Includes a core indicator list with baselines and targets 2 1 Not there
2 Partially there
Includes specification on data collection methods, digital 3
3 Mostly/all there
architecture required for reporting of key indicators
The sum of the indicator item scores is compared against the maturity model in table N.2 to determine
the indicator score, which is an integer between 1 and 5.
2
OVERVIEW
TABLE N.2
SCORING TABLE FOR NATIONAL MONITORING AND EVALUATION (M&E)
IS BASED ON STANDARDS
1 2 3 4 5
No M&E or Total score of key Total score of key Total score of key Total score of key
HIS plan exists indicator items is indicator items is indicator items is indicator items is
that is linked to 9 or less 10-14 15-17 18 or higher
the current national
health sector
strategic plan
In our example, the total sum of the indicator scores is 12, which corresponds to “Moderate capacity”.
Therefore, the country scores a 3 on indicator “National monitoring and evaluation (M&E) plan is based
on standards”.
Scoring for the second indicator is conducted in a similar way using Table N.3.
TABLE N.3
SCORING EXAMPLE FOR INDICATOR “NATIONAL DIGITAL HEALTH/
eHEALTH STRATEGY IS BASED ON STANDARDS”
The sum of the indicator item score is 16, which corresponds to “Sustainable capacity” in the scoring
table N.4. Therefore, the country scores a 5 for indicator “National digital health/eHealth strategy is
based on standards”.
3
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE N.4
SCORING TABLE FOR INDICATOR “NATIONAL DIGITAL HEALTH/
eHEALTH STRATEGY IS BASED ON STANDARDS”
1 2 3 4 5
An eHealth Total score of key Total score of key Total score of key Total score of key
strategy is indicator items is indicator items is indicator items is indicator items is
non-existent 8 or lower 9-12 between 13-15 16 or higher
or is no longer
current
The element score is the simple mean of the Therefore, the calculation of the intervention score
indicator scores under the element. In this is as follows:
example, the two indicator scores calculated
above are used to determine the element score: Score of “Enable data use for policy and action”
= [(0.3*Score of “data evidence”) + (0.4* Score
Score of “Strong country-led governance of data” of “data access and sharing”) + (0.3*Score of
= (Score of “National monitoring and evaluation “governance of data”)]
(M&E) is based on standards” + Score of “National
digital health/e-health strategy is based on Using the score for “Governance of data” we
standards”)/2 = (3+5)/2 = 4 calculated above and taking hypothetical scores
of 3 and 2 for the other two key elements, the
intervention score is calculated as follows:
SCORING THE INTERVENTION Score of “Enable data use for policy and action” =
(0.3*3) + (0.4*2) + (0.3*4) = 2.9
The intervention score is the weighted sum
of the elements under the intervention. The For simplicity, the final intervention score is
elements are weighted based on review by a set rounded up to make an integer. Therefore, in our
of experts to reflect their relative importance to a example, the country’s score for intervention “E
country’s ability to achieve high capacity for that (Enable data use for policy and action)” is 3.
intervention. Thus, elements that are considered
It is worth noting that the element scores are
critical are given higher weights.
usually calculated by taking the average of
In the following example, there are three elements the indicator scores, respectively. The scoring
in intervention “Enable data use for policy and methods for interventions are more complex
action”. The element “data access and sharing” is and are given in Annex 1.
considered the most important and was given a
weight of 0.40. The remaining two elements “data
and evidence” and “governance of data” are both
4
OVERVIEW
TABLE N.5
INDICATORS AND RESPONSES FOR DATA AVAILABILITY MEASUREMENT
TO MONITOR HEALTH-RELATED SDGS AND UHC
Maternal mortality ratio (per 100 000 live births) 0 No, not available
1 Yes, available
Proportion of births attended by skilled health personnel
Total alcohol per capita (≥15 years of age) consumption (litres of pure alcohol)
5
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Average death rate due to natural disasters (per 100 000 population)
6
OVERVIEW
Mortality rate due to homicide (per 100 000 population) 0 No, not available
1 Yes, available
Estimated direct deaths from major conflicts (per 100 000 population)
SCORING METHODOLOGY
An indicator gets a score of 1 if data are available total number of indicators that are relevant in
for this indicator since 2013 in the country. The the country’s context. This percentage is then
number of indicators for which data are available compared against the table N.6 to determine the
is divided by the total maximum score of 53, the country’s score.
TABLE N.6
SCORING TABLE FOR DATA AVAILABILITY SINCE 2013 TO MONITOR
HEALTH-RELATED SDGs AND UHC
1 2 3 4 5
Over last five years, Over last five years, Over last five years, Over last five years, Over last five years,
data available for data available data available data available data available for
<25% of indicators for 25–39% of for 40-59% of for <60-79% of at least 80% of
indicators indicators indicators indicators
DATA SOURCES
7
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Survey populations
and health risks
Census conducted in
Regular last 10 years in line with
population international standards with
census population projections for
sub-national units
8
SURVEY POPULATIONS AND HEALTH RISKS
TABLE S1.1
INDICATOR ITEMS AND RESPONSE FOR “A SYSTEM OF REGULAR
AND COMPREHENSIVE POPULATION HEALTH SURVEYS THAT MEETS
INTERNATIONAL STANDARDS”*
9
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
10
SURVEY POPULATIONS AND HEALTH RISKS
A value of 1 is assigned if there are five or more An overall score is calculated using three indicator
surveys, 0.9 for four surveys, 0.8 for three surveys, scores as follows:
0.7 for two surveys, and 0.6 for one survey.
0.35 * “health topics” + 0.55 * ”survey attributes”
+ 0.1 * score of “number of surveys”
TABLE S1.2
SCORING TABLE FOR ELEMENT S1: A SYSTEM OF REGULAR AND
COMPREHENSIVE POPULATION HEALTH SURVEYS THAT MEETS
INTERNATIONAL STANDARDS
1 2 3 4 5
Overall scores Overall scores Overall scores Overall scores Overall scores
<0.25 0.25-0.49 0.50–0.70 0.71-0.89 ≥0.90
DATA SOURCES
11
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
12
SURVEY POPULATIONS AND HEALTH RISKS
TABLE S2.2
INDICATOR ITEMS AND RESPONSE FOR “INDICATOR AND EVENT-BASED
SURVEILLANCE IN PLACE BASED ON IHR STANDARDS” AS MEASURED
THROUGH SPAR*
TABLE S2.3
INDICATOR ITEMS AND RESPONSE FOR “INDICATOR AND EVENT-BASED
SURVEILLANCE IN PLACE BASED ON IHR STANDARDS” AS MEASURED
THROUGH JEE*
Inter-operable, 1 None
inter-connected, 2 Being developed for either public health or veterinary surveillance systems
electronic real-time 3 In place for either public health or veterinary surveillance systems
reporting system but not yet able to share data in real-time
4 In place for public health and/or veterinary surveillance systems
but not yet fully sustained by host government
5 Fully functional for both public health and veterinary surveillance systems
13
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE S2.4
INDICATOR ITEMS AND RESPONSE FOR “INDICATOR AND EVENT-BASED
SURVEILLANCE IN PLACE BASED ON IHR STANDARDS” AS MEASURED BY
IHR SELF-ASSESSMENT*
14
SURVEY POPULATIONS AND HEALTH RISKS
SCORING METHODOLOGY
For countries that report SPAR or use IHR self-assessment average score, the mean of item percentages
is calculated. For JEE, the percentage is calculated by dividing the total item score by the total maximum
score of 30. The resulting percentage is then compared against the table below to obtain the indicator
score respectively.
TABLE S2.5
SCORING TABLE FOR ELEMENT S2. INDICATOR AND EVENT-BASED
SURVEILLANCE IN PLACE BASED ON INTERNATIONAL HEALTH
REGULATIONS STANDARDS
1 2 3 4 5
Average % Average % Average % Average % Average %
implementation implementation implementation implementation implementation
of surveillance of surveillance of surveillance of IHR surveillance of surveillance
indicators indicators indicators indicators indicators
≤20% 21%-40% 41%-60% 61%-80% 81%-100%
DATA SOURCES
The main data source for this indicator is the IHR SPAR tool, which is available for the majority of WHO
Member States. For countries without a SPAR, the JEE would be the second choice and finally the self-
assessed IHR.
15
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE S3.1
INDICATOR ITEMS AND RESPONSES FOR “CENSUS CONDUCTED IN LAST
10 YEARS IN LINE WITH INTERNATIONAL STANDARDS WITH POPULATION
PROJECTIONS FOR SUBNATIONAL UNITS”
SCORING METHODOLOGY
A percentage is calculated by dividing the sum score of the three indicator items by the total maximum
score of 7 as described in table S3.1. This percentage is then compared against the scoring table S3.2 to
determine the overall indicator score.
16
SURVEY POPULATIONS AND HEALTH RISKS
TABLE S3.2
SCORING TABLE FOR INDICATOR S3.1. CENSUS CONDUCTED IN LINE
WITH STANDARDS
1 2 3 4 5
25% of criteria 26-49% 50%-70% of 71%-90% of Greater than
are met or less of criteria are met criteria are met criteria are met 90% of criteria
are met
DATA SOURCES
17
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Completeness of death
Full birth and
registration
death registration
Core attributes of a
functional CRVS in place to
generate vital statistics*
Quality of cause-of-death
Certification and
data (% of cause of death
reporting of causes
with ill-defined or unknown
of death causes of mortality)
Core attributes of a
functional system to
generate cause-of-death
statistics*
18
COUNT BIRTHS, DEATHS AND CAUSES OF DEATH
SCORING METHODOLOGY
Completeness of birth registration is assessed by calculating the percentage of registered birth among all
births. This percentage is compared against the tables below to determine the score for birth registration.
TABLE C1.2
SCORING TABLE FOR INDICATOR C1.1. COMPLETENESS OF BIRTH
REGISTRATION
1 2 3 4 5
There is no <50% 50-74% 75-89% ≥90%
data on birth
registration
completeness
19
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
DATA SOURCES
SCORING METHODOLOGY
TABLE C1.4
SCORING TABLE FOR INDICATOR C1.2. COMPLETENESS OF DEATH
REGISTRATION
1 2 3 4 5
There is no <50% 50-74% 75-89% ≥90%
data on death
registration
completeness
DATA SOURCES
20
COUNT BIRTHS, DEATHS AND CAUSES OF DEATH
21
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
SCORING METHODOLOGY
The eight indicator items that measure a functional CRVS system are assessed based on their availability
as shown in table C1.5. This indicator is not used in overall scoring but can be included in additional
analysis where available.
DATA SOURCES
ELEMENT SCORING
The score for element C1 is calculated using formula: C1 = [indicator C1.1 (completeness of birth
registration) + indicator C1.2 (completeness of death registration)] / 2. The calculated value is rounded
down to the closest integer and compared to the scoring table C1.6 below.
TABLE C1.6
SCORING TABLE FOR ELEMENT C1. FULL BIRTH AND DEATH
REGISTRATION
1 2 3 4 5
22
COUNT BIRTHS, DEATHS AND CAUSES OF DEATH
SCORING METHODOLOGY
The indicator score is determined by comparing the response from table C2.1 against the scoring table C2.2.
23
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE C2.2
SCORING TABLE FOR INDICATOR C2.1. COMPLETENESS OF DEATHS
WITH CAUSE OF DEATH REPORTED TO NATIONAL AUTHORITIES AND/OR
INTERNATIONAL INSTITUTIONS
1 2 3 4 5
There is no Score <30% Score 30-69% Score 70-89% Score ≥90%
standardised
system for medical
certification of
cause of death
DATA SOURCES
SCORING METHODOLOGY
The response from table C2.3 is compared against the scoring table C2.4 to determine the indicator score.
24
COUNT BIRTHS, DEATHS AND CAUSES OF DEATH
TABLE C2.4
SCORING TABLE FOR INDICATOR C2.2. QUALITY OF CAUSE-OF-
DEATH DATA
1 2 3 4 5
Not applicable At least 30% 20-29% ill-defined 10-19% ill-defined Less than 10%
in the absence of ill-defined or or unspecified or unspecified ill-defined or
data unspecified causes causes causes unspecified
DATA SOURCES
25
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
SCORING METHODOLOGY
The nine indicator items that measure a functional system to generate cause-of-death statistics are
assessed based on their availability as shown in table C2.5. This indicator is not used in overall scoring but
can be included in additional analysis where available.
DATA SOURCES
Country rapid and/or comprehensive CRVS assessments.
ELEMENT SCORING
The score for element C2 is calculated using formula: C2 = [indicator C2.1 (completeness of death with cause of
death reported) + indicator C2.2 (quality of cause-of-death data)] / 2. The calculated value is rounded down to
the closest integer and compared to the scoring table C2.6 below.
1 2 3 4 5
26
COUNT BIRTHS, DEATHS AND CAUSES OF DEATH
27
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Optimize health
service data
Regular system to
Well-established system
monitor service
to independently monitor
availability, quality health services
and effectiveness
28
OPTIMIZE HEALTH SERVICE DATA
Documented data quality checks for primary health care facility data 0 No/Not available
1 Partial
Documented data quality checks for hospital data 2 Comprehensive
29
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
SCORING METHODOLOGY
The first 11 items reported from health facilities score of 1. For example, the item of OPD visits
are scored on availability at national level. (new/revisits) gets a score of 0 if there is no
Most of them are also scored on availability at data; it gets a 0.5 if data is available at national
sub-national level and disaggregation by age level only, but not at sub-national level with no
and sex. The score for each indicator item is the disaggregated data by age and sex; it gets a score
sum of weighted scores on the four attributes of 1 (0.5+0.25+0.125+0.125=1) if data is available
(national, subnational, age, sex) with more credit at both national and sub-national level, and
given for having national level data. Weighting disaggregated data are also available by both age
details are in table O1.2. All 11 indicator items and sex.
have a minimum score of 0 and a maximum
TABLE O1.2
WEIGHTS AND THEIR APPLICABILITY FOR 11 FACILITY-BASED INDICATORS*
Sub-
Indicator items National National Age Sex Item weight
0.7 national
DTP/Penta3 (<1 )
0.3 subnational
Institutional maternal
mortality ratio
0.625 national
Low birthweight prevalence
0.25 subnational
among institutional births
0.125 sex
0.625 national
Tuberculosis treatment
0.25 subnational
success rates
0.125 age
0.6 national
ART coverage 0.2 age
0.2 sex
30
OPTIMIZE HEALTH SERVICE DATA
The remaining five items in table O1.1 are added The total score for this indicator is calculated
as a measure of the quality of the reported data. by summing up all the 16 item scores, and then
These items have scores ranging from 0 to 2 or divided by the total maximum score of 24 to
from 0 to 3 based on the response category. The determine the percentage of the criteria that are
maximum sum score for these five items is 13. met. This percentage is then compared against the
scoring table O1.3 to determine the indicator score.
TABLE O1.3
SCORING TABLE FOR ELEMENT O1. AVAILABILITY OF ANNUAL STATISTIC
FOR SELECTED INDICATORS DERIVED FROM FACILITY DATA
1 2 3 4 5
Meets <25 % Meets 25-49% Meets 50-70% Meets 71-89% Meets ≥90%
of criteria for of criteria for of criteria for of criteria for of criteria for
availability availability availability availability availability
DATA SOURCES
Health management information system (HMIS) reports (primary health care and hospital reports),
master facility list documentation/report, cancer registry annual report.
31
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
*All items are not included in the calculation of overall element score.
The nine indicator items that measure a functional HMIS reports (primary health care and hospital
facility/patient reporting system are assessed reports), master facility list documentation/
based on their availability as shown in table O1.4. report, cancer registry annual report.
This indicator is not used in overall scoring but can
be included in additional analysis where available. HMIS/HIS assessment reports, Performance of
Routine Information System Management (PRISM)
assessment reports.
32
OPTIMIZE HEALTH SERVICE DATA
TABLE O2.1
INDICATOR ITEMS AND RESPONSE FOR “WELL-ESTABLISHED SYSTEM
TO INDEPENDENTLY MONITOR HEALTH SERVICES”
SCORING METHODOLOGY
Only the first two indicator items in table O2.1 are used in the overall scoring for this indicator. Based on
the system in place, countries are scored on the availability of either items using table O2.2 below.
33
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE O2.2
SCORING TABLE FOR ELEMENT O2. WELL-ESTABLISHED SYSTEM
TO INDEPENDENTLY MONITOR HEALTH SERVICES
1 2 3 4 5
Survey-based Survey-based Survey-based Survey-based Survey-based
system for system for system for system for system for
monitoring of monitoring of monitoring of the monitoring of the monitoring of
the quality of the quality of quality of services quality of services the quality of
services = 1 and services = 2 or =3 =4 services = 5 or
accreditation accreditation accreditation
system = 1 system = 2 system = 3
DATA SOURCES
Facility survey reports, annual statistics reports, adverse event reports and accreditation reports.
34
OPTIMIZE HEALTH SERVICE DATA
All countries should also have a system of national 3. national human resource for health information
health workforce accounts (NHWA) that can system (HRHIS) is in place and functional.
generate and improve the availability, quality and
use of health workforce data (including health
workforce distribution).
The three indicator items in table O3.1 are scored National health accounts reports/data bases
individually; and the total sum score is compared
against the scoring table O3.2 to determine the
indicator score.
35
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE O3.2
SCORING TABLE FOR INDICATOR O3.1. AVAILABILITY OF LATEST DATA
ON NATIONAL HEALTH EXPENDITURE
1 2 3 4 5
Key health Total weighted Total weighted Total weighted Total score of key
expenditure score of key score of key score of key indicator items is 3
indicators are not indicator items is indicator items is indicator items is
produced less than 1 between 1 and 2 between 2 and 3
Sub- Public/
Indicator items National national private Age Sex Item weight
Nurses/midwives (where
not reported separately)
*When nurses and midwives are measured separately in a country, the maximum score is 5; if they are assessed jointly, the
maximum score is 4.
36
OPTIMIZE HEALTH SERVICE DATA
SCORING METHODOLOGY
For each item, the score is calculated on data availability at national level and subnational level, and
disaggregation by age, sex and private/ public facilities. The score for each indicator is the sum of weighted
scores based on the five attributes described above with more credit given for having national level data.
The minimum score for each item is 0 and maximum 1. The average of the item scores is calculated and
compared against the scoring table O3.4 to determine the indicator score.
TABLE O3.4
SCORING TABLE FOR INDICATOR O3.2. HEALTH WORKER DENSITY AND
DISTRIBUTION UPDATED ANNUALLY
1 2 3 4 5
Meets <20 % Meets 20-39% Meets 40-59% Meets 60-79% Meets ≥80%
of criteria for of criteria for of criteria for of criteria for of criteria for
availability availability availability availability availability
DATA SOURCES
37
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
SCORING METHODOLOGY
This indicator is not used in overall scoring but can be included in additional analysis where available.
DATA SOURCES
38
OPTIMIZE HEALTH SERVICE DATA
39
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Review progress
and performance
Institutional
Institutional capacity in
capacity for
data analysis at national
analysis and and subnational levels
learning
40
REVIEW PROGRESS AND PERFORMANCE
TABLE R1.1
INDICATOR ITEMS AND RESPONSE FOR “HIGH QUALITY ANALYTICAL
REPORT OF PROGRESS AND PERFORMANCE OF HEALTH SECTOR
STRATETIC PLAN PRODUCED ANNUALLY”
SCORING METHODOLOGY
The ten items in table R1.1 are scored based on the responses; and the total sum score is calculated and
compared against the scoring table R1.2 to determine the indicator (element) score.
41
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE R1.2
SCORING TABLE FOR ELEMENT R1. HIGH QUALITY ANALYTICAL REPORT
OF PROGRESS AND PERFORMANCE OF HEALTH SECTOR STRATETIC
PLAN PRODUCED ANNUALLY
1 2 3 4 5
No report Total weighted Total weighted Total weighted Total score of key
produced in past score of key score of key score of key indicator items is
5 years indicator items is indicator items is indicator items is 25 or higher
less than 12 12 to less than 20 20 to less than 25
DATA SOURCES
Ministry of health’s health sector performance reports (annual, midterm, final evaluations), annual health
sector analysis reports/other scorecards and reports, and health sector/programme reviews.
42
REVIEW PROGRESS AND PERFORMANCE
TABLE R2.1
INDICATOR ITEMS AND RESPONSE FOR “INSTITUTIONAL CAPACITY IN
DATA ANALYSIS AT NATIONAL AND SUBNATIONAL LEVELS”
*Item is not included in the calculation of overall indicator score. **Average score for the three areas listed is used.
SCORING METHODOLOGY
The three items in table R2.1 are scored based on the responses; the average score is calculated and
compared against the scoring table R2.2 to determine the indicator (element) score.
43
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE R2.2
SCORING TABLE FOR ELEMENT R2. INSTITUTIONAL CAPACITY IN DATA
ANALYSIS AT NATIONAL AND SUBNATIONAL LEVELS
1 2 3 4 5
Key indicator items Key indicator Key indicator items Key indicator items Key indicator items
meet 25% or less items meet more meet 50% to meet 67% to meet at least 85%
of standards than 25% but less than 67% of less than 83% of of standards
less than 50% standards standards
standards
DATA SOURCES
44
REVIEW PROGRESS AND PERFORMANCE
45
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Foundational elements to
promote data use and access
are present
46
REVIEW PROGRESS AND PERFORMANCE
TABLE E1.1
INDICATOR ITEMS AND RESPONSE FOR “NATIONAL HEALTH PLAN AND
POLICIES ARE BASED ON DATA AND EVIDENCE”
National health plan/policies include review of past performance (trends) 1 Not there
2 Partially there
National health plan/policies include burden of disease analysis
3 Mostly/all there
National health plan/policies include health system strength analysis
(response strength)
Level of output of a central unit or function in MoH for data and evidence 1 Rarely/no outputs
to policy translation 2 Annual
3 At least quarterly
SCORING METHODOLOGY
The six items in table E1.1 are scored based on the response; and the total sum score is compared
against the scoring table E1.2 to determine the score.
47
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE E1.2
SCORING TABLE FOR ELEMENT E1. NATIONAL HEALTH PLAN AND
POLICIES ARE BASED ON DATA AND EVIDENCE
1 2 3 4 5
Total score of key Total score of key Total score of key Total score of key Total score of key
indicator items is indicator items is indicator items is indicator items is indicator items is
3 or less 4-6 7-8 9-11 12 or higher
DATA SOURCES
48
ENABLE DATA USE FOR POLICY AND ACTION
TABLE E2.1
INDICATOR ITEMS AND RESPONSE FOR “HEALTH STATISTICS ARE
PUBLICLY AVAILABLE”
49
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE E2.2
SCORING TABLE FOR ELEMENT E2. HEALTH STATISTICS ARE PUBLICLY
AVAILABLE
1 2 3 4 5
Total score of key Total score of key Total score of key Total score of key Total score of key
indicator items is indicator items is indicator items is indicator items is indicator items is
8 or less 9-12 13-16 17-20 21 or higher
The eight indicator items in table E2.1 are scored On-line databases/briefs and reports.
based on the response; and the total sum score
is compared against the scoring table E2.2 to
determine the indicator (element) score.
50
ENABLE DATA USE FOR POLICY AND ACTION
Includes a core indicator list with baselines and targets 1 Not there
2 Partially there
Includes specification on data collection methods,
3 Mostly/all there
digital architecture required for reporting of key indicators
SCORING METHODOLOGY
51
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
TABLE E3.2
SCORING TABLE FOR INDICATOR E3.1. NATIONAL MONITORING AND
EVALUATION (M&E) IS BASED ON STANDARDS
1 2 3 4 5
No M&E or HIS Total score of key Total score of key Total score of key Total score of key
plan exists that indicator items is indicator items is indicator items is indicator items is
is linked to the 9 or less 10-14 15-17 18 or higher
current national
health sector
strategic plan
DATA SOURCES
National health strategic plan; national M&E plans; national eHealth or m-Health plans;
plans; national health annual operational plans; national policy legal and regulatory frameworks
national health budget; HIS assessment reports; for HIS; M&E coordination mechanism terms
HMIS assessments; national digital health or reference.
Digital plan/eHealth strategy includes discussion of health data architecture 1 Not there
2 Partially there
Digital plan/eHealth strategy includes description of health
3 Mostly/all there
data standards and exchange
52
ENABLE DATA USE FOR POLICY AND ACTION
SCORING METHODOLOGY
The six indicator items in table E3.3 are scored based on the response; and the total sum score is
compared against the scoring table E3.4 to determine the indicator score.
TABLE E3.4
SCORING TABLE FOR INDICATOR E3.2. NATIONAL DIGITAL HEALTH/
eHEALTH STRATEGY IS BASED ON STANDARDS
1 2 3 4 5
An eHealth Total score of key Total score of key Total score of key Total score of key
strategy is indicator items is indicator items is indicator items is indicator items is
non-existent or is 8 or less 9-12 between 13-15 16 or higher
no longer current
DATA SOURCES
National health strategic plan; national M&E plans; national annual operational plan; national health
budget; HIS assessment reports; HMIS assessments; national digital health plans; national eHealth or
m-Health plans; national policy legal and regulatory frameworks for HIS; M&E coordination mechanism
terms or reference.
53
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Legal framework or policies are enforced 1 Legislation exists but is not enforced
2 Legislation exists but is not enforced
consistently
3 Legislation exists and is enforced
4 Legislation exists, is enforced and actively
reviewed to reflect changes in health domain
SCORING METHODOLOGY
This indicator is not used in overall scoring but can be included in additional analysis where available.
DATA SOURCES
National health strategic plan; national M&E plans; national health annual operational plans; national health
budget; HIS assessment reports; HMIS assessments; national digital health plans; national e-Health or
m-Health plans; national policy legal and regulatory frameworks for HIS; M&E coordination mechanism
terms or reference.
ELEMENT SCORING
The score for element E3 is calculated using formula: E3 = [indicator E3.1 (national M&E is based on
standards) + indicator E2.2 (national eHealth strategy is based on standards)] / 2. The calculated value is
rounded down to the closest integer and compared to the scoring table E3.6 below.
TABLE E3.6
SCORING TABLE FOR ELEMENT E3. STRONG COUNTRY-LED
GOVERNANCE OF DATA
1 2 3 4 5
54
ENABLE DATA USE FOR POLICY AND ACTION
55
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
Annexes
Annex 1.
SCORE Intervention calculation
Annex 2.
SCORE Intervention, elements and indicators
Annex 3.
SCORE Assessment maturity models for
indicators included in scoring
56
ANNEX 1
TABLE 1.
SCORE INTERVENTION CALCULATION ALGORITHM
Intervention Element Weight Element Intervention scoring
All values calculated for interventions are rounded up to the next integer and are compared to table 2
below for final scoring, except intervention C for which the value is rounded down to the closest integer.
TABLE 2.
SCORING TABLE FOR INTERVENTIONS
1 2 3 4 5
57
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
S1. S1.1. A system of regular • At least one survey conducted in the last five years that:
System of regular and comprehensive • Cover major health priorities
population-based population health surveys • Cover major dimensions of inequity
health surveys that meets international • Are aligned with international standards
standards • Are funded by government
*The indicator or attribute is not included in the calculation of overall element score.
58
ANNEX 2
59
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
O3. O3.1. Availability of • Data available within last five years on:
Health service latest data on national • Public health expenditure
resources: health health expenditure • Private health expenditure
financing and • Catastrophic spending
health workforce
O3.2. Availability of data • Information, including availability at sub-national level and
on health workforce major levels of disaggregation for:
density and distribution • Medical doctors
updated annually • Nurses
• Midwives
• Dentists
• Pharmacists
O3.3. National human • Human resource for health information systems tracks
resources health • Number of entrants to the labour market
information system is in • Number of active stock on the labour market
place and functional* • Number of exits from the labour market
• Demographic distribution of health workers
• Subnational level data of active health workers
• Number of graduates from education and training
institutions
• Information on foreign-born and/ or foreign-trained
health workers
*The indicator or attribute is not included in the calculation of overall element score.
60
ANNEX 2
R1. R1.1. High quality • Analytic report published within last five years:
Regular analytical analytical reports • Uses all available data sources
reviews of on progress and • Assesses progress against targets
progress and performance of health • Pays attention to measures of inequity
performance, sector strategy/plan are • Links performance to health inputs
with equity produced annually • Provides comparative analysis
• Includes subnational rankings
• Evaluates performance of hospitals and large facilities
• Summarizes main findings for use for policy
and planning
61
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
E1. E1.1. National health plan • National health plan/policies include review
Data and evidence and policies are based on of past performance (trends)
drive policy and data and evidence • National health plan/policies include burden
planning of disease analysis
• National health plan/policies include health system
strength analysis (response strength)
• Presence of a central unit or function in ministry of
health for data and evidence to policy translation
• Level of output of a central unit or function in ministry
of health for data and evidence to policy translation
• Coordination function between ministry of health
and partners
*The indicator or attribute is not included in the calculation of overall element score.
62
ANNEX 3
1 2 3 4 5
S1. Overall score is Overall score is Overall score is Overall score is Overall score is
System <0.25 0.25-0.49 0.50–0.70 0.71-0.89 ≥0.90
of regular
population-
based health
surveys
C2.1. There is no Score <30% Score 30-69% Score 70-89% Score ≥90%
Certification standardised
and reporting system
of causes for medical
of death certification of
- reporting cause of death
63
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
1 2 3 4 5
O1. Meets <25 % Meets 25-49% Meets 50-70% Meets 71-89% Meets ≥90%
Routine facility of criteria for of criteria for of criteria for of criteria for of criteria for
reporting availability availability availability availability availability
system with
patient
monitoring
O3.1. Key health Total weighted Total weighted Total weighted Total score of
Health service expenditure score of key score of key score of key key indicator
resources indicators are indicator items indicator items indicator items items is 3
- health not produced is less than 1 is between is between
financing 1 and 2 2 and 3
O3.2. Meets <20 % Meets 20-39% Meets 40-59% Meets 60-79% Meets ≥80%
Health service of criteria for of criteria for of criteria for of criteria for of criteria for
resources availability availability availability availability availability
- health
workforce
R1. No report Total weighted Total weighted Total weighted Total score of
Regular produced in score of key score of key score of key key indicator
analytical past 5 years indicator items indicator items indicator items items is 25 or
reviews of is less than 12 is 12 to less is 20 to less higher
progress and than 20 than 25
performance,
with equity
R2. Key indicator Key indicator Key indicator Key indicator Key indicator
Institutional items meet items meet items meet items meet items meet at
capacity for 25% or less of more than 50% to less 67% to less least 85% of
analysis and standards 25% but less than 67% of than 83% of standards
learning than 50% standards standards
standards
64
ANNEX 3
1 2 3 4 5
E1. Total score of Total score of Total score of Total score of Total score of
Data and key indicator key indicator key indicator key indicator key indicator
evidence drive items is 3 or items is 4-6 items is 7-8 items is 9-11 items is 12 or
policy and less higher
planning
E2. Total score of Total score of Total score of Total score of Total score of
Data access key indicator key indicator key indicator key indicator key indicator
and sharing items is 8 or items is 9-12 items is 13-16 items is 17-20 items is 21 or
less higher
E3.1. No M&E or HIS Total score of Total score of Total score of Total score of
Strong plan exists key indicator key indicator key indicator key indicator
country-led that is linked items is 9 or items is 10-14 items is 15-17 items is 18 or
governance of to the current less higher
data – M&E national health
sector strategic
plan
E3.2. An eHealth Total score of Total score of Total score of Total score of
Strong strategy is key indicator key indicator key indicator key indicator
country-led non-existent items is 8 or items is 9-12 items is items is 16 or
governance of or is no longer less between 13-15 higher
data – eHealth current
strategy
65
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
66
SCORE FOR HEALTH DATA TECHNICAL PACKAGE: ASSESSMENT METHODOLOGY, 2020. SECOND EDITION
20 Avenue Appia
CH-1211 Geneva 27
Switzerland
score@who.int
who.int/healthinfo/en