You are on page 1of 8

Published by Oxford University Press in association with The London School of Hygiene and Tropical Medicine Health Policy

cy and Planning 2012;27:527–534


ß The Author 2011; all rights reserved. Advance Access publication 8 December 2011 doi:10.1093/heapol/czr076

How to do (or not to do) . . . Tracking data on


development assistance for health
Karen A Grépin,1* Katherine Leach-Kemon,2 Matthew Schneider3 and Devi Sridhar4
1
Assistant Professor of Global Health Policy, New York University Robert F Wagner Graduate School of Public Service, New York,
United States, 2Data Development Manager, Institute for Health Metrics and Evaluation, University of Washington, Seattle, United States,
3
Post-Bachelor Fellow, Institute for Health Metrics and Evaluation, University of Washington, Seattle, United States and 4University
Lecturer in Global Health Politics, Department of Public Health, Oxford University, Oxford, United Kingdom
*Corresponding author. NYU Robert F Wagner Graduate School of Public Service, 295 Lafayette Street, 3rd Floor, New York, NY 10012-9604,
USA. Tel: þ1-212-998-7428. Fax: þ1-212-995-4162. E-mail: karen.grepin@nyu.edu

Accepted 23 September 2011

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


Development assistance for health (DAH) has increased substantially in recent
years and is seen as important to the improvement of health and health systems
in developing countries. As a result, there has been increasing interest in
tracking and understanding these resource flows from the global health
community. A number of datasets, each with its own strengths and weaknesses,
are available to track DAH. In this article we review the available datasets on
DAH and summarize the strengths and weaknesses of each of these datasets to
help researchers make the best choice of which to use to inform their analysis.
Finally, we also provide recommendations about how each of these datasets
could be improved.
Keywords Development assistance for health, global health data, foreign aid, bilateral
donors, multilateral donors, Global Fund, GAVI

KEY MESSAGES
 The provision of development assistance for health (DAH) is important to the improvement of health and health systems
in developing countries, and has increased substantially. Interest in tracking and understanding these resource flows
from the global health community has likewise increased.

 This review provides an overview of the strengths and weaknesses of the datasets available to track DAH, in order to help
users decide which dataset is best suited for their analysis.

Introduction Over the past decade, the global health community has
shown greater interest in understanding general trends in DAH
Development assistance for health (DAH) has increased sub-
(Ravishankar et al. 2009; Murray et al. 2011; Stuckler et al.
stantially in recent years.1 According to the Organisation
2011), how DAH has been allocated among different health
for Economic Co-operation and Development’s (OECD)
priorities (Greco et al. 2008; Shiffman 2008; Sridhar and Batniji
Creditor Reporting System (CRS), total DAH commitments 2008; Liese and Schubert 2009; Patel et al. 2009; Piva and Dodd
have increased from $6.6 billion in 2000 to $19.9 billion in 2009; Ravishankar et al. 2009; Schaferhoff et al. 2010), the
2009.2 These resources have not only increased in absolute allocations of DAH made by particular donors (McCoy et al.
amount but have also increased relative to the gross domestic 2009), and the impact of these resources on health outcomes
product of recipient countries (Lu et al. 2010). These increases (Mishra and Newhouse 2009). There has also been an increase
have been driven by larger commitments from both traditional in the availability of DAH statistics; in the past few years alone
donors and from new donors, such as the Bill & Melinda Gates two major new datasets have been developed to provide data on
Foundation (BMGF) (McCoy et al. 2009). DAH. Those interested in conducting research on DAH now

527
528 HEALTH POLICY AND PLANNING

have a choice between datasets on DAH. Since each of these procedures across a range of donors, thereby collecting com-
datasets has been developed for a different purpose, for parable data from a diverse set of donors. Finally, the OECD
a different audience and using a different approach, one provides the data freely on its website which can be easily
dataset might be better suited than another for a particular downloaded in a number of formats (http://www.oecd.org/dac/
type of analysis. stats/idsonline).
The purpose of the following article is to provide an overview There are also a number of limitations to using the DAC
of the data sources currently available to track DAH. We datasets. While the completeness of data reporting to the DAC
summarize the features of the main datasets, including the has improved over the years, the comprehensiveness of the CRS
kind of DAH tracked, the donors and recipients included, data varies overtime and was not considered sufficiently
the years for which the data were available and types of outlays comprehensive until recently.5 Furthermore, since only bilateral
included. We discuss the strengths and limitations of each contributions of donor countries are reported in the CRS, it is
dataset and describe how to access the data. Table 1 provides a not possible to account for all resource contributions from an
summary of the main features and information of each dataset individual donor country using the CRS alone. Plus, the CRS
included in this review. In addition, we provide recommenda- mainly only collects data from DAC members, so it only
tions about how data collection efforts could be improved. captures limited data from select global health initiatives and
non-DAC bilateral donors and does not capture data from
non-governmental organizations (NGOs) or foundations, with
DAH datasets the exception of data from BMGF which began reporting data

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


to the DAC in 2009, and can be downloaded from the CRS
OECD-DAC online in the file containing data on Other Official Flows and
The most commonly used source of information on DAH comes Private Grants.6
from the OECD Development Assistance Committee (DAC),
which collects on an ongoing basis data on aid and other
resource flows to developing countries from member institu- AidData/PLAID dataset
tions, some multilateral organizations, and other donors.3 These Designed to address some of the limitations of the CRS dataset,
data feed into two databases: the DAC annual aggregate the Project-Level Aid (PLAID) dataset was developed by
statistics, which provide data on aid flows broken down by researchers at the College of William and Mary and Brigham
either donor, geographic region, type of aid, or sector; and the Young University in the United States (US). It has built on the
CRS aid activity database, which provides project-level data, CRS dataset by including data from more non-DAC bilateral
including descriptive data of the projects when provided by and other donors, collecting data directly from multilateral
donors, which can be more flexibly manipulated by users. DAC donors, standardizing some problematic variables, improving
members report annually to the DAC secretariat official project-level data descriptions and increasing the accessibility of
development assistance (ODA), other official flows (OOF) and the data via a more user-friendly interface. In 2010, PLAID
private funding (foreign direct investment, bank and non-bank partnered with Development Gateway to become known as
flows) to developing countries. The DAC secretariat is AidData. AidData tracks ODA plus additional aid flows, such as
responsible for processing and disseminating the data. market-rate loans, but like CRS it currently only tracks aid
The aid component of these flows is known as ODA, which is flows from official aid agencies.7
defined as grants, technical assistance or concessional loans A major advantage of AidData over CRS is that it includes
given by official donors to developing countries for the purpose more data from non-DAC bilateral donors, as well as additional
of improving welfare or promoting economic development multilateral and inter-governmental organizations.8 Data from
(OECD-DAC, no date, a). The CRS reports ODA and OOF, these agencies were collected from a number of sources, such as
while the aggregate data also contain additional aid flows annual reports, public websites or the statistical agencies of the
(OECD-DAC, no date, b). To avoid double counting, the CRS donors. While expanding the availability of data, this approach
only reports the bilateral contributions of donors and not their has led to a less standardized data collection process across
contributions to the regular budgets of multilateral institutions; donors than is used by the CRS, which uses the same data
however, data on these contributions can be obtained in the collection procedure across all reporting agencies. In addition,
aggregate DAC statistics. For example, Canada may provide the approach of collecting data from multilateral donors directly
bilateral funding directly to the government of Mali and some may have lead to some double counting of aid flows. Moreover,
of the funds it contributes to the World Bank’s regular budget the availability of historical data by donor varies greatly and
may also be used to finance health projects in Mali. The CRS therefore aggregate estimates of aid flows will also be
would only attribute the former and not the latter as aid influenced by the entry of new agencies into the dataset and
flowing from Canada to Mali.4 Expenditures from the regular not just a change in funding commitments of previously
budgets of multilateral institutions are counted as multilateral reporting agencies.
aid in the CRS database. AidData has made efforts to recode traditionally problematic
There are many advantages to using the OECD-DAC data- CRS variables, such as country names and dollar amounts. The
bases. First, they are the most comprehensive source of data on development team has also developed a new coding scheme to
development assistance in general and therefore can be used to allocate aid flows to multiple sectors and purposes, if appro-
make comparisons across sectors. The DAC has been collecting priate, thus enabling users to gain more insight into the use of
data since 1967 and therefore provides the longest times series the aid flows. To construct such variables, however, the
of any dataset. In addition, the DAC uses standard reporting developers had to manually inspect project descriptions and
Table 1 Main features of the development assistance for health (DAH) datasets reviewed

Dataset Dates available Types of outlays Included donors Included recipients Types of aid flows Suitable analyses
OECD Aggregate 1973 onwards, Commitments and DAC members, select non-DAC Developing countries or territories ODA, other official flows and Aggregate trends in DAH by
Aid Statistics annually disbursementsa donors, World Bank, Regional and multi-country recipients private funding by sector, recipient/donor/sector;
Development Banks, and some donor or recipient comparisons with other sectors/
UN agencies total aid
OECD CRS 1973 onwards, Commitments and DAC members, select non-DAC Developing countries or territories ODA by sector, donor Aggregate trends in DAH by
annually disbursementsa bilaterals, World Bank, Regional and multi-country recipients and/or recipient recipient/donor/sector;
Development Banks, BMGF comparisons with other sectors/
(2009-onwards), and some UN total aid; project descriptions
agencies
AidData/PLAID 1945 onwards,b Commitments or DAC members, select non-DAC Developing countries or territories Grants, loans and technical Aggregate trends in DAH;
annually disbursements bilaterals, World Bank, Regional and select middle-income assistance (in-kind or non-traditional donors; detailed
Development Banks, UN countries financial) project descriptions; comparisons
agencies, multilaterals, GAVI with other sectors/total aid
and GFATM
IHME’s DAH 1990 onwards, Estimated and National treasuries, corporations, World Bank (IBRD and IDA), IDB, Loans and grants (in-kind and Volume and sources of DAH
Database 2010 annually, preliminary debt repayments, US ADB, AfDB, DAC bilateral donors, financial) received by global health actors;
projections for disbursements foundations, other public and EC, GAVI, GFATM, UNAIDS, analysing trends in DAH over
recent years private donors, unspecified UNICEF, UNFPA, WHO, PAHO, time
donors US-based NGOs and foundations
IHME DAH 1990 onwards, Estimated World Bank (IBRD and IDA), Regions and countries Loans and grants (in-kind and DAH received by recipients over
Database annually disbursements AfDB, ADB, IDB, DAC bilateral financial); funding for HIV/ time; trends in DAH by 6 health
(Country donors, BMGF, EC, GAVI, AIDS, malaria, tuberculosis, focus areas; DAH by burden of
and Regional GFATM, UNFPA, UNICEF health sector support, disease
Recipient non-communicable diseases,
Level) 2010 and maternal, child and
neonatal health
GAVI data 2007-onwards Commitments and GAVI Alliance Recipient country governments, Grants (financial) Commitments and disbursements
reported to disbursements multilateral organizations, by recipient country, primary
OECD-CRS other recipients recipient and health focus area
GAVI financial 2005-onwards Total expenditure GAVI Alliance Unspecified Grants (in-kind and financial) Trends in commitments and
statements on accruals basis disbursements; administrative vs
programme expenses
GFATM 2002-onwards Disbursements GFATM Principal recipients by country Grants (financial) Commitments and disbursements
by recipient country, primary
recipient and health focus area
BMGF Online 1995-onwards Commitments BMGF Universities, research institutes, UN Grants (financial) Trends in commitments by
Grants agencies, World Bank, recipient, region and health focus
Database public–private partnerships, area; can be supplemented with
NGOs, foundations, governments, disbursement data from IRS-990
corporations PF forms
WHOSIS 1995-onwards Estimated Bilateral and multilateral donors; Governmental and Grants Researchers may want to consider
disbursements other external donors non-governmental sectors using more comprehensive,
(aggregated) (aggregated) detailed DAH databases
WHO’s National 1995-onwards Estimated Bilateral and multilateral donors; Governmental and Grants Researchers may want to consider
Health disbursements other external donors non-governmental sectors using more comprehensive,
Accounts (aggregated) (aggregated) detailed DAH databases

Notes:
a
While data on commitments and disbursements are available from 1973-onwards, the DAC only recommends using commitment data after 1996 and disbursement data after 2002.
b
The vast majority of projects in the AidData database range from 1973–2009, although data on a few select donors are available prior to 1973.
AfDB ¼ African Development Bank; AsDB ¼ Asian Development Bank; BMGF ¼ Bill & Melinda Gates Foundation; CRS ¼ Creditor Reporting System; DAC ¼ Development Assistance Committee; DAH ¼ development assistance
TRACKING DEVELOPMENT ASSISTANCE FOR HEALTH DATA

for health; EC ¼ European Commission; GAVI ¼ Global Alliance for Vaccines and Immunisation; GFATM ¼ Global Fund to Fight AIDS, Tuberculosis and Malaria; IADB ¼ Inter-American Development Bank;
IBRD ¼ International Bank for Reconstruction and Development; IDA ¼ International Development Association; IFFIm ¼ International Finance Facility for Immunisation; IHME ¼ Institute for Health Metrics and
Evaluation; NGO ¼ non-governmental organization; ODA ¼ official development assistance; OECD ¼ Organisation for Economic Co-operation and Development; PAHO ¼ Pan-American Health Organization; PF ¼ Private
529

Foundation; PLAID ¼ Project-Level Aid; UN ¼ United Nations; UNAIDS ¼ Joint United Nations Programme on HIV/AIDS; UNFPA ¼ United Nations Population Fund; UNICEF ¼ United Nations Children’s Fund; US ¼ United
States; WHO ¼ World Health Organization; WHOSIS ¼ World Health Organization Statistical Information System.

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


530 HEALTH POLICY AND PLANNING

subjectively code the new variables, which might introduce DAH to provide more current estimates.12 The preliminary
some errors. At the time of writing, these new codes had only estimates are based on data from bilateral, multilateral and
been introduced for a subset of the dataset. Finally, AidData private channels including data from budgets, appropriations
has had to make some assumptions about categorizing the CRS and correspondence. These data should be interpreted more
data as a commitment or a disbursement, which may have led cautiously than estimates based on actual disbursements.
to under-reporting of disbursements. AidData aims to provide Users should also keep in mind some of the limitations of the
ongoing updates to their databases, however, it is not known IHME datasets. IHME used statistical models to impute certain
when additional releases will be made. quantities in the dataset when faced with missing data, such as
DAH flowing through NGOs (Institute for Health Metrics and
IHME DAH databases Evalution 2010). Also, while the IHME DAH Database includes
DAH from many non-DAC bilateral donors, it only includes
The Institute for Health Metrics and Evaluation (IHME) has
their contributions to the European Commission, the World
developed its own DAH databases, which unlike the previous
Bank, UN Agencies and public–private partnerships that are
databases discussed, were developed specifically to track health
tracked through these institutions’ income statements, but
projects (Institute for Health Metrics and Evalution 2010). To
does not include direct transfers to developing countries.
compile their datasets, IHME begins with the data available in
Furthermore, in tracking private flows, IHME’s databases only
the OECD databases and then complements with additional
include DAH channelled through a subset of US-based NGOs
data collected from reports, financial statements, online data-
and foundations, as non-US NGOs and foundations are more
bases, tax filings and other sources of information (Institute for

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


difficult to track.13 Finally, while the IHME DAH Database
Health Metrics and Evalution 2010). IHME uses a broader
(Country and Regional Recipient Level) includes DAH estimates
definition of aid that includes both ODA and non-ODA flows,
for six health focus areas, the raw project descriptions are not
including aid provided through private donors such as select
included in the databases, therefore it cannot be used to track
NGOs and foundations as well as loans from IBRD. The IHME
DAH to health focus areas beyond those reported on by IHME.
databases, updated annually, primarily include flows channelled
In future updates of its DAH research, IHME is working on
through institutions whose main objective is the provision of
strategies to expand the scope of its databases and address
development assistance.10 There are two main databases:
these limitations.
(1) The IHME DAH Database (http://www.healthmetricsande
valuation.org/record/development-assistance-health- Donor-specific tracking mechanisms
database-1990-2008), which allows users to examine the
Global Fund to Fight AIDS, Tuberculosis and Malaria
volume and sources of DAH received by different global
The Global Fund provides detailed information on approved
health actors, referred to as ‘channels of assistance’, and to
grants and disbursements against these grants on its website
analyse trends in the volume of DAH disbursed by each
(http://portfolio.theglobalfund.org/). For each approved grant
channel over time; and
agreement, the Global Fund provides information on the
(2) The IHME DAH Database (Country and Regional Recipient
principal recipient, the target disease area, the amounts
Level) (http://www.healthmetricsandevaluation.org/record/
disbursed and the date of disbursement. This information is
development-assistance-health-country-and-regional-
reported in Excel format, summaries of which can also be
recipient-level-database-1990-2008), which can be used to
obtained through the website. The data are updated as new
analyse DAH flowing from channels to countries and
grant agreements are signed and as disbursements against
regions over time and to assess trends in aid earmarked for
existing projects are made. However, the Global Fund does not
six health focus areas, HIV/AIDS; malaria; tuberculosis;
provide any information on how the resources are used by the
health sector support; non-communicable diseases; and
principal recipient, thereby limiting the usefulness of this data
maternal, child and newborn health (Institute for Health
for analysis.
Metrics and Evalution 2010).

The IHME databases provide a number of advantages over the GAVI Alliance
other datasets. First, the databases contain estimated disburse- GAVI Alliance data are available in the OECD-DAC databases.
ments from both public and private sources, including founda- They provide detailed information on annual grant commit-
tions such as BMGF. Second, as with AidData, multilateral ments and disbursements, project descriptions, country focus
donors are tracked using information obtained directly from the and primary recipient from 2007 onwards. GAVI’s financial
donors instead of using the data from CRS, which is incomplete statements include annual expenditure data on an accruals
for some multilateral donors (Ravishankar et al. 2009). basis, which reflects expenditure when incurred instead of
Disbursement data not included in the CRS, such as data actual disbursements, from 2005 onwards (GAVI Alliance,
from GAVI prior to 2007, and the World Health Organization no date; OECD-DAC, no date, c). For years prior to 2007,
(WHO) and Pan-American Health Organization (PAHO), are researchers can obtain country-level disbursement data from
also included. Third, IHME has carefully eliminated double- GAVI’s website (http://www.gavialliance.org/performance/dis-
counting among those channels that provided sufficient data bursements/index.php), but disbursement data comparable to
about sources of income and aid recipients.11 Finally, since there the GAVI disbursement data reported to the OECD-DAC are not
is usually a delay of a year or two on development assistance available on the GAVI website for these years. Users can obtain
reporting, in addition to reporting actual disbursement data, GAVI’s disbursement data for missing years from IHME’s DAH
IHME also generates preliminary estimates (i.e. projections) of databases (Institute for Health Metrics and Evalution 2010).
TRACKING DEVELOPMENT ASSISTANCE FOR HEALTH DATA 531

The OECD-DAC data allows users to analyse commitments and injuries). Users can also search by goal, which includes
and disbursements by recipient country, primary recipient and health, communicable disease and health-related Millennium
health focus area. Expenditure totals from GAVI’s financial Development Goals. This basic information, as well as amount
statements are useful for observing time trends and comparing of commitment and year of approval, is provided in multiple
administrative vs programme expenses, but are not as detailed formats making it easy for users to manipulate the data.
as the OECD-DAC data.14 Cumulative disbursement data are available upon exporting to
GAVI updates its data annually. While it has made significant Excel. Upon clicking on individual projects, further information
progress in transparency by reporting to the OECD-DAC, it is available such as the breakdown of the loan as well as the
could further improve its aid reporting by providing commit- name of the recipient in-country.
ment and disbursement data for all years and all grants on Given these features, the World Bank database has many
its website, as GFATM does. advantages for users looking for information on closed and
on-going projects. However, it has two major limitations. First,
Bill & Melinda Gates Foundation data are provided cumulatively, not annually. The commitment
BMGF is the first foundation to report to the OECD-DAC, amount is provided only for the year of approval with details
reporting 2009 data that have been included into the CRS on project duration, making it difficult to estimate yearly
including information such as sector and purpose codes, project disbursements. Second, the database does not provide any
descriptions, identification of primary recipient, and commit- information on World Bank Trust Funds, which have grown
ments and disbursements. Also, BMGF’s online grant database from $95 million in 2003–04 to $2.4 billion in 2006–07, which

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


includes data on annual commitments for global health and is almost equal to the core funding, provided by the Inter-
other sectors from 1995 onwards (http://www.gatesfoundation. national Bank for Reconstruction & Development (IBRD) and
org/grants/Pages/search.aspx). Additional data include: name, International Development Association (IDA) ($2.8 billion). In
location and website of the primary aid recipient; project 2009, health and social services received 42% of all Trust Fund
description; terms of commitment; health focus area; and disbursements meaning that a large amount of finance is not
region. recorded in the project portfolio search (World Bank Group
While BMGF provides more detailed grant disbursement et al. 2009).
information than many other US foundations, users should be The World Bank database could be improved by providing
aware of the online grant database’s limitations. Disbursement yearly disbursements and by establishing a Trust Fund data-
data are missing, and details about recipient country or base, similar to the Projects Portfolio database, to provide
countries are sometimes available in the project description, information on the significant resources flowing through this
but this level of detail is not systematically reported. Project- mechanism.
level disbursement data are available in BMGF’s tax forms, but
these lack information on sector, region and health focus area The Regional Development Banks
that is available in the online grants database (Bill & Melinda The Asian Development Bank (AsDB), the African Development
Gates Foundation, no date; Guidestar, no date, a; Guidestar, no Bank (AfDB) and the Inter-American Development Bank (IDB)
date, b). Researchers can merge data from these two sources, as have searchable project databases starting in the years 1968,
IHME has done, but this process is arduous.15 1991 and 1963, respectively, and up to the present.17 While all
BMGF’s online grant database is updated frequently, but it three banks generate lists similar to the World Bank project
does not publish notifications about updates to the database. To portfolio, this information is not exportable. In addition, limited
analyse the data, users must copy and paste data into Excel, information on the amount of the project is only available
which makes using the data time-consuming. when clicking on each individual project. For the AsDB, for
While BMGF provides useful DAH data, several improvements further details on the project, such as project length and
could be made. It would be helpful if more years of data could cumulative disbursement information, users must go to a
be included in the CRS. In its online database, the inclusion of different part of the website which has a detailed description of
a variable denoting grant recipient country (when applicable) in the project in question. Complete information is only available
addition to reporting the region(s) to which grants are allocated on the commitment amount, not on annual disbursements. In
would be helpful. In addition, BMGF could set up a subscrip- contrast, the AfDB provides detailed information on the
tion service to alert users to updates, include disbursement description of the project, the objectives, the rationale and
information in the online grant database and allow users to benefits, and finally the estimated cost (i.e. commitment). It
export data. Since the CRS data has a one year lag, the also provides the name of the key contact for the project.
availability of detailed disbursement data in BMGF’s online Disbursement data are available for closed projects only. The
grants database could give users more timely access to data. IDB provides minimal project descriptions with cumulative
commitments and disbursements, not annual disbursements,
World Bank through the ‘Advanced Search’ on its website.
The World Bank provides on its website a Projects Portfolio While the data provided by the Regional Development Banks
Search which allows users to search projects by recipient are perhaps useful for those looking for individual project
country, sector, theme and goal as well as year of project details, to move towards better accessibility and transparency,
approval.16 The database is available from 1947 onwards and these banks should consider developing a similar online
allows users to specify a particular theme, such as human database to the World Bank that gives more detailed informa-
development, as well as sub-themes (e.g. tuberculosis, malaria tion in an exportable format. All of these banks also report their
532 HEALTH POLICY AND PLANNING

data to the CRS and users may find that interface more useful amounts of DAH have online grant databases, such as the Doris
for extracting aggregate data from these donors. Duke Charitable Foundation, the Ford Foundation, the David &
Lucile Packard Foundation and the William and Flora Hewlett
USAID Foundation.20 For more finely detailed information on founda-
The US produces an annual publication known as the tions’ international health grants, users can collect data directly
Greenbook, which provides data on the foreign aid loans and from these online resources if time permits.
grants authorized18 by the US Government every fiscal year Users seeking to find in-depth data on DAH from bilateral
(http://www.usaid.gov/policy/greenbook.html). The data are donors can review detailed project data on the following
available from 1946 onwards and are organized by recipient agencies’ websites: the UK’s Department for International
country and by programme area. Relevant to global health, Development (DFID), the Canadian International Development
the data can be categorized by a number of programme areas Agency (CIDA), the Swedish International Development
(e.g. the Global HIV/AIDS Initiative). However, if health Cooperation Agency (SIDA) and the Agence Française de
projects are covered by other programme areas, these funds Développement (AFD).21 These project databases provide infor-
cannot be tracked using the Greenbook. The data reported in mation such as project descriptions, details about primary
the Greenbook differ in a number of ways from the ODA flows recipients and financial data. If using these databases,
reported to the OECD-DAC. Greenbook data are reported using researchers should be aware that they may not capture all of
a different calendar year, they include military assistance and the DAH provided by a bilateral donor during a given period of
contain reports on all countries that receive foreign aid from interest. If comparing the data from these agencies’ databases

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


the US. The Greenbook does not provide any information to OECD-DAC data, users need to consider that the data may
about the primary recipient of each loan or grant in a given not match due to differences in reporting standards.
recipient country.

Other relevant datasets


Discussion and conclusion
WHOSIS, housed in WHO’s Global Health Observatory (http://
www.who.int/gho/en/), provides data on external resources for The choices made in the design and construction of the various
health as a percentage of total expenditure on health from datasets that are available to track DAH may make one dataset
1995 onwards, while the WHO’s National Health Accounts more suitable to answer a particular question than another.
(NHA) include estimates of external resources for health from Our goal is to provide an overview of these datasets to allow
1995 onwards (http://www.who.int/nha/en/). For some country users to better understand the advantages and limitations of
years, these datasets contain estimates from in-country reports the datasets and to help them determine which dataset is best
or NHAs. For other years, WHO relies on data sources such as suited for their particular research question.
the OECD-DAC and data from other international funders such The CRS, AidData and IHME databases are all suitable for
as the Global Fund.19 estimating trends in DAH. However, if users are interested in
These data have important limitations. First, these databases trends in ODA from the same set of donors over time, then the
neither disaggregate external resource data by donor, nor do CRS might be the best option. If users wish to also include
they provide descriptions about the primary recipient and estimates of flows from non-DAC members, then AidData
health focus areas of flows. Second, when WHO relies solely might be the most useful. If users are also interested in trends
upon OECD-DAC to estimate external resources, private flows including select NGOs and foundations, when these data are
to countries are not captured, and flows from some global available, then the IHME datasets might be the most
health actors like GAVI are likely underestimated (Institute for appropriate.
Health Metrics and Evalution 2010). The CRS and the AidData datasets also contain information
For additional information on US foundations providing DAH, on development assistance flows to the non-health sectors, and
the Foundation Center provides tabular data on the foundations can provide estimates of total aid flows from particular donors
giving the most international health grants from 2004 onwards, or to particular recipients. Therefore, these datasets are the
and the total value of grants for international health since 2005 most appropriate to use when comparing DAH with other forms
(http://foundationcenter.org/findfunders/statistics/listing02. of international financial flows.
html). Total grants for international health are grouped into six If users are more interested in overall allocations to particular
categories, including reproductive health care and mental disease areas, including funding that is channelled into
health. While helpful for understanding the overall amount of countries and regions, then the IHME databases might be
DAH given by US foundations and information about total helpful. For other health areas, some disaggregation is also
contributions from a select number of foundations, these data available using the purpose codes contained in the CRS and the
are highly aggregated. A publicly available database at the AidData databases. If users are interested in aid flows from a
individual grant level that contained variables such as founda- particular donor, then users might be advised to use data
tion name, grant amount, project descriptions, recipient name directly from the donor.
and recipient country would allow users to better track the No dataset is perfect. Users just need to understand the
geographical focus and purpose of DAH from US foundations. strengths and weaknesses of each dataset before using them.
Users in search of detailed information on DAH from Furthermore, the authors encourage users to read the user
foundations can also go straight to the source of these funds. guides or manuals that accompany these datasets for more
In addition to BMGF, many foundations that provide large details before using the data.
TRACKING DEVELOPMENT ASSISTANCE FOR HEALTH DATA 533

4
We welcome the efforts of donors and other agencies to However, contributions from bilateral donors for projects executed by
multilateral institutions but that are not financed through regular
increase the accessibility and transparency of DAH data.
budgets (for example, Canada provides funding for a health system
However, more improvements can still be made. First, the project in Mali but executed by the World Bank) would be
movement towards making data on DAH resource flows included in the CRS under bilateral aid.
5
available on the web should be encouraged. While availability The DAC publishes coverage ratios for reported commitments and
is the first step, accessibility, i.e. user friendliness, is equally disbursement data in the CRS database. In general, commitments
have higher coverage than disbursements. Users are encouraged to
important; for example, by making data downloadable in
analyse the coverage ratios for the data before undertaking any
multiple formats. Second, donors should highlight when they analyses using the CRS data. As such, the DAC recommends not
release new versions of data and make efforts to ensure that using the CRS commitment data prior to 1995 or disbursement
users can easily incorporate newer updates into their analysis. data prior to 2002.
6
Third, for most donors there are significant differences between A number of non-DAC countries have begun to report their ODA
contributions to the DAC secretariat on a voluntary basis in
the amounts they commit to a project in a given year and aggregate form; however, such data are not reported in the regular
how much they actually disburse, and therefore all donors DAC databases. A list of these non-DAC countries, as well as
should report both commitments and disbursements. aggregate aid data, can be obtained from the following website:
Finally, donors should provide timely information, as the http://www.oecd.org/document/0,3343,en_2649_34447_41513218_
1_1_1_1,00.html.
Global Fund does, to enable researchers and decision-makers 7
In the future, it hopes to cover other forms of aid, such as those
to understand what is happening to health aid flows with originating from NGOs and foundations, but this information is
little delay. not yet available.

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


8
A key step in improving the effectiveness of DAH is The additional donors include the Economic and Social Commission
understanding where money comes from and where it goes. for Asia and the Pacific, the Economic and Social Commission
for Western Asia, the Food and Agriculture Organization, the
We hope this paper will be useful to a range of researchers, Fast Track Initiative, the World Trade Organization (WTO), the
policy makers, donors and aid recipients so that they can WTO - International Trade Centre, Bulgaria, Czech Republic,
choose the best data on which to base their DAH research. Czechoslovakia, Guadalupe, Hungary, Kosovo, Lebanon,
Lithuania, Martinique, Poland, Reunion, Romania, Russia, Serbia
and Montenegro, Slovakia, Saint Pierre and Miquelon, Iceland,
Liechtenstein, Monaco, Chile and Estonia.
9
Funding The full list of NGOs included in the IHME DAH Database can
be downloaded from IHME’s Global Health Data Exchange
None received. (GHDx): http://www.healthmetricsandevaluation.org/record/ihme-
formatted-usaid-volag-database-1990-2007. To view the list of
foundations included in this database, please refer to the
Foundation Center’s grants database: http://foundationcenter.org/.
Conflict of interest 10
See Financing Global Health 2010: Development Assistance and Country
Spending in Economic Uncertainty Methods Annex for details about
KAG: none. KLK and MS participated in the development of
the methodology used to develop these databases: http://www
the IHME development assistance for health datasets discussed .healthmetricsandevaluation.org/sites/default/files/policy_
in this manuscript. DS is a member of the IHME’s Financial report/2010/financing_global_health_2010_methods_IHME.pdf.
11
Flows Advisory Panel which advised the development of the IHME provides STATA code that allows users to eliminate
IHME DAH datasets. double-counting in the data provided in the IHME DAH Database.
12
Preliminary estimates of DAH are included in the DAH Estimates
Tables 1990–2010 and can be downloaded from IHME’s GHDx:
http://www.healthmetricsandevaluation.org/record/development-
assistance-health-estimates-1990-2010-tables.
Endnotes 13
IHME has not directly tracked NGOs and foundations based outside
1
DAH is generally defined as external resources, financial or in-kind, the US due to data limitations.
14
that are channelled into a country from external sources to support Users should keep in mind that the GAVI data in the OECD-CRS and
health-related activities. It generally includes funding for health financial statements are produced using different accounting
sector activities, as well as population programmes, but generally methods.
15
does not include activities outside the health sector that may Alternatively, users can obtain BMGF disbursement data from
impact health (e.g. water and sanitation programmes). IHME’s databases.
2 16
Calculated as the sum of commitments to purpose codes 120 (health), http://web.worldbank.org/WBSITE/EXTERNAL/PROJECTS/0,,menu
130 (population) and 160.64 (social mitigation of HIV/AIDS) by PK:41389pagePK:95863piPK:95983tab:T1tgDetMenuPK:
both bilateral and multilateral donors in the CRS database in 2009 228424tgProjDetPK:73230tgProjResPK:95917tgResMenuP-
constant US dollars. K:224076theSitePK:40941,00.html
3 17
As of 1 January 2010, OECD-DAC members included: Australia, Asian Development Bank: http://www.adb.org/Projects/. African
Austria, Belgium, Canada, Denmark, Finland, France, Germany, Development Bank: http://www.afdb.org/en/projects-operations/
Greece, Ireland, Italy, Japan, Korea, Luxemburg, Netherlands, New project-portfolio/. Inter-American Development Bank: http://www
Zealand, Norway, Portugal, Spain, Sweden, Switzerland, United .iadb.org/en/projects/projects,1229.html.
18
Kingdom, United States, and the Commission of the European Actual disbursements, or outlays, are not recorded in the Greenbook.
19
Communities. Korea only became a member of the OECD-DAC in The ‘Sources and Methods’ tab in NHA country pages contains
2010. The multilateral organizations that report to the DAC are information on data sources that WHO has used to estimate
the World Bank, the African Development Bank, the Asian external resources for health.
20
Development Bank, the Inter-American Development Bank, the Doris Duke Charitable Foundation: http://www.ddcf.org/Grants-
International Fund for Agricultural Development, the United Awarded/. Ford Foundation: http://www.fordfoundation.org/
Nations Children’s Fund, the Joint United Nations Programme grants/search. David & Lucile Packard Foundation: http://www
on HIV/AIDS, the United Nations Development Programme, the .packard.org/searchGrants.aspx?RootCatID¼3&CategoryID¼226.
United Nations Population Fund, the United Nations Economic William and Flora Hewlett Foundation: http://www.hewlett.org/
Commission for Europe, and the World Food Programme. grants/search.
534 HEALTH POLICY AND PLANNING

21
DFID: http://www.dfid.gov.uk/About-DFID/Finance-and-performance/ Murray CJ, Anderson B, Burstein R et al. 2011. Development assistance
Project-information/. CIDA: http://les.acdi-cida.gc.ca/project- for health: trends and prospects. The Lancet 378: 8–10.
browser. SIDA: http://openaid.se/. AFD: http://www.afd.fr/jahia/
OECD-DAC. [no date, a]. DAC Glossary of Key Terms and Concepts.
Jahia/home/projets_afd/sante-health/pid/1335 (this website is
only available in French). Online at: http://www.oecd.org/document/32/0,3746,en_2649_33721_
42632800_1_1_1_1,00.html (Accessed 14 July 2010).
OECD-DAC. [no date, b]. User’s Guide to the CRS Aid Activities database.
Online at: http://www.oecd.org/document/50/0,3746,en_2649_
References 34447_14987506_1_1_1_1,00.html (Accessed 1 August 2010).
Bill and Melinda Gates Foundation. [no date]. Financials. Online OECD-DAC. [no date, c]. International Development Statistics (IDS) online
at: http://www.gatesfoundation.org/about/Pages/financials.aspx databases on aid and other resource flows. Online at: http://www.oecd
(Accessed 5 July 2010). .org/dataoecd/50/17/5037721.htm (Accessed 20 May 2011).
Gavi Alliance. [no date]. Financial Performance. Online at: http://www Patel P, Roberts B, Guy S, Lee-Jones L, Conteh L. 2009. Tracking official
.gavialliance.org/performance/financials/index.php (Accessed 5 July development assistance for reproductive health in conflict-affected
2010). countries. PLoS Medicine 6: e1000090.
Greco G, Powell-Jackson T, Borghi J, Mills A. 2008. Countdown to 2015: Piva P, Dodd R. 2009. Where did all the aid go? An in-depth analysis of
assessment of donor assistance to maternal, newborn, and child increased health aid flows over the past 10 years. Bulletin of the
health between 2003 and 2006. The Lancet 371: 1268–75. World Health Organization 87: 930–9.
Guidestar. [no date, a]. Bill and Melinda Gates Foundation. Online at: Ravishankar N, Gubbins P, Cooley RJ et al. 2009. Financing of global
http://www2.guidestar.org/organizations/56-2618866/bill-melinda- health: tracking development assistance for health from 1990 to

Downloaded from http://heapol.oxfordjournals.org/ by guest on August 17, 2015


gates-foundation.aspx (Accessed 5 July 2010). 2007. The Lancet 373: 2113–24.
Guidestar. [no date, b]. Bill and Melinda Gates Foundation Trust. Online at: Schaferhoff M, Schrade C, Yamey G. 2010. Financing maternal and
http://www2.guidestar.org/organizations/91-1663695/bill-melinda- child health—what are the limitations in estimating donor flows
gates-foundation-trust.aspx (Accessed 5 July 2010). and resource needs? PLoS Medicine 7: e1000305.
Institute for Health Metrics and Evalution. 2010. Financing Global Shiffman J. 2008. Has donor prioritization of HIV/AIDS displaced aid for
Health 2010: Development assistance and country spending in other health issues? Health Policy and Planning 23: 95–100.
economic uncertainty. Seattle, WA: Institute for Health Metrics
Sridhar D, Batniji R. 2008. Misfinancing global health: a case for
and Evalution.
transparency in disbursements and decision making. The Lancet
Liese BH, Schubert L. 2009. Official development assistance for health – 372: 1185–91.
how neglected are neglected tropical diseases? An analysis of
Stuckler D, Basu S, Wang SW, McKee M. 2011. Does recession
health financing. International Health 1: 141–7.
reduce global health aid? Evidence from 15 high-income countries,
Lu C, Schneider MT, Gubbins P et al. 2010. Public financing of health in 1975–2007. Bulletin of the World Health Organization 89: 252–7.
developing countries: a cross-national systematic analysis. The
World Bank Group, Global Partnership and Trust Fund Operation
Lancet 375: 1375–87.
Department, Concessional Finance and Global Partnerships. 2009.
McCoy D, Chand S, Sridhar D. 2009. Global health funding: how much, 2009 Trust Fund Annual Report. Washington, DC: The World Bank
where it comes from and where it goes. Health Policy and Planning Group.
24: 407–17.
Mishra P, Newhouse D. 2009. Does health aid matter? Journal of Health
Economics 28: 855–72.

You might also like