You are on page 1of 6

Policy Brief #22, September 2010

The National Poverty Center’s Policy Brief


series summarizes key academic research
Sharing Lessons from the First
Conditional Cash Transfer
findings, highlighting implications for policy.

The NPC encourages the dissemination of

Program in the United States


this publication and grants full reproduction
right to any party so long as proper credit
is granted the NPC. Sample citation: “Title,
National Poverty Center Policy Brief #x”. By James Riccio

In January 2010, the National Poverty found that Family Rewards substantially the hope of reducing poverty over the
Center sponsored a preview briefing of early reduced poverty and material hardship longer term.
results from MDRC’s study of Opportunity and had a range of effects on education,
An incentives-only program (with no social
NYC: Family Rewards, New York City’s health-related, and work-related outcomes.
services or case management component),
bold demonstration and evaluation of a The third and final year of the program
Family Rewards is coordinated by a private,
conditional cash transfer (CCT) program concluded on August 31, 2010.
nonprofit intermediary organization,
to help families break the cycle of poverty.

CCT programs offer cash assistance to


What Is Opportunity NYC: Seedco, in partnership with six community-
based organizations. It is being evaluated by
reduce immediate hardship and poverty, Family Rewards? MDRC, which helped design the initiative,
but condition this assistance—or cash Opportunity NYC: Family Rewards was through a randomized control trial.
transfers—on families’ efforts to improve launched by New York City’s Center for
The program includes an extensive set
their “human capital” in an effort to Economic Opportunity in 2007 as an
of financial rewards, most of which are
reduce intergenerational poverty. Inspired experimental, privately funded1 temporary
available for three years, that are provided
by Mexico’s pioneering Oportunidades program to help families in six of the city’s
to participants who meet the following
program, such programs have grown highest-poverty communities break the
conditions:
rapidly across lower- and middle-income cycle of intergenerational poverty. The
countries, and evaluations have found some program offers cash assistance to reduce • Education-focused conditions, which
important successes. Family Rewards, immediate hardship and poverty, but include meeting goals for children’s
though, is the first comprehensive CCT conditions this assistance on efforts to attendance in school, achievement levels
program in a developed country. As such, improve children’s school performance, on standardized tests, and other school
it has been the focus of much attention obtain family preventive health care, and progress markers, as well as meeting
domestically and internationally. augment parents’ work and training—in goals for parental engagement with
children’s education
In March 2010, MDRC released a report of
findings from its evaluation of the first two
1. These funders include Bloomberg Philanthropies, The Rockefeller Foundation, The Starr Foundation, the
years of the three-year Family Rewards Open Society Institute, the Robin Hood Foundation, the Tiger Foundation, The Annie E. Casey Foundation,
demonstration. This brief provides an American International Group, the John D. and Catherine T. MacArthur Foundation, and New York
overview of the full MDRC report, which Community Trust.

Gerald R. Ford School of Public Policy, University of Michigan www.npc.umich.edu


• Health-focused conditions, which Figure 1. Effects on Economic Well-being
include maintaining health insurance
coverage for parents and their children,
as well as obtaining age-appropriate
73.3
preventive medical and dental checkups 70.0

for each family member


58.9
• Workforce-focused conditions, aimed 51.8
at parents, which include sustaining
41.8
full-time work and completing approved 36.5
34.1
education or job training activities 29.2

The program offered 22 different incentives 22.1

during its first two years, ranging in value 14.8

from $20 to $600. The program designers


purposely chose to test a wide variety of
rewards to see where incentives would—
and would not—work in the very different
Statistical significance levels: *** = 1% ** = 5% * = 10%
U.S. context. By rewarding a wide range of
activities, the program also gave families
many different ways in which to earn
money, and it was able to avoid attaching
How Was the Evaluation the short-term will be most evident

overly large amounts of money to any one Conducted? for measures of poverty and material
hardship, which can be directly influenced
activity or outcome. Based on assessments The ongoing evaluation uses a randomized
by transferring resources. Its impacts on
of the program’s early operational control trial involving approximately
human capital outcomes, which require
experiences, including the complexity of 4,800 families and 11,000 children, half
changes in how family members spend
administering so many different rewards, of whom can receive the cash incentives if
their time and energy, and, in some cases,
along with preliminary impact evidence, a they meet the required conditions, and half
necessitate learning new skills, may take
number of rewards were discontinued for who have been assigned to a control group
longer to emerge.
the third year. This was done to simplify the that cannot receive the incentives. The
program, lower its costs, and make it easier
to replicate should it prove to be successful.
period covered in the report, beginning
in September 2007 and ending in August
What Were the Program’s
2009, encompasses a start-up phase as Effects on Reducing
How Well Was the Program well as a stage when the program was Material Hardship and
Implemented? beginning to mature. The report presents Poverty?
early findings on the program’s effects on a
Overall, the rapidly launched program was The effects on material hardships and
wide range of outcome measures. For some
successfully implemented after a first year in other economic outcomes were substantial.
measures, the results cover only the first
which operational kinks were being worked Family Rewards:
program year, while for others they also
out. Participating families were substantially
cover part or all of the second year. No data • Reduced measures of material hardship—
engaged with the program, earning reward
are available yet on the third year of the which are often challenging to affect—
payments of more than $3,000 per year, on
program, which ended on August 31, 2010. including difficulty providing enough
average, during each of the first two years.
food for one’s family (by 7 percentage
Nearly all families (98%) earned at least The results reported here provide only
points) and not being able to “make ends
some rewards in both program years (mostly an early indication of the program’s
meet” (by 8 percentage points).
in the education and health domains), and effects. Given the nature of the model,
65% earned payments in every period in it is reasonable to expect that, if Family • Reduced the share of families living
which rewards were available. Rewards is successful, its effects in in poverty by 11 percentage points and

www.npc.umich.edu 2
cut “severe poverty” (defined as having of school attendance (averaging about more likely than the control group to help
income less than 50% of the federal 90 percent), among younger students. their children with homework.
poverty level) by nearly half, (from However, a survey of parents indicates that
Family Rewards has been more successful
30% of the control group to 17% of the Family Rewards increased the likelihood
at the high school level. While Family
program group). that participating middle school students
Rewards participation has not impacted
were more likely than control group
• Increased the likelihood that parents overall student achievement at the high
members to be involved in school-related
had bank accounts by 22 percentage school level, to date, it has increased the
activities, such as programs to help with
points, increased their savings, and proportion of high school students with
schoolwork or homework, school clubs,
reduced their use of alternative banking a 95% attendance rate by 5 percentage
school musical programs, and dance or art
institutions, such as check cashers by 7 points, which may, in the long term, impact
lessons. In addition, parents of elementary
percentage points. student achievement. More dramatic
school students who participated in the
gains were made among the subgroup
What Were the Program’s Family Rewards program were somewhat

Effects on Children’s
Education? Figure 3. Education Effects for High School Students
At the elementary and middle school Students in 9th grade when study began who were not proficient on 8th-­g rade tests
levels, Family Rewards impacts were small.
Family Rewards has not, to date, had an
impact on elementary and middle school
21.8
students’ attendance or achievement. The 19.3
absence of effects on attendance is not
surprising, though, given the high rates
25.2
21.8 38.1 22.9 40.1
22.1

Figure 2. Effects on Younger


Children’s Activities

Child participated in program to help with


school work/homework
Students in 9th grade when study began who were proficient on 8th-grade tests

51.9 64.5
48.6 36.2 71.7
46.2
8.8
42.7

51.1

3.0

72.7 77.6

Statistical significance levels:


*** = 1% ** = 5% * = 10% Statistical significance levels: *** = 1% ** = 5% * = 10%

3 NPC Policy Brief #22


Figure 4. Effects on Health Outcomes of incoming ninth-graders who scored
“proficient” in eighth grade—that is, the
Parents
students who were better able to take
advantage of the performance incentives
95.6 (although many still end up struggling in
16.1
high school)—there were positive impacts.
For this audience, Family Rewards:

15.8 • Reduced the proportion of students


3.3 who repeated the ninth grade by 6
percentage points.
93.7
19.4
• Increased the likelihood of having a 95%
or better attendance rate in the second
47.2 program year by 15 percentage points.
67.4 57.9 44.4 5.3
13.5
• Increased the likelihood of earning at
least 22 credits (11 credits per year are
needed to remain on track for on-time
graduation) by 8 percentage points.

• Increased the likelihood of passing


at least two Regents exams2 by 6
Statistical significance levels: *** = 1% ** = 5% * = 10%
percentage points.

Figure 5. Effects on Work and Training


What Were the Program’s
Effects on Family Preventive
Parents
Health Care?
The health-related incentives of the
48.6
56.2 Family Rewards program were designed to
58.6
43.0 encourage low-income families to maintain
54.2
insurance coverage and to adopt better
10.2
preventive health care practices. It turned
out that a higher proportion of families
than the program’s designers had expected
were already receiving health insurance
coverage and practicing preventive health
care. This finding may reflect the success of
51.2 efforts by New York State and New York
7.7
City to expand access to health coverage
in recent years. Although the high rates
of insurance coverage left little room for
improvement on this outcome, the analysis
Statistical significance levels: *** = 1% ** = 5% * = 10%
found that Family Rewards still had a
number of promising impacts on a variety
2. Regents exams are administered to all public high school students in New York State. Students must pass at of health-related indicators (which are
least five tests in specified subject areas in order to graduate with a diploma recognized by the New York State often difficult to move):
Board of Regents, which sets standards and regulations for all public schools.

www.npc.umich.edu 4
• Increased families’ consistency of health necessary to qualify for the program’s work it has reduced immediate poverty and
insurance coverage (by 2 to3 percentage rewards. Such jobs may also have been material hardship and produced at least
points). more attractive options if they were more some improvements in human capital
conveniently located, easier to obtain, or investment across the domains of children’s
• Reduced their reliance on hospital
offered more flexible schedules than UI- education, family health care, and parents’
emergency rooms for routine care (by 2
covered jobs. employment. Importantly, the effects on
percentage points) and increased their
poverty did not lead to major unintended
receipt of preventive medical care. With regard to incentives for training,
consequences, such as substantial
Family Rewards increased had a small
• Produced substantial increases in receipt reductions in work effort. The magnitude
but statistically significant impact (of
of at least two preventive dental care of Family Rewards’ effects is comparable
2 to 3 percentage points) on increasing
visits by 10 percentage points. to what has been found in evaluations
the likelihood of receiving a training
of CCTs in other countries. In addition,
What Were the Program’s certificate or associate’s degree by 2 to 3
percentage points.
Family Rewards is the first CCT to show
Effects on Parents’ Work any positive effects on workforce outcomes
During the second and third years of the and student achievement.
and Training? Family Rewards program—the worst years
Family Rewards’ early impacts on of the recent economic recession—program Ongoing Evaluation of the
employment outcomes are mixed. The administrators made extra efforts to market Family Rewards Program
early findings point to gains in the workforce rewards to participating families.
While the Family Rewards pilot officially
likelihood of full-time employment and However, because these marketing efforts
ended on August 31, 2010, the MDRC
average earnings, but not in jobs covered were launched during the second program
research team will continue to follow
by the unemployment insurance (UI) year, longer-term evaluation will be required
program and control group families for a
system. According to an 18-month survey to fully understand how they have impacted
total of five years from the time they entered
of parents, the program increased the family outcomes. Still, it is noteworthy that
the study, allowing the evaluation to show
likelihood of working at the time of the despite transferring substantial amounts of
whether any positive effects achieved during
interview (by 6 percentage points), driven cash to families, the program has not led to
the three years in which the program
by an increase in full-time work. At the any appreciable reduction in work effort.
operated persist or grow, even after the
same time, the program also led to a small
reduction in average quarterly employment National and International incentives end. The final evaluation report
is slated to be completed in early 2014.
rates (by 1.4 percentage points) in UI- Interest in Opportunity NYC
covered jobs over a 12-month follow-up
Evaluations of CCT programs in other
period, according to administrative records
data. However, the effect on average annual
countries have convincingly shown that
such programs can reduce poverty and
About the Author
earnings from such jobs (a decline of $286) James Riccio, Director of MDRC’s Low-Wage
improve the consumption of goods and
was not statistically significant. Workers and Communities Policy Area, is the
services (for example, food consumption)
lead author of Toward Reduced Poverty Across
Some jobs are not covered by the state’s UI among very poor families—their main
Generations: Early Findings from New York City’s
system, such as self-employment, federal short-term objective. CCT programs have
Conditional Cash Transfer Program.
government employment, and out-of-state also had some positive effects on human
work. The UI system also misses informal capital development outcomes (although the
(casual or irregular) jobs that are never evidence here is more mixed).
reported to state agencies. It is not clear
Overall, the initial results from the New
why the effects of the program would vary
York City project show that the CCT
across types of employment. Perhaps for
concept is feasible to implement and can
some parents, non-UI jobs were easier
make a difference in the lives of poor
to get in today’s economy, particularly
families in a developed country. So far,
those that offered the full-time hours

5 NPC Policy Brief #22


Major funding for the National Poverty Center
is provided by the Office of the Assistant
Secretary for Planning and Evaluation, U.S.
Department of Health and Human Services.

National Poverty Center


Gerald R. Ford School of Public Policy
University of Michigan
735 S. State Street
Ann Arbor, MI 48109-3091
734-615-5312
npcinfo@umich.edu

www.npc.umich.edu 6

You might also like