Evaluation of Play on Philly!

Work to Date &

Future Directions

Steven J. Holochwost, Ph.D., M.P.A.

Dennie Palmer Wolf, Ed.D.
WolfBrown
October 31, 2012
 Overview
• Logic of the Evaluation

• Work to Date

• Next Steps

• Future Directions
The Logic of the Evaluation
The Intersection of Risk & Resilience

PoP Academic
Experience Achievement

Risk

Pro-social
Behaviors
The Intersection of Risk & Resilience

PoP Academic
Experience Achievement

Executive
Risk Functions

Resilience Pro-social
Factors Behaviors
Why Executive Functions Matter

PoP Academic
Experience Achievement

Executive
Risk Functions

Resilience Pro-social
Factors Behaviors
Why Executive Functions Matter
Achievement

Lower-risk children

Higher-risk children

Time
 Work to Date: The Measurement Model
Years Attendance Juries Evaluations Math grades

ELA grades

Income
PoP Academic
Experience Achievement Math scores

Marital status
Reading scores
Executive
Education Risk Functions

Neighborhood Attendance

Financial stress Resilience Prosocial Behavior

Factors Behaviors
Extracurricular

Routines Relationships Social support Attributes Community

 Pilot Sample
• N = 91 students at St. Francis de Sales
– 55.7% female, 44.3% male (3 missing gender data)
Ethnicity n Valid Percent
Black/African American 76 86.4%
Hispanic/Latino 5 5.7%
Multiracial 3 3.4%
Asian/Pacific Islander 3 3.4%
White/Caucasian 1 1.1%
Missing 3 ---

– Age on the day of the test ranged from 6.98 to 14.78

years, with a mean of 10.83 (SD = 2.00)
 Tasks of Working Memory
• Digit span task
– Recall a series of up to 8 digits in order

• Spatial span task (Corsi block task)

– Recall a series of blocks in order

• Spatial working memory task

– Recall a series of pictures in order
 Tasks of Inhibition
• Go / No-go task
– Respond only to select stimuli

• Stroop task
– Indicate the name of a word green

• Tower of London
– Arrange disks to match a figure
 Tasks of Flexible Attention
• Flanker task
– Focus on a central figure

• Trail making task

– Switch between ordinal sets

• Card sorting task

– Sort cards according to shifting criteria
 Summary of Measured Variables
Task Measure

Mem Digit span Maximum number of digits recalled

ory
Spatial span (Corsi block) Number of correct trials

Spatial memory Mean number of items recalled (across 10 trials)

Inhib Go / No-go Mean reaction time (in msec)

ition
Stroop Mean reaction time (in msec)

Tower of London Percent of trials solved in the minimum number of moves

Atten Flanker Median reaction time for incongruent trials (in msec)
tion
Trail making Mean total time required (in msec)

Card sort Percent of perseverative errors

 Next Steps
• Fall testing
– 106 PoP students (6 missing due to school absence)
– 111 matched-control students
PoP Academic
Experience Achievement

Executive
Risk Functions

Resilience Prosocial
Factors Behaviors
 Albert Bert Carl

Risk 7 6.5 7.5

Resilience 6 8 7

PoP experience 0 3 9

Academic achievement 2 4 8

Prosocial behavior 2.5 5 9

Executive functions 3 5 8

10.0

7.5

5.0

2.5

0
Albert Bert Carl
Risk Resilience
 Future Directions

• Longitudinal work at initial study site

• Expansion of the evaluation to additional sites

• Friere in 2013-2014
• Other sites in 2014-2015 and beyond

• Long-term longitudinal work

 Phase 2 Data Collection begins at St. Francis

St. Francis St. Francis St. Francis St. Francis St. Francis St. Francis
Data collection Data collection Data collection Data collection Data collection Data collection
Year 1, Spring Year 2 Year 3 Year 4 Year 5 Year 6

2012-2013 2013-2014 2014-2015 2015-2016 2016-2017 2017-2018

Friere Friere Friere Friere Friere

Data collection Data collection Data collection Data collection Data collection
Year 1 Year 2 Year 3 Year 4 Year 5

TBA A TBA A TBA A TBA A

Year 1 Year 2 Year 3 Year 4

TBA B TBA B TBA B

Year 1 Year 2 Year 3

TBA C TBA C
Year 1 Year 2

Phase 2 Data Collection begins at Friere

Year 1 Report Year 2 Report Year 3 Report Year 4 Report Year 5 Report Year 6 Report
$75,000 $125,000 $150,000 $175,000 $200,000 $225,000
 Selected References
(available in paper or digital format upon request)

Blair, Granger, & Razza (2005). Child Development, 76, 554-567.

Blair & Razza (2007). Child Development, 78, 647-653.

Brooks-Gunn & Duncan (1997). The Future of Children, 7, 55-71.

Carlson, Mandell, & Williams (2004). Developmental Psychology, 40, 1105-1122.

Masten (2001). American Psychologist, 56, 227-238.

Sameroff & Seifer (1983). Child Development, 54, 1254-1268.

Appendix
Tasks of Working Memory: Measures
Range
Mean SD Skew Kurtosis
Measure Min. Max.

Digit span: max digits recalled 3 8 5.53 .963 .037 -.236

Digit span: correct responses (%) .188 .625 .527 .059 -2.47 12.46

Spatial span (Corsi): max blocks recalled 2 8 5.08 1.19 .640 1.35

Spatial span (Corsi): correct trials (#) 1 10 7.03 1.91 -.529 .225

Spatial memory: max items recalled 5 9 8.44 1.12 -1.76 1.67

(for any trial)
Spatial memory: mean items recalled 1.70 8.60 4.85 1.43 .418 -.007
(across 10 trials)
Working Memory: Selected Measures (1 of 3)
Working Memory: Selected Measures (2 of 3)
Working Memory: Selected Measures (3 of 3)
Working Memory: Problematic Measures (1 of 2)
Working Memory: Problematic Measures (2 of 2)
 Tasks of Inhibition: Measures
Range
Mean SD Skew Kurtosis
Measure Min. Max.

Go / No-go: omission errors (#) 0 104 8.16 15.35 3.94 19.05

Go / No-go: commission errors (#) 4 143 29.11 18.55 3.23 16.65

Go / No-go: mean reaction time (in msec) 322.7 617.2 457.8 54.26 .138 .458

Stroop: total errors (#) 0 13 2.58 2.59 1.76 4.09

Stroop: mean reaction time (in msec) 949.5 4839 1928.1 815.7 1.45 2.45

ToL: trials solved in minimum number of moves (%) 0 .86 .34 .19 .149 -.119

ToL: mean number of additional moves (#) ,14 15.3 3.91 2.61 2.06 6.24

ToL: planning time (msec) 3061 17420 6764.2 2887.6 1.42 2.07
Inhibition: Selected Measures (1 of 3)
Inhibition: Selected Measures (2 of 3)
Inhibition: Selected Measures (3 of 3)
Inhibition: Problematic Measures (1 of 2)
Inhibition: Problematic Measures (2 of 2)
 Tasks of Attention: Measures
Range
Mean SD Skew Kurtosis
Measure Min. Max.

Flanker: errors (#) 1 98 30.19 24.11 .876 -.016

Flanker: median reaction time, congruent trials (msec) 174.0 802.5 503.3 124.1 .194 .303

Flanker: median reaction time, incongruent trials (msec) 214.0 803.0 470.9 113.6 .571 .794

Trial making task: mean total time required (msec) 4916 54749 27461 7470.2 1.39 2.92

Card sort: perseverative errors (%) 0 34.38 14.68 8.21 .233 -.364

Card sort: conceptual level responses (%) 10.9 85.9 53.0 19.6 -.407 -.952
Attention: Selected Measures (1 of 3)
Attention: Selected Measures (2 of 3)
Attention: Selected Measures (3 of 3)
Attention: Problematic Measures (1 of 2)
Attention: Problematic Measures (2 of 2)
 Summary of Measured Variables
Range
Mean SD Skew Kurtosis
Measure Min. Max.

me Digit span: max digits recalled 3 8 5.53 .963 .037 -.236

mor
y Spatial span (Corsi): correct trials (#) 1 10 7.03 1.91 -.529 .225

Spatial memory: mean items recalled 1.70 8.60 4.85 1.43 .418 -.007
(across 10 trials)
inhi Go / No-go: mean reaction time (in msec) 322.7 617.2 457.8 54.26 .138 .458
bitio
n Stroop: mean reaction time (in msec) 949.5 4839 1928.1 815.7 1.45 2.45

ToL: trials solved in minimum number of moves (%) 0 .86 .34 .19 .149 -.119

atte Flanker: median reaction time, incongruent trials (msec) 214.0 803.0 470.9 113.6 .571 .794
ntio
n Trial making task: mean total time required (msec) 4916 54749 27461 7470.2 1.39 2.92

Card sort: perseverative errors (%) 0 34.38 14.68 8.21 .233 -.364
 Matrix of Measured Variables
Measured Variable 1. 2. 3. 4. 5. 6. 7. 8. 9. 10.

1. Digit span: max digits recalled 1 .21 .31** -.21 -.20 .06 -.20 -.26* .07 .27*

2. Spatial span (Corsi): correct trials (#) 1 .56** -.14 -.42** .37** -.11 -.35** 0 .51**

3. Spatial memory: mean items recalled 1 -.25* -.36** .34** -.13 -.43** -.12 .45**

4. Go / No-go: mean reaction time 1 .35** .03 .47** .07 .02 -.37**

5. Stroop: mean reaction time 1 -.34* .21 .37** .15 -.50**

6. ToL: trials solved in minimum moves 1 -.23 -.29* -.06 .28*

7. Flanker: reaction time, incongruent trials 1 .26* .11 -.35**

8. Trial making task: mean total time 1 -.07 -.36**

9. Card sort: perseverative errors 1 0

10. Age (years) 1

* Correlation is significant at p < .05

** Correlation is significant at p < .01