Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Look up keyword
Like this
1Activity
P. 1
Evidence in the Real World: The development of Project Oracle

Evidence in the Real World: The development of Project Oracle

Ratings: (0)|Views: 5|Likes:
Published by Nesta
On 14 March 2012 we hosted an event for the Greater London Authority to announce the development and expansion of Project Oracle. To coincide with the event we published this paper examining why - in the words of a recent Education Select Committee report - "many services are unable or unwilling to measure the improvements they make in outcomes for young people."

Project Oracle is an attempt to try and remedy this. It is the only city-wide evidence generation campaign of its kind anywhere in the world. Led by Greater London Authority with a consortium of co-funders, it strives to bring evaluations of youth programmes - many of which are delivered by small or charitable organisations - in line with academically rigorous and internationally recognised standards of evidence, improving consistency and quality in our understanding of what does - and does not - work.
On 14 March 2012 we hosted an event for the Greater London Authority to announce the development and expansion of Project Oracle. To coincide with the event we published this paper examining why - in the words of a recent Education Select Committee report - "many services are unable or unwilling to measure the improvements they make in outcomes for young people."

Project Oracle is an attempt to try and remedy this. It is the only city-wide evidence generation campaign of its kind anywhere in the world. Led by Greater London Authority with a consortium of co-funders, it strives to bring evaluations of youth programmes - many of which are delivered by small or charitable organisations - in line with academically rigorous and internationally recognised standards of evidence, improving consistency and quality in our understanding of what does - and does not - work.

More info:

Categories:Types, Research
Published by: Nesta on Apr 20, 2012
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

04/20/2012

pdf

text

original

 
:
]ek jgcrk z{c}k ip rkwy p}wilida$ Ib pkwri`k xwcrimkwp jwk idmkkm
„{djgnk cw {dqinnida‟ 
}cokjp{wk }ek ioxj`} }eky ejrk. ecq qinn qk ldcq qek}ekw }ek nirkp cb yc{da xkcxnk jwk gkidaxcpi}irkny kdejd`km3 Cw jp }eip z{kp}icd ip ocwk `coocdny xewjpkm id j{p}kwk }iokp. ecq qinnqk ldcq ib ocdky ip gkida qjp}km cd idkbbk`}irk pkwri`kp3]ek gjpi` xwkoipk cb gkejric{wjn p`ikd`k ip „ib yc{ qjd} pcokgcmy }c mc pcok}eida yc{pec{nm p}jw} gy ojlida i} kjpy bcw }eko }c mc i}‟$
:
Yk} okjp{wida }ek c{}`cokp bwco pc`ijnxwcawjookp ip xkw`kirkm }c gk xnja{km qi}e mib`{n}ikp$ ]cc cb}kd }ek ku`{pkp bcw qey yc{`jd’} okjp{wk jwk {pkm }c f{p}iby j nj`l cb p`w{}idy$ ]eip ip qej} ojlkp Xwcfk`} Cwj`nk pcid}kwkp}ida$Xwcfk`} Cwj`nk pecqp }ej} i} ip xcppignk }c krjn{j}k pc`ijn xwcawjookp id nidk qi}e j`jmkoi`jnnywiacwc{p p}jdmjwmp cb krimkd`k$ I} jnpc pecqp }ej} }eip mckpd’} mkojdm `coxnku pyp}ko`ejdak g{} pyp}ko jmf{p}okd}$ ]ek xwcfk`} qcwlp qi}e jrjinjgnk `coxcdkd}p. bcwaida`cddk`}icdp gk}qkkd j`jmkoij ‐ jdm i}p wkjminy jrjinjgnk wkpkjw`e }jnkd} ‐ qi}e }ek xwcrimkwgjpk$ ]ej}’p }ek ―ojlida i} kjpy’ gi}$ G{} }ekd ecq mc yc{ kdp{wk cwajdipj}icdp jwk qinnida3Id }ek `jpk cb Xwcfk`} Cwj`nk i} ip dc} cgniaj}cwy bcw }ecpk wk`kirida Awkj}kw Ncdmcd J{}ecwi}y%ANJ) b{dmida }c }jlk xjw}$ Idp}kjm }eky rcn{d}jwiny piad {x id wk`cadi}icd }ej} krjn{j}icd`jd gk {pkb{n bcw ioxwcrida xwj`}i`k jp qknn jp j}}wj`}ida jmmi}icdjn b{dmida jdm p{xxcw}$ Idkppkd`k. Xwcfk`} Cwj`nk ip j}}kox}ida }c `ejdak }ek oidmpk} cb xwcrimkwp. }cak}ekw qi}e }ekqimkw `coo{di}y cb mk`ipicd ojlkwp jdm b{dmkwp. id cwmkw }c piadjn }ek ioxcw}jd`k cb accmkrimkd`k jdm }c p}io{nj}k }ek mkojdm bcw i}$]eip gwikb xjxkw pkklp }c akdkwj}k mkgj}k cd }ek ipp{k cb qey. id ojdy `jpkp. }ek yc{}epk`}cw `jddc} cw qinn dc} mkocdp}wj}k wcg{p} krimkd`k cb i}p c{}`cokp$
7
Qekwk }ek pk`}cw`jd xwcrimk pcok krimkd`k. }ekpk p}{mikp jdm krjn{j}icdp. }ec{ae xwcbkppicdjnny `cdm{`}km.
]ek mkrkncxokd} cb Xwcfk`} Cwj`nk
Akdkwj}ida jdm {pida krimkd`k id }ek wkjn qcwnm
Oj} Ini`. Awkj}kw Ncdmcd J{}ecwi}y jdm W{}e X{}}i`l. DKP]J
Ojw`e 78:7
„Qk dm }ej} ojdy pkwri`kp jwk {djgnk cw{dqinnida }c okjp{wk }ek ioxwcrkokd}p}eky ojlk id c{}`cokp bcw yc{da xkcxnk$‟
Km{`j}icd Pknk`} @cooi}}kk. ]eiwm Wkxcw}. Pkwri`kp bcw Yc{da Xkcxnk. F{dk 78::Qej} ip Xwcfk`} Cwj`nk3
J Ncdmcd/gjpkm kdmkjrc{w}c gwida krjn{j}icdp cbyc{}e xwcawjookp ‐ ojdycb qei`e jwk mknirkwkmgy pojnn cw `ejwi}jgnkcwajdipj}icdp ‐ id nidk qi}ej`jmkoi`jnny wiacwc{p jdmid}kwdj}icdjnny wk`cadipkmp}jdmjwmp cb krimkd`k.ioxwcrida `cdpip}kd`y jdmz{jni}y id c{w {dmkwp}jdmidacb qej} mckp jdm mckpd’}qcwl$ Xwcfk`} Cwj`nk ip dcqocrida id}c j dkq xejpk$$$
 
jwk wjwkny `cd`n{pirk$ ]eip xjxkw. ecqkrkw. mckpd’} bc`{p cd j}}wig{}ida gnjok. g{} idp}kjmkuxncwkp }ek mydjoi`p cb qey }eidap jwk }ek qjy }eky jwk$ I} }ekd ackp cd }c kp}jgnipe}ek ―idjgini}y cw {dqinnidadkpp’ jp j `cnnk`}irk j`}icd xwcgnko idrcnrida j d{ogkw cb j`}cwp$Bidjnny. }ewc{ae wp}/ejdm kuxkwikd`k jdm wkpkjw`e jwipida bwco qcwl cd Xwcfk`} Cwj`nk. }ekxjxkw kuxncwkp }ek ojlk cw gwkjl oc}irj}icdp id }ek akdkwj}icd cb accm xwcfk`} krimkd`k$ I}{n}ioj}kny pk}p c{} kujoxnkp cb qekwk }ek `i}km `cdp}wjid}p cd pc`ijn ioxj`} wkxcw}ida jxxkjw}c gk crkw}{wdkm }ewc{ae iddcrj}irk `cnnjgcwj}icdp$
:$ ]ek dkkm bcw `ejdak
[d}in wk`kd}ny. rkwy ni}}nk kuxncwj}icd ejp gkkd airkd }c }ek wkjpcdp qey }ek yc{}e pk`}cw ipki}ekw ―{djgnk cw {dqinnida’ }c okjp{wk c{}`cokp `cdpip}kd}ny$ ]ek z{kp}icd cb qey cdny jnioi}km d{ogkw cb yc{}e xwcawjookp jwk jgnk }c j``c{d} bcw }ekiw p{``kpp cw bjin{wk j} jnn.nk} jncdk id j `cdpip}kd} jdm bwkz{kd} ojddkw. ip cb `c{wpk cdk }ej} nikp j} }ek ekjw} cb qej}Xwcfk`} Cwj`nk ip }wyida }c j`eikrk. gy {dmkwp}jdmida }ek p}jw}ida xcpi}icd cb airkd xwcfk`}pjdm dmida wc{}kp bcw }eko }c ioxwcrk }ekiw krimkd`k gjpk crkw }iok$ I} ojy gk }cc o{`e }c`njio }ej} }ek xwcfk`} qinn gk jd {dz{jnikm p{``kpp. g{} i} qinn `kw}jidny ejrk }jlkd {p j ncdaqjy id xi`}{wida j Ncdmcd id qei`e ocwk }wjdpj`}icdp id yc{}e pkwri`kp jwk ojmk }ewc{aewj}icdjn mk`ipicd ojlida. b{knnkm gy }ek jrjinjgini}y cb {pjgnk krimkd`k$
J wkdkqkm bc`{p cd c{}`cokp
Jncda qi}e c}ekw `cooippicdkwp cb rcn{d}jwy pkwri`kp. }ek @cjni}icd Acrkwdokd} ejp bc{dmi}pknb `cdi`}km id i}p ocp} wk`kd} ku`ejdakp qi}e rcn{d}jwy pk`}cw xwcrimkwp cb yc{}e pkwri`kp$J} j }iok qekwk }ek ocdky jrjinjgnk ip pewidlida. acrkwdjd`k p}w{`}{wkp jnn }ek qjy bwco`kd}wjn acrkwdokd} jdm }ek ]wkjp{wy mcqd }c nc`jn j{}ecwi}y `jgidk} okk}idap jwk wkpxcdmidaqi}e awkj}kw nkrknp cb p`w{}idy$ ]ek koxejpip cd xjyokd} gy wkp{n}p jdm c}ekw xwc`{wkokd}ok`ejdipop. qei`e jio }c mirkw} p`jw`k wkpc{w`kp }c xwcawjookp }ej} qinn akdkwj}k }ekgiaakp} kbbk`}p. ojy pkko gc}e ncai`jn jdm dk`kppjwy$ Yk} ib }eip ip }c qcwl. }ek pyp}ko qinnmkojdm ocwk jdm gk}}kw krimkd`k cb c{}`cokp ‐ krimkd`k qei`e qinn dc} gk }ekwk {dnkppid}kwrkd}icdp jwk x{} id xnj`k }c mknirkw i}$
Id}kwrkd}icdp }c p}io{nj}k jdm nidl }ek p{xxny jdm mkojdm bcw krimkd`k
I} ip wk`cadipkm }ej} j nj`l cb krimkd`k id mk`ipicd ojlida ojy dc} gk gk`j{pk cb bjin{wk id}ek p{xxny cb krimkd`k$ Idp}kjm krimkd`k ojy gk idj``kppignk. {d}iokny. cw i} pioxny mckpd’} nnj `kd}wjn xjw} cb }ek mk`ipicd ojlida xwc`kpp$ Id c}ekw qcwmp }ek mkojdm bcw krimkd`k ip dc}jnqjyp idp}i}{}icdjnipkm id mk`ipicd ojlida$Jncdapimk Xwcfk`} Cwj`nk. }ekwk jwk pcok id}kwkp}ida xwcawjookp }ej} jwk j}}kox}ida}c wkokmy }eip$ Pcok cb }ekpk ocmknp jwk idp}i}{}icdp }ej} j}}kox} }c pyd}ekpipk jdm`coo{di`j}k wkpkjw`e. cb}kd id j }cx/mcqd jdm `kd}wjnip} ojddkw$ ]ek ocp} qknn ldcqd ipxkwejxp }ek Dj}icdjn Idp}i}{}k bcw Ekjn}e jdm @nidi`jn Ku`knnkd`k %DI@K)$
0
Jdc}ekw kujoxnk ip}ek Qjpeida}cd P}j}k Idp}i}{}k bcw X{gni` Xcni`y %QPIXX)$
=
]ek Qjpeida}cd P}j}k Nkaipnj}{wk`wkj}km QPIXX id :950 }c `jwwy c{} xwj`}i`jn. dcd/xjw}ipjd wkpkjw`e cd ipp{kp cb p}j}kioxcw}jd`k. qei`e `{wwkd}ny id`n{mkp ec{pida. x{gni` ekjn}e. km{`j}icd jdm `wiok$ ]ek gjpip cbmk`imida ―qej} qcwlp’ ip }ekiw bc{w/p}kx xwcawjook. qei`e idrcnrkp ocmknnida mibbkwkd} xcni`ycx}icdp }c xwcrimk kp}ioj}kp. id`n{mida }ek gkdk}p }ej} j``w{k }c pkwri`k {pkwp. }ek p}j}k jdm}ek }ju xjykw$ ]ekpk dmidap bkkm id}c }ek `wkj}icd cb
Qei`e3
/p}ynk `cdp{okw wkxcw}p }c jimP}j}k Nkaipnj}{wk mk`ipicd ojlida. jn}ec{ae i} pec{nm gk dc}km }ej} QPIXX ejp dc xcqkw }ckdbcw`k Qjpeida}cd P}j}k }c `cooippicd cw {pk }ek wk`cookdmkm cx}icdp }ej} jwipk$
;
 C}ekw j}}kox}p `jd gk ocwk xwcawjooj}i`$ Cdk kujoxnk ip }ek Bwkd`e Kuxkwiokd}j}icdB{dm bcw Yc{}e. `wkj}km gy }ek Bwkd`e Oidip}wy cb Yc{}e Jbbjiwp id 7885 }c p{xxcw}}ek ―ojidp}wkjoida’ cb kuxkwiokd}jn ‐ kpxk`ijnny wjdmcoipkm ‐ ok}ecmcncaikp id}c }ekxcni`yojlida xwc`kpp$
2
]ek Bwkd`e Kuxkwiokd}j}icd B{dm bcw Yc{}e qjp mkrkncxkm id`cdf{d`}icd qi}e }ek Jgm{n Nj}ib Fjokkn Xcrkw}y J`}icd Njg %F/XJN) qei`e ip gjpkm j} OI]$F/XJN ejp jd id}kwkp}ida ocmkn bcw j}}kox}ida }c kdp{wk }ej} xcni`y ip mwirkd gy wkpkjw`e jdm
Xwcfk`} Cwj`nk ip dcqocrida id}c j dkqxejpk•
]ek Awkj}kw NcdmcdJ{}ecwi}y %ANJ) ip qcwlidaqi}e xjw}dkwp }c b{dm }ekkuxjdpicd jdm mkrkncxokd}cb Xwcfk`} Cwj`nk. }ckd`coxjpp ocwk xwcfk`}pmknirkwida yc{}e pkwri`kpjdm qcwl qi}e ocwk b{dmkwpcb }eko$ I} qinn idrcnrkj ―oj}`eojlida’ pkwri`kgk}qkkd pc`ijn wkpkjw`ekwpjdm yc{}e xwcfk`}p idNcdmcd }c kdjgnk }eko }ckbbk`}irkny ocrk {x }ekp}jdmjwmp cb krimkd`k.akdkwj}ida {pkjgnkidbcwoj}icd bcw j rjwik}ycb mk`ipicd ojlkwp. jdmgkdk}}ida b{}{wk xcni`yjdm xwj`}i`k$
 
krimkd`k$ ]eky mc }eip }ewc{ae j dk}qcwl cb ;5 j`jmkoi`p j`wcpp 08 `c{d}wikp {dmkw}jlidawiacwc{p krjn{j}icd. jdm }ekd }jlida i} b{w}ekw gy gnkdmida i} qi}e xcni`y c{}wkj`e jdm`jxj`i}y g{inmida ok`ejdipop$
1
 
7$ ]ek `coo{di}y jdm rcn{d}jwy pk`}cw `cd}ku}
Id }ek jgpkd`k cb wka{nj}icd jdm `cdpip}kd`y id kuxk`}j}icdp id rcn{d}jwy pk`}cw ojwlk}p.pc`ijn ioxj`} okjp{wkokd} kdmp {x gkida j xwc`kpp gy qei`e pc`ijn kd}wkxwkdk{wp pkkl}c id{kd`k c}ekwp jdm `wkj}k cxxcw}{di}ikp bcw }ekopknrkp$
5
Okjp{wkokd} qi}e j rikq }cjw}i`{nj}ida pc`ijn rjn{k cw ioxj`} `jd gk`cok j `{wwkd`y gk}qkkd cwajdipj}icdp$ Ecqkrkw.id }ek jgpkd`k cb p}jdmjwmp jdm `cdpip}kd`y id ldcqnkmak jdm kuxk`}j}icd. p{`e j `{wwkd`yqinn cdny pkwrk }c p{xxcw}
 p}j}{p z{c
wknj}icdpeixp wj}ekw }ejd cxkdida {x ojwlk}p$ Ojwlk}pid qei`e pojnnkw jdm nkppkw/ldcqd xwcrimkwp `jd gk`cok wk`cadipkm cgfk`}irkny bcw rkwijgnkkrimkd`k cb ―accm qcwl’$C}ekw `cookd}j}cwp ejrk qwi}}kd jgc{} }ek rcn{d}jwy pk`}cw’p krkw/xwkpkd} `cd`kwd qi}e―ioxwkppicd ojdjakokd}’$
9
@coo{di}y awc{xp jwk cb}kd xwid`ixjnny oc}irj}km gy awjd}/ojlida jdm `cooippicdida jakd`ikp’ pkjw`e bcw idrkp}okd}p$ Wk`kd} wkpkjw`e ejp jnpc bc{dmojwlk}ida x{wp{i}p jdm id}kwdjn nkjwdida qkwk ioxcw}jd} oc}irj}icdp$
:8
Qeink }ek id}kwkp}p cb b{dmkwp jdm `cooippicdkwp qkwk ioxcw}jd} id pxjwlida }ek oc}irj}icdjdm {wakd`y jocda }ek rcn{d}jwy pk`}cw. cdny qekd xwcrimkm qi}e p{xxcw} id lidm jdm krkdb{dmida jp xjw} cb j acrkwdokd} xinc} cw xwirj}k idi}ij}irk. qkwk cwajdipj}icdp jgnk }c peib}}cqjwmp gk`coida krimkd`k/gjpkm jdm bc`{pkm cd okjp{wkokd}$ ]ek idrcnrkokd} cb `eikbkuk`{}irkp jdm c}ekw pkdicw nkjmkwp eknxkm bj`ini}j}k }eip }wjdpi}icd$
::
 ]ek `j}jny}i` wcnk cb cwajdipj}icdp p{`e jp Xwc Gcdc K`cdcoi`p.
:7
Xinc}niae}
:0
jdm G{pidkppid }ek @coo{di}y
:=
mkocdp}wj}kp }ej} }ek idfk`}icd cb }iok. plinnp jdm kuxkw}ipk bwcomibbkwkd} pk`}cwp `jd `wkj}k j p}kx `ejdak qi}eid rcn{d}jwy pk`}cw cwajdipj}icdp$ Ocwkcrkw.mip}wig{}ida }eip xj}wcdjak jdm p{xxcw} }ewc{ae `coxk}i}icd %i$k$ ojlida cwajdipj}icdp jxxnybcw i}) id`wkjpkp }ek xkw`kirkm rjn{k cb }ek p{xxcw} jdm i} }ekwkbcwk }jlkp cd awkj}kw id}kwdjn`{wwkd`y$]qc xwkppida `cd`kwdp wkojid. jp imkd}ikm gy wk`kd} wkpkjw`e ‐ }ej} }ekwk ip p}inn―`cdpimkwjgnk mirkwpi}y qi}eid }ek }eiwm pk`}cw qi}e wkajwm }c i}p }jlk {x jdm jxxwcj`ekp’ }cpc`ijn ioxj`} okjp{wkokd}.
:;
qei`e ip `coxc{dmkm gy `cdb{picd jdm `coxk}i}icd gk}qkkdmibbkwkd} kuxk`}j}icdp jdm jxxwcj`ekp jocda b{dmkwp jdm x{gni` pk`}cw `cooippicdkwp$Xwcfk`} Cwj`nk pkklp }c bj`k {x }c }ekpk `ejnnkdakp gy xwcxcpida j p}jdmjwm bcw krjn{j}icd}ej} `jd gk jxxnikm }c kd`c{wjak `cdpip}kd`y. }cak}ekw qi}e j xj`ljak cb p{xxcw} }ej} `jd`j}jnypk cwajdipj}icdp id }ekiw fc{wdky }cqjwmp krimkd`k akdkwj}icd jdm pkwri`k ioxwcrkokd}$ 
0$ Xwcfk`} Cwj`nk wkpkjw`e
Id Mk`kogkw 78:8. }ek ANJ `cooippicdkm @coo{di}y Nidlp }c w{d j d{ogkw cb qcwlpecxpjp xjw} cb j `cdp{n}j}icd bcw mkrkncxida }ek Xwcfk`} Cwj`nk a{imkgccl$ ]eky jnpc `jwwikm c{} jp{wrky. qei`e {n}ioj}kny wkj`ekm :;1 wkpxcdmkd}p. ocp}. }ec{ae dc} jnn. cb qeco qkwk yc{}epk`}cw xwcrimkwp$
:2
]ek p{wrky akdkwj}km id}kwkp}ida wkk`}icdp cd jd cwajdipj}icdp jgini}y }c krjn{j}k$ Bcwkujoxnk nj`l cb }iok %17 xkw `kd}). b{dmida %2= xkw `kd}) jdm kuxkw}ipk %=9 xkw `kd}) qkwkimkd}ikm jp }ek xwiojwy `cdp}wjid}p }c ejrida accm krjn{j}icd$ @c{xnkm qi}e id`cdpip}kd}%cw ―{d/p}jdmjwmipkm’) kuxk`}j}icdp bwco j mirkwpi}y cb b{dmkwp. cwajdipj}icdp jwk {djgnk }cxwicwi}ipk krjn{j}icd p}wj}kai`jnny jdm }c kuk`{}k i} wcg{p}ny$ ]e{p ojdy cwajdipj}icdp `jddc}ak} crkw }ek idi}ijn e{wmnk cb krjn{j}icd qi}ec{} pcok bcwo cb p}io{n{p bcw mcida pc ‐ jd ipp{k

You're Reading a Free Preview

Download
scribd
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->