You are on page 1of 4

October 2015

Cultural Commissioning Programme:

Evidence Measures requested by Commissioners and Evidence Measures in use in the arts & cultural sector (initial findings
200 cultural organisations and from commissioners who have contributed to CCP case studies and events)
Note 1: Survey question focussed on measurement methods, rather than on type of outcome. Some measures indicate type of outcome ag
being collected, whereas others do not.
Note 2: Several measures mentioned by arts & cultural organisations are not listed as measures requested by commissioners. However, thi
they have not been requested by some commissioners.
Measures asked for by commissioners
Measures used in the arts & cultural sector
Wellbeing Measures
Wellbeing Measures
WEMWBS - Warwick Edinburgh Mental
Wellbeing Scale
WEMWBS - Warwick Edinburgh Mental Wellbeing Scale
Mental Health Recovery Star - one of the
Outcomes Stars
The Flourishing Scale - measures wellbeing
Lodex

Outcomes Star - comprises several Stars to measure change across range of outcomes eg
NPC's wellbeing measure - measures eight aspects of wellbeing
Locally developed outcome measures
The SOUL Record (BIG Lottery funded) - measures progression against soft outcomes

Other Outcome Measures
General Health Questionnaire (GHQ-28)

Framework of Outcomes for Young People - set of outcome measurement systems, includin
GSES - General Self-Efficacy Scale
Other Outcome Measures
Outcomes Star (see above under Wellbeing Measures)

Global Quality of Life Scale (GQOL)
Quality impact studies
Added social value

Generic social outcomes (Museums, Libraries & Archives Council) - impact on social outcom
Generic learning outcomes (Museums, Libraries & Archives Council) - impact on learning ou
PIRGAS - Parent-Infant Relationship Global Assessment Scale

Evidence of need in respect to new target
audiences/participants

BITSEA - Brief Infant Toddler Social and Emotional Assessment
1

Health / clinical impact measures

Parental Stress Scale

Outcome measures not specified - left to
provider to determine

EDIMS - Equality & Diversity Impact Measures

Value of Infrastructure Programme - tools to help voluntary sector infrastructure organisatio
Likert Scale - measure of attitudes or opinions

Economic Impact Measures

Knowledge East Creative Impacts Matrix - measures value of performing arts in addressing
Economic Impact Measures

Social Return on Investment
Value for money - measure not specified

Social Return on Investment (Note: small no of respondents mentioned, and generally com
Economic Return on Investment

Return on investment/cost benefit analysis measure not specified

Case Studies
Case studies to identify impact on individuals
Statistical
Demographic data on users
Socio-economic data on users
Other statistical data
No of groups supported for people facing
mental health challenges

Measures drawn from clinical practice
GAD Scale - for assessing and monitoring general anxiety disorder
PHQ Scale - for assessing and monitoring depression
DASS - Depression Anxiety Stress Scale
Quality of Life Measures
QALYS - Measure of quality-adjusted years
NESTA's Qualia app - means of measuring mood of audiences after experiencing arts & cult
Case studies
Case studies to identify impact on individuals
Statistical
Demographic data on project attenders / visitors
Socio-economic data on users
Evaluation forms (although may also include scope for commentary)
Templates provided by commissioning organisations / funders
No of people into jobs
2

Measures evidencing achievement of accreditation / accredited training
Completion / drop out rates of participants

Creative work of participants
Arts work produced by participants

National Library Indicators includes statistical info such as no of library book issues, no of li
Benchmarking data - eg through national CIPFA Library Survey
Online visits
Creative work of participants
Video diaries, vox pops, drawings, performance, craft etc

Sustainability

Sustainability

Sustainability of work eg Peer tutors
empowered to set up own groups
Completion rates

Sustainability of work eg Peer tutors empowered to set up own groups
Completion rates
Funding levered from elsewhere
External studies, evaluations, comment
Evaluation commissioned from academic institutions
Evaluation commissioned from external evaluators
External observation of impact on participants - examples given include work with people w
Commissioner feedback
Feedback from practioners in partner organisations
Internal logs, observations
Artists' logs / session logs
Documentation through film, video, photography, storify
Interactive
Focus groups, meetings, interviews
Social media interaction and commentary
Use of Pre-existing evidence
Pre-existing academic evidence
Pre-existing evidence from other practitioners
3

Evidence supplied by health professionals showing impact on participants and savings from
Other
Mystery shoppers

Arts Council England's self-evaluation framework - helps organisations monitor performanc
Press coverage
360˚ feedback from participants, carers, customers, practitioners, peers, critical friends
Some comments
Commissioners
The evidence base for our social prescribing
service is so strong and so consistent that
rather than getting everybody to sample
continuously, we ask for one cohort per year
Part of the remit is to make sure groups end in
a good way. We look at what happens to them
—do members go onto other things, like
education?
Because WMWBS has been used so
extensively, commissioners tend to have
confidence in it as a measurement tool
Only collect data that is actually collectable
We're working in a complex environment
where we rarely understand what works first
time - so have an adaptive approach: TestLearn-Adapt

Some comments
Arts & Cultural Organisations

We are hampered by the commissioners' list of output-based outcomes

We don't have the capacity for in depth, long term research such as tracking users over lon

Filling out end of session questionnaires - this would ruin any good effect from the session.

It's always a learning curve with each new commissioner, so while sometimes challenging t

We try to balance statistical data and case studies, photographs of exhibitions and physica
headline figures as well as the emotional side and impact on people lives

4