On 25th October 2018 I had the pleasure of being asked to join a panel to discuss evaluation in the context of working with the arts with children and young people in challenging circumstances at the New Horizon’s Conference, hosted by The Garage in Norwich. The whole day was planned to support discussion, debate and importantly opportunities to learn. I was joined on the panel by the inspirational Deborah Bullivant, Founder of Grimm & Co, Dr. Matthew Hill, Head of Research and Learning and Deputy Director for the Centre for Youth Impact, and our excellent panel Chair, Lucy Marder, Strategic Manager at ArtsWork. Â
Here is an outline of what I talked about in the session.
How do we best evaluate the impact of work by and with children in challenging circumstances?
Good evaluation for me is underpinned by three core principles.
Firstly, good evaluation is collaborative.
Good evaluation has stakeholders at the heart of the process, not just as people to fill in forms but to help plan the methodology, set the questions that are most important to them and reach out to their networks where appropriate. Evaluation is concerned with making judgements, but we need to think carefully about who makes those judgements about what works. Our most vulnerable groups are most likely to be the least powerful, and so why would we as evaluators add to their powerlessness by assuming as the experts we have all the answers about how an evaluation would work for them. I’m not suggesting this is always easy. In one project I evaluated, we started off with a participatory action research project at the centre of the evaluation, but needed to move away from this approach to an engaged but researcher led evaluation after the first year. This was as a result of funders requiring larger samples sizes than a truly participatory evaluation could achieve, and restrictions on how much I could direct the research, let alone the community researchers. This became a quite an ethical dilemma for me. Why were we asking volunteers to give up their time to work on a well-funded project that they had very little real power to influence? Don’t get me wrong, the funders and project were very keen to help people shape the programme, and we were pragmatic in our solutions, but ultimately the systems of ‘evaluation’ got in the way of stakeholders being able to direct and genuinely influence the evaluation in any meaningful way.
Secondly, good evaluation is embedded deep into the activity of the project.
So often evaluation is thought of something that fits onto the end of a project. An afterthought. Or something that a project pulls out annually in the form of interim reports. For me good evaluation is stealthy. It isn’t an add on, but embedded throughout the whole cycle of planning, listening and learning, analysing and sharing. It is about evaluation activities being immersed in the day to day activity. In my experience artists are some of the best people to run effective evaluations because artists don’t do boring. And once given permission to throw away their evaluation forms they go to town using creative activities to help stakeholders reflect on impact in exciting and engaging way. Which bring me to my last principle.
Good evaluation is creative and engaging.
Who says an evaluation has to be a long list of questions asked at the end of a session? Who says an evaluation has to be written up by an evaluator into a report that gathers dust on a shelf for 5 years until the next office move when it is thrown in the bin? In my experience using creative evaluation tools can help attract people to tell you their thoughts. In creative projects we have limitless ways of both gathering and disseminating our evaluation findings. And quite often the people best able to decide what that should be are those I talked about in principle number 1.
I think it is important to note that we can’t beat ourselves up over this if we can’t always achieve this balance. In some cases, as is illustrated in the examples I have just mentioned, I took the decision to focus more on creative engagement than full participation of community researchers. At other times I have been asked to evaluate projects three months before it is due to end. And that is ok. I’m also not denying the importance of data and clear and consistent evaluation frameworks. But these three principle help us reflect on work: Whose voice are we hearing? How well does evaluation fit with inside the project itself? And will our evaluation be a passive observation of practice or play a part in deliberately addressing some of the power inequalities experienced by the young people we work with?
ed medications
generic stromectol ivermectin powder ivermectin covid19
cheap drugs ed meds online without doctor prescription canadian drugs
steroids prednisone for sale prednisone for sale prednisone daily use
where can i buy ivermectin for dogs can you buy stromectol over the counter where to buy ivermectin lotion (sklice)
cialis for sale online cialis usa prescription original cialis pills
walgreens ivermectin ivermectin 6 mg walgreens ivermectin 50 mg
buy prednisone online without a script buy prednisone online prednisone 20
erectile dysfunction medications cheap erectile dysfunction pills online ed treatment pills
stromectol for sale durvet ivermectin horse paste ivermectin paste for cattle
canadian medications pain meds online without doctor prescription prescription drugs online
ivermectin 6 mg walgreens can you buy stromectol over the counter stromectol brand
ed pills cheap best ed drug top ed drugs
non prescription ed drugs canadian online drugs sildenafil without a doctor’s prescription
erectile dysfunction medicines ed pill what is the best ed pill
stromectol 12 mg tablets prescribing stromectol prescribing stromectol
provigil cost modafinil 200mg over the counter
modafinil online buy order provigil 200mg without prescription
buy modafinil 200mg pill
buy modafinil generic
viagra price for viagra sildenafil
oral modafinil 200mg modafinil 100mg oral
order modafinil pill buy provigil 100mg pills
buy generic provigil
where to buy cheap clomid online buy clomid buy clomid 50mg
clomid for sale canada clomid tablets clomid tablets for sale
provigil 100mg tablet order provigil sale
price for viagra viagra pills sildenafil 20 mg
provigil 200mg for sale buy provigil 100mg for sale
clomid for sale canada clomid for sale canada clomid for sale canada
order modafinil 100mg online buy provigil 100mg pill
provigil order online provigil buy online
https://erythromycin1m.com/# erythromycin base 250mg
stromectol for sale maximum dose of ivermectin ivermectin cost in india
stromectol 12 mg tablets stromectol tablets for humans stromectol for sale
stromectol for humans for sale stromectol 12 mg tablets stromectol for sale
viagra 100mg price viagra pills 100mg viagra
erythromycin cream for acne erythromycin for ear infection
order viagra online viagra pills price of viagra
cheapest cialis tadalafil 20 mg tadalafil 20mg best price buy cialis with dapoxetine
cialis overnight shipping canada buy tadalafil cialis pro
?В»?cialis tadalafil cialis 5mg
erythromycin eye drops erythromycin ointment
fed ex overnight delivery cialis tadalafil without a doctor’s prescription buying generic cialis
cialis buy online canada price of cialis 20 mg generic cialis au
cialis uk cialis daily cialis reviews
erythromycin overdose
erythromycin lactobionate http://erythromycin1m.com/#
erythromycin cost https://erythromycinn.com/#
erythromycin how to use erythromycin ophthalmic ointment
hydroxychloroquine 200 mg price other names for plaquenil
order hydroxychloroquine without a prescription
generic plaquenil 200mg plaquenil generic
gsn casino
pop slots
slots casino
slotomania online slots
my free vegas slots on facebook
casino free play slot
chicago illinois dissertation help
dissertation research and writing
dissertation methodology
dissertation structure
dissertation meaning
help with writing dissertation proposal
dissertation writing software
write a dissertation abstract
proposal and dissertation help geography
writing a proposal for your dissertation
best dissertation writing service review
dissertation help online
writing a dissertation
writing your dissertation proposal
writing editing services
paper writing service
doctoral dissertation defense
thesis dissertation writing
free sign up bonus no deposit casino
no deposit casino bonus
online real money casinos
help dissertation thesis advice
help with dissertation topic
need help with dissertation
best online casino deposit bonuses
real casino games
online bingo real money
uga dissertation
dissertation help scam
writing a literature review for a dissertation
research writing help
writing a proposal for your dissertation
dissertation abstract example
real money online casino
no deposit casino
online spins
statistics help for dissertation
writing my dissertation
dissertation editing help
no deposit welcome bonus casino
best casino sites
free bonus slots
premium dissertation writing service
dissertation chapters
dissertation services
best usa online casino
online casino bonus
best online casino welcome bonus
how to write a dissertation
dissertation help india
writing services
win real money online casino for free
what is the best online casino for real money
free cash bonus no deposit casino
best casino online usa
biggest online casino bonuses
best us online casinos
free no deposit
best online casino us
bonus no deposit
online casinos no deposit bonus
casinos online real money
casino welcome bonus
online casinos
sign up bonus no deposit casino
sign up bonus casino
kasino bonus
casinos online real money
no deposit casino
online casinos with no deposit bonus
deposit bonus casino
best online usa casinos
avast secureline vpn
what is vpn?
business vpn connection
best no deposit bonus
no deposit welcome bonus
top us online casinos
vpn router best buy
free vpn reddit
vpn with free trial
online gambling for real money
casino games for real money
best mobile casino
buy avast vpn
business vpn solutions
india vpn free
online casino usa real money no deposit bonus
online casinos real money
cherry jackpot casino
buy residential vpn
best torrenting vpn
best windows vpn
no deposit casino
online casinos no deposit bonus
best online casino reviews
best vpn for roku
best free windows vpn 2017
best vpn 2018 reddit
play blackjack online money
best mobile casinos
online casino free spins
vpn to change location free
vpn for netflix free
open vpn free
usa online casino
best no deposit bonus online casino
casino reviews
free vpn for chrome
free vpn server list
10 best vpn services
no deposit slots for real money
online casinos no deposit
online casino us