Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge...

Post on 18-Jan-2016

217 views 1 download

Tags:

Transcript of Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge...

Better commissioning for better evaluations

Dr Carmen Huckel-Schneider

Principal Analyst

Knowledge Exchange Division

Sax Institute

Duncan Rintoul

Principal Evaluator

Centre for Education Statistics and Evaluation

Department of Education

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Commissioning in the evaluation lifecycle

A simplified

Commissioning in the evaluation lifecycle

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Commissioning in the evaluation lifecycle

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Commissioning in the evaluation lifecycle

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Commissioning in the evaluation lifecycle

scenario1You need to be able to explain your program to an outsider

Better commissioning

for better evaluations

scenario2You program needs to have clear and reasonable objectives

Better commissioningfor better evaluations

scenario3

You need to be able to explain how your activities are supposed to lead to your intended outcomes

Better commissioning

for better evaluations

1. Know your program well

Logic modelling is a great tool for this

Better commissioning

for better evaluations

scenario4Be open-minded about what the evaluation may discover

Better commissioning

for better evaluations

scenario5Be open to methods and approaches that you are unfamiliar with

Better commissioning

for better evaluations

6Anticipate use: Who is going to find the evaluation helpful, and for what purpose?

Better commissioning

for better evaluationsscenario

1. Know your program well2. Commission for use

Better commissioning

for better evaluations

1. Know your program well2. Commission for use3. Build evaluation in early

Better commissioning

for better evaluations

• baseline data• comparison• built-in data collection

1. Know your program well2. Commission for use3. Build evaluation in early4. Prioritise in light of the trade-off

between cost, time and quality

Better commissioning

for better evaluations

Better commissioning for better evaluations

Carmen.Huckel-Schneider@saxinstitute.org.au

Duncan.Rintoul@det.nsw.edu.au

1. Know your program well2. Commission for use3. Build evaluation in early4. Prioritise