Youth Development Strategy Journey to Evaluation

Ross Wortham Regional Manager Perth

Save the Children Australia

Save the Children Australia

Save the Children Australia

Why evaluate?

We knew we were making an impact anecdotally but couldn't always prove it!

Our experience with Monitoring & Evaluation

• Old school Logic Models – measures the:

– Inputs – yes – Activities - yes – Outputs (quantitative data) – yes – Outcomes – mostly ad hoc – Analysis? – not normally!

• Qualitative Research

– It Takes a Village and Communities for Children – Rich analysis – But who’s got the $ and time?

Mostly driven by funder KPIs

Youth Development Model

The Journey began with strategic thinking to improve our practice in supporting young

people

Circle of Courage

W.H.O. Life Skills

Culturally appropriate questions

Risk

Outcomes

Resilience

Research!

Data collection

Log-frames

evidence

Indicators

Protective Factors

Impact analysis

Behaviour Change Theory Theory

Theory Theory

Time time time

Vulnerability

Complexity!

Start with the problem and work backwards

Vulnerable children and families

Protective x Risk = Vulnerability

Focus on the solution

Resilience?

Protective x Risk = Resilience!

Our Approach Resilience vs Vulnerability

Resilience is • an individual and collective

process in which young people, families, and communities develop the capacity to respond positively to difficult situations

Vulnerability is • the interplay between risk

and protective factors which together determine to what extent a young person is vulnerable

Building Capacity

Assets Resources

Increasing: • Life skills • Cultural connection • Confidence • Etc.

Increasing: • Family functioning • Community connection • Role models • Etc.

Decreasing: • Low confidence • Poor social skills • Etc.

Decreasing: • Truancy • Drug abuse • Etc.

Unpacking Resilience

GOAL: To protect young people and improve their resilience by building their capacity to respond positively to adversity

Priority Area 1: Community Connectedness

Objective 1: Young people increase their

engagement and participation with their

community, peers, family and services

Objective 2: Young people increase their

safety

Priority Area 2: Individual Capacity

Objective 3: Young people develop life skills

and cultural values to respond positively to

risk

Objective 4: Young people increase their connection to formal

education and training opportunities

Youth Development Model

Level of Risk Factors High Low

Leve

l of P

rote

ctiv

e Fa

ctor

s Lo

w

High

Universal:

Early Intervention: Children and Youth

Secondary Intervention: Young people and Family

Family and Community Events

Reconnect and Strong Tomorrow

One Step Closer

Primary Prevention: Early Childhood Intensive Supported Play scheme Armadale

Implementing the Youth Development Model

Medium term Long term Time line of program implementation

Measuring Change Small Steps to Success in our Youth Development Model

“I haven’t smoked in over a year and I even helped my

friend give up pot”

“I’m no longer smoking anymore

and haven’t for the last 6 months”.

“I know Marijuana affects my motivation, but I’m not ready to give up”

Using evidence base evaluation tools

Mapping our tools and indicators to the YDM objectives Reconnect - Outcomes Star model for individual assessments One Step Closer – Circle of Courage domains and now implementing Dr Ungar's Child and Youth Resilience Measurement tool

Next Steps

We are working on ‘get it right’

We dream to evaluate: • Collective impact • Evaluating across the life continuum • Collecting hard vs soft indicators • Engaging universities and academic institutions • Counterfactual analysis and research

Questions?

Ross Wortham | Regional Manager Perth Save the Children Australia 1074 Hay Street, West Perth, Western Australia 6005 Direct line: +61 8 9267 3920 | Fax: +61 8 9486 9503 Mobile: +61 (0) 450 085 562 Email: ross.wortham@savethechildren.org.au