We work with you to create the change

you envision, planning progress through

knowledge and action

2

Federal Evaluation of Linkages:

Supporting Sustainability

Prepared For

CFPIC

October 16, 2007

3

Sustainability Starts with a Theory of Change

4

Linkages P

articip

atio

n

Linkagesv1

Linkagesv2

Linkagesv3

No linked services

ServiceCoordination (TDM)

Outcomes

Org

aniza

tional C

han

ge

Family to Family or

similar

Alternative

Impact

Local CBO

assistance

programs

CFPIC suppo

rt Privately-

funded

changes

Privately-

funded

changes

Child Welfare policy

changes

Otherpolicy chang

es

CalWORKs policy changes

Economic

changes

Linkages Theory of Change

Precursors Implementation Outputs Outcomes External Factors to Implementation

5

6

Sustainability Built in to Evaluation Design

7

Three-Pronged Design Retrospective Evaluation

Outcome-focused for existing programs Provides justification for sustainability

Prospective Evaluation Links rigorous process evaluation with outcomes

Supports sustainability by investigating what org change and implementation elements are needed for maintaining successful outcomes over time

Case Studies Detailed description of three county Linkages programs

Elaborates on sustainability process of existing programs

8

Retrospective Design Timeframe

Historical data from 1999-2006

Sample Del Norte, Calaveras, Merced, Orange,

San Francisco, Santa Barbara, Stanislaus “Historical” comparison group

Measures Organizational change Implementation Outcomes External factors

Data Sources State and County databases: CWSCMS, ISAWS, Leader, C-IV, CalWIN,

EDD Historical documents describing program development and

implementation

9

Prospective Design Timeframe

2007- 2011

Sample Selected Pioneer, Phase II, and Phase III Counties Comparison counties with no Linkages-like programs

Measures Rigorous process and implementation evaluation Outcomes External factors

Data Sources State and County databases: CWSCMS, ISAWS, Leader, C-IV,

CalWIN, EDD Surveys of Linkages staff

10

Case Studies Timeframe

2007-2011

Sample (proposed) Stanislaus, Los Angeles, Santa Clara

Research Questions How is Linkages implemented? How do Linkages activities produce outcomes?

Data Sources Interviews with Linkages staff Focus groups with Linkages clients

11

Contact

Paul Harder

pharder@harderco.com

Erika Lehmann, Ph.D.

elehmann@harderco.com

530.757.8420

harderco.com

12

Organizational Change Elements

Culture

Leadership

Policy

Administration

*

13

Implementation ElementsConfidentiality

Data Sharing

Coordinated Services

Co-location

Training

Accountability

Staff Support

*

14

Outcomes

Children experience less abuse

Children safe in their homes

Parents have resources to support their children

Children in foster care achieve permanency

*