Using the Family Development Matrix to Share Outcomes

ICCS/CSUMB

Strategies

OCAP

Today’s ObjectivesUnderstand the structure, benefits, and applications of the Matrix Outcomes Model

Understand the role of the Matrix to build on family strengths and track their progress

Use the Matrix as a tool for family support, healthy families, child welfare and mental health to develop shared outcomes and evaluate results for preventing child abuse

History

Government Performance and Results Act (GPRA) of 1993.Scales Committee, HHS developed Agency, Family and Community Matrices. Results Oriented Management and Accountability (ROMA). ICCS began examining the California Community Action model in 1996 by providing workshops locally.

History

In 1999, conducted testing for validity & reliability.

Since 1997, we have assisted 300 programs to design their indicators and train staff to use the Matrix in a variety of settings.

Today, Website provides online design & data base assessment and reports.

The Matrix is:

• An outcome tool for measuring performance and establishing results accountability

• A process for conducting ongoing assessments, case management, outcomes measurement and evaluation

“Success is defined as improvement as measured against a baseline”

Mark Friedman, Fiscal Policies Studies Institute

Matrix Outcomes Model

Key Point:The purpose of an outcome-based approach is to focus on the well being of the family and

ultimately the ability of the community to preparechildren for success.

Matrix Structure

Outcome categories define the Matrix

Four status levels define each of the indicators for the outcome categories

Strength-based assessment, case planning and outcome results

Family Development MatrixProvides information directly from family members.

Assists staff to build on strengths, address challenges, and track change

Families recognize their strengths as well as areas in need of further assistance

The data assists agencies and funders to improve family-centered services.

Categories and Indicators

Children

Children’s Care & Safety Children’s Development Children’s Education

Access to quality health care Age-appropriate behavior & social skills

Access to appropriate educational services

Access to age-appropriate after school program

Children’s behavior Appreciation of intergenerational relationship

Supervision by the family Children’s communication Comprehensive: retelling a story

Assure safe environment (risk of physical violence, sexual abuse)

Development milestones Connectedness with local schools

Family respite Care Peer relationships Desire to read

Resource for recreation & play opportunities

Educational development

Verbal communications Reading exposure by number of books read

Age-appropriate development School/Program attendance

Vocabulary

AdolescenceAdolescence Development Student Development

Attitude Knowledge of goal setting

Quality of immediate family support

Ability to follow directions

Job skill; work history Peer relationship Quality of community or school support

Communication with friends and adults

College/Vocational Goals Conflict resolution skills with family

School/Program attendance

Leadership skills

Communication with Adults

Disciplinary problems Sense of personal responsibility

Make wise decisions

FamilyAdult Education/Employment Children’s Care and Safety Children's Development Children's Education

Job Skills; Work History Access to Quality Healthcare Development Milestones Access to Educational Services

Educational Development Access to Age-Appropriate after school program

Age-Appropriate Behavior and Social Skills

Family Connectedness to School

Career Goals/Achievement Supervision by Family Verbal Communication School Program Attendance

Quality of Employment Assured Safe Environment Peer Pressure Skill Building

Language skills & Literacy Family Respite Care Adolescent job skills Resources for recreation and play

Family Environment Finances Food/Clothing Health/Safety

Family Communication Skills Savings and Finance Resources Resources for Nutrimental Foods Environmental Conditions

Family Rules and Expectations Budgeting Skills Quality of Diet Health Habits

Conflict/Resolution Skills Income Level in Context with Local Cost of Living for Basic Needs

Adequacy of Clothing Access to Health Resources

Parent/Child Relationship Condition of Food Preparation (Utensils, Space, Appliance, Furniture

and Sanitation)

Status of Psychical Health

Adult Self Care Knowledge and Understanding of Financial Intuition and Resources

Ability to Afford Health Care

Extended Family Support

Immigrant/Resettlement Shelter/Community Environment Social and Emotional Health and Competency

Transportation/Mobility

Immigration Status Housing Resource Quality of Social Support System Access to Transportation

Language Sills Based on Needs Stability of Housing Presence, Degree of Substance Abuse Legal Status of Driver & Vehicle (Driver’s License, Insurance, Etc)

Preservation of Language Origin Adequate for Family Size Coping Skills

Maintaining Cultural Diversity Relations with Neighbors Quality of Emotional Well Being Safety, condition of Transportation

Involvement in Culture of Origin Community Service & Engagement Ability and Willingness to Identify Needs and Access to Resource

Reliability and Safety of Transportation

Customize a Matrix ModelAdolescence

Adult Education & EmploymentAgency Organizational Standards

AmbitionsAttachment Status (child)

Basic NeedsCaregiver Support (senior)

Children’s Care & SafetyChildren’s Education

Children’s DevelopmentChildren’s Skill Building

Community EngagementCommunity Environment

Community HealthCultural Competence

Elder SupportFamily Environment

Family RelationsFinancial Stability

Health Access Health Safety

Health Care PolicyImmigration

Individual HealthIntergenerational Programs

Long Term Care (senior)Parent Involvement

Parents/Child RelationshipsPrenatal Healthcare

School Healthy EnvironmentSexual Activity

Shelter Social & Emotional Health

Social Family SupportStudent Development

Substance AbuseTransportation

Volunteers

The Matrix Creator

A Web-based system:

Programs design outcome measurement and collect data

Customize an assessment to a specific population

Conduct local reliability and validity tests

Conduct ongoing assessments and outcomes measurement

Enter and retrieve data and chart findings

A Partnership is Formed2005-2011

California State University Monterey BayInstitute for Community Collaborative Studies

+Strategies Training and Technical Assistance Centers

+California Department of Social Services

Office of Child Abuse Prevention

Project Goals

• To build capacity within FRCs to use an integrated family outcomes tool for program assessment and intervention evaluation

• To support FRCs in partnering with local child welfare systems to develop shared target outcomes for families where differential response is indicated

• To conduct research and provide a framework of information for a pathway to prevention of child abuse to keep children in stable and nurturing homes

Project Partners 90 agencies in 14 counties in collaborative

networks

Butte San FranciscoDel Norte Santa BarbaraLake San Luis ObispoMadera San JoaquinOrange SiskiyouSacramento Tehama

Ventura10 tribal communities Yolo

Pathways Mapping Project• Harvard University research – identifies outcomes,

strategies, examples, actions for PCAN

Pathway knowledge base bridges disciplines serving families

Pathway identifies actions that contribute to achieving specified outcomes

Pathway identifies indicators of progress toward specified outcomes

http://www.pathwaystooutcomes.org

Prevention Model

The Matrix ProcessCore categories and indicators

Tested and evaluated for validity and reliability locally

Field Test with staff working with families

Establish protocols and codes for data

Train staff to use the Matrix with families

Conduct the assessment with families

Track progress by individual, family, program, agency

and county

Use data to tell the story of change

Status Level Change(4) SAFE/SELF-SUFFICIENT

A strong and secure position for a person or family

(3) STABLE A current plan and readiness for change

(2) AT-RISK Indicates a threat; not yet committed to

strategies for change(1) IN-CRISIS

Inability to meet needs; situation near collapse; requires immediate intervention

c/r Jerry Endres

Edit Your Chosen Indicators

Matrix Assessment Measures both where family is strong and has

resources and where it needs support Creates a partnership with the family

Facilitates family ownership of their efforts

Helps to develop skills in the family

Documents, over time, the family’s progress toward outcomes

Family Assessment Listen to the Family’s situation.

Restate what you have heard using Matrix indicators.

Ask more questions to cover the Matrix categories.

Score each category together.

Subsequent AssessmentsBaseline Assessment

The worker and family member determine initial scores for each of the outcome categories

Additional AssessmentsSubsequent meetings depend on the duration of services.

The Matrix "scores" established at the previous meeting are revisited, and another assessment is completed.

Enter Your Data

Auto-Generated Assessment Summary

Family Empowerment Plan(Based on Principles of Family Support)

Step one: Identify areas of strength and issues of concern.

Step Two: Ask the family the goal they would like work on at this time.

Step Three: Assist family to identify strengths that can be applied to assist with goal achievement.

Step Four: Complete a Family Empowerment Plan.

Empowerment PlanningClient ID# Case Partners Date Case Opened

Write in the name of the Matrix categories and family objectives below

Goals Matrix category Matrix category Matrix category Accomplishment

objective objective objective Objectives

Family

Program

What will the family want to accomplish?

What the the family will do to help reach the objective?

Review Date: Parent signature: Staff Person:Supervisor:

What other resource persons will do to help reach objectives?

What the program will do to help reach objectives

Strength Based ChangeAWARENESS Family sees their situation from a strength

based perspective

SKILLS Family has the knowledge, skills and ability to move toward self-selected priorities

MOTIVATION Rewards and benefits for change outweigh attitudes or obstacles that may prevent the Family from achieving goals

MAINTENANCE Family is using strengths to reach and maintain self-sufficiency

Family Focused ModelKey Point:

The Matrix tracks Family needs from the beginning

of a relationship.

It functions as an empowerment tool to

accomplish the overall goal of the Family--- to

become and remain self-sufficient.

Family Focused ModelKey Point:

The Matrix is a tool built on the Principles of

Family Support. The family has central, active role

in determining their goals and steps they can take

toward achieving their goals

Benefits of Using the MatrixMeasures strengths and risks

Creates a partnership with worker and family

Documents the process that achieves outcomes

Facilitates family ownership of their efforts

Helps families develop skills

Analyzing Data

Status level change based on time in program

Compare baseline to current quarter

Analyzing effects ofdiffering interventions

Charts Enable Quick Understanding of the Data

Matrix DataFamily Empowerment

Program Improvement

Agency Strategic Planning

Reports to Funders

Legislative Advocacy

Analysis of FDM data• Overall data.• Factors contributing to change in scores

Baseline Scores

Change in Scores

Our Theory of Change• Building/Testing a theory of change

Family

WorkerIntervention

Family 1: ParticipationFamily 2: Follow empowerment planFamily 3: BarriersFamily 4: Level of support

Pathway Intervention Case management activity

A Model of Change

scorei= + ’(Family)+(baseline)+ (strengths)+ (ethnicity)+ (gender)+ A’i

Change as a function of:

Family engagementInitial status levelOverall strengthsEthnicityGenderCollaborative specific effects

Basic change model

***p<.01,**p<.05, *p<.1; Collaborative variables omitted from table

ParticipationFollow through

Barriers Supports

DR Paths and Change• Are different DR paths related to change in

outcomes?

Change as a function of:

DR PathFamily engagement

Initial status levelOverall strengthsEthnicityGenderCollaborative specific effects

DR Paths in the FDM

• Path 1 : Child Welfare refers to FRC with no investigation (Referral)

• Path 2 : Child Welfare investigates and refers to FRC (Handoff)

• Path 3 : Child Welfare opens a case and refers to FRC (Partnership)

• Path 4 : Walk-ins / non Child Welfare referrals

Mean baseline scores by DR path

DR Paths in Change Model

***p<.01,**p<.05, *p<.1 Collaborative variables omitted from table

Conclusions from FDM data analysis

• Family engagement is an important factor in determining change. Families that follow through the empowerment plan and use strategies to address barriers show greater gains in scores.

• FDM differential response paths are not related to change in outcomes.

• No relationship between FDM DR path and family engagement levels.

Handouts

Questions