Measuring Our Impact: Lessons from the Field

12
Measuring Our Impact: Lessons from the Field Verna P. Best, MSA Freeman Denton, MPA, NCRT NASCSP Annual Training Conference September 12, 2013 Phoenix, AZ North Carolina DHHS Division of Social Services

description

North Carolina DHHS Division of Social Services . Measuring Our Impact: Lessons from the Field. Verna P. Best, MSA Freeman Denton, MPA, NCRT NASCSP Annual Training Conference September 12, 2013 Phoenix, AZ. NC is SLIGHTLY Different. - PowerPoint PPT Presentation

Transcript of Measuring Our Impact: Lessons from the Field

Page 1: Measuring  Our Impact:  Lessons  from the  Field

Measuring Our Impact: Lessons from the Field

Verna P. Best, MSAFreeman Denton, MPA, NCRT

NASCSP Annual Training Conference September 12, 2013

Phoenix, AZ

North Carolina DHHS Division of Social

Services

Page 2: Measuring  Our Impact:  Lessons  from the  Field

“So let's be honest with ourselves and not take ourselves too serious, and never condemn the other fellow for doing what we are doing every day, only in a different way.” – Will Rogers

• Primarily used to fund 8 Service Delivery Models (Self-Sufficiency, Employment, Housing, Education, Nutrition, Emergency Assistance, Information and Referral & Income Maintenance)

• Limited use for Administrative Support of Other Programs

• Discretionary restricted to Limited Purpose Agencies

• Reserves 5% for CSBG Administration

NC is SLIGHTLY Different

Page 3: Measuring  Our Impact:  Lessons  from the  Field

35 Community Action Agencies 4 Limited Purpose Agencies (Outcomes vary

significantly) 9 State Level Staff (1 ROMA NPtP Certified

Trainer/3 In-Progress) Active State Association(2 ROMA NPtP

Certified Trainers/1 In-Progress)

Current Service Delivery System Basics

Page 4: Measuring  Our Impact:  Lessons  from the  Field

Self-Sufficiency (comprehensive case management) mobilizes CSBG funding for direct service provision

to low-income families while also leveraging dollars with other agency and community resources.

Affords us a methodology to demonstrate 1) CSBG’s effectiveness of changing people’s 2) Scaled participant progress 3) Framework for creating meaningful collaborations/optimal partnerships 4) Usage for direct service provision not solely for administrative purposes

Why the Self-Sufficiency Focus?

Page 5: Measuring  Our Impact:  Lessons  from the  Field

Eligibility based on 100% of the Federal Poverty Guidelines

Standard MeasuresPerformance: #of low-income families participating in comprehensive activities designed to remove them from povertyEfficiency: $per family participating in comprehensive activities designed to remove them from povertyKey Outcomes: The number of low-income families rising above the poverty level The average change in annual income per participant family The number of participants obtaining employment The number of jobs with medical benefits obtained The participant average wage rate The number of participants completing education/training programs The number of participants securing standard housing The number of participants provided emergency assistance

Eligibility & Standard Measures

Page 6: Measuring  Our Impact:  Lessons  from the  Field

The number of families participating in and/or receiving comprehensive services designed to remove them from poverty

5076

The number of low-income families rising above FPG 702The number of participants obtaining employment 789The number of participants obtaining better employment 219The average change in annual income $7,288The participant average wage rate $9.05The number of participants obtaining jobs with medical benefits

220

The number of participants completing education/training programs

897

The number of participants securing standard housing 312The number of participants provided emergency assistance 994

FY 2012-13 Self-Sufficiency Outcomes

Page 7: Measuring  Our Impact:  Lessons  from the  Field

The Not So Good Thing …

No standard methodology to capture ROI to really make the numbers tell a more comprehensive

and convincing story…

Page 8: Measuring  Our Impact:  Lessons  from the  Field

Monthly Financials (includes performance objective)◦ Specific to CSBG funding

Quarterly Performance Reports◦ Specific to CSBG funding

Year-End Report of State Contracted Outcome◦ Specific to CSBG funding

CSBG-IS◦ Agency wide/ inclusive of all funding streams

Federal and State Reporting(Methods for Data Collection and Measuring Outcomes)

Page 9: Measuring  Our Impact:  Lessons  from the  Field

Context Matters Monitoring and Verification Timely and Consistent Guidance ROMA Cycle vs. Numbers Only Establishing Expected Achievement Rates

(80%-120%) Local, Regional and Statewide

Considerations Ask Questions Tell the Story Simply

Examining Impact

Page 10: Measuring  Our Impact:  Lessons  from the  Field

Past ROMA Efforts

ROMA Training for NC’s CSBG Sub-Grantees 5 Certified NPtP ROMA Trainers Development of AR4CA (Accountable Results for

Community Action) Regional Self-Sufficiency Seminars Strengthened review and guidance for monitoring and

reporting (CSBG-IS and state specific)

Page 11: Measuring  Our Impact:  Lessons  from the  Field

5 network staff became NPtP Certified in 2012 Additional State and Association Staff Seeking NPtP

Certification OEO/NCCAA sponsored NPtP ROMA Certification Performance Management vs. Performance

Measurement Engaged in Center of Excellence Efforts Exploring Data Dashboards Sound Management Practices vs. Reporting

Current ROMA Efforts

Page 12: Measuring  Our Impact:  Lessons  from the  Field

Contact us…we would love to further explore our approach with you!

Verna P. [email protected]

919-527-6251Freeman Denton

[email protected]

North Carolina DHHS Division of Social

Services

Measuring Our Impact: Lessons from the Field