CalMHSA Prevention and Early Intervention (PEI) Program Evaluation Technical Assistance and Capacity...

CalMHSA Prevention and Early Intervention (PEI) Program Evaluation

Technical Assistance and Capacity Building

Facilitating Stakeholder Involvement Through Collecting and Reporting Program

Data

KW-2 03/2013

Overview

• Part 1: Tool description and rationale

• Part 2: How to use the tool

• Part 3: Using program data to facilitate stakeholder involvement

KW-3 03/2013

Part 1:

Tool Description and Rationale

KW-4 03/2013

MHSA Requires Counties Prepare a 3-Year Program and Expenditure Plan

• Plan must be developed with “meaningful stakeholder input”

• Clients and families must be involved in all aspects of community planning process

• Plan must be updated annually

KW-5 03/2013

What is “meaningful” stakeholder input?

• “Knowledge is power”

• In order to make informed decisions, stakeholders need accessible information on current program activities

• Making data easy to understand builds confidence

• Important to have an easy way to collect, analyze and present data in a way that facilitates meaningful stakeholder input

KW-6 03/2013

MHSOAC May Require Counties to Report Program Data

Proposed requirements include:

• Types of programs

• Number served and age distribution of participants for each program

• Cost per participant by program

• Other performance outcomes - not yet defined

KW-7 03/2013

County-funded CalMHSA TTACB Supported RAND/SRI Data Collection and Reporting Tool

• Developed tool in 2013 and pilot tested it with counties at TTACB work groups

• Revised tool using feedback from work group participants and experience from TTACB individual technical assistance to counties and programs

• Designed to display data for stakeholders in easy-to-understand format

• Designed to meet current reporting needs established by MHSOAC

KW-8 03/2013

Tool Consists of Three Parts

• Individual PEI Program Description Questionnaire

• All PEI Program Description Workbook

• Stakeholder PEI Presentation PowerPoint Slide Deck

KW-9 03/2013

Part 2: How to Use the tool

KW-10 03/2013

A Three Part Tool to Describe County PEI Programs

1. Individual PEI Program Description Questionnaire– Can be completed by each PEI program– Two formats, “fillable” and paper/pencil

2. All PEI Program Description Excel Workbook– County staff enter data from all programs– Results automatically calculate and create

graphics

3. Stakeholder PEI Presentation PowerPoint Slide Deck– Easily drop graphics into slides for presentations

KW-11 03/2013

Relationship Among Three Parts

Program

2

Program

1

Program

3

Program 6

Program

7

Program 10

All Program Description ExcelWorkbook

StakeholderPresentationsSlide Deck

Individual Program Questionnaire

KW-12 03/2013

Part 1 - Individual Program Description Questionnaire

• Should be filled out individually for each PEI program in the county

• Should probably be completed by program staff, but could be completed by county staff

• Includes instructions and definitions

• Formatted for easy and accurate data entry

• Purpose: Collect accurate data about each PEI program

KW-13 03/2013

Individual Program Description Questionnaire Data Collection Steps

• Fill in Name of County Contact person on the first page of the questionnaires (both versions)

• Distribute the questionnaires to an email mailing list of all county direct service and contract PEI program directors

• Note returns against the mailing list

• After ten days send a reminder to any program directors who have not yet responded

• Continue to log in returns against the original mailing list

• On day 14 send a deadline reminder to any remaining programs that have not responded

KW-14 03/2013

Suggested Request Email for PEI Program Description QuestionnaireDear Program Director

Completion of this questionnaire is being requested from all contract and direct service county PEI programs. The purpose of the questionnaire is to help our county to describe the PEI services it funds. Please complete it within two weeks of receipt date and return it to the contact below:

Name of County Contact:Email Address:Phone Number:

If you have any questions, not addressed below, please reach out to the County Contact person named above. Thank you for your cooperation.

KW-15 03/2013

Questionnaire Instructions

• Should be completed by the program management staff person most familiar with the program

• Provided in two formats—paper and pencil or a fillable form that can be completed online

• Provide your best estimate when precise information to answer the question is not available

• Definitions of program categories and examples are provided on page 7 and 8 of the questionnaire

• Please save a copy of your completed questionnaire for your records

KW-16 03/2013

Overview of Questionnaire Items

1. What is the name of the program you are describing? (Please provide full name and any acronym commonly used)

KW-17 03/2013

2. Is this program primarily focused on:(Please check one box)

1 Prevention, or2 Early intervention, or3 System change efforts

KW-18 03/2013

3. What are the main activities that this program carries out? Many programs do a bit of everything, so try to identify the most important activities for this program, which are directed at the target population for the program. Please refer to Guide below in determining program activities.(Check all that apply)

1 Outreach and public awareness campaigns2 Community strengthening3 Gatekeeper education and training (including program

staff training)4 Counseling and support5 Screening and referral6 System change efforts7 Clinical services for early intervention8 Other – what activity? __________________________

KW-19 03/2013

4. What was the approximate total amount of PEI funding for this program in fiscal year 2012-13? Do not include funding for the program that comes from other sources.

$ ____________

KW-20 03/2013

5. Please indicate as best you can how the total funding was used across the main activities of this program in fiscal year 2012-13. If an activity is not part of this program, leave the line blank.

ACTIVITIES % OF total program FUNDING Outreach and public awareness campaigns %_________Community strengthening %_________Gatekeeper education and training %_________Counseling and support %_________Screening and referral %_________System change efforts %_________Clinical services for early intervention %_________Other – what activity? %_________

100% = TOTAL FUNDING

KW-21 03/2013

6. What is the intensity of this program’s main activities taken as a whole?(Please check one box)

1 Single or light touch activities2 More intensive activities3 Both levels

KW-22 03/2013

Duplicated vs. Unduplicated Counts

22

• Duplicated Count: Refers to a program participant who may be counted more than one time in a grant year. This might occur if a client received multiple services in the same reporting period within one program or across multiple programs

• Unduplicated Count: is one (1) person/client that is counted only once, no matter how many different services the client is receiving during the funding period – could be within or across programs.

KW-23 03/2013

About how many individuals were served by this program in 2012, based on a duplicated and/or unduplicated count? • Duplicated count – individuals may be counted more than one time if

they receive several services within one program within the same reporting period.

• Unduplicated count – individuals are counted only once, no matter how many different services a client is receiving within a program in the same reporting period.

7. Please provide an unduplicated count if possible.

______________ Number of unduplicated individuals

or [ ] Unduplicated count not available

KW-24 03/2013

8. Please provide a duplicated count if available.

______________ Number of duplicated individuals

or [ ] Duplicated count not available

KW-25 03/2013

9. What are the age groups mainly targeted by this program?(Check all that apply)

1 Children – Age 0-152 TAY – Age 16-253 Adults – Age 26-59 4 Seniors – Age 60+5 No main group(s) – targets all ages equally

KW-26 03/2013

10. What are the race/ethnicities mainly targeted by this program?(Check all that apply)

1 Hispanic/Latino2 White3 Black/African American4 Asian5 American Indian, Native American,

Alaskan Native6 Native Hawaiian, Pacific Islander7 Other8 No main group(s) – targets all equally

KW-27 03/2013

11. Are materials and program activities provided in languages other than English?(Please check one box)

1 Yes – most of them2 Yes – some of them3 Materials and activities are

in English only

KW-28 03/2013

12. What special groups are mainly served by this program?(Check all that apply)

1 Veterans2 Military3 Foster care children/youth and/or families4 LBGTQ5 Undocumented immigrants6 Low income, Medicaid eligible7 Underserved8 Program designed to serve everyone, no targeting

of any special group9 Other10 NONE OF THESE

KW-29 03/2013

13. In the design or operations of this program have there been any specific adaptations to make it more culturally appropriate for the target group(s)?(Please check one box)

1 Yes2 No3 Not applicable

KW-30 03/2013

14. We are going to ask about the program and public health goals targeted by this program. Programs may have multiple goals so please try to identify the main goals for the program. What are the main goals for this program? By goals we mean the most immediate intended results of this program. (Check all that apply)

1 Increased knowledge and more supportive attitudes about mental illness2 Decreased risk behaviors and/or increased coping skills3 Decreased distress and/or fewer and less severe symptoms Could also

include preventing crisis situations from escalating4 Improved individual functioning (could be at home, school, and work) and increased resilience and well-being5 Improved family functioning

6 Increased help-seeking and utilization of additional assessment and/or treatment services7 Increased community resiliency, such as improved social climate, reduced stigma and discrimination, and more social supports available in the community8 Improved systems of care which could include more coordinated and culturally responsive services, increased capacity and access, improved policies and protocols for how individuals move between systems (e.g., primary care to specialty care, or juvenile justice to the school system)

KW-31 03/2013

15. Programs may or may not directly target public health goals, but may be intended to contribute to reducing mental health related public health problems. What main public health problems is this program intended to reduce:(Check all that apply)

1 Suicide2 School dropout related to mental health3 Removal of children from the home related to

mental health4 Incarceration related to mental health5 Homelessness related to mental health6 Unemployment related to mental health7 Stigma and discrimination related to mental health8 Prolonged suffering related to mental health9 Disparities related to mental health treatment access

and/or utilization

KW-32 03/2013

16. Are there main program goals that were not covered in these questions?(Please check one box)

1 Yes -> What goals?2 NO, ALL WERE COVERED

KW-33 03/2013

Guide to classifying program activities

OUTREACH AND PUBLIC AWARENESS CAMPAIGNS

Purpose: To increase public knowledge and awareness.

Target: General public - individuals not identified on the basis of a specific risk factor.

Examples: Public service announcements; developing and hosting informational websites; creating and distributing pamphlets or other printed material for wide scale distribution; stigma reduction campaigns; hosting health fairs.

Note: Do not include outreach intended to recruit program participants or build community partnerships in this category.

KW-34 03/2013


COMMUNITY STRENGTHENING

Purpose: To increase community resources and resiliency, or to improve social climate and increase social support.

Target: These are universal prevention activities and are not directed towards individuals who have specific risk factors.

Examples: A resource or drop in center (if the primary purpose of the resource program is community strengthening); a school-based anti-bullying program directed at the entire school or community; an exercise program for the elderly; NAMI Family to Family programs and vocational programs; Parent education programs for all parents; school readiness programs that are targeted at all children.

KW-35 03/2013


GATEKEEPER EDUCATION AND TRAINING

Purpose: To train and educate individuals to recognize someone who is in distress and could benefit from further evaluation or treatment and/or to create a safe and non-stigmatizing environment where someone can self-identify as needing help.

Target: Community leaders, school personnel, emergency workers, and other gatekeepers.

Examples: Teacher training programs, training for suicide hotline operators, training for outreach workers and community leaders.

Note: This category includes training of program staff.

KW-36 03/2013


COUNSELING AND SUPPORT

Purpose: To reduce risk factors and increase coping skills.

Target: At-risk individuals, rather than individuals with a known diagnosis. These programs do not include universal prevention programs.

Examples: Peer support programs; Resource centers (if the primary purpose is to provide counseling and support); Suicide hot and warm lines; Parent training programs for children with identified needs or risk factors; Violence prevention programs directed at selected children or youth; Promotoras home visiting programs.

Note: These activities are generally conducted by individuals who are not licensed mental health clinicians.

KW-37 03/2013


SCREENING AND REFERRAL

Purpose: To identify individuals who might benefit from additional assessment and/or counseling.

Target: At risk individuals such as foster youth, new moms, frail elderly.

Examples: School-based screening; suicide hot and warm lines, some Promotoras programs.

KW-38 03/2013


SYSTEM CHANGE EFFORTS

Purpose: To improve system functioning in order to increase appropriate identification of need and access to services.

Target: Public and private systems.

Examples: Efforts to develop and disseminate culturally appropriate policies and procedures and culturally competent services, as well as data systems to track individuals. Development of referral networks and efforts to increase and make more efficient collaboration across systems and programs. Efforts to increase access and capacity by reducing inefficiencies could also be included here.

KW-39 03/2013


CLINICAL SERVICES FOR EARLY INTERVENTION

Purpose: To keep mental illnesses from becoming chronic and increasing in severity.

Target: Individuals with either a known or likely diagnosis or symptoms related to a diagnosis.

Examples: First break psychosis programs, PTSD/PTSD symptom treatment programs; primary care integration programs; school-based trauma treatment; family therapy.

Note: These activities are generally conducted by licensed mental health clinicians.

KW-40 03/2013

Part 3: Using Program Data to Facilitate Stakeholder Involvement

KW-41 03/2013

All Program Description Excel Workbook

• Example worksheets (labeled EX_Entry on the tabs) show how the Excel worksheets should be completed for the questionnaire items shown on the tabs

• EX_Outputs shows example tables and graphics calculated from the data

• Using the three sheets labeled AC_Entry, use one row for each program to enter the responses to the Individual PEI Program Questionnaire (make sure the program number is same on all sheets)

• Check that all entries are accurate

• Excel automatically calculates summary statistics and produces the tables and graphics on AC_Outputs_Sheet

• Purpose: Enter the responses received on the Individual PEI Program Description Questionnaires and create graphics

KW-42 03/2013

PLEASE REFERENCE “THE ALL PROGRAM DESCRIPTION

EXCEL WORKBOOK “IN THE DOCUMENTS LIST

AT THIS TIME

KW-43 03/2013

Stakeholder Presentation Slide Deck

• The PowerPoint slide deck contains charts that can be populated using the All Program PEI Description Excel Workbook worksheet labeled AC_Outputs_Sheet

• Begin by saving a copy of the Slide Deck with the title of your upcoming presentation

• You can select some or all of the Excel graphics depending on your audience and purpose

• Simply click on a graphic chart in the AC_Outputs_Sheet tab of the Excel Workbook, copy it and paste it into the PowerPoint slide with the same title

- Use the “destination theme” Paste function

Purpose: Share descriptions of PEI programs with stakeholders

KW-44 03/2013

Workbook Creates Graphics for Slides

• As program data are entered the workbook will automatically generate graphics

• Graphics can be “dropped into” slide deck for presentations to stakeholders

• Slides summarize the data provided by individual programs into an easily understandable format

• Program information will help stakeholders provide meaningful input into the decision-making process

KW-45 03/2013

Example Charts for “Golden County”

• List of programs and characteristics– Cost– Count of participants– Intensity

• What activities programs are doing and distribution of dollars across activities

• Target participant characteristics

• Short term goals

• Public health goals

KW-46 03/2013

List of Programs and Characteristics

Program Name Dollars Devoted Duplicated Individuals Count Program Intensity Description

Example Program 1 $4,400,400

PreventionExample Program 2 $58,000 150

Systems ChangeExample Program 3 $3,000,000 400

Early InterventionExample Program 4 $250,000 600

Systems ChangeExample Program 5 $100,000 1,000

Early InterventionExample Program 6 $750,000 2,000

PreventionExample Program 7 $40,000


Early InterventionExample Program 9 $1,500,000 300


Early Intervention

Program Name Dollars Devoted Duplicated Individuals Count Program Intensity Description

KW-47 03/2013

Distribution of Programs by Primary Focus

Prevention; 4; 40%

Early Intervention; 4; 40%

System Change Efforts; 2; 20%

Number of Programs by Primary Focus

PreventionEarly InterventionSystem Change Efforts

KW-48 03/2013

• Outreach and public awareness campaigns

• Community strengthening

• Gatekeeper education and training

• Counseling and support

• Screening and referral

• System change efforts

• Clinical services for early intervention

Types of Activity

KW-49 03/2013

How Many Programs are Doing Each Type of Activity?

Outrea

ch an

d pub

lic aw

arene

ss

Commun

ity st

rength

ening

Gateke

eper

educ

ation

and t

rainin

g

Couns

eling

and s

uppo

rt

Screen

ing an

d refe

rral

System

chan

ge ef

forts

Clinica

l serv

ices f

or ea

rly in

terve

ntion

Other

0

1

2

3

4

5

6

Number of Programs by Activity

Number of Programs

KW-50 03/2013

How are PEI Funds Distributed Across Activities?

Outreach and public awareness; 2657200;

25%

Community strengthening; 1615000; 15%

Gatekeeper ed-ucation and

training; 82000; 1%

Counseling and support; 2407100;

23%

Screening and re-ferral; 470000; 4%

System change efforts; 1525060; 15%

Clinical services for early intervention;

840000; 8%

Other; 852040; 8%

Total Dollars by Activity

Outreach and public awarenessCommunity strengtheningGatekeeper education and trainingCounseling and supportScreening and referralSystem change effortsClinical services for early interventionOther

$10,448,400

TOTAL -

KW-51 03/2013

How Intensive are Programs?

Single or light touch activities More intensive activities Both levels0

1

2

3

4

5

6

Number of Programs by Intensity Level

# Programs

KW-52 03/2013

• Race/Ethnicity

• Primary Language

• Age groups (children, school-age, TAY, adults, seniors)

• Gender

• Special populations– Veterans, military– Foster care, undocumented, undeserved– Low income, Medicaid eligible– LGBTQ

Demographics of Participants

KW-53 03/2013

How many programs mainly target each racial/ethnic group?

Hispan

ic/La

tino

White

Black/A

frican

-Ameri

can

Asian

America

n Ind

ian…

Native

Haw

aiian

…Othe

r

No Main

Grou

p0

1

2

3

4

5

6

Number of Programs by Race/Ethnicities

# Programs

KW-54 03/2013

How many programs mainly target each age group?

Age 0-15 Age 16-25 Age 26-59 Age 60+ No Main Group - targets all ages equally

0

1

2

3

4

5

6

7Number of Programs by Age Groups Targeted

# Programs

KW-55 03/2013

How Many Programs Target Special or Underserved Groups?

Veterans Military Foster care youth LBGTQ Undocumented Underserved Low income Everyone Other0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

Number of Programs by Special Group Served

# Programs

KW-56 03/2013

How Many Programs Mainly Address Each Short-Term Goal?

Increased knowledge and more supportive attitudes about mental illness

Decreased risk behaviors and/or increased coping skills

Decreased distress and/or fewer and less severe symptoms

Improved individual functioning

Improved family functioning

Increased help-seeking and utilization of assessment/treatment services

Increased community resiliency

Improved systems of care

0 1 2 3 4 5 6

Number of Programs by Main Goal

# Programs

KW-57 03/2013

How Many Programs Seek to Reduce Each Public Health Problem?Number of Programs by

Primary Focus

Suicide

School drop-out

Removal of children from home

Incarceration

Homelessness

Unemployment

Stigma and discrimination

Prolonged suffering

Disparities related to treatment

0 1 2 3 4 5 6 7 8 9 10

Number of Programs by Public Health Goal

# Programs

KW-58 03/2013

Using Program Data to Facilitate Stakeholder Involvement—Sample Questions

• Do our current PEI programs and activities address local priorities? What local priorities are not being met? Are there areas that are getting too much attention?

• Do the types of programs reflect our community values? Do the programs promote access and acceptance for the diverse people of California?

• Is this the right allocation of our budget across programs and activities?

• Do we have the right distribution of programs between Prevention and Early Intervention?

• Do our programs link people with early onset of serious mental illness with medically necessary care provided by county mental health programs? Are we doing enough outreach to potential responders to help them identify early signs of potentially severe mental illnesses?

• Are we meeting the needs of different underserved populations and age groups?

• Are there public health goals we are not addressing that we should?

KW-59 03/2013

BEGINNING BLANK PRESENTATION SLIDE DECK

Golden County PEI Programs Overview and Description

Presentation to GROUP

DATE

KW-61 03/2013

Goals








KW-62 03/2013

Overview

• Background

• Golden County PEI Programs Description

• Stakeholder feedback and discussion

KW-63 03/2013

MHSA Requires Counties Prepare a 3-Year Program and Expenditure Plan

• Plan must be developed with “meaningful stakeholder input”

• Clients and families must be involved in all aspects of community planning process

• Plan must be updated annually

• “Knowledge is power”

KW-64 03/2013

How We Collected Program Information

Program

2

Program

1

Program

3

Program 6

Program

7

Program 10

All Program Description ExcelWorkbook

StakeholderPresentationsSlide Deck

Individual Program Questionnaire

KW-65 03/2013

Individual Program Description Questionnaire

• Filled out individually for each PEI program in the county

• Purpose: Collect accurate data about each PEI program

KW-66 03/2013

Golden County PEI Programs –What Information We Will Provide

• List of programs and characteristics– Cost– Count of participants– Intensity

• What activities programs are doing and distribution of dollars across activities

• Target participant characteristics

• Short term goals

• Public health goals

KW-67 03/2013

List of Programs and Characteristics

KW-68 03/2013

Distribution of Programs by Primary Focus

KW-69 03/2013

• Outreach and public awareness campaigns

• Community strengthening

• Gatekeeper education and training

• Counseling and support

• Screening and referral

• System change efforts

• Clinical services for early intervention

Types of Activity

KW-70 03/2013

How Many Programs are Doing Each Type of Activity?

KW-71 03/2013

How are PEI Funds Distributed Across Activities?

KW-72 03/2013

How Intensive are Programs?

KW-73 03/2013

• Race/Ethnicity

• Primary Language

• Age groups (children, school-age, TAY, adults, seniors)

• Gender

• Special populations– Veterans, military– Foster care, undocumented, undeserved– Low income, Medicaid eligible– LGBTQ

Demographics of Participants

KW-74 03/2013

How many programs mainly target each racial/ethnic group?

KW-75 03/2013

How many programs mainly target each age group?

KW-76 03/2013

How Many Programs Target Special or Underserved Groups?

KW-77 03/2013

Are Materials and Program Activities Provided in Languages Other than English?

KW-78 03/2013

How Many Programs Mainly Address Each Short-Term Goal?

KW-79 03/2013

How Many Programs Seek to Reduce Each Public Health Problem?

KW-80 03/2013

Questions for Stakeholders








KW-81 03/2013

Back-Up SlidesCan Be Used If More Detail Is

Required

KW-82 03/2013

Overview of Questionnaire Items

1. What is the name of the program you are describing? (Please provide full name and any acronym commonly used)

KW-83 03/2013

2. Is this program primarily focused on:(Please check one box)

1 Prevention, or2 Early intervention, or3 System change efforts

KW-84 03/2013

3. What are the main activities that this program carries out? Many programs do a bit of everything, so try to identify the most important activities for this program, which are directed at the target population for the program. Please refer to Guide below in determining program activities.(Check all that apply)

1 Outreach and public awareness campaigns2 Community strengthening3 Gatekeeper education and training (including program

staff training)4 Counseling and support5 Screening and referral6 System change efforts7 Clinical services for early intervention8 Other – what activity? __________________________

KW-85 03/2013

4. What was the approximate total amount of PEI funding for this program in fiscal year 2012-13? Do not include funding for the program that comes from other sources.

$ ____________

KW-86 03/2013

5. Please indicate as best you can how the total funding was used across the main activities of this program in fiscal year 2012-13. If an activity is not part of this program, leave the line blank.

ACTIVITIES % OF total program FUNDING Outreach and public awareness campaigns %_________Community strengthening %_________Gatekeeper education and training %_________Counseling and support %_________Screening and referral %_________System change efforts %_________Clinical services for early intervention %_________Other – what activity? %_________

100% = TOTAL FUNDING

KW-87 03/2013

6. What is the intensity of this program’s main activities taken as a whole?(Please check one box)

1 Single or light touch activities2 More intensive activities3 Both levels

KW-88 03/2013

About how many individuals were served by this program in 2012, based on a duplicated and/or unduplicated count? • Duplicated count – individuals may be counted more than one time if

they receive several services within one program within the same reporting period.

• Unduplicated count – individuals are counted only once, no matter how many different services a client is receiving within a program in the same reporting period.

7. Please provide an unduplicated count if possible.

______________ Number of unduplicated individuals

or [ ] Unduplicated count not available

KW-89 03/2013

8. Please provide a duplicated count if available.

______________ Number of duplicated individuals

or [ ] Duplicated count not available

KW-90 03/2013

9. What are the age groups mainly targeted by this program?(Check all that apply)

1 Children – Age 0-152 TAY – Age 16-253 Adults – Age 26-59 4 Seniors – Age 60+5 No main group(s) – targets all ages equally

KW-91 03/2013

10. What are the race/ethnicities mainly targeted by this program?(Check all that apply)

1 Hispanic/Latino2 White3 Black/African American4 Asian5 American Indian, Native American, Alaskan Native6 Native Hawaiian, Pacific Islander7 Other8 No main group(s) – targets all equally

KW-92 03/2013

11. Are materials and program activities provided in languages other than English?(Please check one box)

1 Yes – most of them2 Yes – some of them3 Materials and activities are

in English only

KW-93 03/2013

12. What special groups are mainly served by this program?(Check all that apply)

1 Veterans2 Military3 Foster care children/youth and/or families4 LBGTQ5 Undocumented immigrants6 Low income, Medicaid eligible7 Underserved8 Program designed to serve everyone, no targeting of

any special group9 Other10 NONE OF THESE

KW-94 03/2013

13. In the design or operations of this program have there been any specific adaptations to make it more culturally appropriate for the target group(s)?(Please check one box)

1 Yes2 No3 Not applicable

KW-95 03/2013

14. We are going to ask about the program and public health goals targeted by this program. Programs may have multiple goals so please try to identify the main goals for the program. What are the main goals for this program? By goals we mean the most immediate intended results of this program. (Check all that apply)

1 Increased knowledge and more supportive attitudes about mental illness2 Decreased risk behaviors and/or increased coping skills3 Decreased distress and/or fewer and less severe symptoms Could also

include preventing crisis situations from escalating4 Improved individual functioning (could be at home, school, and work) and increased resilience and well-being5 Improved family functioning

6 Increased help-seeking and utilization of additional assessment and/or treatment services7 Increased community resiliency, such as improved social climate, reduced stigma and discrimination, and more social supports available in the community8 Improved systems of care which could include more coordinated and culturally responsive services, increased capacity and access, improved policies and protocols for how individuals move between systems (e.g., primary care to specialty care, or juvenile justice to the school system)

KW-96 03/2013

15. Programs may or may not directly target public health goals, but may be intended to contribute to reducing mental health related public health problems. What main public health problems is this program intended to reduce:(Check all that apply)

1 Suicide2 School dropout related to mental health3 Removal of children from the home related to

mental health4 Incarceration related to mental health5 Homelessness related to mental health6 Unemployment related to mental health7 Stigma and discrimination related to mental health8 Prolonged suffering related to mental health9 Disparities related to mental health treatment access

and/or utilization

KW-97 03/2013

16. Are there main program goals that were not covered in these questions?(Please check one box)

1 Yes -> What goals?2 NO, ALL WERE COVERED

KW-98 03/2013


OUTREACH AND PUBLIC AWARENESS CAMPAIGNS

Purpose: To increase public knowledge and awareness.

Target: General public - individuals not identified on the basis of a specific risk factor.

Examples: Public service announcements; developing and hosting informational websites; creating and distributing pamphlets or other printed material for wide scale distribution; stigma reduction campaigns; hosting health fairs.

Note: Do not include outreach intended to recruit program participants or build community partnerships in this category.

KW-99 03/2013


COMMUNITY STRENGTHENING

Purpose: To increase community resources and resiliency, or to improve social climate and increase social support.

Target: These are universal prevention activities and are not directed towards individuals who have specific risk factors.

Examples: A resource or drop in center (if the primary purpose of the resource program is community strengthening); a school-based anti-bullying program directed at the entire school or community; an exercise program for the elderly; NAMI Family to Family programs and vocational programs; Parent education programs for all parents; school readiness programs that are targeted at all children.

KW-100 03/2013


GATEKEEPER EDUCATION AND TRAINING

Purpose: To train and educate individuals to recognize someone who is in distress and could benefit from further evaluation or treatment and/or to create a safe and non-stigmatizing environment where someone can self-identify as needing help.

Target: Community leaders, school personnel, emergency workers, and other gatekeepers.

Examples: Teacher training programs, training for suicide hotline operators, training for outreach workers and community leaders.

Note: This category includes training of program staff.

KW-101 03/2013


COUNSELING AND SUPPORT

Purpose: To reduce risk factors and increase copies skills.

Target: At-risk individuals, rather than individuals with a known diagnosis. These programs do not include universal prevention programs.

Examples: Peer support programs; Resource centers (if the primary purpose is to provide counseling and support); Suicide hot and warm lines; Parent training programs for children with identified needs or risk factors; Violence prevention programs directed at selected children or youth; Promotoras home visiting programs.

Note: These activities are generally conducted by individuals who are not licensed mental health clinicians.

KW-102 03/2013


SCREENING AND REFERRAL

Purpose: To identify individuals who might benefit from additional assessment and/or counseling.

Target: At risk individuals such as foster youth, new moms, frail elderly.

Examples: School-based screening; suicide hot and warm lines, some Promotoras programs.

KW-103 03/2013


SYSTEM CHANGE EFFORTS

Purpose: To improve system functioning in order to increase appropriate identification of need and access to services.

Target: Public and private systems.

Examples: Efforts to develop and disseminate culturally appropriate policies and procedures and culturally competent services, as well as data systems to track individuals. Development of referral networks and efforts to increase and make more efficient collaboration across systems and programs. Efforts to increase access and capacity by reducing inefficiencies could also be included here.

KW-104 03/2013


CLINICAL SERVICES FOR EARLY INTERVENTION

Purpose: To keep mental illnesses from becoming chronic and increasing in severity.

Target: Individuals with either a known or likely diagnosis or symptoms related to a diagnosis.

Examples: First break psychosis programs, PTSD/PTSD symptom treatment programs; primary care integration programs; school-based trauma treatment; family therapy.

Note: These activities are generally conducted by licensed mental health clinicians.

KW-105 03/2013

Duplicated vs. Unduplicated Counts

105

• Duplicated Count: Refers to a program participant who may be counted more than one time in a grant year. This might occur if a client received multiple services in the same reporting period within one program or across multiple programs

• Unduplicated Count: is one (1) person/client that is counted only once, no matter how many different services the client is receiving during the funding period – could be within or across programs.

• Can we get unduplicated counts?– Within individual PEI programs?– Across PEI programs in a county?

KW-106 03/2013

• Enroll participants and assign program IDs– Use an online system to support unique records– Create prepopulated service forms with client name and ID for

providers

• Train providers in the importance and methods for enrolling and tracking services

• Have programs submit data on individuals (without personal identifiers) for more meaningful analyses

• Or – agree that unduplicated counts are OK, but be consistent and clear

Methods for Capturing Unduplicated Counts

KW-107 03/2013

How We Handle Counts

• Collected “duplicated” counts for all programs– This is most common form of information counties have

• Graphic displays based on “duplicated” counts since most programs can provide this information

THANK YOU FOR PARTICIPATING

CalMHSA Prevention and Early Intervention (PEI) Program Evaluation Technical Assistance and Capacity...

Documents

Transcript of CalMHSA Prevention and Early Intervention (PEI) Program Evaluation Technical Assistance and Capacity...