Download - Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Transcript
Page 1: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Nevada Garrett Lee SmithNevada Garrett Lee Smith Local Evaluation UpdatesLocal Evaluation UpdatesNevada Garrett Lee SmithNevada Garrett Lee Smith Local Evaluation UpdatesLocal Evaluation Updates

June 9-10, 2011June 9-10, 2011June 9-10, 2011June 9-10, 2011

Page 2: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

• Stakeholder Reports• PreventionPays Text Messaging Service (PPTMS)

Program Update• Plans for PPTMS Expansion

Local Evaluation OverviewLocal Evaluation Overview

Page 3: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

PPTMS: Reports to StakeholdersPPTMS: Reports to Stakeholders

Background Program ConclusionEvaluation ResultsEvaluation Method

Quarterly Reports to Stakeholders and Project Team:•# of texts into system•Frequency, length, duration of texts•Texter demographics•Issues reported by texters•Details of text conversations with suicidal texters•Outcome of text conversations•Highlights from focus group conversations

Page 4: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

PPTMS Pilot Implementation SitesPPTMS Pilot Implementation Sites

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 5: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

Social Marketing MaterialsSocial Marketing Materials

Page 6: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

Social Marketing MaterialsSocial Marketing Materials

Page 7: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 8: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Pilot Evaluation MethodsPilot Evaluation Methods

• Post-intervention text sheets• Cell phone carrier data• Focus groups with 113 middle and high school youth• Focus groups with Crisis Call Center’s 8 PPTMS staff

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 9: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Texter CharacteristicsTexter Characteristics

Frequency of Texts:

• 319 total text conversations

• 49.4% of texters have texted in more than once

Outcome of Texts:

Background Program ConclusionEvaluation ResultsEvaluation Method

• 61.7% information/support

• 30.1% no resolution/opt out• 7.3% texter calmed/de-escalated

• 1.0% thank-you/all is well

Page 10: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Length of Text ConversationsLength of Text Conversations

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 11: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Texter DemographicsTexter Demographics

• Gender: • 51.7% female • 11.6% male• 36.7% unknown

• Age:• 60.8% are ages 17 and under • 9.4% are ages 18 - 30• 1.9% are ages 31 - 60• 27.6% age is unknown

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 12: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

Primary Issues ReportedPrimary Issues Reported

Page 13: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

Referrals ProvidedReferrals Provided

Page 14: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Youth Focus GroupsYouth Focus Groups

Focus Group Questions:• Are youth aware of program? • Do they know how and when to use it?• Do they relate to the social marketing materials?• Do they think people their age would use the program?• What issues do people their age face?• What resources do they currently use during crises?• What barriers would prevent them from using program?• Do they know someone who has used the line already?

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 15: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Youth Focus GroupsYouth Focus Groups

Are Youth Aware of Program?• All youth were aware of program• Most knew when they could use program

Do They Know How to Use It?• Nearly all understood how to use it• Some confusion about who responds to texts

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 16: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Youth Focus GroupsYouth Focus Groups

Do they relate to marketing materials?• Positive reaction to marketing materials and location• Frustration with destruction of materials• Considered age and tone-appropriate• Want more information on line confidentiality

Would they use it?• Most would refer friends to program• Best when youth “just want to talk” and want anonymity• Might not be appropriate for all crises

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 17: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Youth Focus GroupsYouth Focus Groups

What issues do youth face?• Relational and physical bullying, depression, sex-related

issues, drug/alcohol abuse, interpersonal violence and conflict

What resources do they use when in crisis?• Frustration with current resources available• Reliance on friends during crisis• Mistrust of school-based resources

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 18: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Youth Focus GroupsYouth Focus Groups

Barriers to text line use• No cell phones (~19%)• Concern about confidentiality/anonymity• May not be appropriate for all crises

Know someone who has used it?• 8 knew someone who had used it• Generally positive

o “They texted back pretty fast so that kinda shows like… they like care.” “ Yeah it showed they took it seriously and that they were concerned.”

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 19: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

CCC Focus GroupsCCC Focus Groups

• Strengths of system• Weaknesses of system• Opportunities to improve system• Threats to improving system

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 20: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

CCC Focus GroupsCCC Focus Groups

Strengths of the system:•Meeting unmet youth need•Anonymity of CCC staff•Saved record of all text conversations•Call line strategies can be used with text line

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 21: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

CCC Focus GroupsCCC Focus Groups

Weaknesses of the system:• No voice cues from texter or staff• Length of text conversations• Need to multi-task between texting and calling• Frequent opt-outs

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 22: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

CCC Focus GroupsCCC Focus Groups

Opportunities to improve system in future:• Acknowledging differences between texts and calls• Assigning select staff to texting full-time• Resource and strategy-sharing• Identification of staff who excel at texting• Adapting call sheets to text capabilities

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 23: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Challenges to Overcome for the Future:•Need more texts•Difficult to connect youth to resources•Difficult to transition crisis texter to phone

Background Program ConclusionEvaluation ResultsEvaluation Method

CCC Focus GroupsCCC Focus Groups

Page 24: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

New Social Marketing MaterialsNew Social Marketing Materials

Page 25: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

New Social Marketing MaterialsNew Social Marketing Materials

Page 26: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Background Program ConclusionEvaluation ResultsEvaluation Method

New Social Marketing MaterialsNew Social Marketing Materials

Page 27: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

ConclusionConclusion

• PPTMS increased youth help-seeking behaviors

• Response to program and materials very positive

• Youth and adults use Crisis Line differently

• Phone-based strategies can be adapted for text line

• Difficult to gather demographics on texters

Background Program ConclusionEvaluation ResultsEvaluation Method

Page 28: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

Future DirectionsFuture Directions

• Expansion throughout Nevada• Follow-up with text line users • Coordination with other text-based treatment programs• Development of training materials• Evaluation of long-term outcomes• Publication of evaluation findings

• Book chapter on emerging crisis call center technologies in Crisis Intervention & Counseling by Telephone

• Journal article in development

28Background Program ConclusionEvaluation ResultsEvaluation Method

Page 29: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

“I personally was like ‘Finally! Something that this school needs.’”

-16 year old female

“Sometimes, you know, you just want someone to talk to. You don’t really want them to fix the problem, but you just want someone to talk to.”

-13 year old male

Page 30: Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates Nevada Garrett Lee Smith Local Evaluation Updates Local Evaluation Updates June.

“I don't feel cornered anymore. I feel like I can breathe a little bit better...You have helped so much. Thank you very, very much!”

-34 year old male, father of three children