B CONSULTING, LLC 1

Evaluation Requirements and South

Dakota-PLI Webinar January 5, 2015

BROOKE BLAALID, MSW AND DOUG PIPER, PHD

SPF PFS EVALUATION

B CONSULTING, LLC 2

PFS Community Outcome Measure Requirements

•Community Outcome Measures are due annually in November

•Baseline data must be submitted by November 2015

•Required Collection1. Consumption: 30 day use, binge drinking2. Intervening Variables (Risk & Protective Factors): Risk of harm3. Consequences: Alcohol arrests, prescription drug arrests or emergency room visits

ALL 3 AREAS MUST BE REPORTED ANNUALLY and INCLUDE ALCOHOL AND PRESCRIPTION DRUG USE ( Evaluators will complete forms to be submitted to B Consulting, LLC which will then be uploaded into PEP-C).

B CONSULTING, LLC 3

PFS Community Outcome Measure Requirements (Continued)

Consumption/Substance Use (Required Collection)

1. Past 30-day alcohol use

2. Past 30-day nonmedical use of prescription drugs

3. Binge drinkingIndicator Measure Measure Response Outcome Source Frequency Collected Method of Collection

Substance use: Past 30 day alcohol use

During the past 30 days, on how many days did you drink one or more drinks of an alcoholic beverage?

A number between 0 and 30 Percent who reported having used alcohol during the past 30 days (i.e., percent who responded 1 or more days)

School Survey Annual In-person collection in sub-grantee schools.

Substance use: Past 30 day nonmedical use of prescription drugs

During the past 30 days, on how many days did you use prescription drugs that were not prescribed for you or that you took only for the experience or feeling they caused?

A number between 0 and 30 Percent who reported having used prescription drugs not prescribed or for the experience or feeling during the past 30 days (i.e., percent who responded 1 or more days)

School Survey Annual In-person collection in sub-grantee schools

Substance use: Binge drinking

During the past 30 days, on how many days did you have 5 or more drinks on the same occasion?

A number between 0 and 30 Percent who reported having binge drank during the past 30 days (i.e., percent who responded 1 or more days)

School Survey Annual In-person collection in sub-grantee schools

B CONSULTING, LLC 4

PFS Community Outcome Measure Requirements (Continued)

Intervening Variables / Risk & Protective Factors (Required Collection)

1. Perceived risk or harm of use for alcohol

2. Perceived risk or harm of use for nonmedical use of prescription drugsIndicator Measure Measure Response Outcome Source Frequency Collected Method of Collection Level of Data

Perception of Harm: Alcohol

How much do people risk harming themselves physically and in other ways when they have five or more drinks of an alcoholic beverage once or twice a week?

No risk, Slight risk, Moderate risk, Great risk

Percent reporting moderate or great risk (i.e., percent reporting “moderate risk” and percent reporting “great risk” combined)

School Survey Annual In-person collection in sub-grantee schools

Community

Perception of Harm: Prescription Drugs

How much do people risk harming themselves physically and in other ways if they use prescription drugs that are not prescribed to them or that they took only for the experience or feeling they caused?

No risk, Slight risk, Moderate risk, Great risk

Percent reporting moderate or great risk (i.e., percent reporting “moderate risk” and percent reporting “great risk” combined)

School Survey Annual In-person collection in sub-grantee schools

Community

B CONSULTING, LLC 5

PFS Community Outcome Measure Requirements (Continued)

Consequences (Required Collection)

1. Alcohol-related crime

2. Prescription drug-related emergency room visitsIndicator Measure Outcome Source Frequency

Collected Method of Collection Level of Data

Alcohol-Related Crime*

Measure calculation: The number of alcohol-related arrests divided by the total number of arrests and multiplied by 100

Measure calculation: # of alcohol-related arrests divided by the total number of arrests and x100

Uniform Crime Reporting (UCR) Program

Annual (summer) Administrative Data State

*Alcohol-related arrests include the following Uniform Crime Reporting [UCR] categories: DUI and Liquor Law Violations.)Prescription Drug-Related Emergency Room (ER) Visits**

Measure calculation: The number of ER visits involving prescription drugs divided by the total number of ER visits and multiplied by 100

Measure calculation: # of ER visits involving prescription drugs divided by the total # of ER visits and x 100

Avera Hospitals Annual Administrative Data State

**DAWN defines prescription drug–involved ER visits as those in which prescription drugs are the direct cause or contributing factor).

B CONSULTING, LLC 6

South Dakota PLI SD Prevention is requiring that all coalitions who do individual EBPs must have their students (participants)complete the SD-PLI.

1. Pre and Post are required (non-matching).

2. 13 questions are required for the SD-PLI.

3. Additional questions may be added. This is up to the discretion of the coalition and local evaluator.

4. Coalitions will determine how the SD-PLI is distributed to participants via paper or web-based.

5. Local Evaluators will submit SD-PLI data to B Consulting, LLC in an excel file.

B CONSULTING, LLC 7

PEP-C ReportingQuarterly reporting data that state will need for PEP-C submissionState will need various data from coalitions that ranges from volunteer hours to all available funds (other grants, fundraising activities, in-kind donations, ect). Coalitions will be provided with an excel document to input data.

1. Assessments1. Accomplishments and Barriers

2. Capacity1. Accomplishments and Barriers

3. Planning1. Accomplishments and Barriers2. Strategic Plan

4. Implementation1. Accomplishments and Barriers2. Description of SPF Process

4. Evaluation1. Accomplishments and Barriers2. Evaluation Plan3. Evaluation Report

5. Health Disparity1. Accomplishment and Barriers2. Health Disparity Work-plan

B CONSULTING, LLC 8

PEP-C Reporting (Continued)• Coalitions will report into the PEP-C: May and November• CLI-R is not approved by OMB. Anticipated approval date is May 2015.• CLI-R is similar in nature to CLI data that was submitted for SPF SIG.• Data will include but not limited to:

1. Demographics2. Participants Served3. EBPs implemented4. Fidelity5. Funding

B CONSULTING, LLC 9

Evaluation Plans1. Every coalition will need to complete an evaluation plan that will be utilized throughout the

course of PFS.

2. Coalitions will submit a final Evaluation Plan and Evaluation Report to PEP-C.

3. B Consulting, LLC will provide training and technical assistance for evaluation plans and reports.

4. What do your calendars look like? 1. Potential Training/Work days2. Sometime after the end of March (PFS meeting in Maryland: March 24th and 25th)

B CONSULTING, LLC 10

Questions??

B CONSULTING, LLC 11

Evaluation Contact Information

Brooke Blaalid, MSW

PFS Evaluation Manager

Email: Blaalid.bconsulting@outlook.com

Office: 605-689-0478

Cell: 605-660-9721

Doug Piper, PhD

PFS Evaluation

Email: dpiper2@wisc.edu

Office: 608-263-7629