Evaluation Plan March 7, 2012. General approach to evaluation is broad with the ability to support...

Evaluation PlanMarch 7, 2012

• General approach to evaluation is broad with the ability to support specificity.

• Collecting and evaluating multiple innovations using several methods: dashboard measures (fiscal, quality, patient and staff satisfaction, etc.), administrative data, surveys, focus groups, observations and narratives.

EvaluationEvaluation

• As of now, there isn't an emphasis on direct correlational measures of specific innovations.

This means…we don’t expect to be able to say (for example) that the new Welcome Packet helped improve satisfaction. What we will be able to say is that we implemented X, Y, Z innovations on this unit and there is a relationship between the innovation unit and patient satisfaction, or length of stay.

• Please note, that if you have a specific idea or research interest, we can help design a research plan for those unit or individual specific interests.


• Specifically – we’re going to release a survey for the Attending Nurses probably mid next week, and the survey will get repeated a few times over the next couple years.

ARNs: A link will be in your email.


• Qualitatively, we’re going to:

• Hold focus groups

• Conduct observation studies

• Evaluate narratives


• Quantitatively, we’re going to administer surveys:

• Revised Professional Practice Environment

• Patient Safety Culture

• Patient’s Feeling Known by Their Nurses


• Administrative data that you/ we collect as part of MGH operations such as:

Indicators: Falls, Infections, Pressure Ulcers, etc.

HCAHPS (Patient Satisfaction)

Length of Stay (LOS)

Cost per Case Mix

Staff Retention

Other: Unit specific innovations/ interventions


Innovation Cluster Focus Areas *

Communication

Patient Engagement

Roles & Structures

Interventions ** Throughout Admission1. Relationship-Based

Care2. Attending Nurse 3. Handover Rounding

Checklist

Pre-Admission4. Pre-Admit Data

Collection5. Patient IU Welcome

Packet

During Admission6. Domains of Practice 7. Interdisciplinary 8. Team Rounds9. Electronic White

Boards10. Volte Communication11. Tough books

Post-Discharge12. Discharge Follow-up

Phone Calls

Others as identified

Ed

ucatio

n

Evaluation(Pre, During, Post)

Other measures as identified

Quantitative Qualitative•Culture of Safety Survey

•HCAHPS

•LOS

•Quality Indicators

•Patients Perceptions of Feeling Known (PPFKN)

•Readmissions

•Revised Perceptions of Practice Environment Scale (RPPE)

•Cost per Case Mix

•Staff Retention

•Focus Groups (Staff, Patients, Families, etc)

•Observations

•Narratives

* The clusters are a lens with which we gain perspective on any particular intervention.

** May apply to any or all 3 of the cluster focus areas January 2012

Conceptual Schema

• What do YOU think is important to evaluate in this work?

• Thoughts, Comments, Concerns???

• Feel free to email me [email protected]


Evaluation Plan March 7, 2012. General approach to evaluation is broad with the ability to support...

Documents

Transcript of Evaluation Plan March 7, 2012. General approach to evaluation is broad with the ability to support...