4/25/16 Appendix A:CS-CASH Logic Model END OUTCOMES€¦ · Pincus, H., Zainab, A., Blank, A., &...
Transcript of 4/25/16 Appendix A:CS-CASH Logic Model END OUTCOMES€¦ · Pincus, H., Zainab, A., Blank, A., &...
Appendix A:CS-CASH Logic Model
We conductRESEARCH and OUTREACH….
__________Outreach CorePerformance Indicators1
•Education programs•Outreach activities
Research CorePerformance Indicators1
•External Grants•Funded CS-CASH Pilots•NIOSH-funded projects
That leads toPRODUCTS.
___________Outreach & Research Cores’Performance Indicators1
•Reports•Presentations•Databases •Instruments•Conferences •Trainings•Media and Technology•Publications•New grants
And we
move them to…
ACTIVITIES OUTPUTS OURSTAKEHOLDERS 2
____________Outreach & Administrative Cores’Networks• Healthcare providers• Technology
producers• Policy makers• Labor, trade,
professional organizations
• Extension Agencies • Educators• Government
agencies (e.g.,USDA)• Rural leadersResearch Core Networks• Other Researchers• Funding Agencies
Who TAKE ACTION to
develop or revise practices/policies
____________Outreach & Administrative Cores• Best Practices • Guidelines• New Technology• Trade & media
releases• New Websites• New CurriculaResearch Core• Enhanced
Research Capacity• Large national
grant funding• Pilot projects
sustained
Which influences our END USERS
through improved knowledge and attitudes about
health & safety3…_______________Outreach, Research & Administrative Core End Users•Ag Workers•Ag Employers•Ag Operators•Scientists4
INTERMEDIATE OUTCOMES
END OUTCOMES
SOCIAL BENEFITS METRICS 3,5-7
Population Safety • Self-reported PPE use• Self-reported risk reductions
Population Health • Self-reported hearing status• Self-reported respiratory• Self-reported injury
Quality of Life• BRFS Item
ECONOMIC BENEFITS METRICS5
Health Care Utilization5
• Self-reported office visits Self-reported ED use
• Self-reported hospitalization days
• Self-reported lost work days• Self-reported out of pocket
expenses for injuryCost Benefits
• Program costs relative toeconomic impacts
CENTER SUSTAINABLITY METRICS 8
Effective Governance
And that leads
to long-range impact
4/25/16
1. Performance Measure Source: NIOSH Logic Model. Data collected for CS CASH through Online Database.2. Performance Measure Source: NIOSH Goals and Logic Model. Data collected for CS CASH through Social Network Analysis3. Performance Measure Source: Blumenthal , D., McGinnis, M. (2015). Measuring Vital Signs. JAMA. 2015;313(19):1901-1902. doi:10.1001/jama.2015.4862; Pincus, H., Zainab, A., Blank, A., & Mazmanian, P. (2013). Evaluation and the NIH Clinical Translational Science Awards: A Top Ten List. Evaluation & the
Health Profession, 36,411-431. Data collected for CS CASH through POPULATION-BASED OUTCOMES AND END OUTCOMES EVALUATION SURVEY and CS CASH INJURY SURVEILLANCE SURVEY (NASD)4. Zhang, Y., Wang, L., Diao, T. The Quantitative Evaluation of the Clinical and Translational Science Awards Program Based on Science Mapping and Scientometric Analysis. CTS Journal 6 (6). 452 – 457.5. Performance Measure Source: Institute of Medicine (2015). Vital Signs: Measuring Health and Health Care: Core Metrics for Health and Healthcare Progress. National Academies of Health Accessed at: http://iom.nationalacademies.org/Reports/2015/Vital-Signs-Core-Metrics.aspx; Blumenthal , D.,
McGinnis, M. (2015). Measuring Vital Signs. JAMA. 2015;313(19):1901-1902. doi:10.1001/jama.2015.4862. Data Collected for CS CASH through POPULATION-BASED OUTCOMES AND END OUTCOMES EVALUATION SURVEY and CS CASH INJURY SURVEILLANCE SURVEY (NASD) 6. Data collected through CS CASH INJURY SURVEILLANCE SURVEY (NASS)7. Pincus, H., Zainab, A., Blank, A., & Mazmanian, P. (2013). Evaluation and the NIH Clinical Translational Science Awards: A Top Ten List. Evaluation & the Health Profession, 36,411-431. Data collected from ICE Instrument and Field Visits8. Cramer, M., Atwood, J., Stoner, J. (2006). Measuring the Organizational Effectiveness of Coalitions. Public Health Nursing Journal. 23(1), 74-87.
2017 3/7/2017
Appendix B:Internal Coalition Effectiveness©
The ICE© measures the organizational effectiveness and governance of a coalition, such as the Central States Center for
Agricultural Safety and Health (CS-CASH). There are two sections - please complete both.
Section 1 evaluates how effectively the CS-CASH members work together for common goals and objectives.
Section 2 evaluates how effectively the CS-CASH leaders facilitate achievement of common goals and objectives.
(Note-Leaders include R. Rautiainen, T. Wyatt, E. Duysen, E. Rogan, D. Romberger, J. Poole, C. Kelling, A. Yoder, A. Ramos, M.
Cramer, and J. Pomicter)
SECTION 1. CS-CASH MEMBERS….
Strongly Disagree
Somewhat Disagree
Slightly Disagree
Unsure Slightly Agree
Somewhat Agree
Strongly Agree
1. Have a shared social vision for the CS-CASH goals
2. Agree with the CS-CASH mission and purpose
3. Work together to make CS-CASH financial resources go substantially further
4. Work together to coordinate CS-CASH activities to avoid duplication of efforts and maximize collaboration
5. Work together to strengthen each other’s’ advocacy/dissemination efforts on behalf of the CS-CASH
6. Work together to expand each other’s knowledge and potential for addressing CS-CASH issues that arise
7. Enrich each other’s competencies on topics related to clinical and translational research
8. Work together to establish positive relations with those whom the CS-CASH wants to engage and mobilize
9. Encourage each other’s active participation in CS-CASH decision-making processes
10. Encourage each other to identify and analyze problems, develop solutions, and evaluate outcomes
11. Have a sense of inclusivity that engages a variety of individuals from the community and partnering institutions in the work of the CS-CASH
12. Successfully implement the vast majority of the CS-CASH milestones and metrics on a timely basis .
13. Take the necessary corrective actions when problems arise regarding lack of activity implementation by other CS-CASH members
a. Believe the CS-CASH clinical and translational research resources are shared equitably across the coalition of institutional partners
b. Believe the CS-CASH clinical and translational research resources are responsive to and reflect the needs and interests of faculty and community members
M. Cramer, J. Atwood, J. Stoner, 2007. Reproduction without the authors’ express written consent is not permitted. Permission to sue this scale may be obtained from Mary E. Cramer, University of Nebraska Medical Center, 985330 Nebraska Medical Center, Omaha, NE 68198-5330, or [email protected].
2017 3/7/2017
SECTION 2. CS-CASH LEADERS….
Strongly Disagree
Somewhat Disagree
Slightly Disagree
Unsure Slightly Agree
Somewhat Agree
Strongly Agree
14. Facilitate a shared social vision among CS-CASH members
15. Facilitate member consensus about the CS-CASH mission and purpose
16. Promote involvement by a broad base of members in the work of the CS-CASH
17. Reposition CS-CASH assets, competencies, and resources to meet changing needs and priorities
18. Develop other clinical and translational research leaders within the CS-CASH
19. Provide opportunities for CS-CASH members to be involved in on-going quality improvement processes
20. Provide resources to keep CS-CASH members updated and informed on clinical and translational research topics, methodologies, and best practices
21. Provide resources to support clinical and translational leadership skills across the CS-CASH
22. Establish positive relations with community members (e.g., Community Advisory Board) in order to engage and mobilize them for involvement in clinical and translational research activities
23. Facilitate positive, trusting relations with partnering institutions
24. Build and support respectful relationships with CS-CASH members
25. Encourage CS-CASH members in decision-making processes
26. Facilitate open and transparent communications between CS-CASH members and the CS-CASH Administration Core
27. Facilitate inclusivity by encouraging diverse perspectives from faculty and community members involved in the work of the CS-CASH
28. Work to engage a representative cross section of the CS-CASH regional community to participate in clinical and translational research activities
29. Engage members in using formative evaluation data for quality improvement and goal achievement
30. Take corrective actions when problems arise regarding lack of milestone or metric implementation by CS-CASH members
c. Ensure CS-CASH clinical and translational research resources are shared equitably across the coalition of institutional partners
d. Ensure the CS-CASH clinical and translational research resources are responsive to and reflect the needs and interests of faculty and community members
2017 3/7/2017
M. Cramer, J. Atwood, J. Stoner, 2007. Reproduction without the author's express written consent is not permitted. Permission to use this scale may be obtained from Mary E. Cramer, University of Nebraska Medical Center, 985330 Nebraska Medical Center, Omaha, NE 68198-5330, or [email protected].
SURVEY CODE FOR DATA ENTRY: 1 = SD, 2 = SWD, 3= SLD, 4 = U, 5 = SLA, 6 = SWA, 7 = SA
Please provide comments here:
Page 1 of 2
Appendix C: Field Interview Guide: Cycle 2, Year 1 (May/June 2017)
Seven new Pilot Projects
The Evaluation component of CS-CASH looks at how everyone who is part of the Center (the entire
organization and the leadership) works together to accomplish the Center’s goals. The purpose of the
interview is twofold; one is to learn more about your project and to hear how you view your
collaboration with the Center. In addition, a brief orientation is conducted to familiarize investigators
with the CS-CASH database, website and organizational chart.
1. Knowledge: How familiar are you with the Center’s organizational structure in terms of
leadership and governance?
2. Relationships: Can you tell us how well CS-CASH is achieving its mission of improving the
health and safety of members within the agricultural community?
a. Are respectful relationships built between CS-CASH and the community to engage and
mobilize?
b. Is facilitation open to communication with community members
c. Is engagement a broad cross section of the communities to participate in CS-CASH work?
3. Activities: We know something about your project from the grant proposal or member meeting
updates, but can you also give us a brief description of your project and where you are at now?
a. Are you preparing to publish or submit a new grant-funding request?
Sustainability plans. New collaborations? New funding sources?
4. Activities: Tell us about your timeline for the project … do you feel you are on schedule?
a. If not, how could the Center help?
Administrative Focus
5. So far, has your experience with the CS-CASH Center been positive such that you would consider
doing this again?
a. What has worked well/been problematic?
6. How well does the Center manage their part of the contract with you?
7. Do you receive the communication and/or support you need from the Center and in a timely
manner to ensure, your work plan is completed?
a. Is there any way that the Center might improve?
8. Overall, do you see the Center as being a good partner for your project and its goals?
a. In what ways has the Center been/not been a good partner?
9. Do you foresee any future collaboration with the Center or other new research partners because of
your association with CS-CASH?
A. If yes, in what capacity?
10. What barriers have you encountered in working with the Center?
11. What could the Center do better to help you meet your professional goals?
12. Do you currently, or have you in the past, worked with other Ag Centers?
If yes,
a. How would you say that CS-CASH fares in comparison?
b. Are there positives in the other Ag Centers that CS-CASH should consider as a
way to improve?
13. How would you describe your level of understanding and commitment to the CS-CASH goals and
mission?
Page 2 of 2
a. Has your understanding of Ag Health been strengthened from your participation with CS-
CASH?
b. Has leadership provided or facilitated training opportunities?
Pilot Projects (New Investigators) Additional Questions (Poole, Kelling, Donham, Sheridan)
14. How is the Center as a scientific collaborator? What does the Center bring to your work?
15. Are you getting what you need from the CS-CASH research coordinator?
a. If so, what services/resources in particular do you find most helpful.
b. If not, what services/resources would you like to have made available?
16. Will you be able to use this pilot study for submission of your next level of external funding?
17. At this point in your project, do you foresee collaborating with the CS-CASH Center and/or UNMC
researchers for your future scientific collaborations?
a. If so, what resources/benefits does CS-CASH offer that will be important to your future
work?
b. If not, please share with us what resources/services you need that the Center does not
currently provide.
18. In your opinion, has the effort invested in this pilot been worth the amount of funding that you
received from CS-CASH?
Activities Reporting / CS-CASH Website
19. Have you entered activities into the form yet?
If yes,
a. Were you able to access the form and enter information easily?
b. Are you able to enter information on a regular basis?
c. Have you utilized the “View Activities” tab yet to see a list of activities that you have
entered?
If no,
a. Have you gone onto the website to review the form?
20. Is there anything that you would like to see added to the CS-CASH Website?
http://www.unmc.edu/publichealth/cscash/ click on “About Us” tab then to the left click on “Evaluation
Team” and to the upper right, click on CS-CASH Product Activity Reporting shaded in red; enter user
name and password.
21. Do you have any additional comments or thoughts regarding the CS-CASH Center? Any
suggestions on how the Center leadership can improve?
Just a reminder to all of you who will be presenting and publishing results from work that was sponsored
by CS-CASH. Please remember to acknowledge this funding. This is one more way that we can
demonstrate our Outputs/Outcomes to NIOSH. Here is the grant information:
Funding from the Central States Center for Agricultural Safety and Health
NIOSH Contract grant number: U54 OH010162
Handouts: CS-CASH Org Chart & Logic Model
Web Links: CS-CASH website: http://www.unmc.edu/publichealth/cscash/
CS-CASH fb page: https://www.facebook.com/unmccscash/?fref=ts
CS-CASH Members Project
Activity Reporting