Poetz Phipps Leduc: Handout_Anatomy of an Indicator Worksheet, MEOPAR KT Best Practices Symposium...

4
Anatomy of an indicator - example 1) Name/title of indicator: [CB] % increase in self-rated knowledge about KT 2) Definition (including numerator/denominator X 100 if applicable): Average % increase in self-rated knowledge about KT = Sum (Each self-rated score post-workshop - each matching self-rated score pre-workshop)/# attendees X 100. Using data from question 1 on pre-post questionnaire "How would you rate your knowledge about KT?” This indicator includes data from the pre-post workshop evaluation forms, and excludes data from the overall workshop evaluation form. 3) Type: Outcome 4) Rationale: Useful for measuring how much knowledge was gained (capacity that was built) during a workshop or other training event. While counting # of attendees is ok, it does not tell you how much you changed their knowledge, whereas this measure does. 5) Strengths and Limitations: Strength : measures change in knowledge by comparing pre- event knowledge to post-event knowledge. Limitations : Since it is self-rated, it is subject to bias. Also, chance of missing data if some people leave before the event is over, and do not fill out the 2nd matching form, the data is lost (have pre-event info but no post-event info). 6) Data Source(s): Questionnaires handed out at event. Usually on coloured paper, green for pre-event questionnaire and orange for post-event questionnaire (for example). Numbered Poetz, A., D. Phipps, R. Leduc MEOPAR NCE Sharing of Best Practices for KT Symposium, January 2015

Transcript of Poetz Phipps Leduc: Handout_Anatomy of an Indicator Worksheet, MEOPAR KT Best Practices Symposium...

Page 1: Poetz Phipps Leduc: Handout_Anatomy of an Indicator Worksheet, MEOPAR KT Best Practices Symposium Halifax, Nova Scotia January 26-29, 2015

Anatomy of an indicator - example

1) Name/title of indicator: [CB] % increase in self-rated knowledge about KT

2) Definition (including numerator/denominator X 100 if applicable): Average % increase in self-rated knowledge about KT = Sum (Each self-rated score post-workshop - each matching self-rated score pre-workshop)/# attendees X 100. Using data from question 1 on pre-post questionnaire "How would you rate your knowledge about KT?” This indicator includes data from the pre-post workshop evaluation forms, and excludes data from the overall workshop evaluation form.

3) Type: Outcome

4) Rationale: Useful for measuring how much knowledge was gained (capacity that was built) during a workshop or other training event. While counting # of attendees is ok, it does not tell you how much you changed their knowledge, whereas this measure does.

5) Strengths and Limitations: Strength: measures change in knowledge by comparing pre-event knowledge to post-event knowledge. Limitations: Since it is self-rated, it is subject to bias. Also, chance of missing

data if some people leave before the event is over, and do not fill out the 2nd matching form, the data is lost (have pre-event info but no post-event info).

6) Data Source(s): Questionnaires handed out at event. Usually on coloured paper, green for pre-event questionnaire and orange for post-event questionnaire (for example). Numbered sheets of paper, and each participant gets a green and orange with the same number on it - this is so that the pre- and post- scores can be matched up for measuring capacity building. Same questions on pre-questionnaire as on the post-questionnaire. KT Core uses same questions for each event so events can be compared.

7) Stage in Co-Produced Pathway to Impact (CPPI): All (because Capacity Building events are to teach KT competencies in all stages of the CPPI).

8) Date (of last revision): January 20, 2015

9) Responsibility for collecting data: KT Core

Poetz, A., D. Phipps, R. LeducMEOPAR NCE Sharing of Best Practices for KT Symposium, January 2015

Page 2: Poetz Phipps Leduc: Handout_Anatomy of an Indicator Worksheet, MEOPAR KT Best Practices Symposium Halifax, Nova Scotia January 26-29, 2015

Indicator component Your indicator, defined with each componentName/title of indicator

Definition (including numerator/denominator x 100 if applicable) & what is included/excluded in definition, whether quantitative or qualitative

Type: input (measures resources), process (measures ways in which services/goods are provided), output (quantity of goods/services produced and efficiency of production), outcome (changes in a condition such as health, knowledge, etc.)Rationale (for including this indicator)

Strengths and Limitations Strengths:

Limitations:

Data source(s)

Stage in Co-Produced Pathway to Impact (CPPI)

Date (of last revision)Responsibility for collecting data

Anatomy of an indicator - worksheet

Poetz, A., D. Phipps, R. LeducMEOPAR NCE Sharing of Best Practices for KT Symposium, January 2015