Insert organisational logo here on master slide TECHNIQUES.
-
Upload
clinton-reeves -
Category
Documents
-
view
217 -
download
0
Transcript of Insert organisational logo here on master slide TECHNIQUES.
![Page 1: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/1.jpg)
Insert organisational logo here on master slide
TECHNIQUES
![Page 2: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/2.jpg)
Insert organisational logo here on master slide
REMEMBER
All projects should have – specific aims, – declared outcomes– appropriate methods– sufficient resourcessufficient resources (money, people
and time)– should be evaluated at the end point.
![Page 3: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/3.jpg)
Insert organisational logo here on master slide
What techniques do you use?
• Resources and time will often dictate what you can do.
• Quantitative = How many people agree/disagree with the changes
• Qualitative = Why they agree/disagree
![Page 4: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/4.jpg)
Insert organisational logo here on master slide
TECHNIQUESQualitative and Quantitative
• Not either/or but mix and match• There is a need for Qualitative
and Quantitative to give a complete picture
(This is often a luxury)• Whatever technique used beware
of BIAS. Trade off between bias, convenience and pragmatism
![Page 5: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/5.jpg)
Insert organisational logo here on master slide
Many problems will be avoided if a PILOT
is done first
• A pilot is a small scale replica of the main survey
• All parts of the process must be piloted• Be prepared to make the changes• Re-pilot if necessary
![Page 6: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/6.jpg)
Insert organisational logo here on master slide
•Be brave, abandon rather than waste everyone's time
![Page 7: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/7.jpg)
Insert organisational logo here on master slide
What techniques could we use? (1)
• Open Public Consultation– Meetings– Websites– The Media– Open Days, Road shows
• Citizens’ Panel• Public and/or Patient Forum
– Standing Panels/Health Panels
• Patient/Lay representation on specific groups– Reference group– Liaison Group– Management Group– User Group
• Focus Groups
![Page 8: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/8.jpg)
Insert organisational logo here on master slide
What techniques could we use? (2)
• Surveys– Interview– Questionnaire
• Patient stories/ Patient diaries• Process mapping• Observations of care• Compliments/ Complaints• Staff feedback• Audit• Community Development Initiatives• Participatory/Rapid Appraisal
![Page 9: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/9.jpg)
Insert organisational logo here on master slide
Who will
• collate the responses?• be responsible for quality control, coding and data entry?• undertake the analysis and write the report?• develop any recommendations and action plan?• ensure the changes happen?• disseminate the results/feedback?
![Page 10: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/10.jpg)
Insert organisational logo here on master slide
WHO DO WE ASK?
• Everyone– Patients/Users– “Public”
• Community Health Council• Voluntary Sector
![Page 11: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/11.jpg)
Insert organisational logo here on master slide
WHO DO WE ASK?
• A sample
• Representatives
• All patients
• “Nice” patients
• “Stroppy” patients
• Colleagues
• Friends – ours– patients’
• Relatives– ours– patients’
![Page 12: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/12.jpg)
Insert organisational logo here on master slide
HOW?
• Identify whole population of interest
• What characteristics/variables might affect findings (age, gender etc)?
• Try to identify a true random sample
- convenience samples usually have bias (pub closing time in A&E etc)
![Page 13: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/13.jpg)
Insert organisational logo here on master slide
DO NOT FORGET
ETHICAL APPROVAL
DATA PROTECTION
INFORMED CONSENT
![Page 14: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/14.jpg)
Insert organisational logo here on master slide
PATIENT SATISFACTION SURVEYS HAVE A BAD NAME!
Why?
• No clear purpose behind many in the past• Superficial• No changes made
BUT they can be very useful and informative
![Page 15: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/15.jpg)
Insert organisational logo here on master slide
Benefits of Questionnaire Surveys
• Cheap• Can be done by one person but can separate
design, data handling etc• Repeatable• Cover wide geographical area• Larger sample• Observer bias minimal (take care with question
design)
![Page 16: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/16.jpg)
Insert organisational logo here on master slide
Drawbacks with Questionnaire Surveys
• Low response rate - reminders may be required
• Time lag between questionnaires out and returns
• Sample bias, literate, language etc
• No clarification possible, and the qualitative bit often missing
• Difficult to inform respondents what the outcome was, need to “tell the world”
• Data collection and interpretation may be difficult
![Page 17: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/17.jpg)
Insert organisational logo here on master slide
Benefits of interviews
• Better response rates• In depth – qualitative• Flexible, can follow up leads• Questions can be clarified• Fewer unanswered questions• Interview questions can be refined during the process if
unexpected findings arise or focus on specific problems if necessary
• Tape with permission• ~1 hour
![Page 18: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/18.jpg)
Insert organisational logo here on master slide
Drawbacks of interviews
• Social and ethnic characteristics of interviewer may affect responses
• Expensive, transcribing time ~8:1• Coding difficult• Right answers• May need interpreters• Need to make appointments
![Page 19: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/19.jpg)
Insert organisational logo here on master slide
Benefits of group
• Short time scale• Can work with only one skilled person • Can repeat with cohort, before, during and after service
changes• Can include those with low literacy skills• Stimulates debate• Good at identifying cultural values• Gets those with nothing to say involved• Good back up qualitative for quantitative
![Page 20: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/20.jpg)
Insert organisational logo here on master slide
Drawbacks of groups
• Not representative, volunteers are self-selecting and may want to “hijack” the group
• Can change ideas during discussion when more information available
• Difficult if transport an issue!• Transcription and coding can take a long
time
![Page 21: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/21.jpg)
Insert organisational logo here on master slide
Benefits of Public meetings
• Everyone and anyone invited to attend
• All attendees invited to contribute• Potential for large numbers of
people to become involved
![Page 22: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/22.jpg)
Insert organisational logo here on master slide
Drawbacks for Public Meetings
• Meeting “hijack”• Many people unable/unwilling to speak out in
public• Many staff often required to man event• Difficult to give sufficient background
information in the time available • Poorly attended
![Page 23: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/23.jpg)
Insert organisational logo here on master slide
Whatever technique used, the questions posed must be
• relevant• unambiguous• give some simple options• in appropriate language
![Page 24: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/24.jpg)
Insert organisational logo here on master slide
Questions must not be
• offensive• biased• leading• full of assumptions
![Page 25: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/25.jpg)
Insert organisational logo here on master slide
EVALUATION
• Comprehensive report available – Results presented in understandable format
• All stages described, aim, method etc• Method
– Justified– Repeatable
• Outcome measures specified• Discussion of biases etc• Context of other work given• Recommendations follow from results
![Page 26: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/26.jpg)
Insert organisational logo here on master slide
WHAT COULD BE IMPROVED ABOUT THE METHODS?
• What facilitated/inhibited involvement?• What influenced implementation of
recommendations?• What benefits/drawbacks were there for those
who became involved?• Who else could/should have been involved to
increase information or changes made?
![Page 27: Insert organisational logo here on master slide TECHNIQUES.](https://reader035.fdocuments.in/reader035/viewer/2022062321/56649ed45503460f94be49fd/html5/thumbnails/27.jpg)
Insert organisational logo here on master slide
INFORMATION USED EFFECTIVELY?
• What changes were made?• Were the respondents consulted about
the changes?• Were there conflicts of interest?• Dialogue continued between
professionals and public• Could the results be generalised?