1© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 1

This presentation covers:This presentation covers:- types of interviews: - types of interviews:

structured, unstructured; individual, structured, unstructured; individual, group group - planning the interviews- planning the interviews- questions - probing - questions - probing - interview tips- interview tips- capturing the data - capturing the data

Interviews - - talking and listening to people

The participant is being interviewed, not interrogated

2© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Checking in…What do you think? Answer YES or NO to each of the following1.Interviews involve talking with people 2.Everyone would rather be interviewed than surveyed3.There is one standard method of interviewing 4.Interviews are always done in-person5.Because interviews are personal, they are more culturally appropriate 6.Interviews can create a lot of narrative data that will require time to analyze7.Interviewers should ask the same question in the same way of all respondents.

Check answers

3© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Checking in - Answers 1. Interviews involve talking with people YES2. Everyone would rather be interviewed than

surveyed NO (depends upon the person, topic and situation)

3. There is one standard method of interviewing NO (way to interview falls along a continuum from structured to conversational)

4. Interviews are always done in-person NO (interviews can be conducted by telephone or other audio devices)

5. Because interviews are personal, they are always culturally appropriate NO

6. Interviews can create a lot of narrative data that will require time to analyze YES

7. Interviewers should ask the same question in the same way of all respondents. NO

4© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

These questions are…

• What you mean is that there is not a specific way to learn vocabulary?

• Some people would say that the process of learning a foreign language is easy and takes a couple of years, do you agree with them?

• Imagine you are an English teacher, what activities would you plan for the first class?

• According to your point of view, what is the best way to learn vocabulary?

5© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 5© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Interviewing is…

• Verbally asking program participants the program evaluation questions and hearing the participant’s point of view in his or her own words.

• Interviews can be either structured or unstructured• They can be conducted in person or over the

telephone. • They can be conducted individually or as a group• “Direct quotations from people about experiences,

opinions, feelings and knowledge” (Patton, 1990)

6© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 6© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

7© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 7© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

8© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 8© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

9© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 9© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

How culturally appropriate are interviews?Things to consider:• Preferred by people with

an oral culture• Language level proficiency;

verbal skill proficiency• Politeness – responding to authority (thinking it’s

unacceptable to say “no”), nodding, smiling, agreeing

• Need to have someone present• Relationship/position of interviewer – for

example, do youth feel comfortable speaking frankly to the interviewer?

• May be seen as interrogation• Direct questioning may be seen as impolite,

threatening, or confrontational

10© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 10© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

11© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 11© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

12© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Think about…

• How would the information be different for different types of interviews: structured or unstructured? Individual or group?

• When might you use each?

13© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Plan your interview process

• What do you want to learn – what is your purpose for conducting the interviews?

• Who do you intend to interview?• Will you conduct individual or group

interviews? Which will be more comfortable for youth participants? If you are considering a group interview, how might the presence of peers affect them?– Exactly who will you interview?– How many? – How will they be selected?

14© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Plan the interview, continued…

• Where will the interview be held? – How long will each interview take?

• Who will do the interviewing?– You? Colleagues from another county?

Youth? Others?– Will you need to train the interviewers?

• Will there be an incentive for participants?– Food may be helpful!

15© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Develop the interview questions

• What do you want to know?– Review the purpose of your evaluation

and why you are conducting these interviews

• Decide on the questions you will ask – Brainstorm questions– Prioritize and identify the key questions– Identify possible probing questions– Anticipate how long each question will

take to answer and keep within your timeframe

16© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Develop interview questions continued…• Sequence the questions

– Opening questions, transition questions, ending questions

• Write your questions down in an interview guide that lists the topics or questions to be covered – Remember: the type and specificity of your

questions depends upon whether you are conducting a structured, semi structured or unstructured interview

– Check the wording of your questions, “using words that make sense to the interviewee…” (Patton, 1990)

17© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Avoid asking why questions

Source: Patton, M.Q., 1990. Qualitative Evaluation and Research Methods, 2nd ed. Newbury Park, CA: Sage Publications, pg 316.

18© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

19© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Pilot test the questions

• With a colleague, friend, or family memberand/or

• With a few people like those you intend to interview

20© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Practice – Practice - Practice

• Good interviewing requires skill• Practice interviewing before you begin

– Ask a colleague to ‘stand in’ as the respondent, or solicit someone from the interviewee population

• Know your questions well so the interview flows smoothly

21© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Contact the respondent

• By telephone or in-person• Personalize the request• Explain:

– Purpose of the interview – how data will be used

– How long it will take– How it will be conducted – when,

where, etc.– Solicit participation and arrange

date/time for the interview• Send the interview questions in advance

as appropriate

22© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Introduction

• Create an open, respectful environment

• Ensure the person is comfortable• Review the purpose of the interview• Assure Human subjects protection

– Distribute consent form– “May I proceed?” “Is it okay to

begin”

23© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Use probing to gain insight

Probing is the process

of asking follow-up questions

to dig deeper

in order to obtain

useful, meaningful information- Depended on participants’ answers - Avoid pressing too hard and too

fast

24© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 24© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Probing - example

Interview question:“What did you like best about this program?”

Response: “I liked everything.”

Probe 1: “What one thing stood out?”Response: “Being with my friends.”

Probe 2: “What about the program activities?”Response : “I liked it when we worked as a team.”

Probe 3: “How come?”Response : “It was neat to hear each other’s

perspectives. I heard some things I hadn’t considered before.”

Probe 4: “What is one thing that you learned?”

25© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 25© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Capturing what people say during the interview: Options

• Use paper and write down what the person says as she talks

• Jot down notes during the interview and fill in immediately after the interview

• Type responses into a computer• Tape record the interview

(audio or video tape) – for transcription• Work in pairs: one interviews and the

other records the responses

26© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

At the end…

• Check and fill in your notes at the end of each interview – don’t wait to do this because you will forget details

• Write a brief summary for each interview – highlight themes, quotes, key points

• Postinterview notes allow the investigator to monitor the process of data collection as well as begin to analyze the information itself

27© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Analyzing interview data

• Review notes, listen to tapes or review transcripts

• Organize interviews by question and summarize across all interviews

• Identify themes, patterns and divergences• Highlight key points and notable quotes

• Depending upon the amount of interview data you have, you may do the data processing by hand or by computer (Word, Excel, qualitative software programs)

28© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Analyzing interview data

For help with qualitative data analysis see:

PDE booklet, Analyzing qualitative data http://learningstore.uwex.edu/pdf/G3658-12.PDF

Patton, M. Q. (1990). Qualitative evaluation and research methods (2nd ed.). Newbury Park, CA: Sage.

29© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation 29© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Wrap-up: Interviewing tips

• Establish rapport and comfort • Establish time frame for interview

and stick to it• Pitch your language to the respondent• Begin with topics of interest to the

interviewee• Ask one question at a time• Be careful about verbal and nonverbal

cues• Be respectful• Listen carefully – be patient

30© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Checking back in…What do you think NOW compared to what you thought Before going through this presentation? 1.Interviews involve talking with people 2.Everyone would rather be interviewed than surveyed3.There is one standard method of interviewing 4.Interviews are always done in-person5.Because interviews are personal, they are always culturally appropriate 6.Interviews can create a lot of narrative data that will require time to analyze

31© 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation

Reflection

Spend a few minutes reflecting on what we covered in this presentation

1.What, if anything, did you learn that you didn’t know before?

2.What is one ‘ah-ha’ you had?