InteractiveFocusGroups3rd AnnualEvaluationLabWorkshopCharlaHenley,UNMEvaluationLabTeamLead

cehenley@unm.eduevallab.unm.eduApril27,2018

Draw:

Howdidyoufeelaboutevaluationbefore thisworkshopandhowdoyoufeelaboutitnow?

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 2

SpeedDating:

Whatnew evaluationideasortechniquesdidyoulearntoday?

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 3

GroupLists:

Practicalstepsforimplementingideasandtechniquesyoulearnedtoday.

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 4

Individual:

Whodidyouconnect with?

Whatdidyoulearn fromthem(ifanything)?

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 5

Individual:

Whatdidyouthinkoftheoverallworkshop?Whatdidyouenjoy?Whatwouldyouchange?Whatwouldyouliketosee nextyear?

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 6

InteractiveFocusGroups– 4W1H

• What,When,Why,Who&How?

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 7

WhatisanInteractiveFocusGroup?• Engagesparticipatesinpre-planned activitiestogetanswerstoquestions• Typicallyinvolveswriting,drawing,talkingwithoneotherperson,talkingwiththewholegroup

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 8

WhencanyouuseanInteractiveFocusGroup?• Anytimeyouthinkyoumightbenefitfromavarietyofdatacollectionmethods• Whenyouwanttoknowhowyourparticipantsexperiencedyourprogramandif/howitchangedthem

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 9

WhyuseanInteractiveFocusGroup?• Engagesthetalkers andthelisteners• Allowsmultiplemeansofcommunicatingresponses(verbal,written,drawn)

• Speedsuptranscriptiontime• Theyarefun foryou&participants!• Endupwithcooldrawingstouseinfinalreports.

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 10

EnlaceComunitario YouthLeadersEvaluation

• EvaluationGoal:ImpactoftheprogramonYouthLeadersthemselvesasaresultoftheirtrainingandparticipationintheYouthLeadersprogram.• Activity:AddcharacteristicstothegingerbreadpersontomakehimorhertheperfectYouthLeader

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 11

EnlaceComunitario RelacionesSaludables EvaluationEvaluatingachievementofthegoaltohavelastingimpactongraduates.• Activity:ListonenewthingyoulearnedfromeachthemeintheHealthyRelatingCourse.

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 12

EvaluationoftheEvaluationLab(Eval^2)

Evaluatingachievementofsupportingstudentsindevelopingtheknowledge,skills,andtoolstheyneedtodesignandimplementprogramevaluationsthatreflectorganizations’valuesandmissions.• Activity:Drawthetoolsyounowhaveinyourevaluationtoolbox!

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 13

EvaluationoftheEvaluationLab(Eval^2)Evaluatingachievementofsupportingstudentsindevelopingtheknowledge,skills,andtoolstheyneedtodesignandimplementprogramevaluationsthatreflectorganizations’valuesandmissions.

• Oneofthequestions:Whatdidthecoursefeellikeforstudents?

• Activity:Drawwhatyoufeltlikeonthisgingerbreadperson.

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 14

WhocandotheInteractiveFocusGroup?• Externalevaluator• You!

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 15

How?Buildingtheprotocol (script)

BuildingtheProtocol

1. Articulatetheevaluationgoals2. Assignactivities toeachgoal3. Listmaterials neededtocompleteeachactivity4. Assigntimeframe toeachactivity

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 17

Step1:OurEvaluationGoalsAftertheWorkshop,participantswill:1. feelpositivelyabouttakingonevaluationsthatare

possibleandmeaningful;2. learnsomethingaboutevaluationthatappliestothem;3. learnfromeachotherandabouteachotherin

conversation(network);4. recognizegrindthinking(survivalmode)vs.mission

thinkingandbemotivatedintomissionthinking;and5. learndifferentoptionsforevaluationthatarewithin

reach.

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 18

Step2:PossibleActivitiesGingerbreadPerson– individual◦ Expresssentimentsaboutsomething(feeling)SpeedDating– pairs◦ Shortquestions◦ Answerwithapartner(moreprivate)GroupLists– groupsofnomorethan5◦ Lessprivate,butgivesopportunitytobrainstormIndividualAnswers– individual◦ Entirelyprivate◦ Opportunitytosharefreely◦ Canbedrawn,listed,paragraph,etc.PlusandDelta– biggroup,individual◦ Givesparticipantsachancetovoicethoughtsaboutprograminquestion

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 19

Step2(con’t):AssigningActivitiesAftertheWorkshop,participantswill:1. feel positivelyabouttakingonevaluationsthatarepossibleand

meaningful- Activity:GingerbreadPerson2. learnsomethingaboutevaluationthatappliestothem- Activity:

SpeedDatingand GroupLists3. learnfrom eachotherandabout eachotherinconversation

(network)- Activity:IndividualAnswers4. recognizegrindthinking(survivalmode)vs.missionthinkingand

bemotivatedintomissionthinking- Activity:GroupLists5. learndifferentoptionsforevaluationthatarewithinreach-

Activity:GroupLists

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 20

Step3:Materials!

• GingerbreadPerson– eitherflipchartwithgingerbreadpersondrawnor printoutsofgingerbreadperson,markers,pens• SpeedDating– flashcards,tape,markers,questionsprintedorwrittenontheboard• IndividualAnswers– flashcards,pens• GroupLists– flipchartorflashcards,tape,markers,printedoutvisualoftheactivity• Plusanddelta– flipchart,markers,alsopens,paperforthosewhomaynotwanttoshareoutloud

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 21

Step4:Timeframe

• Stronglybasedinhowlongyouhaveforthegroup• Actualtimeineachactivityshouldallowformovement,explanation,questions• Activitytimesintheprotocol willbeshorterthanhowlongtheoverallactivityactuallytakes

• Today– 40minutes• GingerbreadPerson– Participantsget5minutes– totalactivitytime10minutes

• SpeedDating– Participantsget4minutes– totalactivitytime10minutes• GroupLists– Participantsget5minutes– totalactivitytime10minutes• IndividualAnswers(includingPlusandDelta)– Participantsget5minutes– totalactivitytime10minutes

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 22

OurProtocol

• Seehandout– emailmeforacopy(cehenley@unm.edu)• Wewillpostonworkshopwebsite

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 23

ClosingandNextSteps• InteractiveFocusGroups:

• Engagethetalkersandthelisteners• Speeduptranscriptiontime• Arefunforyouandtheparticipants!

• AfteryourInteractiveFocusGroup:• Takepicturesofeverythingpostedonthewallsoroneaselssoyoucantypeintoexcelorword.• Debrief:Askyourself,howdiditgo?Whatcouldhavebeenbetter?• Reviewdata:trytohighlight thediversityofideasandthecommonthemes

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 24

Questions,thoughts,ideas?

• Wewillsendallparticipantsawrite-upoftheworkshopevaluation!

4/27/18 UNMEvaluationLab:InteractiveFocusGroups 25