Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1....
Transcript of Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1....
![Page 1: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/1.jpg)
![Page 2: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/2.jpg)
![Page 3: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/3.jpg)
Opening
![Page 4: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/4.jpg)
JamiBartgis,Ph.D.OneFireAssociates,LLC
HonoringtheGatheringofNativeAmericans(GONA)throughEvaluation
![Page 5: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/5.jpg)
It’sOurEvaluation!
![Page 6: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/6.jpg)
Gratitude
• NationalCouncilofUrbanIndianHealth• CaliforniaConsortiumofUrbanIndianHealth• SacramentoNativeAmericanHealthCenter• GONAExpertsandSAMHSAConsultants• Communitymembers• Students
![Page 7: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/7.jpg)
Objectives• IdentifymajorworldviewdifferencesandchallengestoovercomewhenimplementingevaluationinIndianCountry
• UnderstandtheCommunity-BasedParticipatoryResearch(CBPR)process
• IdentifymethodsofGONAevaluation• ListthemajoroutcomesandaccomplishmentsoftheGONAcross-sitestudy
• Accessresourcesforstrength-basedevaluationofGONAandsimilarprograms
![Page 8: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/8.jpg)
Community-BasedParticipatoryResearch
“Ifyoulookatour data…”CommunityAdvisoryBoardMember,
Tulsa,OK
![Page 9: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/9.jpg)
WesternMedicine/Research IndigenousMedicine/ResearchFocus/Measure pathologyandcuringdisease
Focus/Measure healthandhealingthepersonandcommunity
Reductionist:Diseasesarebiological,andtreatment/researchshouldproduce/demonstratemeasurableoutcomes
Complex:Diseasesdonothaveasimpleexplanation,andoutcomesarenotalwaysmeasurable
Investigate/research diseasewitha“divide-and-conquer”strategy,lookingformicroscopiccausethatcanbeisolatedusing statistics
Looksatthe“bigpicture”:thecausesandeffectsofdiseaseinthe physical,emotional,environmental,social,andspiritualrealmsthatmaynotbeisolatedusingstatistics
![Page 10: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/10.jpg)
WesternMedicine/Research IndigenousMedicine/ResearchContinued
Intellectisprimary;medicalpractice/research isbasedonscientifictheory
Intuitionisprimary;healing/researchisbasedonspiritualtruthslearnedfrom,nature,elders,andspiritualvision
Thephysician/researcher isanauthority
Thehealer/researcher isahealth/research counselorandadvisor
Bartgis,2017- AdaptedfromHonoringtheMedicine,KennethCohen,2006
![Page 11: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/11.jpg)
CurrentChallengesinConductingResearch/Evaluation
• NoAI/ANparticipationinresearchdesign/IRB• Expectedresearchoutcomesoftenconflictwithtribalinterventionsand/ordesiredoutcomes
• NationalevaluationtoolsandmethodsconflictwithIndigenousWaysofKnowing (i.e.,beliefs)
• FlawedstudieswithlimitedtonoscientificallyvalidtoolsforusewithAI/AN
• Highlytraumatizedpopulationvulnerabletoretriggeringoftraumaresponseandothernegativeoutcomes,suchasaccessbarriers
![Page 12: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/12.jpg)
WhatisCommunity-BasedParticipatoryResearch?
• Empowers thecommunitytosolvetheirownproblemsusinglocalknowledge
• Creates equalpartnershipbetweenscientistsandthecommunity
• Buildslocalcapacityforevaluationsothecommunitycandoitthemselves
• Involves thecommunityinalllevelsofevaluation• Integrates evaluationintothecommunity’scontextand
events• Values youthandfamiliesasexpertsontheirownlives
andtheircommunity
![Page 13: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/13.jpg)
CommonOutcomesSystem• QualityImprovement• ProcessImprovement• LeveragedFunding• Increasedsustainability
Community• WorkforceDevelopment• Youth/FamilyDrivenCare
– Confidence– PublicSpeaking– Education/Skills
• IncreasedAccesstoCare• ImprovedCultural
Competence
![Page 14: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/14.jpg)
GatheringofNativeAmericans
• 4-DayYouthandCommunityGathering– Belonging– Mastery– Interdependence– Generosity
• Linkagestoreferralsandlocalyouthcenters
![Page 15: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/15.jpg)
NCUIHNAHC
OaklandFAIHPFresno
SystemofCare(SOC–5years)
10YearsofGONAImplementation
RequestingEvaluationSupport
forGONA
CirclesofCare(COC–3years)
PreparingforFirstGONAEver
COCSpecialActivitiesNeedsAssessmentProcessEvaluationGONAProcess
PlanningCalls:Outcomes
MethodologyAssessmentTools
Trainings
Worldview:Strength-based
RelationalHolistic
Youth-Friendly
Cross-SiteYear1
![Page 16: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/16.jpg)
ComponentsBelonging
– UrbanIndianHealthOrganizations– Familieswithsimilarhistoriesandchallenges
Mastery– Needtobuildcapacityinevaluation– Needtoimprovethehealthofthecommunity
Interdependence– Moreresourcestogetherthanapart– Advancementofone;advancementofall
Generosity– Sharingtoolsandresources– Sharingworkloads
![Page 17: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/17.jpg)
StartfromtheBeginning…
• Worldview—TribalandYouthCultures–Relational vs. Individual– Strength-basedvs. Deficit-Based–Holisticvs. Segmented– Youth-friendlyvs. Adult-friendly
![Page 18: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/18.jpg)
Community-DrivenOutcomes
• HopefortheFuture• StrongSenseofEthnicIdentity• Feelingconnectedtofamilyandcommunity
• Volunteerism
![Page 19: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/19.jpg)
DevelopingMethodology
YouthAssessment• Pre-GONA• Post-GONA• 6-monthfollowup
ParentAssessment• 6-monthfollowup
StaffandVolunteerAssessments• 6-monthfollowup
![Page 20: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/20.jpg)
IdentifyingMeasurementStandardizedTools
– HerthHopeIndex(HHI)– Multi-EthnicIdentityMeasure(MEIM)
Non-StandardizedTools– GONAYouthTool(pre-,post-,and6-months)
• GONAcomponents• CommunityandFamilyConnection• SatisfactionandImpact
– GONAParentTool– StaffandVolunteerTool
![Page 21: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/21.jpg)
TrainingProtectionofHumanParticipants
– UniqueIdentifiersandMasterlist– ProtectionofData
Methodology– PreandPost
EvaluationQuality– ReliabilityandValidity– Standardization(methodsandtools)
UnderstandingDataAnalysis– T-testforDependentSamples– IntrotoANOVAandregression
![Page 22: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/22.jpg)
StudyOutcomes• Annualevaluations• Longitudinalstudy(3years)
– Master’sThesis,CarolynKraus,Berkley– PublicationinPreparation
• Cumulativeeffectonhopeforthefuture• Increasedfeelingsofethnicidentity• Increasedfeelingsofconnectiontocommunity• Improvedpro-socialbehaviors
![Page 23: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/23.jpg)
ProjectOutcomes
Valuingevaluation• Reducingfearanduncertainty• Identifyingusesforpositivegrowth• Increasingevaluationlanguage
CapacityBuilding• Increasingmethodologyanddatacollectionskills• ImplementingQualityImprovement/GONAtoolkit
LeveragingResources• GONAdonations,contributions,andfunding• Increasedpartnersandvolunteers
![Page 24: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/24.jpg)
EnergyFollowsThought
![Page 25: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/25.jpg)
Community-BasedParticipatoryResearchOutcomes
![Page 26: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/26.jpg)
GatheringofNativeAmericansFidelityTool
• Trainingonimportanceoffidelity• UsingGONAfacilitatorstodevelopfidelitytool• Testingacross3sites
“Even[without]aresearchproject,I’mstillgoingtousethefidelitytool.”
– GONAfacilitator
![Page 27: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/27.jpg)
FresnoNativeYouthCouncilPersonalBalanceTool
AdaptedfromAdultVersion– Strength-Based– Holistic– Youth-Friendly
PilotTested– Youthadministeredtoover100youth
– SmallFocusGroupsPublishedin2016
![Page 28: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/28.jpg)
SAMHSAServicetoScience
• RetrospectiveStudy– DeterminedMethods– DevelopedSurveys– PilotedTools– RevisedTools
• DevelopedIRBApplication
![Page 29: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/29.jpg)
ReplacingtheMulti-EthnicIdentityMeasure
• CulturalConnectednessScale-Revised– StandardizedonFirstNationsYouthinCanada– RevisedandtestedinCaliforniabytheNativeAmericanHealthCenter,Inc.
– Adaptabletodiversetribalcommunities
![Page 30: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/30.jpg)
GatheringofNativeAmericansCrossSiteStudyToday
• 6YearsofLongitudinalDataCollectionfromNAHCandFAIHP,nowsupportedbyCCUIH
• FundingfromCaliforniaReducingDisparitiesActinitiativetosupportsystematicmulti-communitybaselinestudy– Adding2newGONAcommunitiesthisyear– PreparingforGONARetrospectiveStudy
![Page 31: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/31.jpg)
EvaluatorObservations:WhatWorked• Focusingonyouth,families,andmission• Beingflexibleandjoiningthecontext• Involvingcommunitytoincreasereliability,validity,anduseofdata
• Includingstrength-basedmeasurementmadeiteasyandwasembracedbycommunity
• On-the-groundsupportindatacollectioniscritical• Ongoingtrainingisnecessaryandsignificant,butresultsinagrowingNativeworkforce
![Page 32: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/32.jpg)
LessonsLearned• CBPRtakesmoreresourcesupfront,butrewardsaregreat
• Needadequateresearchfundingforcommunitybestpractices
• Aculturally-basedapproachmeansmakingrealchangesacrossalllevels§ Policy=Practice=Evaluation
• CBPRisaninteractiveprocessthatisitselfaninterventionthatproducesoutcomes
• Youthbringthecommunitytotheproject
![Page 33: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/33.jpg)
Balance
• Mind• Heart• Body• Spirit
![Page 35: Evaluation in Indian Country Part 1 FINAL 032917 in Indian... · 2019-09-10 · Cross-Site Year 1. Components Belonging –Urban Indian Health Organizations –Families with similar](https://reader035.fdocuments.in/reader035/viewer/2022070816/5f0fd2097e708231d4460b79/html5/thumbnails/35.jpg)
Presenter:JamiBartgis,Ph.D.CherokeeNationofOklahomaOneFireAssociates,[email protected]
Facilitator:BernadetteEchoHawk,CommunicationsCoordinator,SAMHSATribalTTACenter,[email protected]
Honoring the GONA through Evaluation
Tribal Training and Technical Assistance Center Website: http://www.samhsa.gov/tribal-ttac
Email: [email protected]
We will be sending out a brief participant feedback questionnaire shortly after the webinar. We greatly appreciate any input you are willing to provide. Thank you for attending today!