SenseMaker approach Ghana
-
Upload
irc -
Category
Technology
-
view
1.689 -
download
2
description
Transcript of SenseMaker approach Ghana
BEYOND THE STATISTICS ABOUT WATER
WATER SERVICE DELIVERY IN GHANA:
SENSEMAKER® APPROACH
WATER SERVICES THAT LAST …2
BEYOND THE STATISTICS ABOUT WATER SERVICE DELIVERY IN
GHANA: SenseMaker®
APPROACH
2
Presented By: Esinu Abbey (IT Coordinator, CWSA) &
Prosper Dzansi (Monitoring, Evaluation & Learning Expert)
WATER SERVICES THAT LAST …3
Irene Guijt, Learning by DesignDave Snowden, Cognitive Edge
Acknowledgement
WATER SERVICES THAT LAST …4
Outline
Part 1: The SenseMaker Approach
Part 2: Application of SenseMaker
WATER SERVICES THAT LAST …5
SenseMaker….. What is it?
•A software suite developed by Cognitive Edge to help find patterns among stories•A tool for capturing story based data•An Evaluation tool
WATER SERVICES THAT LAST …6
SenseMaker Suite
Attempt to Hear What Really Matters to People
WATER SERVICES THAT LAST …7
Examples of applications
Liverpool Museum of Slavery culture of violence – Latin America grassroots initiatives - East Africa girls’ empowerment – Rwanda, Ethiopia agricultural value chains - cotton, tea, banana water service delivery - Ghana, Uganda youth leadership - global
WATER SERVICES THAT LAST …8
Why use SenseMaker?
Dynamic contexts need adaptive programme Respond to emerging needs Understand diversity of perspectives Focus on values and people’s experiences, with
quantification
Not stand alone approachBuild in other evaluation frameworks
WATER SERVICES THAT LAST …9
What using SenseMaker involvesWhat using SenseMaker involves
An An approach approach to making sense of different fragments of information about to making sense of different fragments of information about a complex change process or about a dynamic contexta complex change process or about a dynamic context Lots of different Lots of different ‘stories’ from many sources ‘stories’ from many sources : water users, water : water users, water
professionals, policy documents, videos, photographsprofessionals, policy documents, videos, photographs Together they build a rich and diverse picture of what is happeningTogether they build a rich and diverse picture of what is happening
Looking at patterns that are emerging can help plan next stepLooking at patterns that are emerging can help plan next steps s (rather than the individual stories……the paterns (rather than the individual stories……the paterns direct us to find out what a cluster of pple are direct us to find out what a cluster of pple are saying …helps in forming themes)saying …helps in forming themes)
SenseMakerSenseMaker® ® is the software is the software to help find patterns among the to help find patterns among the storiesstories But people need to make sense of it and decide on actionBut people need to make sense of it and decide on action
WATER SERVICES THAT LAST …10
Essence
WATER SERVICES THAT LAST …11
From question to action
Prompting question
patterns
Act on signals
Story capture
Self-signification
Visualize patterns (theme, org, time, geo)
Make sense
WATER SERVICES THAT LAST …12
start
Methodology in Practice - GlobalGiving
WATER SERVICES THAT LAST …13
Asking what?
Goals, values, behaviours Non-negotiables
seek surprise & confirm known
WATER SERVICES THAT LAST …14
Tell us about a time when a person or an organization tried to change something in your community.
WATER SERVICES THAT LAST …15
Stage 1 Analysis – Sensemaker (& Excel, SSP, SNA, text analysis)
WATER SERVICES THAT LAST …16
Stage 2 Analysis – People
WATER SERVICES THAT LAST …17
Ghana Group Discussions per ThemeGhana Group Discussions per Theme
Look at the patterns, reflect on your own experiences and read the related stories.
Discuss:1. What messages are emerging from the
patterns?2. Which patterns are odd? And what might
explain those patterns? 3. Which patterns do you recognise?4. What do the patterns suggest might be areas
and issues that require attention? New issues needing investment, some not worthwhile, etc.
WATER SERVICES THAT LAST …18
Library of lived experiencesVisualizing shifting story patternsDissemination to official aid sectorActionable – client, constituent voice
Rolling baselinesUseful for organizations – facilitate decision-making Information challenges existing frameworksCross-organizational thinking
Stories for evidence-based policy changesFraming the impact for/to donorsPeer-to-peer knowledge management
After 18 months
WATER SERVICES THAT LAST …19
Wider Sharing, eg geomapping
WATER SERVICES THAT LAST …20
Last thoughts
See- Attend-ActIt’s not just getting material in front of people
Statistical links (especially self-discovered) create attention– Linked “objectivised anecdotes” provide explanatory power and lead to action
Measure success without pre-defining (no pre defined mined set like logg frames…open mind)
measures of success change over time
allowing learning through tolerated failure (do and learn from mistakes made)
contextual adjustment
Evidence-based policytests of coherence empower ‘people’ to use statistics
potential for whole of population engagement
complexity/narratives alternatives to “Delphi” to allow real time distributed consultation
20
WATER SERVICES THAT LAST …21
Part 2
WATER SERVICES THAT LAST …22
BEYOND THE STATISTICS ABOUT WATER SERVICE
DELIVERY IN GHANA:
SENSE MAKER APPLICATION IN TRIPLE-S
WATER SERVICES THAT LAST …23
PRESENTATION OUTLINE
1.Background of Triple-S
2. Why use SenseMaker in Triple-S 3. Methodology for story collection
4. Analysis
5. Results
6. Next steps
WATER SERVICES THAT LAST …24
BACKGROUND TO TRIPLE-S
Triple-S: a six year research project 2009 – 2014 Managed by IRC in collaboration with partners and funded by
the Bill & Melinda Gates Foundation Seeks to tackle log-term challenges of sustainable water
supply by contributing to shift from “infrastructure perspective” to service delivery approach for rural water sector through:
Action research in Ghana, Uganda (& Burkina Faso) Working with government and sector stakeholders Research, documentation and dissemination International partnerships and advocacy
WATER SERVICES THAT LAST …25
WHY USE SENSE MAKER FOR WHY USE SENSE MAKER FOR TRIPLE S ?TRIPLE S ?
•Respond to emerging needs – flexible funding for Respond to emerging needs – flexible funding for new ideas. new ideas.
• Diversity of perspectives - especially users and Diversity of perspectives - especially users and professionals.professionals.
•Getting beyond statistics about water points and Getting beyond statistics about water points and policy intentions to people’s lived experiences in policy intentions to people’s lived experiences in the water sector.the water sector.
• Monitor water users satisfaction of the services they are receiving..
WATER SERVICES THAT LAST …26
SERVING A LARGER LEARNING PURPOSE
•Triple-S identified Narratives as a means of monitoring and evaluation.•Learning in Triple-S takes place in two areas (Narratives).• Narrative 1: tells the story about sector change towards sustainability (changes in discourse, new ideas emerging, changing practices and policies)• Narrative 2 tells the story of the process to enable this change.• Use of statistical methods and stories in these narratives• Learning is geared towards improving our performance;
WATER SERVICES THAT LAST …27
METHODOLOGY OF STORY COLLECTION
Who tells stories?
1. Two main categories of stakeholders;•Users at water facility level: Akatsi, East Gonja, & Sunyani West District Assemblies• Water Professionals: Government & NGO staff at Central & Decentralized level
2. Actual stories collected: 1, 256, water users 842, water professionals 4143. Pilot stage =300
WATER SERVICES THAT LAST …28
METHODOLOGY OF STORY COLLECTION
Who collects stories? Recruited and trained 22 story collectors•young unemployed graduates or national service personnel, •teachers, •assembly men , •environmental health officers, • community development officers and •Social welfare officers
WATER SERVICES THAT LAST …29
METHODOLOGY OF STORY COLLECTION
Methods for Story Collection• User stories were collected through interviews: • Story collectors where deployed to all area councils in each pilot
District to ensure spread of stories & representativeness.
• Water Professionals stories were collected through:- interviews( in offices of water professionals and sector events- an e-based collector website
IncentivesLunch and transport allowances were provided to story collectorsFeedback ( sharing and discussion of results to motivate people to
share stories)
WATER SERVICES THAT LAST …30
LESSONS/CONSIDERATIONS
Things that work well• Both water users and professionals were willing to share
stories• The use of the word ‘story’ prompted respondents to share
long narratives and sometimes fairytales or fiction’
Things that did not work well • The use of the collector website did not work well as
practitioners saw no motivation to respond • Practitioners preferred speaking out their experiences
rather than writing them.
WATER SERVICES THAT LAST …31
DATA ENTRY & ANALYSIS
1. Data entry outsourced
2. Two levels of analysis are planned:
• Preliminary analysis on demographics, & key highlights and trends observed by Triple- S
• Sharing the Results with Stakeholders at National Learning Alliance Platform for them to:1. Make sense of the trends observed, 2. Identify messages that emerging from the patterns?3. New issues needing investment, some not worthwhile
WATER SERVICES THAT LAST …32
B. ResultsB. Results
WATER SERVICES THAT LAST …33
What do we need to know? What do we need to know?
Water UsersWater Users• How do people think of their water supply (quality, reliability, quantity etc)? • How do water users perceive water professionals? • How do people know their rights and responsibilities to water use• What are the views of water users/people on who should pay for water?
Water Professionals? Water Professionals? • What are the implementation challenges associated with sustainable provision
of new water facilities? • What success story of non technical /infrastructure can the sector build on? • Where are we seeing stagnation and where are we seeing good• Is there harmonization and alignment being done positive and negative?
WATER SERVICES THAT LAST …34
HOW DO USERS THINK OF THEIR WATER SUPPLY?
WATER SERVICES THAT LAST …35
Water Users How do water users see water professionals
500 stories59.4%
n =842 stories
Their own goalsTheir own goals
People in needPeople in need Their organizationTheir organization
The water providers directly involved in are mainly focused on…
WATER SERVICES THAT LAST …36
Water Users How do people know their rights and
responsibilities to water use
Play no rolePlay no role
Help make decisionsHelp make decisionsKnow who to talk toKnow who to talk to
n =813 stories
287 stories35.3%
WATER SERVICES THAT LAST …37
Water Users How do people know their rights and
responsibilities to water use
Responsibility for water supplyResponsibility for water supply
Rights to water useRights to water use Knowledge about maintaining water supplyKnowledge about maintaining water supply
n =855 stories
334 stories39.1%
My story is about people’s...
WATER SERVICES THAT LAST …38
Water Users What are the views of water users on who should
pay for water
Government or aid organizationGovernment or aid organization
Water userWater userLocal water providerLocal water provider
n =815 stories
267 stories32.8%
In your story, who should pay if the water system breaks?
WATER SERVICES THAT LAST …39
Water Professionals What are the implementation challenges associated with sustainable provision of new water facilities?
ChallengeChallenge
SolutionSolutionProblemProblem
n =414 stories 102 stories24.6%
WATER SERVICES THAT LAST …40
Water Professionals What are the implementation challenges associated with sustainable provision of new water facilities?
PolicyPolicy
ImplementationImplementation FinancingFinancing
n =414 stories
78 stories18.8%
•The story has to do with….
WATER SERVICES THAT LAST …41
Water Professionals What are the implementation challenges associated with sustainable provision of new water facilities?
.
New InfrastructureNew Infrastructure
Post constructionPost construction General sector SupportGeneral sector Support
n =414 stories
70 stories16.9%
Your story is about….
WATER SERVICES THAT LAST …42
Water Professionals
•Context of the story and the emotions associated.
WATER SERVICES THAT LAST …43
Water Professionals What success story of non technical /infrastructure can the sector build on?
.
•How do you feel about your story?
WATER SERVICES THAT LAST …44
WHERE ARE WE SEEING STAGNATION AND WHERE ARE WE SEEING GOOD PROGRESS
.
Story relates to policies and practices about...?
WATER SERVICES THAT LAST …45
WHERE ARE WE SEEING STAGNATION AND WHERE ARE WE SEEING GOOD PROGRESS
.
The same as alwaysThe same as always
The same things but in a better wayThe same things but in a better way Fundamentally different thingsFundamentally different things
118 stories28.5%
n =414 stories
The story is about a situation in which organizations/ people do.?
WATER SERVICES THAT LAST …46
IS THERE HARMONIZATION AND ALIGNMENT BEING DONE POSITIVE AND NEGATIVE
The story is about a situation in which organizations/ people do?
Work independentlyWork independently
Fully align their approachesFully align their approachesCoordinate their activitiesCoordinate their activities
n =414 stories
69 stories16.7%
In your story, organisations...
WATER SERVICES THAT LAST …47
NEXT STEPS
In the Next Steps…
• Sharing and discussing outputs from story analysis in review & coordination platforms at:
- District - Regional- - National level
• Setting up an institutionalized system of data collection • Anchor sense maker activities into M&E system of CWSA and
the sector
WATER SERVICES THAT LAST …48
Thank you
WATER SERVICES THAT LAST …49
Group Discussions per ThemeGroup Discussions per Theme
Look at the patterns, reflect on your own experiences and read the related stories.
Discuss:1. What messages are emerging from the patterns?2. Which patterns are odd? And what might explain those
patterns? 3. Which patterns do you recognise?4. What do the patterns suggest might be areas and issues
that require attention? New issues needing investment, some not worthwhile, etc.