Www.ifrc.org Saving lives, changing minds. RAMP S urvey Changing the way we collect data in Surveys...
-
Upload
caren-lucas -
Category
Documents
-
view
216 -
download
0
Transcript of Www.ifrc.org Saving lives, changing minds. RAMP S urvey Changing the way we collect data in Surveys...
www.ifrc.orgSaving lives, changing minds.
RAMP Survey < Rapid Mobile Phone-based >
Changing the way we collect data in Surveys
Presented by Jenny Cervinskas, Bong Duke
and Laimi Onesmus
Windhoek, Namibia
February 7, 2012
www.ifrc.orgSaving lives, changing minds.
Outline
• Background to the survey• Preliminary results• Survey report• Q&A/Discussion• Next steps?
www.ifrc.orgSaving lives, changing minds.
With the RAMP you automate your survey
Conduct surveys and enter data
using a standard mobile phone
Manage surveys, people and data from your web-based server
www.ifrc.orgSaving lives, changing minds.
Caprivi region (north eastern Namibia) Ongoing NRC project on Communities Fighting Malaria Malaria a serious public health program Malaria prevention and control strategies being implemented RAMP malaria indicators survey provides a measure for some
of the project’s key indicators, and for some of the Namibia’s core malaria indicators
Mobile network coverage (MTC provider)
Site and project identification
www.ifrc.orgSaving lives, changing minds.
Survey Objectives
Estimate ITN ownership Proportion of individuals with access to an ITN in the
household (assuming one ITN covers two persons) Proportion of households with one or more ITNs.
www.ifrc.orgSaving lives, changing minds.
Estimate ITN use Proportion of all persons in the household that slept
under an ITN the previous night Proportion of children < 5 years old who slept under
an ITN the previous night Percentage of ITNs that were used last night.
www.ifrc.orgSaving lives, changing minds.
To assess ITN ownership and usage by household socio-economic status
To measure the proportion of households with at least one ITN and/or sprayed by IRS in the past 12 months.
www.ifrc.orgSaving lives, changing minds.
To measure prompt access to effective treatment and use of diagnostics Proportion of children < 5 years old with fever in the
last two weeks who received anti-malarial treatment according to national policy
Proportion of children < 5 years old with fever in the last two weeks who had a finger or heel stick.
www.ifrc.orgSaving lives, changing minds.
Modeled after the standardized MIS (malaria indicator survey) questionnaires Household questionnaire Person roster/Treatment and diagnosis of fever in
under-fives Net roster◦ Types of bednets, source of nets, age of nets, who
slept under each ne, number of people that slept under each net
Survey questionnaires
www.ifrc.orgSaving lives, changing minds.
Standard survey methodology used in a RAMP survey 1st stage: standard probability-proportional-to-
estimated-size (PPES) selection of clusters Master Sampling frame:, 2008 (from Bureau of Statistics)
2nd stage: PPES to segment the cluster Selection of households- simple random sampling
(SRS) to choose 10 households/cluster
Survey methods
www.ifrc.orgSaving lives, changing minds.
NRC volunteers that serve as supervisors in the CFM project (interviewers)
12 of the 18 had been involved in the 2011 RAMP survey in Caprivi
Training – 4 days (January 2012) in Katima Mulilo
Recruitment of surveyors
Training
Adapted from the RAMP survey curriculum and guide
Content Cellphone basics Questionnaires Informed consent Interview techniques Field procedures Field logistics/reporting Supervisor training
Methods Presentations, role play, group
discussion, demonstrations, field practice, energizers
Red Cross volunteers carried out the interviews
Six teams- two interviewers and one supervisor per team
+Survey Supervisory Support Team
Survey Team Debriefing: 1 day after last interviews
Presentation and discussion of preliminary results
Award of certificates
“I feel happy knowing how to collect data with the cellphone”
Organizers are happy the survey was completed successfully
www.ifrc.orgSaving lives, changing minds.
Preliminary Results- RAMP malaria survey
Caprivi region
January-February 2012 survey
www.ifrc.orgSaving lives, changing minds.
Access: Just 52% of ITNs needed to reach universal coverage are present. Gap is 48%.
Key indicators
Target population 46,727
Persons per net 1.88
ITNs needed 11,816
Survey-estimated ITNs in HH of target pop
13,038 (52%)
ITN/LLIN need/gap 11,416 (48%)
www.ifrc.orgSaving lives, changing minds.
Results: High percentage of ITNs are being used. Use gap is due to insufficient ownership of ITNs
Key indicators Point estimate
% ITNs that were slept under last night 94%
% ITNs that were hung last night 94%
ITN use, all ages 44%
ITN use, <5 yo 55%
www.ifrc.orgSaving lives, changing minds.
Age in months % Cum. %<1 Year 15 151 Year 28 432 Years 16 583 Years 26 854 Years 6 91>5 Years 5 96
Age of ITNs
* 97% of nets were LLINs
www.ifrc.orgSaving lives, changing minds.
Number of persons sleeping under ITN last night %, nets
1 person 33
2 persons 48
3 persons 16
4 persons 2
Number of persons under a ITN last night
www.ifrc.orgSaving lives, changing minds.
Children Tested and Treated for Malaria
Key indicators %
Children with Fever within the last two weeks 49
% who received a heel or finger stick 25
% who received ACT 29
% who received ACT within 24hrs of fever 22
% who received any anti-malarial 46
- Denominator for all indicators was % of children <5y with fever in the previous two weeks
www.ifrc.orgSaving lives, changing minds.
A main message…
There is an ITN gap The # ITNs in the whole survey domain=
52% of the need The gap is 15,965 nets (11,816+4,149)
www.ifrc.orgSaving lives, changing minds.
So, does the RAMP “work”?
RAMPS Namibia February 2012 Daily data cleaning accomplished Preliminary survey results bulletin finished within
24 hours Preliminary report finished within 72 hours Provided excellent management information on
the key indicators
RAMP has made surveying EASY!!!
“I feel happy knowing how to collect data with the cellphone”
Organizers are happy the survey was completed successfully
www.ifrc.orgSaving lives, changing minds.
Take time to prepare cellphones prior to the survey Establish strong working partnerships Develop and implement a capacity building plan, with
dedicated human resources Data entry: worked well, all teams were able to collect
data using the cellphone and send to server Red Cross volunteers with secondary school education
can collect data in the field
Lessons learned
www.ifrc.orgSaving lives, changing minds.
What’s next?
Extract lessons learned from Namibia and apply in next survey Implement RAMP malaria and other health surveys in Africa
and other continents Finalize and disseminate the RAMP survey technical manual
and the training manual Continue developing strategies for technical support in order to
gradually reduce external support Test the RAMP in other sectors and disciplines if appropriate Continue searching for innovative ways to collect data in a
timely fashion in order to better serve the communities we work in
www.ifrc.orgSaving lives, changing minds.
Purpose of the RAMP survey
To provide a survey methodology in which Red Cross and Red Crescent National Societies, governments and other partners can conduct health surveys at reduced cost, with limited external technical assistance achieve high standards of survey design and quality
To dramatically decrease the time that data is available for decision making
To use mobile phones and a web-based, freely accessible software domain as a data collection technique to conduct health surveys.
www.ifrc.orgSaving lives, changing minds.
Key Features of the RAMP survey
Web based questionnaire design using EpiSurveyor Questionnaire forms are uploaded to standard mobile
phones Data is collected using low cost, familiar and widely
available mobile phones (e.g. Nokia, Samsung) Has an accompanying training manual, technical manual,
and tools adaptable to your setting/your environment Data can be exported to Microsoft Excel, as a text file,
and in Mdb format Allows for rapid analysis and reporting of survey results
www.ifrc.orgSaving lives, changing minds.
Traditional Paper and Pencil Questionnaire
The time and monetary costs of data collection can be substantially reduced if mobile phone data collection is used in place of the traditional paper and pencil method that has been the best practice in health surveys for decades
www.ifrc.orgSaving lives, changing minds.
Web Based Server
Create a free account using EpiSurveyor software
Access your web based server from a web browser anywhere in the world
Design your questionnaire with single or multiple languages
Monitor, manage and communicate with your team
Export data and analyze results in real-time.
www.ifrc.orgSaving lives, changing minds.
Why use mobile phones to collect data? Real-time data entry on cell phones Limitless upload of data from cell phone over cell network to
internet database Real-time data monitoring and data quality checks Real-time data cleaning and analysis Rapid production of survey results within minutes of last
interview
www.ifrc.orgSaving lives, changing minds.
Stakeholder benefits
Decision Makers• No software licensing or subscriptions • Optimizes resource usage and reduces environmental impact• Maintain data security and respondent confidentiality• Scalable solution for teams and studies of varying sizes
Evaluators/Researchers• Incorporate a multitude of question types with custom logic and validation• Manage and upload surveys in multiple languages• Monitor staff work rate, productivity and quality• Export data for custom analysis with your favourite statistical analysis package
Fieldworkers• Conduct surveys anywhere, even in areas with no network coverage• Use standard and familiar mobile phones• Minimal training requirements• No more paper to collect, transport or return• Automated submission of data when network reception is available
www.ifrc.orgSaving lives, changing minds.
Cellphone-based Surveys: Summary Points
REAL-TIME DATA AVAILABILITY AND ANALYSIS Via your web-based server, responses may be viewed, monitored and exported
instantly
IMPROVED DATA INTEGRITYThe removal of paper from the research process reduces the number of points at which error can be introduced
FIELDWORKER MONITORING/MANAGEMENT Monitor the productivity and quality of research conducted by field staff (GPS, time
and date stamp)
ENHANCED MOBILITY Do not need network coverage to conduct surveys, responses are stored securely on
the mobile phone, thus can reach even the most remote communities
OPTIMISED RESOURCE USAGE Save on survey printing, distribution and collection costs