Challenges Collecting Real-Time Survey Data Using Smartphones · • Software pros & cons...
Transcript of Challenges Collecting Real-Time Survey Data Using Smartphones · • Software pros & cons...
© 2016. Materials may not be reproduced without permission of the author.
Challenges Collecting
Real-Time Survey Data Using Smartphones
Marie Nitschke, Tara Piché
University of Wisconsin Survey Center
University of Wisconsin-Madison
International Field Directors & Technologies Conference
Austin, Texas
May 16, 2016
Overview
• WiscAid Time Use study
• Study design
• Development considerations
• Introduction to PACO
• Administrator & user walkthrough
• Software pros & cons
• Features
• Implementation/technical issues
• Alternative software options
2
Time Use Study
• Sponsor
• Purpose
• Collect real-time data about time use from
undergraduates receiving financial aid
• Method
• Ecological Momentary Assessment
• Experience Sampling Method (ESM)
3
Study protocol
4
Pre-survey •n=557
Time Use •n=402
Post-
survey•n=403
Post-
incentive•n=329
5
Development Considerations
• Requires phone plan
• Skip patterns difficult
• Limited question
formats
• Analyzing data
• No data plan required
• More question formats
• Higher quality interface
• Greater technical
complexity
Text (SMS) Application
6
7
Software needs
• Low cost
• User-friendly
• Developed
• iOS and Android compatible
8
9
10
11
12
13
14
15
16
17
18
Data View
19
Stat View
20
21
22
23
24
• Features
• Open-source
• Usability
• Data
• Alternative apps
and options
PACO Pros & Cons
25
• Free, Google-
based
• Open-source/
Collaborative
• Technical support
• PACO team
• Respondents
• Small development team
Pros Cons
26
Pros
• Project set-up
• Simple, customizable
inputs
• Timing/alerts
Cons
• Sample management
• Enrolling respondents
• Follow-up
Usability
27
• Paradata
• Data export
• Missing data
• Syncing errors
Data
28
• Custom App Development
• Qualtrics SMS
• iHabbit
• Mobile Market Research
• iSURVEY/droidSURVEY
• Ondevice Research
Alternative apps/services
29
Lessons learned
• Field considerations for PACO
• Pilot to train respondents & staff
• Software updates
• Importing Gmail addresses
• Troubleshooting with respondents
• Guides/tutorials
• Managing data for progress monitoring
• Expect some missing data due to bugs/errors
30
Please visit us at:
www.uwsc.wisc.edu
Thank You!
For copies of this presentation or more information, contact:
Marie Nitschke
Tara Piché
31