Conducting the eCRC Survey A Practical Guide The Asia Foundation, Dambulla, September 1-4, 2013.

Conducting the eCRC Survey

A Practical Guide

The Asia Foundation, Dambulla, September 1-4, 2013

•DREAMERS•LEARNERS•DOERS•DOUBTERS

Meeting Expectations


SESSION 1

Methodology of eCRC

The Key Steps…

1. Identifying services & issues– Which services and what to study?

2. Determining the sample – Whom to ask?3. Designing the questionnaire – What to ask?4. Conducting the survey – How to collect

information?5. Analyzing the information – What to

report?6. Using the information – How to use the

findings to improve services?


What services are we looking at

LG Regulatory Services (10)

LG Common Services (10)

Local Infrastructure

(9)


1. Local Infrastructure

• What do we want to know? - meeting community priority- quality of construction- time taken to complete the work- availability of information- performance of the contractor- awareness & performance of SACs- community participation

•Whom do we ask?- Immediate beneficiaries


1. Local Infrastructure (Contd.)

• What type of information / analysis are we interested in?

- variations of experiences across a. LAsb. GN Divisions (within a LA)c. Type of infrastructured. Value of contracte. Contractors


2. LG Common Services

• What do we want to know? - Availability of service- Usage of service- Quality of service- Reliability of service- Satisfaction with service

`•Whom do we ask?

- Users (in a household)


2. LG Common Services (Contd.)


- variations of experiences across a. LAsb. GN Divisions (within a LA)c. Genderd. Agee. Ethnicityf. Economic statusg. Distance of residence from centre


3. LG Regulatory Services

• What do we want to know? - Availability of information- Ease of applying- Process time- Satisfaction with service

`•Whom do we ask?

- Users


3. LG Regulatory Services (Contd.)


- variations of experiences across a. LAsb. GN Divisions (within a LA)c. Genderd. Ethnicitye. Economic statusf. Distance of residence from centre


Understanding the Questionnaire

Components of questionnaire•Enumerator information•Introduction•Filter / qualifiers questions•Demographics•The body of the schedule - sections if needed - sub- schedules if required

12The Asia Foundation, Dambulla, September 1-4, 2013

Ayubowan! I am ……… from the ……LA. This is my identity card. We are currently conducting a survey on the services provided by the LA. We are conducting interviews at over 1500 households and your house is one of them that was chosen by chance from this area. We would like to discuss your experiences with these services. Information from this interview will be used to study and improve the services and will not be used for any other purpose. Your identity will be kept confidential and your name will not be recorded here. This survey will take about 10 minutes. May I please talk with you or any other adult member in the family who can give me information on the services?

Introduction***


What not to do during an introduction!

14

In a previous CRC, an enumerator introduced himself by saying, “We are here to find out

what problems you face when using services provided by the government.”

This introduction immediately communicates a biased tone to the interview. Let the

respondent tell you about their experience with service delivery—not the other way

around!The Asia Foundation, Dambulla, September 1-4, 2013

Section 3 – Filter Questions

“Have you, or anyone in your family, visited a Trade Licence Office in the past one year?”

•Yes [continue with interview] •No [terminate interview]

15

Filters/Qualifiers

Section 4 – Demographics

•Basic information about the household/respondent – age, gender, ethnicity, economic status, etc.

16

Sampling

•Population: The complete collection of individuals or objects that are of interest to us.

•Sample: A subset of the population which can help us study the population

17

•Size of the sample has no meaning after a certain number•Sample should be representative•How?Sampling techniques: Ex: Simple Random Sampling

Stratified samplingCluster samplingetc…

Some Simple Rules

Population – (People who live in the Eastern Province)

Sampling (FOR COMMON SERVICES)

1 32 65 7 8 1094

11 1312 1615 17 18 201914

21 2322 2625 27 28 302924

Simple Random Sampling (SRS)

Randomly select 12 peopleGenerate 12 random numbers between 1 – 30

11, 28, 4, 2, 21, 13, 19, 26, 16, 7, 23,30 Sample size - 12

Stratified Sampling

Identify possible Strata

Strata

Proportionately allocate people from strata ( 4 from each stratum). Then apply SRS

Batti

Ampara

Kalmunai

How do we sample within a LA

2 methods

a. Scientific Method – PPS

b. Quick Method – Social Mapping


What is PPS?

Probability Proportionate to Size (PPS)

-Selecting sample within a strata in the same proportion as they are represented in the population.

-E.g., Ethnicity, location,


How do we do a PPS selection

a. First allocate the total sample for the LA (1500) across the GN Divisions using PPS

b. Within each GND, select the sample on the basis of a pre determined criteria – ethnicity, location, economic status

c. Randomly select households keeping the quotas in mind

….Let us see an example



NUWARA ELIYA Municipal Council

Ethnicity

GN. Divisions Sinhalese SL Tamil

Indian Tamil

Moor Other Total

535 - Nuwara Eliya 10 5 7 4 0 26535A - Magasthota 16 2 1 2 0 21535B - Kalukele 13 1 0 1 0 15535C - Kelegala 13 7 4 1 0 25535D - Nuwara Eliya Central 35 11 12 5 1 64535E - Sandathenna 14 5 18 1 0 38535F - Hawaeliya West 14 6 2 4 0 26535G - Hawaeliya North 18 9 7 2 0 36535H - Hawaeliya East 18 10 2 2 1 32535I - Bulu Ela 14 4 2 3 0 23535K - Bambarakele 18 5 22 2 1 48535L - Nuwara Eliya West 12 10 12 1 0 35535M - Shanthipura 15 2 1 1 0 18535N - Kalapura 9 11 22 2 0 44Total 217 88 110 31 5 450

Quick Method

a. First allocate the total sample for the LA (1500) across the GN Divisions using PPS

b. Within each GND, select the sample on the basis of a clusters (diversity)

c. Select sample households randomly within each cluster


SAMPLING (FOR REGULATORY)

3 Methods

a. Census of HHs within GN Division

b. Tracer Interviews

c. Exit Interviews / Intercept Interviews


1. Census of HHs in a LA

a. Quick survey of all HHs to identify which HHs have used which of the 10 services.

b. Target HHs where maximum number of services have been used.

c. Proceed with the list till you get the required number for all services (50 respondents per service)


2. Tracer Interviews

a. Obtain a list of all users of a service who applied /interacted during the last 1 year.

b. Generate a random list of 50 names from the list

c. Carry out the interview for the identified names


3. Exit/ Intercept Interviews

a. Stand outside the centre/facility

b. Interview persons coming out at a pre-determined frequency (every 3rd person) – first determine the average number of transactions per day.

c. Ensure that the quota is obtained (50)


Conducting the eCRC Survey A Practical Guide The Asia Foundation, Dambulla, September 1-4, 2013.

Documents

Transcript of Conducting the eCRC Survey A Practical Guide The Asia Foundation, Dambulla, September 1-4, 2013.