Planning and Implementation of Post Enumeration Surveys Pres. 4

United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010

Planning and Implementation of Post Enumeration Surveys

Pres. 4


Some Requirements for a Good PES

Adequate planning Technical personnel with requisite skills and experience in

survey methodology and in designing and implementing the whole PES process

Sample design, implementation, matching and estimation Develop an efficient sample design

A successful PES calls for a good sample design and survey implementation

The timing of PES should be soon after census Maintain operational independence


Some Requirements for a Good PES (Contd.)

Ensure quality assurance in all the stages of the PES, thus from planning to data processing

Control of non-sampling errors is essential like in any other surveys, as unlike sampling errors, they are difficult to measure, therefore one is better off controlling them

Credible estimation methodologies and procedures


Planning of PESJudicious planning for the PES is critical in order to yield reliable

resultsPlanning of PES should be:

Preceded by a clear and unambiguous statement of objectives as this facilitates to articulate planning of PES activities

Synchronized with planning for the censusStart early and adequate resources devoted to it as part of

overall census programmeDevelop a comprehensive survey plan showing budgetary and

manpower requirements


Planning of PES (contd.)Adequate Resources:Financial allotment: Without sufficient funds the

PES would be poorly implemented and therefore may not produce better results than the census. This would defeat the whole purpose of evaluating a census

Human resources: There is need to have requisite number of specialist staff such as survey methodologists; demographers; and analysts; qualified enumerators and supervisors


Planning of PES (contd.)Commitment to the philosophy of a PES: it is very critical to have the

top management of a statistical/census office committed to the philosophy of the PES, so that they can plan for resources and support its efficient implementation

Establishment of an independent unit: It is advisable that an independent PES planning and implementation unit is established. This also enhances the operational independence between the census and PES

Technical planning: It is necessary to have sub-technical teams to work on the sample design; plan for the implementation of the PES; the design of a Dual System of Estimation plan, matching and the reconciliation exercise


Planning of PES (contd.)

Elements of planning a PESPreparatory activitiesData collection related activitiesMatchingReconciliation (if undertaken)Data processingEstimation of coverage and content errorReport preparation and dissemination


Planning of PES (contd.)

Publicity campaignPES as a specialized data collectionImportance of not biasing potential sample

populationStrategies used in different countries(??)


Implementation of PES

Pilot TestThis can be a dress rehearsal of the actual PES as the pilot census

is a dress rehearsal of the censusIt can be conducted in selected administrative divisions (taking

into account costs)The purpose of the pilot test is to test the adequacy of the entire

PES plan and its organizationIt should be conducted in conditions similar to the actual

enumeration of the actual PES


Implementation of PES (contd.)

Pilot Test (Contd.)The pilot test should follow immediately the census pilot testWhile it is not a source of usable data it provides insights into

operational aspects of data collection that can contribute to a successful conduct of a PES and census

Ideally it should be taken a year before the actual PES just as a pilot census is taken a year before a census (UN, 2008 P&R)


Implementation of PES (contd.)Pilot Test (Contd.)Provides an opportunity to test questions and the

overall field methodology before mounting the PESIt also offers a chance to test the matching and

analytical proceduresResults of the pilot test contribute to establishment

of matching rules, reconciliation procedures and logistical flows of documents between PES and census


Implementation of PES (contd.)Data collectionMethod commonly used in a PES is the face-to-face interviewEnumerators go to households, in selected EAs/clusters, and

interview respondentsThey collect information by asking questions from a PES

questionnaireThis method provides an opportunity for probingEnumerators can explain the objectives of the PES to

respondents


Implementation of PES (contd.)

Questionnaire Should be based on the final census questionnaire The format and size of questionnaire are important for

recording of responses and for data capture Pre-testing of questionnaire is imperative Selection of items for the questionnaire deserves careful

consideration Items to be used in matching process should ideally be

considered for the questionnaire


Implementation of PES (contd.)Questionnaire (Contd.) Variables for which information is to be collected on the

PES should have been included on the census as well Commonly considered variables include – age, sex,

relationship to reference person, marital status, educational level and type of housing unit


Implementation of PES (contd.)Selection and training of field staffEnumerators are the interface with respondents

should be able to communicate effectively with respondentsTheir work is critical to the success of the PES field work and

therefore their selection is critical and should be done objectivelyThey should be thoroughly trained before being assigned field workMain objective of training is to enhance uniformity and minimize

measurement error during interviews


Implementation of PES (contd.)Training Qualified instructors well versed with the objectives of the PES

should be responsible for trainingIt is advisable that the trainers should be part of the PES planning

and implementation teamsTrainees should take turns in explaining to others various items in

the questionnairePractical lessons are essential both in the classroom and the field.

Based on performance trainees can be retained as enumerators or dismissed


Implementation of PES (contd.)The role of supervisorsDespite good training of enumerators, without good supervision, in the

field, there may be inaccurate results Need for dedicated and effective supervisionSupervisors should be more experienced and better qualified than

enumeratorsLike enumerators, they should undergo extensive training in all aspects

of the PESSupposed to organize work for enumerators by determining field

assignments


Implementation of PES (contd.)The role of supervisors (Contd.)They review completed work and maintain a high

commitment of enumerators to the PES A supervisor can make follow-up visits to non-respondents

as they are better qualified and experiencedThere should be a manageable ratio between enumerators

and a supervisor (1 to 5 ratio should be okay)


Implementation of PES (contd.)Field data collectionDuring data collection objective is to classify

individuals by enumeration status relative to census night

Use of probing is necessary to adequately establish census night residence status


Planning of PES (contd.)Reconciliation (if done) Developing instructions for field reconciliation visits Training of enumerators and supervisors Carrying out reconciliation visits Final decisions on unresolved cases with respect to final statusData processing Selection or development of computer programmes for data processing,

tabulation & estimation Recruitment and training of data processing staff Carrying out data entry, editing and tabulation


Planning of PES (contd.)Estimation of coverage and content error (i) Estimation of coverage error (ii) Estimation of content error

Report preparation and dissemination (i) Analysis of PES results including producing and interpretation

of sampling errors for key variables (ii) Preparation of PES analytical report (iii) Dissemination of results


Implementation of PES (contd.)Control of non-sampling errorsShould be controlled and reduced to the level that their

presence does not compromise the usefulness of the PES results

Particularly harmful when they are non-random because they introduce bias in the PES estimates

Bias is difficult to measureBest way to control non-sampling error is to follow the right

procedures in all PES activities


Implementation of PES (contd.)Control of non-sampling errors (Contd.)Should be controlled and reduced to the level that their

presence does not compromise the usefulness of the PES results

Particularly harmful when they are non-random because they introduce bias in the PES estimates

Bias is difficult to measureBest way to control non-sampling error is to follow the right

procedures in all PES activities


Implementation of PES (contd.)Factors contributing to non-sampling errorVague objectives of the PESDuplication or omissions due to imprecise definition of boundaries

of EAsInappropriate methods of interviewingLack of trained and experienced field interviewers and

supervisorsInadequate identification particulars of sampling unitsErrors occurring in data processing


Thank You!

Planning and Implementation of Post Enumeration Surveys Pres. 4

Documents

Transcript of Planning and Implementation of Post Enumeration Surveys Pres. 4