Web viewThe project “Common Framework for a Literacy Survey” was executed by the...

<< Replace/Add/delete logo(s)>>

COMMON FRAMEWORK FOR A LITERACY SURVEY PROJECT

Literacy SurveyTraining Guide

<< Insert Date>>

<< Insert other relevant information on cover page of Guide>>

Table of Contents

Preface......................................................................................................................................................4How to Use the Training Guide...................................................................................................................5Classroom Training Procedures and Techniques...........................................................................................6Supplies Required for Training....................................................................................................................7Welcome and Introductions.........................................................................................................................9Client Presentation...................................................................................................................................12Home Study.............................................................................................................................................13Objectives of the Training Session.............................................................................................................14Objectives of the <<Country Name>> Literacy Survey................................................................................16Overview of <<Country Name>> Literacy Survey......................................................................................17Survey Flow............................................................................................................................................20Survey Sections.......................................................................................................................................21Material and Supplies...............................................................................................................................26Step-by-Step Instructions for the Administration of the Assessment Booklets for Interviewers........................32Interview Steps........................................................................................................................................33Exercises.................................................................................................................................................39In Class Exercises....................................................................................................................................40Mock Interviews - Introduction.................................................................................................................43Mock Interview #1...................................................................................................................................44Mock Interview #2...................................................................................................................................46Mock Interview #3...................................................................................................................................48Mock Interview #4...................................................................................................................................50After the Interview...................................................................................................................................51Conclusion and Evaluation........................................................................................................................53Appendix A: Workshop Powerpoint Presentation........................................................................................54Appendix B: Interviewer’s Manual............................................................................................................55Appendix C: Supervisor’s Manual.............................................................................................................56Appendix D: Review Exercise (without answers)........................................................................................57Appendix E: Review Exercise (with answers).............................................................................................58Appendix F: Exercise to Minimize Non-Responses (without answers)..........................................................59Appendix G: Exercise to Minimize Non-Responses (with answers)..............................................................60Appendix H: Interviewers’ Debriefing Questionnaire..................................................................................61

Preface

The project “Common Framework for a Literacy Survey” was executed by the Caribbean Community (CARICOM) Secretariat under funding provided by the Inter-American Development Bank (IDB) Regional Public Goods Facility and was intended to design a common approach to the measurement of literacy in countries. This common framework is built upon international methodologies and fundamentally the International Survey of Reading Skills (ISRS) that enable reliable measurement of literacy than what presently exists in the Region.

The literacy assessment is designed to measure functional literacy. In other words, it will determine an individual’s literacy level by employing a series of questions designed to demonstrate the use of their literacy skills. This involves two steps – the objective testing of an adult’s skill level and the application of a proficiency standard that defines the level of mastery achieved. The assessment measures the proficiency of respondents on three continuous literacy scales - prose, document and numeracy. In addition it will collect information on reading component skills. Component skills are thought to be the building blocks upon which the emergence of reading fluency is based. Information on the reading component skills will be collected from people at the lower end of the literacy scale only. The testing phase is preceded by a selection phase which includes the administering of a Background or Household questionnaire and post the selection of the respondent from the specific household an initial pre-assessment is undertaken through a filter test booklet to determine what type of assessment should be undertaken in the testing phase.

A consultant, Mr. Scott Murray of Canada was hired to undertake the provision of services on this project. The CARICOM Secretariat (including Regional Statistics and Human and Social Development Directorate) and the CARICOM Advisory Group on Statistics (AGS) were instrumental in the execution of the project throughout all phases. In addition, there was participation by Member States and some Associate Members relative to the technical rollout of the instruments and documents.

This training Guide is aimed at providing <<country undertaking a Literacy Survey>> with guidelines that can enable the effective training of interviewers and other field staff relative to the conduct of a literacy survey as recommended under the IDB-funded CARICOM project.

The Secretariat is indebted to the Consultant, Scott Murray, for his inputs and guidance as well as to the AGS and representatives from MS/AMS

How to Use the Training Guide

General Instructions

This Training Guide will help Trainers train Interviewers to conduct PAPI (Paper and Pencil Interviews) for the <<Country Name>> Literacy Survey.

This Guide provides verbatim text to be used when conducting training for Interviewers. In order to ensure that the context and format are understood, Trainers must review this Guide in advance of the training. This Guide must be followed closely to ensure that ALL the survey materials are covered.

Mock Interview Instructions

For the Mock Interviews

Trainees are required to answer the questionnaires based on the following:

o Summary profile of hypothetical households and

o the information relative to the questionnaires, booklets and exercises.

Two trainees will volunteer to act out the interview- One as the respondent, the other as the interviewer.

The trainees will read aloud the questions in the survey instruments, i.e., questionnaire, booklet, exercise. These are printed in bold.

The answer that the trainer will give are printed in regular text and preceded by a R:

Any relevant comments (information) the trainer must give will be in regular text.

Refer to the entries highlighted in red and enclosed in <<brackets>> ONLY if the trainees are experiencing a problem answering the questions.

Try not to offer more information in the mock interview than provided as this may result in inconsistencies or problems in the mock interview.

Classroom Training Procedures and TechniquesInstructions

1. Before starting your training session, meet with your co-trainers and observers (if any) to explain what you expect them to do. Make sure they know:

How you will proceed during the training; How much involvement you want on their part; Who you want to help the interviewers during the mock interviews; and How you want the interviewers to be helped.

2. Take a few minutes before the training to prepare your material.

3. If the trainee asks a question on a topic that will be covered later in the training, provide a brief answer and state that you will be covering the subject later. Avoid lengthy discussions, since they can cause confusion.

4. Be approachable. Ensure that the trainees feel they can come to you for assistance.

5. If a trainee asks a question you cannot answer, ask one of the co-trainers or observers to provide the answers if you think they might know it. Otherwise, take a note of the question and provide an answer as soon as possible.

6. Provide encouragement and keep the training session positive. Positive reinforcement is the best teaching method. Notice and comment on effort and progress. Be aware that the volume of information that trainees are being asked to absorb can be overwhelming.

7. Provide stretch breaks if you feel they are needed.

8. Be relaxed in your delivery. When possible, don’t hesitate to get up and walk around while instructing. Take several pages of the text with you. A change of pace helps the learning process.

9. If the mock interview is very long, ask various trainees to take turns role playing.

10. If you feel that trainees have not fully understood a part of the interview use another practice case, if time permits, to demonstrate areas of weaknesses.

<<Country Name>> Literacy Survey Training Guide

Supplies Required for Training

Before you begin your training session, make sure you have the following supplies.

For the trainer

PC viewer with adapter and connector Laptop computer loaded with PPT presentations Overhead projector

Training Agenda Training Evaluation Training Guide + Mock Interviews Interviewer Home Study Package – Interviewer’s Manual, Review Questions (with answers) and

Exercise to Minimize Non-response (with answers)

Administration Guide for Interviewers Assignment Control List (ACL) Background Questionnaire (BQ) Response Card Carrying Bag – 2B pencils, erasers, pencil sharpeners, tape recorder, cassettes, labels for cassettes,

timer Interviewer’s Debriefing Questionnaire Interviewer’s Manual Introductory Letter Notice of Visit Numeracy Toolkit – calculator, photo, ruler Materials Return List PPVT Notebook – Shortened Version Procedure’s Manual Reading Exercise Cards (6) Reference Card Respondent Envelope containing:

o Background Questionnaire (BQ)o Change of Address Formo Digit Span Forward – Interviewer’s Recording Sheeto Digit Span Backward – Interviewer’s Recording Sheeto Filter Bookleto Filter Scoring Sheeto Interviewer Observation Noteo Locator and Main Bookleto Non-Interview Reporto PPVT – Interviewer’s Recording Sheeto Respondent Envelope Checklist

Transmittal Form


For each trainee Training Agenda Training Evaluation Name Card Writing Pad/Post-it Pad Pencil

Each trainee should also bring

Administration Guide for Interviewers BQ Response Card Home Study Package

o Exercise to Minimize Non-Response (completed)o Interviewer’s Manualo Review Questions (completed)

Interviewer’s Debriefing Questionnaire Introductory Letter Notice of Visit Materials Return Form PPVT Notebook – Shortened Version Reading Exercise Cards (6) Reference Card Respondent Envelope containing:

o Background Questionnaire (BQ)o Change of Addresso Digit Span Forward – Interviewer’s Recording Sheeto Digit Span Backward – Interviewer’s Recording Sheeto Filter Bookleto Filter Scoring Sheeto Interview Observation Noteo Locator and Main Bookleto Non-Interview Reporto PPVT – Interviewer’s Recording Sheeto Respondent Envelope Checklisto Spelling Answer Sheet

Transmittal Form


Welcome and Introductions

Good morning and welcome to the Literacy Survey Training. Over the next 5 days we will be training you to conduct the Literacy Survey.

Introduce yourself. Explain your role within the project team.

Let your co-trainer or observers introduce themselves.

Let the trainees give their name, where they are from, and if they worked on other surveys.

You can invent your own icebreaker activity. The activity should not last longer than 10 minutes.

Tell us what you enjoy reading, where you find your reading material, and why you enjoy reading that specific material, i.e. I enjoy reading the home section of the newspaper because I am always looking for a new home.

Administration

Before we get started, I’d like to mention some administration things.

Describe the location of washrooms, cafeteria and emergency exits.

Schedule

We will do our best to follow the following schedule

Start - 9:00

Break - 10:00

Lunch - 12:00

End - 4:00

General

All the information that we cover during training can be found in the Interviewer’s Manual and the Administration Guide for Interviewers.

Comments/ Questions

Are there any questions before we get started?


Training Agenda

See Appendix A for powerpoint presentation

Day 1 (Slide 2)

Introduction/Presentations/ Ice Breaker

Objectives of the Training Session

Objectives of the Literacy Survey

Survey Overview

Survey Flow

Survey Materials and Supplies

Interview Steps

Review Exercise

Day 2 (Slide 3)

Review of Day 1 Training

Mock Interviewso Contacto Background Questionnaire (BQ)o Filter and Main Booklets

Exercise to Minimize Non-Response

Review Exercise

Scoring Exercise

Day 3 (Slide4)


Mock Interviewo Contacto Background Questionnaire (BQ)o Filter + Locator Bookletso Reading Exercises


Review Exercise

Scoring Exercise


Day 4 (Slide 5)


Mock Interview o Contacto Background Questionnaire (BQ)o Filter and Locator Bookleto Reading Exercises


Review Exercise

Scoring Exercise

Day 5 (Slide 6)


Mock Interview o Contacto Background Questionnaire (BQ)o Filter and Locator Bookleto Reading Exercises


Review Exercise

Scoring Exercise

After the Interview

Interviewer’s Debriefing Questionnaire

Conclusion and Evaluation

Administration

Question/ Comments

Are there any questions about the agenda?


Client Presentation

Client Presentation

Introductions - Survey manager, clients, guest speakers, visitors.

Question/Comments

Are there any questions for any of the presenters?

Thank the speaker.


Home Study

Home Study Package

Are there any questions or comments regarding the Home Study Package?

Interviewer’s Manual Review Exercise Exercise to Minimize Non-response

Set-up

I would like you to take out all the material you received as part of your home study, now. We will be referring to these documents throughout the training today.


Objectives of the Training Session

Objectives of Training SessionPPT 7

1. To understand the <<Country Name>> Literacy Survey

M … Why are we conducting the survey?

To gain information on the distribution of literacy skills and areas where interventions in literacy education would be most useful.

M … Who are we interviewing?

Usual residents aged 16 to 65.

M … Where are we conducting this survey?

Several communities – we hope to collect a good cross section of individuals in terms of age, gender and education.

M … When are we conducting the survey?

<<Collection Start Date>> to <<Collection End Date>>

M … How are we conducting the survey – what method?

Paper and Pencil Interview (PAPI) – personal interview.

2. To become familiar with the survey’s definitions and concepts

M … What is Literacy?

The information processing skills necessary to use printed material commonly encountered at work, at home and in the community.

M … Why do we collect Background Information from the respondent?

The Background Questionnaire was designed to collect data on the factors thought to be associated with reading skills.


Objectives of Training Session, continuedPPT 7

3. To become familiar with the sections of the survey

M … What are the sections of the survey?

Contact/Entry, Household Questionnaire, Background Questionnaire (BQ), Filter Booklet, Locator or Main Booklet, Reading Exercises, Exit.

M … Do we administer the Reading Exercises to all respondents?

No – only respondents who have scored 05 or less, and 06 to 15 in the Filter Booklet are administered the Reading Exercises.

4. To learn how to conduct interviews

M … How do we make initial contact with the respondent?

Personal interview

M … What are some of the steps in conducting an interview?

Administering booklets, scoring answers, documenting results

5. To learn how to minimize non-response

M … How do we minimize non-response

o Know the survey

o Review the Exercise to Minimize Non-Response for questions and answers, and

o Review the Interviewer’s Manual – How to React to Difficult Situations

Our goal is to provide you with the information, materials, and training you will need to successfully conduct interviews.

Question/ Comments

Is there anything else that you would like to get out of this training session?


Objectives of the <<Country Name>> Literacy Survey

Objectives of <<Country Name>> Literacy Survey, PPT 8, 9

The objectives of the <<Country Name>> Literacy Survey are to:

Help the Government of <<Country Name>> to objectively diagnose the different levels of literacy among adults aged 16 to 65;

Find practical solutions and suggestions to reduce illiteracy in all it’s forms and eventually to eliminate it completely;

Document how skill influences labour market, health, educational and social success;

Profile the skills of youth aged 16 to 25. This will shed light on the quality of recent school leavers both graduates and leavers;

Provide literacy profiles for small areas for program planning and delivery;

Raise the levels of literacy of the population in order to increase the social, health, economic and living levels and to eliminate illiteracy in all its forms.

In Class Exercise 1 Paraphrase in your own words the objective of the <<Country Name>> Literacy Survey.

Refer to the <<Country Name>> Literacy Survey objectives in the Interviewer’s Manual and any other material you may have that may be helpful.

Try to keep your answer as brief as possible Time – 10 minutes Ask each trainee to answer aloud.

Comments/ Questions

Are there any questions about the objectives of the survey?


Overview of <<Country Name>> Literacy Survey

PartnershipPPT 10

M … Who are the partners in this survey ?

<<Partners>>

UsePPT 11

M … What are the primary uses of the data?

to assist in developing skill enhancement policies and programs, and

to identify those individuals at risk because of low literacy skills so that programmes can better targeted to improving their skills.

UsersPPT 12

M … Who are the primary users of the data?

policymakers o to plan national programs aimed at improving literacy skills

(including identifying best practices) through providing them with information about the distribution of literacy and numeracy skills which can then assist in developing skill enhancement policies and programmes;

local/community level officials o to enhance adult education and other literacy programs;

business and educational organizationso to better understand the skills of the labour force and plan

programs to address skill gaps; Social/welfare and related agencies, civil society

o to assist in identifying those individuals/households at risk because of low literacy skills so that programs can be better targeted to improving their skills;

researchers and other users o to inform the public about similarities and differences of literacy

of the adult populations across countries.


Target PopulationPPT 13

Sample Distribution PPT 14

M … Who is the target population?

The target population comprises usual residents, aged 16 to 65, who are living in private housing units at the time of the survey.

M … Who is excluded?

Residents of Institutions - prisons, hospitals, residents of senior homes and hospices, etc.

Response Rate/SamplePPT 15

M … What is the response rate?

85% complete cases

M … Where does the sample come from?

<<Sample Frame to be included here>>

Collection MethodPPT 15

M … What is the method of data collection of <<Country Name>> Literacy Survey?

Paper and Pencil Interviewing (PAPI) method.

M … How do we make initial contact?

Initial contact will be attempted by personal visit.

M … Do we allow proxy interviews?

No. The Filter, Locator, Main Booklet and Reading Exercises can not be completed with the help of another household member.

M … Can an interpreter be used for this survey?

No. The Filter, Locator, Main Booklet and Reading Exercises can not be completed with the help of an interpreter.

Continued on next page


Collection PeriodPPT 15

M … When does data collection begin and end?

<<Country Name>> Literacy Survey is scheduled to begin <<Collection Start Date>> and will be in the field until <<Collection End Date>>.

Comments/ Questions

Are there any questions about the overview of the survey?


Filter Booklet (21 questions)

Locator Booklet(49 questions)

Main Booklet(57 questions)

Reading Exercises- PPVT- RAN- TOWRE- Digit Span- Spelling

Exit

Filter Booklet Score 05 or less

Filter Booklet Score 06 to 15

Filter Booklet Score 16 or more

Background Questionnaire (BQ)

Contact/Entry (Household Questionnaire)

Survey Flow

Survey FlowPPT 16, 17

All respondents will be administered the Contact/Entry (Household Questionnaire), Background Questionnaire (BQ), the Filter Booklet, and the Exit.

The Locator Booklet will be administered to respondents who score 06 to 15 in the Filter Booklet. The Main Booklet will be administered to respondents who score 16 or more in the Filter Booklet. The Locator and Main Booklet are not administered to respondents who score 05 or less in the Filter Booklet.

The Reading Exercises are administered to respondents who score 05 or less, or 06 to 15 in the Filter Booklet. The Reading Exercises are not administered to respondents who score 16 or more.

Comments/ Questions

Are there any questions about the survey flow?


Survey Sections

ContactPPT 18

The Initial Contact will be done by personal visit.

M … What are the steps in the Initial Contact?

Introduce the interviewer Confirm and record the address and phone number of the selected

household Roster the household Select a household member to complete the interview using the Personal

Selection Grid, and Schedule an appointment to conduct a personal interview

M … What are the steps in the Entry?

Introduce the survey Provide information regarding the use and users of survey data Provide information regarding confidentiality, and Administer the household questions. <<inclusion of household questions

is optional>>

M … Where do you find the instructions for administering the Contact/Entry?

Special instructions to the interviewer, instructions to be read to the respondent are found in the Administration Guide for Interviewers.

M … What is the estimated time for Entry component?

The estimated time for the Entry is 10 minutes.


Background Questionnaire (BQ)PPT 19

M … Is the Background Questionnaire administered to all household members?

No, the BQ is administered to the selected respondent only.

M … How many sections are there in the BQ and what type of information does the modules ask?

There are 9 sections:

1 General Information

2 Linguistic Information

3 Parental Information

4 Labour Force Activity

5 Literacy and Numeracy Practices at Work

6 Participation in Education and Learning

7 Literacy and Numeracy Practices Generally, Social Capital and Well Being

8 ICTL – Information and Communication Technology Literacy

9 Household Information and Income

M … Where do you find the instructions for administering the Background Questions?

Special instructions to the interviewer and instructions to be read to the respondent are found in the Administration Guide for Interviewers.

M … What is the estimated time for the Background Questions?

The estimate time for the Background Questionnaire (BQ) is 30 minutes.



Filter BookletPPT 20

M … How is the Filter Booklet administered?

All selected respondents complete this booklet (PAPI). At the same time, the interviewer scores each item using the Filter

Scoring Sheet. The scoring must appear transparent to the respondent.

M … Where do you find the instructions for administering the Filter?


M … What is the estimated time to complete the Filter Booklet?

The estimate time to complete the Filter Booklet is 12 minutes.

Locator or Main BookletPPT 21

M … How is the booklet selected for each respondent?

The Locator booklet will be administered to respondents who score 06 to 15 in the Filter Booklet.

The Main booklet will be administered to respondents who score 16 or more in the Filter Booklet.

The Locator and Main booklet will not be administered to respondents who score 05 or less in the Filter Booklet.

M … Where do you find the instructions to be read to the respondent?

Special instructions to the interviewer, instructions to be read to the respondent are found in the Administration Guide for Interviewers.

M … What is the estimated time to complete the Locator or Main Booklet?

The estimate time to complete the Locator or Main Booklet is 45 to 50 minutes.



Reading ExercisesPPT 22

M … How many Reading Exercises are there? Could you name them?

1. PPVT (Peabody Picture Vocabulary Test)2. RAN (Rapid Automized naming) 3. TOWRE (Test of Word Reading Efficiency) 4. Digit Span (2)5. Spelling

M … Where do you find the instructions to be read to the respondent?


M … What is the estimated time to complete the Reading Exercises?

The estimate time to complete the Reading Exercises is 40 minutes.

PPVTPPT 23

M … How is the PPVT Administered?

Four different pictures are presented to the respondent on each page of the Picture Vocabulary notebook.

As you show one notebook page, you will read a word that describes one of the pictures.

The respondent must indicate which picture matches the word. You will record the respondent’s responses on the PPVT – Interviewer’s

Recording Sheet. Eight incorrect responses and the exercise is over.

RANPPT 24

M … How is the RAN Administered?

RAN is administered using the tape recorder. The respondent is asked to read as rapidly as possible two lists of

alphabet letters from the Reading Exercise Cards. The response is recorded on the tape recorder and timed (45 seconds).

TOWREPPT 25

M … How is the TOWRE Administered?

TOWRE is administered using the tape recorder. The respondent is asked to read as rapidly as possible four lists of words

from the Reading Exercise Cards. The response is recorded on the tape recorder and timed (45 seconds).



Digit Span Forward/BackwardPPT 26

M … How is the Digit Span Forward/Backward administered?

The Digit Span Forward/Backward is administered using the tape recorder.

The respondent is asked to complete 2 tasks Repeat sets of numbers forward, ie. 1-3-5, repeats 1-3-5 Repeat sets of numbers backwards, ie. 1-3-5, repeats 5-3-1

You will record the respondent’s answers on the Digit Span Forward/Backward – Interviewer’s Recording Sheet.

2 incorrect responses within a trial and the exercise is over. The response is recorded on the tape recorder and timed (60 seconds).

SpellingPPT 27

M … How is the Spelling Exercise administered?

You will read a word to the respondent, and then read a sentence containing the word.

You will repeat the word and then ask the respondent to write the word on the Spelling Answer Sheet.

ExitPPT 28

This is the final section of the personal interview. Once the above sections have been completed you will enter and assign a Final Outcome Code to the case and it is ready to be sent to your Supervisor/<<Survey Executing Office>>.

Comments/ Questions

Are there any questions about the Survey Sections?


Material and Supplies

General Bulk material and supplies you will receive will be used:

When contacting selected respondents, When conducting interviews, and When documenting and sending survey material.

Below is the full list of supplies.

Let’s discuss some of the supplies now.

Supply listPPT 29, 30

You will use the following items when contacting and conducting interviews with the selected respondent:

Administration Guide for Interviewers Assignment Control List (ACL) Background Questionnaire (BQ) Response Card Calendar Interviewer bag: 2B pencils, erasers, pencil sharpeners Interviewer’s Debriefing Questionnaire Introductory letter Notice of Visit Numeracy Toolkit – Calculator, Photo, Ruler. Personal Selection Grid/Sample Quota Sheet PPVT Notebook – Shortened Version Reading Exercise Cards (6) Reference Card Respondent Envelope containing the following:

o Background Questionnaireo Change of Address Formo Digit Span Forward/Backward – Interviewer’s Recording Sheeto Filter Bookleto Filter Scoring Sheeto Household Questionnaireo Interview Observation Noteo Locator or Main Bookleto Non-Interview Reporto PPVT – Interviewer’s Recording Sheeto Respondent Envelope Checklisto Spelling Answer Sheet

Tape recorder, cassettes, labels for cassettes, spare batteries, timer


Step-by-step Instructions for the Administration of the Assessment Booklets for Interviewers

M … What is the purpose of the Step-by-step Instructions for the Administration of the Assessment Booklets for Interviewers?

The Step-by-step Instructions for the Administration of the Assessment Booklets for Interviewers is used by the Interviewer at every interview. It provides detailed instructions on how to administer all questionnaires, booklets and exercises, as well as instructions that you must read to the respondent. You must carry it with you at all times.

Assignment Control List (ACL)

M … What is the purpose of the Assignment Control List (ACL)?

The Assignment Control List (ACL) is used by Interviewers to manage cases. The information on this report will be summarized on the Progress and Cost Report and reported to the Supervisor every Monday.

The following information will be recorded on the Assignment Control List: Respondent ID Selected Household Address and Phone Number Contact Outcome Code Final Outcome Code Transmittal # Date sent to Supervisor/<<Survey Executing Office>>, and Any comments

Background Questionnaire (BQ) Response Card

M … What is the purpose of the Background Questionnaire (BQ) Response Card?

The Background Questionnaire (BQ) Response Card is used by the Interviewer when administering the Background Questionnaire (BQ). It contains answer categories that are used for a series of questions.

Calendar M … What is the purpose of the Calendar?

The Calendar is used by the Interviewer when administering the Background Questionnaire (BQ). It is used as a reference document when referring to activities in the past.

Change of Address Form

M … What is the purpose of the Change of Address Form?

This Change of Address Form is used by the Interviewer to record a change of address if the selected respondent changes address during the collection period.



Digit Span Forward /Backward – Interviewer’s Recording Sheet

M … What is the purpose of the Digit Span Forward/Backward – Interviewer’s Recording Sheet?

The Digit Span Forward and Backward – Interviewer’s Recording Sheet is used by the Interviewer to record the respondent’s answers to the Digit Span Forward/Backward exercises and indicate incorrect responses.

M … How many incorrect responses before the exercise is over?

2 incorrect responses within a trial and the exercise is over.

Filter Scoring Sheet

M … What is the purpose of the Filter Scoring Sheet?

The Filter Scoring Sheet is used by the Interviewer to record/score the respondent’s answers to the Filter Booklet.

Household Questionnaire

M … What is the purpose of the Household Questionnaire?

The Household Questionnaire is used by the Interviewer during the Contact /Entry Section of the survey. It is used to:

record all attempts to contact the selected household/respondent, roster all household members of the selected household, select one person from the household for an interview, record the date, time, outcome codes of the interview, and ask a series of household questions.

Interview Observation Note

M … What is the purpose of the Interview Observation Note?

The Interview Observation Note is used by the Interviewer to report any difficulties encountered while administering the interview.

Interviewer’s Debriefing Questionnaire

M … What is the purpose of the Debriefing Questionnaire?

The Debriefing Questionnaire is completed by the Interviewer. The questionnaire asks about your experiences with the survey and any problems you may have encountered while conducting interviews. Your answers to this questionnaire will be used to improve survey procedures, manuals, and training.



Introductory Letter

M … What is the purpose of the Introductory Letter?

<<Survey Executing Office>> will prepare Introductory letters. Interviewers will deliver the Introductory Letter during the first home visit. The purpose of the letter is to introduce the household/respondent to the survey.

Materials Return Form

M … What is the purpose of the Materials Return Form?

The Materials Return Form is used by Interviewers when returning unused survey documents and material to <<Survey Executing Office>> at the end of collection.

Non-Interview Report

M … What is the purpose of the Non-Interview Report?

The Non-Interview Report is used by the Interviewer, Supervisor and/or <<Survey Executing Office>> to document (explain) any non-interview case as well as any follow up action taken.

Notice of Visit M … What is the purpose of the Notice of Visit?

The Notice of Visit is used by the Interviewer to notify a respondent that a visit has been attempted and that the Interviewer will return at a later date.

Numeracy Toolkit M … What is included in the Numeracy Toolkit?

Calculator – May be used by the selected respondent to accomplish certain tasks in the Locator or Main Booklet.

Photo of 24 People - May be used by the selected respondent to accomplish certain tasks in the Locator or Main Booklet.

Ruler – May be used by the selected respondent to accomplish certain tasks in the Locator or Main Booklet.

M … When is the Numeracy Toolkit made available to respondents?

The Numeracy Toolkit is made available to respondents during the administration of the Filter, Locator and/or Main Booklet.



Personal Selection Grid/Sample Quota Sheet

M … What is the purpose of the Personal Selection Grid/Sample Quota Sheet?

The Personal Selection Grid/Sample Quota Sheet is used by the Interview when selecting a respondent at the household. It shows the interviewer how many cases, by age, sex and education are required.

PPVT Notebook – Shortened Version

M … What is the purpose of the PPVT Notebook – Shortened Version?

The PPVT (Peabody Picture Vocabulary Test) Notebook – shortened version is an instrument used by the Interviewer to administer the PPVT exercise to the selected respondent.

PPVT Recording Sheet

M … What is the purpose of the PPVT Recording Sheet?

The PPVT – Interviewer’s Recording Sheet is used by the Interviewer to record the selected respondent’s answers to the PPVT exercise, and indicate incorrect responses.

M … How many incorrect responses before the exercise is over?

8 incorrect responses and the exercise is over.

Progress and Cost Report

M … What is the purpose of the Progress and Cost Report?

The Progress and Cost Report is used by the Interviewer/Supervisor/<<Survey Executing Office>> to record the progress and cost for all cases. The Interviewer will complete this report every Monday and forward it to the Supervisor.

Reference Card M … What is the purpose of the Reference Card?

The Reference Card is used by the Interviewer as a reference document. It contains important facts about the survey.

Reading Exercise Cards (6)

M … What is the purpose of the Reading Exercise?

The Reading Exercise Cards (6) are used by the Interviewer to administer the following Reading Exercises to the selected respondent. 1. RAN (Rapid Automatized Naming) – 2 cards2. TOWRE (Task of Word Reading Efficiency) – 4 cards



Respondent Envelope

M … What is the purpose of the Respondent Envelope?

Each case requires a Respondent Envelope. The envelope (pre-packaged in <<Survey Executing Office>>) contains the following material: Background Questionnaire (BQ) Change of Address Form Digit Span Forward – Interviewer’s Recording Sheet Digit Span Backward – Interviewer’s Recording Sheet Filter Booklet Filter Scoring Sheet Interviewer Observation Note Locator Booklet or Main Booklet Non-Interview Report PPVT – Interviewer’s Recording Sheet Respondent Envelope Checklist Spelling Answer Sheet

Respondent Envelope Checklist

M … What is the purpose of the Respondent Envelope Checklist?

The Respondent Envelope Checklist is used by the Interviewers, Supervisors and <<Survey Executing Office>> to record/account for all contents of the Respondent Envelope.

Spelling Answer Sheet

M … What is the purpose of the Spelling Answer Sheet?

The Spelling Answer Sheet is used by the selected respondent to record his/her answers to the Spelling Exercise.

Tape recorder, cassettes, labels, and timer

M … What is the purpose of the tape recorder, cassettes, labels and timer?

The tape recorder and timer are used by the Interviewer when administering some of the Reading Exercises. You will receive a supply of cassettes and labels, as well as spare batteries. The tape recorder must be stored carefully so as not to damage it.

Transmittal Form M … What is the purpose of the Transmittal Form?

The Transmittal Form is used by the Interviewer and Supervisor every time completed questionnaires or survey material are delivered/sent to <<Survey Executing Office>>.



Step-by-Step Instructions for the Administration of the Assessment Booklets for Interviewers


Introduction and OverviewPPT 31

M … Describe the six sections of the Step-by-step Instructions for the Administration of the Assessment Booklets for Interviewers.

Contact/Entry (Household Questionnaire) Background Questionnaire (BQ) Filter Booklet Locator Booklet or Main Booklet Reading Exercises, and ExitM … Do you need to use your Step-by-step Instructions for the Administration of the Assessment Booklets in each interview?YES - Always remember to bring it into the selected household.

This Guide contains instructions for you, the interviewer, to use in administering the following tasks: Contact/Entry (Household Questionnaire), Background Questions, Filter Booklet, Locator or Main Booklet, Reading Exercises, and Exit.

It is important that you follow these instructions so that the administration of the tasks is standardized.

General Formatting Guidelines

Points to remember when using the Step-by-step Instructions for the Administration of the Assessment Booklets for Interviewers

All text to be read to the respondent is in bold. The ‘book’ graphic-

- Text to be read to the respondent. - instructions for the interviewer in regular text

The ‘pencil’ graphic indicates procedures for the Interviewer. The ‘tape recorder’ graphic indicates the use of the tape recorder. The ‘timer’ graphic indicates the use of the timer.

Flow of the Survey Instrument Response Recorded by:

Scored by:

1. PPVT Interviewer Interviewer

2. RAN Tape recorded << Survey Executing Agency >>

3. TOWRE Tape recorded << Survey Executing Agency >>

4. Digit Span Tape recorded Interviewer

5. Spelling Respondent Interviewer


Interview Steps

Initial Contact

Step 1:PPT 32

M … What is the first step?

Administer the Initial Contact – roster and select respondent.

M … Could you explain this step?

The interviewer is required to contact the selected household in person, roster the household, select a respondent and schedule an appointment to conduct a personal interview with the selected respondent

Refer to the Administration Guide for Interviewers

Entry

Step 2:PPT 32

M … What is the next step?

Administer the Entry (selected respondent).


The interviewer conducts a personal interview with the selected respondent.

Refer to the Administration Guide for Interviewers.

Background Questions (BQ)

Step 3:PPT 32


Administer the Background Questionnaire (BQ).


Administer the Background Questionnaire (BQ) to the selected respondent as indicated in the Administration Guide for Interviewers.


Filter Booklet

Step 4:PPT 32


Administer the Filter Booklet.


Read the Filter Booklet instructions to the selected respondent and have him/her complete the Filter Booklet as indicated in the Administration Guide for Interviewers.

Score the Filter Booklet

Step 5:PPT 33


Score the Filter Booklet.


Score the Filter Booklet as indicated in the Administration Guide for Interviewers.

Locator or the Main Booklet

Step 6:PPT 33


Administer the Locator Booklet.


Read Locator or Main Booklet instructions to the respondent and have them complete the Locator or Main Booklet as indicated in the Administration Guide for Interviewers.


PPVT

Step 7:PPT 33


Administer the PPVT Exercise.


Read the PPVT instructions to the selected respondent as indicated in the Administration Guide for Interviewers.

Record the PPVT

Step 8:PPT 33


Record the PPVT Exercise responses ,


Record the PPVT as indicated in the Administration Guide for Interviewers.

8 incorrect responses and the exercise is over.

RAN

Step 9:PPT 34


Administer the RAN Exercise.


Read RAN instructions to the selected respondent as indicated in the Administration Guide for Interviewers.

This exercise is tape recorded and timed. The respondent has 45 seconds to complete this exercise.


TOWRE

Step 10:PPT 34


Administer the TOWRE Exercise.


Read TOWRE instructions to the selected respondent as indicated in the Administration Gide for Interviewers.


Digit Span Forward/Backward

Step 11:PPT 34


Administer the Digit Span Forward/Backward.


Read DIGIT SPAN FORWARD/BACKWARD instructions to the selected respondent as indicated in the Administration Gide for Interviewers.


Record the Digit Span Forward/Backward

Step 12:PPT 34


Record the Digit Span Forward/Backward responses.


Record the Digit Span Forward/Backward as indicated in the Administration Guide for Interviewers.

2 incorrect responses within a trial and the exercise is over.


Spelling

Step 13:PPT 35


Administer the Spelling Exercise.


Read Spelling instructions to the selected respondent as indicated in the Administration Guide for Interviewers.

Exit

Step 14:PPT 35


Administer the Exit.


Assign a Final Outcome Code to the Case Thanks the respondent for his/her time and cooperation.

Review Work for Completeness, Accuracy and Legibility

Step 15:PPT 35


Review Work for Completeness, Accuracy and Legibility.


Review the Respondent Envelope Checklist and ensure all documents are complete, legible and accounted for.

Ensure the Respondent ID has been recorded on each document inside the Respondent Envelope,

Complete the Interview Observation Note – if applicable Complete the Non-Interview Report – if applicable Place all survey documents in the Respondent Envelope


Final Status Code

Step 16:PPT 35


Assign a Final Status Code


Assign a Final Outcome Code to the case. Update the Assignment Control List Update the Progress and Cost Report and inform your Supervisor. Thank the Respondent for his/her time and cooperation.

Return documents to the <<Survey Executing Office>>

Step 17:PPT 36


Return documents to the << Survey Executing Office >> of <<Country Name>>


Send all completed case to <<Survey Executing Office>> every Monday. The first five cases should be sent to your Supervisor to ensure that proper procedures are being followed.


Exercises

Review Exercise Review Exercise

Review the answers to the Review Questions with the Interviewers. Discuss problem areas Distribute the copy of Review Exercise (with answers)

You may administer the review of the Review Exercise all at once or you may split it up over the three days of training.

Exercise to Minimize Non Response


Review the answers to the Exercise to Minimize Non-response with the Interviewers.

Practice difficult situations. Distribute copy of Exercise to Minimize Non-Response (with answers).

You may administer the review of the Exercise to Minimize all at once or you may incorporate it into Mock Interviews.

Outcome Code Exercise

Outcome Code Exercise

Refer to the Interviewer’s Manual and complete the Record of Visits/Calls for Mock 1, 2 and 3.


In Class Exercises

In Class Exercise 2

Interviewer Introduction

Allow the trainees 10 minutes to review the Interviewer Introduction in the Interviewer’s Manual.

Then ask each trainee to present the introduction as they were making first contact with a household.

In Class Exercise 3

Contact/Entry Component

The purpose of this exercise is to practice the completion of the Contact/Entry component.

Divide the class into pairs.

Ask each Interviewer in the pair to alternate playing the role of Interviewer and Contact Person.

Use the Exercise to Minimize Non-Response to ‘sell the survey’.

In Class Exercise 4


The purpose of this exercise is to familiarize the Interviewer with Background Questionnaire (BQ) concepts and definitions

Discuss with the group the following concepts and definitions.

General

o Full-time equivalence, remedial help, schooling completed

Parental Information

o Guardian

Linguistic information

o Language first learned in childhood and still understands.

Labour Force Activity Information

o Employed, Temporary lay-off, Looking for work, Main Job

Participation n Education and Learning

o Participation in a programme of studies

ICTL o Typical month.


In Class Exercise 5

Filter Booklet


Ask the class to provide, in order, the step by step procedures that must be followed after the completion of the Background Questionnaire (BQ), to administer the Filter Booklet to a respondent.

Allow the class 10 minutes to review the administration instruction for the Filter Booklet in the Interviewer’s Manual/Administration Guide.

After 10 minutes, solicit answers from the class for the list of steps, in order, and make a list on the flipchart or white board as they provide the answers.

Instruct each pair to alternate playing the role of Interviewer and respondent.

The Interviewer role-player should practice reading aloud the Filter Booklet Introduction and all Filter questions. As well, the Interviewer role-player must score the respondent answers to the Filter questions as the respondent records them.

In Class Exercise 6

Locator and Main Booklet


Ask the class to provide, in order, the step by step procedures that must be followed after the completion of the Filter Booklet to administer the Locator or Main Booklet.

Allow the class 10 minutes to review the administration instruction for the Locator or Main Booklet in the Interviewer’s Manual/Administration Guide.

After 10 minutes, solicit answers from the class for the list of steps, in order and make a list on the flipchart or white board as they provide the answers.


The Interviewer role-player should practice reading aloud the Locator or Main Booklet Introduction and Instructions.


In Class Exercise 7

Reading Exercises


Ask the class to provide, in order, the step by step procedures that must be followed after the completion of the Main/Locator, to administer the Reading Exercises to a respondent.

Allow the class 15 minutes to review the administration instruction for the Reading Exercises in the Interviewer’s Manual/Administration Guide.

After 15 minutes, solicit answers from the class for the list of steps, in order, and make a list on the flipchart or white board as they provide the answers.


The Interviewer role-player should practice reading aloud the Reading Exercise Introduction.

As well, the Interviewer role-player must score the respondent answers to the PPVT and Digit Span Forward/Backward questions as the respondent repeats/answers them.


Mock Interviews - Introduction

General 1) Two interviewers will volunteer to act out the interview. One as the interview one as the respondent.

2) The mock interview summary profile has been produced for the selected respondent.

3) The interviewer will be provided with the Respondent Envelope.


Mock Interview #1

Mock #1 We will now do Mock Interview #1

Contact M … How do we initially make contact with the selected household?

Initial contact is by person visit.

Description M … Would you describe the case to me:

The respondent ID 13501 Address: <<Mock 1 Address>> The telephone number is: 758-285-3057 The selected respondent is: Sherma Beroo-Joseph

Sherma is a reluctant respondent – you have to sell the survey.

Selling the Survey

M … How do we sell the survey?

Know the objectives, contents, users, etc. of the <<Country Name>> Literacy Survey.

Be prepared to answer general as well as specific questions regarding your Statistical Agency as well as the survey.

Contact as many of your cases within the first week of data collection so that you have time to identify any non-response cases.

Practice convincing reluctant respondents to participate.

Ensure that the respondent has the Introductory Letter that explains the survey.

If the respondent states that he/she is too busy, look at alternatives.

Emphasize the important of their participation.

If you encounter a respondent who adamantly refuses, try to obtain as much information about the household as you can. Your supervisor will contact the household and try to convert the refusal.


Mock Interview #1, Continued


Below are the responses to be used when administering the Household Questionnaire

S2 No one away from the household attending school, visiting, … S3 Yes there are other persons living at the household.H2 Wood & ConcreteH3 Main type of toilet facilities used by household – W.C. (flush toilet) linked to

Septic tankH4 Owned (without mortgage)H5 3 Rooms – 2 BedroomsH6 Household owns the following:

Television set Refrigerator Washing Machine Telephone – Cellular

Gas Stove Computer Internet Access

DVD Player Motor Vehicle Electric Iron


Below are the responses to be used when administering the Background Questionnaire (BQ)

This address reaches Sherma Beroo-Joseph – <<Mock 1 Address>>General Information Sherma was born August 19, 1978 and is married. Background Information: Sherma completed secondary education, completed a BSC and is currently working

on a Masters Degree.Linguistic Information: Sherma can speak English and Patois but mostly speaks English.Parental Information Sherma’s parents are both self employed. Her father has an incomplete primary

education and her mother completed secondary education.Labour Force Activity: Sherma is employed with the Government of <<Country Name>>.Literacy and Numeracy Practices at Work: Sherma is a Statistician. Her main responsibilities are data collection, analysis and

calculation of value added. Participation in Education and Learning: Sherma is presently pursuing a Masters Degree.Literacy and Numeracy Practices: Sherma reads a lot of newspapers, novels, magazines. ICTL: Sherma is always on the computer – playing games, doing research.Household Information and Income: Sherma’s household income is $6,000 monthly

Filter Booklet Sherma correctly answers all of the questions.


Main Booklet Sherma attempts all questions.


Mock Interview #2



Initial contact is by person visit.


The respondent ID 13502 Address is: <<Mock 2 Address>> Telephone number is: 758-453-8582 The selected respondent is: Mary Cecilia Alphonse

Mary has low level literacy skills – you have to convince her to continue during every step of the way.

Sensitivity Be sensitive to the literacy abilities of the respondent.

Recognize defense strategies and encourage respondents to either take part or continue.

Reinforce that there are no right or wrong answers

Present yourself in a non-threatening and non-judgmental way.





S2 No one away from the household attending school, visiting, travelling or in a hospital who usually live here.

S3 Yes – there are other persons living at the household.H2 Construction material of outer walls – PlywoodH3 Main type of toilet facilities used by household - Pit LatrineH4 Household is owned without mortgageH5 2 Rooms 1 BedroomH6 Household owns the following:

Television set Refrigerator Washing Machine Telephone – Landline

Telephone - Cellular Internet Access

Gas Stove

Computer DVD Player Electric Iron

Background Questionnaire


This address reaches: Mary – <<Mock 2 Address>> General Information : Mary was born December 4th, 1969 and is single. Background Information : Mary completed primary school education. Linguistic Information : Mary can speak English and Patois but mostly speaks patois. Parental Information : Mary’s parents are both retired farmers; they never attended

school. Labour Force Activity : Mary is working full time on her banana farm. Literacy and Numeracy Practices at Work : Mary record all transactions pertaining to

her farm. She measures the pesticide and counts her banana boxes. Participation in Education and Learning : Mary is taking part time courses in cake

making and decorating at the learning centre. Literacy and Numeracy Practices: Mary reads the newspaper sometimes. ICTL : In her spare time Mary plays games and reads her email on the computer. Household Information and Income: Mary’s household income is $2,000 monthly.

Filter Booklet Mary attempts the first 10 questions but wants to stop.

Locator BookletMary gets through the first 15 questions, but then finds it vey tough.

Reading Exercises

PPVT: 10 mistakes ***Digit Span Forward: fails at the 4th trailDigit S pan Backward: fails at the 3rd trail


Mock Interview #3



Initial contact with the selected respondent is by person visit.


The respondent ID 13503 Address is: <<Mock 3 Address>> Telephone number is: 758-717-7763 The selected respondent is: Mark St. Clair

Mark wants to know why you are doing everything, i.e. questionnaires, exercises, etc.





S2 No S3 No.H2 Concrete/Concrete BlocksH3 W.C. (flush toilet) linked to septic tank/soak-awayH4 Owned (without mortgage)H5 5 Rooms 2 BedroomsH6 Household owns the following:

Television set Refrigerator Washing Machine

Telephone – Cellular Stove

VCR Electric Iron

Background Questionnaire


This respondent wants to know why you are doing everything, ie. questions, exercises, etc.

This address reaches: Mark St. Clair as <<Mock 3 Address>> General Information : Mark was born on October 24, 1988 and is single with a

dependent child. Background Information : Mark completed secondary school education. Linguistic Information : Mark speaks English. Parental Information : Mark’s mother has completed primary school education and

works at a supermarket. Her father is dead. Labour Force Activity : Mark is unemployed and is looking for a job. Literacy and Numeracy Practices at Work : Unemployed Participation in Education and Learning : Mark is not taking and education and

training because she is looking for work and won’t know her schedule until she is back to work.

Literacy and Numeracy Practices: Mark reads magazines. ICTL : Mark is computer literate. Household Information and Income: Mark is not sure of the household income.

Filter Booklet Mark completes the filter booklet.

Locator Booklet

Mark attempts every question but is not able to answer all of them.

Reading Exercises

PPVT: 6 mistakesDigit Span Forward: 1 error at the 5th trial, 1 error at the 6th trial, 2 errors at

the 7th trialDigit S pan Backward: fails at the 4th trial


Mock Interview #4

Mock #4 This is an unscripted Mock Interview


After the Interview

Interview Observation Note PPT 37

M … When do you use an Interview Observation Note?

The Interview Observation Note is used by the interviewer to report difficulties administering any part of the interview.

M … Could you demonstrate to the class how you would go about completing the Interview Observation Note (using an unscripted Mock Interview and transparencies)

Non-Interview Report

M … When do you use a Non-Interview Report?

The Non-Interview Report is used by the Interviewer, Supervisor and or <<Survey Executing Office>> to explain any non-interview case and the follow-up action taken.

M … Could you demonstrate to the class how you would go about completing the Non-Interview Report (using an unscripted Mock Interview and transparencies)

Assignment Control List

Interviewer’s Progress and Cost Report

M … Could you demonstrate to the class how you would complete the Assignment Control List.

Use an unscripted Mock Interview and transparencies.

M … Could you demonstrate to the class how the information from the Assignment Control List (ACL) is transferred to the Interviewer’s Progress and Cost Report.


After the Interview, Continued


Before Transmittal of Documents

M … Before packaging the survey documents to send to your Supervisor/<<Survey Executing Office>> , what must you do:

1) Review all material Ensure the Respondent ID has been recorded on each document inside

the Respondent Envelope2) Complete all forms

Account for all contents of the Respondent Envelope3) Document Progress

Ensure that you have updated your Assignment Control List (ACL) and Interviewer’s Progress and Cost Report.

4) Report progress to your Supervisor Using the Assignment Control List (ACL) and Interviewer’s Progress

and Cost Report.

Transmittal Form M … When do you use the Transmittal Form?

The Transmittal Form is used by the Interviewer and Supervisor every time completed questionnaires or survey material are delivered/sent to <<Survey Executing Office>>.

M … Could you demonstrate to the class how you would go about completing the Transmittal Form (using an unscripted Mock Interview and transparencies)

Sending/Delivering Documents

1) Ensure that documents are packaged according to <<Survey Executing Office>> procedure for sending confidential material.

2) Send the completed documents to your Supervisor every Monday along with the <<Country Name>> Literacy Survey Transmittal Form.

Note: At the end of the survey, send all remaining unused Respondent

Envelopes to <<Survey Executing Office>>. An outcome code must be assigned to each case.

At the end of the survey, return material indicated on the Materials List Form to <<Survey Executing Office>>.

Contact your Supervisor

Contact your Supervisor every Monday and inform her/him of Non-Interview cases Progress and Cost Delivery of material


Conclusion and Evaluation

Review of Training Objectives

To understand the <<Country Name>>Literacy Survey

To become familiar with the survey’s concepts and definitions

To become familiar with the survey’s sections

To learn how to conduct <<Country Name>> Literacy Survey interviews

To learn how to minimize non-response.

Debriefing Questionnaire

PPT 38

M … What is the purpose of the Debriefing Questionnaire?

To provide feedback to <<Survey Executing Office>> regarding all aspects of the survey.

o General Feedbacko Difficulty with conceptso Difficulty administering booklets or exercises

Training EvaluationPPT 39

I would like to ask you to take a couple of minutes to complete the Training Evaluation.

Good luck in Collection


Appendix A: Workshop Powerpoint Presentation(see attachment)


Appendix B: Interviewer’s Manual(see attachment)


Appendix C: Supervisor’s Manual(see attachment)


Appendix D: Review Exercise (without answers)(see attachment)


Appendix E: Review Exercise (with answers)(see attachment)


Appendix F: Exercise to Minimize Non-Responses (without answers)(see attachment)


Appendix G: Exercise to Minimize Non-Responses (with answers)(see attachment)


Appendix H: Interviewers’ Debriefing Questionnaire(see attachment)


Web viewThe project “Common Framework for a Literacy Survey” was executed by the...

Documents

Transcript of Web viewThe project “Common Framework for a Literacy Survey” was executed by the...