8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 1/32
OECD Programme for International Student Assessment 2012
PISA 2012 MAIN SURVEYSCHOOL CO-ORDINATOR·SMANUAL
(CORE PISA)
Consortium:
Australian Council for Educational Research (ACER, Australia)
cApStAn Linguistic Quality Control (Belgium)
Deutsches Institut für Internationale Pädagogische Forschung (DIPF, Germany)
Educational Testing Service (ETS, USA)
Institutt for Lærerutdanning og Skoleutvikling (ILS, Norway)
Leibniz - Institute for Science and Mathematics Education (IPN, Germany)
National Institute for Educational Policy Research (NIER, Japan)
The Tao Initiative: CRP - Henri Tudor and Université de Luxembourg - EMACS (Luxembourg)
Unité d'analyse des systèmes et des pratiques d'enseignement (aSPe, Belgium)
Westat (USA)
Final versionSeptember 2011
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 2/32
School Co-ordinators Manual MS 12
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 3/32
School Co-ordinators Manual MS 12
3
TABLE OF CONTENTS
INTRODUCTION ......................................................................................................................... 4
What is PISA? .................................................................................................................................... 4
The PISA assessment ........................................................................................................................ 4
STAGE I: PREPARATION .............................................................................................................. 6
1. Nominate dates for the assessment ............................................................................................. 6
2. Prepare List of Eligible Students ................................................................................................... 9 3. Complete Schools Computer System Diagnostic Report ............................................................ 10
STAGE I I: BEFORE THE ASSESSMENT ....................................................................................... 111
4. Receive and check materials sent by EPRD .............................................................................. 111
5. Notify teachers, students and parents of the assessment ....................................................... 111
6. Review and update Student Tracking Form.............................................................................. 111 7. Give School Questionnaire to appropriate person at your school ............................................. 17
8. Organise and confirm assessment plans with school staff and with Test Administrator ........... 17
9. Collect completed School Questionnaire ................................................................................. 177
STAGE III: DURING/AFTER THE ASSESSMENT ........................................................................... 188
10. Provide Test Administrator with Student Tracking Form and School Questionnaire ..... ...... .... 188 11. Be present throughout the assessment to assist Test Administrator (if possible) ................. 188
12. Arrange for follow-up session (if needed) .............................................................................. 188
13. Arrange assistance for Test Administrator for Computer-Based Assessment session ........... 188
Appendix 1: PISA 2012 Main Survey - Assessment Dates Form ....................................................... 200
Appendix 2: PISA 2012 Main Survey - School's Computer System Diagnostic Report .............. ....... 211 Appendix 3: PISA 2012 Main Survey - List of Eligible Students........................................................... 32
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 4/32
School Co-ordinators Manual MS 12
4
Introduction
1. Thank you for agreeing to be a School Co-ordinator for PISA. The purpose of this manual is to help you
step by step to understand how you can assist with the successful implementation of this large scale
international assessment programme.
What is PISA?2. PISA stands for the Programme for International Student Assessment, sponsored by the Organisation
for Economic Co-operation and Development (OECD). PISA 2012 is the fifth PISA study that has been
conducted since 2000 and involves more than 60 participating countries.
3. PISA has the following characteristics:
y It is the worlds largest international survey in education;
y It surveys students aged about 15 years;
y It assesses students preparedness for adult life; and
y It measures students Mathematical, Scientific, Problem Solving and Reading Literacy.
4. Typically, between 4,500 and 10,000 students in each country take part in this programme.
5. Undertaking PISA is important because the results of the assessment can be used:
y to indicate how well prepared students in Malaysia are for learning once they leave school;
y by schools, education systems and governments to identify areas for improvement over time;
and
y to allow a comparison of student performance and the learning environment between
different countries.
6. For more details about PISA, please refer to the information materials that Educational Planning and
Research Division (EPRD) has provided or the OECD website at: http://www.pisa.oecd.org/.
Note 1: All data collected in PISA are kept strictly confidential. No individual or school is
identified in any report released from the assessment programme.
The PISA assessment
7. Thirty-five students from your school will be sampled to complete a two-hour paper-based test
consisting of Mathematics, Science and Reading questions. These students will also be asked to
complete a questionnaire. After the P aper-Based PISA and questionnaire, a sub sample of 14 students
who participated in the print assessment will also participate in a forty-minute Computer-Based
Assessment of P roblem Solving. In addition, schools will be requested to complete one School
Questionnaire.
8. As a School Co-ordinator you will be responsible to act as the liaison between your school and EPRD.
The key activities you will carry out are listed in Table 1Table 1 with their associated dates.
9. Please note that the actual assessment will be conducted by a Test Administrator who will be
appointed by EPRD.
Field Cod
Formatte
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 5/32
School Co-ordinators Manual MS 12
5
Table 1: Key Activities of PISA School Co-ordinators
Stage Date Activity Page
number
I. Preparation 6 weeks prior to
assessment
1. Nominate dates for the assessment 6
2. Prepare a List of Eligible Students 9
3. Complete Schools Computer System
Diagnostic Report
10
II. Before the
Assessment
2 weeks prior to
assessment
4. Receive and check materials sent by EPRD 11
5. Notify teachers, students and parents of the
assessment
11
6. Review and update Student Tracking Form 11
1-2 weeks prior to
assessment
7. Give School Questionnaire to appropriate
person at your school
17
8. Organise and confirm assessment plans
with school staff and with TestAdministrator
17
A few days prior to
the assessment
9. Collect completed School Questionnaire 17
III. During/ After
the assessment
Assessment Day 10. Provide Test Administrator with Student
Tracking Form and School Questionnaire
18
11. Be present throughout the assessment to
assist Test Administrator (if possible)
18
12. Arrange assistance for the Test
Administrator for the Computer-Based
Assessment session
18
Same week as the
main session if
possible
13. Arrange for follow-up session (if needed) 18
If you have any questions, please contact us at:
EPRD, MOE. Tel: 03-88846548/6595, Fax:03-88846579, email:[email protected]
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
Field Cod
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 6/32
School Co-ordinators Manual MS 12
6
Stage I: Preparation
1. Nominate dates for the assessment
10. PISA will take place between 09.04.2012 and 11.05.2012. Please provide details of your preferred
assessment dates by completing the attached Assessment Dates Form (see Appendix 1Appendix 1).
Then, e-mail or fax this form to [email protected] or 03-88846579 before 20.02.2012. Please take
into account the issues listed on the Assessment Dates Form when nominating assessment dates. Youwill receive details of your assigned assessment date and time by 19.03.2012. Please inform the
Principal and school staff of the details.
11. The P aper-Based PISA will take approximately 3 hours and 15 minutes to administer as outlined in
Table 2Table 2, and the Computer-Based Assessment (including preparation and administration time)
will take about 1 hour 30 minutes as outlined in Table 3Table 3.
Table 2: Timing of P aper-Based PISA Administration
Activity Time
Distributing the materials and reading the
General Directions10-15 minutes (approximately)
The Test Booklet 1 hour (exactly)
Short break No more than 5 minutes
The Test Booklet 1 hour (exactly)
Break 15 minutes
The Student Questionnaire 35 minutes (approximately)
Collecting the materials and ending the
session3-5 minutes (approximately)
Total 3 hours and 15 minutes (approximately)
Table 3: Timing of Computer-Based Assessment Administration
Activity Time
Computer room setup 15 minutes (approximately)
Student log-ons, passwords and introducing
the test
5 minutes (approximately)
Computer-Based Assessment practice session 15 minutes (approximately)
Completing the Computer-Based Assessment 40 minutes (exactly)
Ending the assessment session, collection and
transfer of data
15 minutes (approximately)
Total 1 hour 30 minutes (approximately)
12. Please note that the Computer-Based Assessment session should take place after the P aper-Based
PISA, and preferably on the same day. Because some students will participate in both the Paper-Basedand Computer-Based sessions, it is best to schedule the start of the P aper-Based PISA at the beginning
of the school day. It is recommended that the Computer-Based Assessment be scheduled for the
afternoon.
13. Please allow an adequate interval of at least 1 hour after the P aper-Based PISA has finished before
beginning the Computer-Based Assessment session. The Test Administrator will need to prepare the
Computer-Based Assessment area and run checks and preparations for each computer. Also, students
participating in the Computer-Based Assessment will need a break between assessments.
Field Cod
Formatte
Formatte
Field Cod
Formatte
Field Cod
Formatte
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 7/32
School Co-ordinators Manual MS 12
7
[This page is left blank on purpose]
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 8/32
School Co-ordinators Manual MS 12
8
Figure 1: Example of List of Eligible Students
School Name: SMK Putrajaya 2
Address: Presint 9, Putrajaya
Telephone: 03-88887678 Fax: 03-88888768
List prepared by: Maria Adam E-mail: [email protected]
Date List prepared: 17.02.2012 Total Number of Students Listed: 14
DIRECTIONS: Please list ALL students in your school in Form 1 and higher born between 01.01.1996 and
31.12.1996.
(A)Student Name
(B)Form
(C)Gender
(Female=1;Male=2)
(D)Birth Date
(MM-YYYY)
(E)Study
Programme
(F)SEN
*
Ronny Liew 4 2 12 1996 1
M. Muthusamy 3 2 11 1996 1
Salina Ahmad 4 1 12 1996 1
P. Letchumy 4 1 05 1996 1
Ahmad Amir 4 2 04 1996 1 3
Khaw Meng 4 2 09 1996 1 3
M. Mahendran 4 2 07 1996 1 1
Mariah Muda 3 1 04 1996 1
Florence Teoh 4 1 07 1996 1
LaiKwang 4 2 10 1996 1 1
Tammy Lim 4 1 12 1996 1
V. Shahrukhkhan 4 1 08 1996 1 2
Sharifah Azman 3 1 09 1996 1
Kamal Hassan 3 2 07 1996 1
*SEN = Special Education Needs
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 9/32
School Co-ordinators Manual MS 12
9
2. Prepare List of Eligible Students
Steps for preparing a List of Eligible Students
Step 1: Identify ALL students at your school who meet the eligibility criteria
14. Criteria for PISA student eligibility are:
y Enrolled in Form 1or higher; ANDy Born between 01.01.1996 and 31.12.1996.
15. PISA needs accurate information about all students at your school who meet the above criteria for
student eligibility. A small number of these students may be unable to complete the PISA assessment.
For now, any such students must be added to your list of students. Later, you may need to identify
students who cannot participate in PISA. This will be covered in the next chapter.
Step 2: List each of the eligible students using the form in Appendix 3Appendix 3, along with
their demographic information (see Figure 1Figure 1 for an example)
y Student name Column A;
y Grade Column B;
y Gender Column C: Indicate 1 (female) or 2 (male); and
y Birth Date Column D: Indicate as MM/YYYY. For example, if an eligible student was born in
September 1996, write 09/1996.
Step 3: Write a Study Programme code for each eligible student Column E
16. Table 4Table 4 below shows a code for each study programme. Please choose the appropriate study
code for each eligible student and fill in column E.
Table 4: Codes for Study Programme
Study Programme Code
Science Upper Secondary 1
Arts Upper Secondary 2
Technical/Vocational Secondary 3
Religious Secondary 4
Lower Secondary 5
Step 4: Identify students with Special Education Needs Column F
17. Column F is used to record the Special Education Needs of eligible students. The codes are defined in
Table 5Table 5 below. Please identify any student who has a special education need by placing the
appropriate code in column F.
Table 5: Codes for Special Education Needs
Description Code
Functional disability student has a moderate to severe permanent physical
disability1
Cognitive, behavioral or emotional disability in the opinion of qualified staff,
student has a cognitive, behavioral or emotional disability2
Limited assessment language experience student is not a native speaker of
any of the languages of the assessment in the country and has limited
proficiency in these languages
3
Field Cod
Formatte
Field Cod
Formatte
grammar
Field Cod
Formatte
Field Cod
Formatte
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 10/32
School Co-ordinators Manual MS 12
10
Examples of using Special Education Needs codes
18. Please refer to Figure 1: Example of List of Eligible StudentsFigure 1: Example of List of Eligible
Students, in which the following codes have been applied:
y Ahmad Amir is not a native English speaker and has less than one year of instruction in English.
Therefore, he is coded as 3 in column F.
y Khaw Meng is not a native speaker of English.While he has received instruction in English for
more than one year, he still has some difficulties with English expression and requires some
extra tuition. Therefore, he is also coded as 3 in column F.
y M. Mahendran is blind and is coded as 1 in column F.
y Lai Kwang is physically disabled so he is coded as 1 in column F.
y V. Shahrukhkhan has been professionally assessed as cognitively delayed and is coded as 2
in column F.
y All other students do not have any special education needs and column F is left blank. For most
students column F will be left blank, meaning they have no Special Education Needs.
3. Complete Schools Computer System DiagnosticReport
19. You will need to complete a Schools Computer System Diagnostic Report (Appendix 2Appendix 2).
This provides information about the computer hardware, operating systems and administrativepermissions at your school and will be used to ascertain how many computers are available to
implement the Computer-Based Assessment session. This information will be used for student
sampling to determine the number of students who will participate in the Computer-Based
Assessment . Therefore, it is important that the information you provide is as accurate as possible.
20. The completion of this report will require input from a member of staff who is familiar with the
technical aspects of the schools computer resources and the schools IT policies. Ideally this person will
have responsibility for the schools IT systems.
21. Please email or fax to the Schools Computer System Diagnostic Report , along with the completed List
of Eligible Students to [email protected] or 03- 88846579, EPRD, MOE before 20.02.2012.
About Quality Monitors
22. On the day of the assessment, PISA Quality Monitors will visit some randomly selected schools. Themain task of the PISA Quality Monitors is to document the extent to which testing procedures have
been followed and are being implemented by the Test Administrator. In order to do this, PISA Quality
Monitors will visit some schools, observe the PISA assessment sessions and have a short interview
(approximately 15 minutes) with you after the assessment session. Their task is strictly limited to these
PISA related activities.
23. Should your school be selected for this visit, a Quality Monitor will contact you a few days prior to the
assessment to inform you of his/her visit. On the morning of the assessment he/she will report to the
school office. Please contact EPRD, MOE if you have any questions about the visit of the Quality
Monitor.
Field Cod
Formatte
Field Cod
Formatte
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 11/32
School Co-ordinators Manual MS 12
11
Stage II: Before the Assessment
4. Receive and check materials sent by EPRD, MOE.
24. About two weeks prior to the assessment, EPRD, MOE will send you a package of the following
materials:
y The Student Tracking Form listing the students who have been sampled to participate in the
assessment;
y The School Questionnaire; and
y Other materials, e.g., promotional materials, form for reimbursement of expenses,
participation certificates, etc.
25. Please check whether the package includes these materials. If you find any materials missing or
damaged, please contact EPRD, MOE as soon as possible. Please note also that EPRD, MOE will send
all assessment materials to the Test Administrator who has been assigned to your school.
5. Notify teachers, students and parents of theassessment
26. Please inform teachers, students (especially the sampled students), and parents of the sampled
students according to the schools policies.
27. It is very important to introduce the aims of PISA to school staff and students prior to the assessment
in order to engage students and promote their participation. Therefore, please use the informational
and promotional materials that have been provided to assist you with this activity such as posters,
brochures as well as sample covering letters.
28. Please request the assistance of a staff member who has knowledge of the schools computers to
provide technical support for a short duration (i.e. at the beginning and end of the Computer-Based
Assessment session for the initial set-up of the computers, if necessary).
6. Review and update Student Tracking Form
29. You will receive a Student Tracking Form. This form lists sampled students along with their background
data. You will need to review this form and complete it with additional information. An example of the
Student Tracking Form is provided in Figure 2Figure 2. Field Cod
Formatte
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 12/32
School Co-ordinators Manual MS 12
12
[This page is left blank on purpose]
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 13/32
School Co-ordinators Manual MS 12
13
Figure 2: PISA 2012 Main Survey - Student Tracking Form (example after completion)
School Name: SMK Putrajaya 2 School Coordinator: Maria Adam Test Administrator: Rashid Ishak
RegionStratum
ID
School
ID
Student
ID
LST Line
NumberStudent Name Form
Gender
(F=1; M=2) Birth DateStudy
Prog.SEN
*
N/P
PISA
00 01 010 00004 00003 Ronny Liew 4 2 12 1996 1
00 01 010 00009 00008 M. Muthusamy 3 2 11 1996 1 4
00 01 010 00005 00012 Salina Ahmad 4 1 12 1996 1
00 01 010 00002 00016 P. Letchumy 4 1 05 1996 1
00 01 010 00014 00020 Ahmad Amir 4 2 04 1996 1 3 3
00 01 010 00008 00024 Khaw Meng 4 2 09 1996 1 3
00 01 010 00011 00028 M. Mahendran 4 2 07 1996 1 1 3
00 01 010 00013 00033 Mariah Muda 3 1 04 1996 1
00 01 010 00001 00037 Florence Teoh 4 1 07 1996 1
00 01 010 00007 00041 LaiKwang 4 2 10 1996 1 1
00 01 010 00012 00045 Tammy Lim 4 1 121996
19951 n
00 01 010 00010 00049 V. Shahrukhkhan 4 1 08 1996 1 2 3
00 01 010 00003 00053 Sharifah Azman 3 Y6 1 09 1996 1 n
00 01 010 00006 00057 Kamal Hassan 3 2 07 1996 1
*SEN = Special Education Needs
CBA = Computer-Based Assessment
Completed by EPRD, MOETo be checked by School Co-ordinator
To be
completedby School
Co-
ordinator
Codes to enter into SEN column:
1 Functional disability
2 Cognitive, behavioral or emot
3 Limited assessment language
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 14/32
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 15/32
School Co-ordinators Manual MS 12
15
Steps for reviewing and completing the Student Tracking Form
Step 1: Check student details and demographics
30. For columns Student Name, Grade, Gender, Birth Date, Study Programme, and SEN,identify and correct missing or incorrect information regarding student name, grade, gender, birth
date, study programme and special education needs (SEN).
Step 2: Identify students who CANNOT participate in PISA
31. Column N/P PISA is used to record sampled students who cannot participate in PISA. The intention
of PISA is to be as INCLUSIVE as possible. However, some students may not be able to participate for
various reasons. These reasons for non-participation have to be recorded in this column of the Student
Tracking Form, using the following specific codes:
Code 2 - Students parents refuse for their child to participate in PISA
32. A small number of parents may refuse to allow their child to participate in PISA. If you have received
such notification from parents, record a code 2 for this student in column N/P PISA.
Code 3 - Student with Special Education Needs who cannot be assessed
33. The guidelines in Table 6Table 6 are provided to assist you in deciding whether a student with Special
Education Needs can be excluded from PISA. If a student with a special education need is to be
excluded from the assessment, record a code 3 for this student in column N/P PISA.
Note 2: Many students with a Special Education Need will be able to be included in the
assessment.
Table 6: Guidelines - Exclusion/inclusion of students with Special Education Needs
Type of SEN Students who may be excluded Students who should be
included
Functional
disability
The student has a moderate to severe permanent
physical disability such that she/he cannot participate
in the PISA testing situation. Code 3 in column N/ P
PISA.
The student can respond
to the assessment.
Cognitive,
behavioral or
emotional
disability
The student has a cognitive, behavioral or emotional
disability such that in the opinion of qualified staff,
she/he cannot participate in the PISA testing situation.
This includes students who are cognitively, behaviorally
or emotionally unable to follow even the general
instructions of the assessment. Code 3 in column N/ P
PISA.
The student can respond
to the assessment.
He/she should NOT be
excluded solely because
of poor academic
performance or
disciplinary problems.
Insufficient
assessment
language
experience
The student meets ALL of the following three criteria:
- not being a native speaker in the assessmentlanguage,
- having limited proficiency in the assessment language,
and
- having received less than one year of instruction in
the assessment language.
Code 3 in column N/ P PISA.
The student meets ONLY
one or two of the
criteria.
Field Cod
Formatte
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 16/32
School Co-ordinators Manual MS 12
16
Codes 4 and 5 - Student was transferred to another school or left the school
y If a student has transferred to another school, record a code 4 for this student in column
N/P PISA.
y If a student has left school, but it is not known which school the student has transferred to,
record a code 5 for this student in column N/P PISA.
Code n - Student does not meet student eligibility criteria
y If a student is enrolled in Std 6 or lower, he/she is not eligible to participate in PISA. Record a
code n for this student in column N/P PISA.
y If a student was NOT born between 01.01.1996 and 31.12.1996, he/she is not eligible to
participate in PISA. Record a code n for this student in column N/P PISA.
Summary of non-participant codes
34. All codes to be used in column N/P PISA for non-participants are summarised in Table 7Table 7. If in
doubt about which code to use, leave that column blank and insert a brief note in the Comments
column.
Table 7: Codes for Non-Participant
Reason for non-participation Code
Parent refusal 2
Excluded on SEN (Special Education Needs) basis 3
Now enrolled at another school 4
Not enrolled in this school, and enrollment is unknown 5
Does not meet PISA criteria for eligibility n
Examples of using Non-P articipant codes
35. Please refer to Figure 2Figure 2, in which the following example codes have been applied:
y M. Muthusamy has recently transferred to another school. Therefore, he is coded as 4 in
column N/P PISA.
y Ahmad Amir is coded as 3 in column SEN. He has been taught in English for less than one
year and his teachers believe that he will not be able to participate in the assessment.
Therefore, he is coded as 3 in column N/P PISA.
y While Khaw Mengs experience with English is limited, he has been taught in English for more
than one year and therefore does not meet the PISA criteria for exclusion on the basis of
insufficient language experience. Therefore, column N/P PISA is left blank, and Khaw is
considered to be able to participate in the assessment.
y M. Mahendran is blind and is coded as 1 in column SEN. PISA is not offered in Braille.
Therefore, he is unable to participate in the assessment and is coded as 3 in column N/P
PISA.
y Even though Lai Kwang is functionally disabled, it does not affect his ability to participate. So,
although he is coded as 1 in column SEN, column N/P PISA is left blank.
y The following two students are ineligible according to the PISA eligibility criteria. However,
their wrong demographic information was recorded in the List of Eligible Students, and these
students were subsequently sampled. The School Co-ordinator found the incorrect information
on the Student Tracking Form and corrected it:
- Tammy Lim does not meet the age definition and is coded as n in column N/P PISA.
- Sharifah Azman is in Grade 6 and so is coded as n in column N/P PISA.
Field Cod
Formatte
Field Cod
Formatte
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 17/32
School Co-ordinators Manual MS 12
17
y V. Shahrukhkhan has been professionally assessed as cognitively delayed and is coded as 2
in column SEN. She does not participate in other testing programs. Therefore, she will not
participate in the assessment and is coded as 3 in column N/P PISA.
Note 3: Column N/P PISA of Student Tracking Form
The purpose of setting a column N/P PISA is to record the reasons of non-participation for
those students who have no possibility to participate in PISA under any circumstances even if a
follow-up session is provided after the assessment. Therefore, you should NOT use a code 2 if
a student is unable to attend the PISA assessment, for example, due to a competing activity
in/outside the school or illness, as he/she might be able to attend a follow-up session.
Students to be assessed in PISA
36. Only those students who have NO codes placed in column N/P PISA can be assessed in PISA.
Important! Under No circumstances may a sampled student be replaced with any other student.
7. Give School Questionnaire to appropriate person atyour school
37. The School Questionnaire should be completed by the school principal, but she/he may delegate the
task to another person in the school.
8. Organise and confirm assessment plans with schoolstaff and with Test Administrator
38. During the two weeks preceding the assessment, you will need to confirm these plans:
y arranging for a technical support person to prepare computers for the Computer-Based
Assessment ;y asking participating students to bring a: (a) pencil; (b) eraser; (c) ruler; and (d) calculator on
the day of the assessment or preparing the above stationery at the school;
y obtaining a few spare items of the stationery listed above and some books or magazines for
students who finish the assessment ahead of schedule; and
y informing those concerned of any change in the date or time of the assessment. In particular,
it is important to advise EPRD, MOE, so that the Test Administrators and Quality Monitors can
be advised.
39. The Test Administrator assigned to your school should contact you approximately one week before
the assessment date to confirm the updates of the Student Tracking Form and details of the
assessment session.
9. Collect completed School Questionnaire40. Please collect the completed Questionnaire A FEW DAYS BEFORE THE ASSESSMENT DAY. It will need
to be returned to the Test Administrator on the day of the assessment.
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 18/32
School Co-ordinators Manual MS 12
18
Stage III: During/After the Assessment
10. Provide Test Administrator with Student Tracking
Form and School Questionnaire41. Please make sure that you have updated the Student Tracking Form before the assessment. There
might be some students who are eligible to participate in the assessment, but are absent from the
assessment. For such cases, please leave column N/P PISA blank. The Test Administrator will record
student attendance during the assessment, using a Session Attendance Form.
42. The Test Administrator will collect your Student Tracking Form as well as the completed School
Questionnaire to return to EPRD, MOE. You should make a photocopy of the Form for yourself to keep
at your school. Please store that copy until the end of the school year.
11. Be present throughout the assessment to assist TestAdministrator (if possible)
43. If it is not possible for you to be present throughout the assessment, you should be present at least atthe beginning of the assessment session. This will help set the tone of the session and demonstrate
the importance of the study.
Note 4:
y Because PISA materials may be used in the future, their security is very important;
y You and other school staff members are allowed to look through unused booklets only after
the assessment, and in the presence of the Test Administrator; and
y DO NOT photocopy or copy the test booklet and Computer-Based Assessment materials in
any way under any circumstances.
12. Arrange for follow-up session (if needed)
44. PISA requires a high level of participation amongst the sampled students. If several students are
absent from the P aper-Based PISA session or the Computer-Based Assessment session, it may
therefore be necessary to arrange a follow-up session. The Test Administrator will guide you through
the process of determining whether or not you will need to arrange a follow-up session.
45. If you and the Test Administrator decide that a follow-up session should be arranged, please select a
date and time that will maximize the number of students attending the session and that is convenient
for the Test Administrator.
Note 5: There can only be ONE follow-up session. Please make every attempt to ensure that
absent students attend the follow-up session.
13. Arrange assistance for Test Administrator for
Computer-Based Assessment session46. If the P aper-Based PISA and Computer-Based Assessment sessions will be conducted by different Test
Administrators, please make sure that the Test Administrator for the Computer-Based Assessment will
obtain from the other Test Administrator:
y The Student Tracking Form to check the consistency; and
y A copy of the Session Attendance Form used for the P aper-Based PISA. This will enable her/him
to check that only students who were present for the P aper-Based PISA are assessed in the
Computer-Based Assessment .
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 19/32
School Co-ordinators Manual MS 12
19
Your help with PISA is very important to its success.
EPRD, MOE and the International Project Team appreciate your time and
effort.
Thank you!
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 20/32
School Co-ordinators Manual MS 12
20
Appendix 1: PISA 2012 Main Survey - Assessment Dates Form
To: Dr Ihsan Ismail
Fax or e-
mail:
03-88846579 or
From: Fax No.: ( )
Phone No.: ( ) E-mail:
School Name: State:
Date:
Issues to consider when selecting assessment dates for your school
y The PISA will take place between 09.04.2012 and 11.05.2012;
y TheP aper-Based PISA session will take about 3 hours and 15 minutes, including breaks and time for
distributing and collecting materials;
y The Computer-Based Assessment session will take approximately 1 hour 30 minutes, including
time to set-up the test area;
y You are encouraged to schedule the P aper-Based PISA to commence early in the morning, and the
Computer-Based Assessment to be carried out in the afternoon. The Computer-Based Assessment
session should be conducted after the P aper-Based PISA;
y EPRD, MOE will send a trained Test Administrator to the school to carry out both the P aper-Based
PISA and the Computer-Based Assessment sessions;
y For the Computer-Based Assessment session, it is advisable that a member of staff familiar with the
schools computers and IT policies is available to assist the Test Administrator. Otherwise, you
should be available for the beginning of the assessment and/or periodically;
y Please check your School Calendar to ensure there are no other events that coincide with PISA (for
example, tests/exams, sports festival or excursions); and
y Please ensure you have made arrangements for the assessment location. For the P aper-Based PISA,
the room should have a capacity for 35 sampled students sitting at single desks. For the Computer-
Based Assessment , a single room able to accommodate 14 computers should be available.
Please nominate three alternative dates for the PISA assessment to take place at your school:
Preferences Date Time of commencement
First
Second
Third
Please specify any dates which will NOT be suitable for testing:
Please e-mail, fax or post back this form to EPRD, MOE by 20.02.2012. Thank you!
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 21/32
School Co-ordinators Manual MS 12
21
Appendix 2: PISA 2012 Main Survey - School's Computer System Diagnostic Report
Introduction
1. Fourteen (14) students in your school will participate in the Computer Based Assessment(CBA) as part of the PISA assessment. It is important to establish whether the computers
students will use for the test have the required capabilities to run the CBA test successfully.
2. This manual provides instructions for the completion of a Systems Diagnostic (SD) which
will test computer capabilities for running the CBA test. The information gained from this
diagnostic will then enable the completion of the CBA Systems Diagnostic test results
forms so that the number of suitable computers available in one room can be determined.This information will need to be provided to EPRD, MOE.
Running the Systems Diagnostic
3. The CBA Systems Diagnostic (SD) runs from a single USB drive.
4. The user must have an account with administrative rights to run the SD. This is explainedfurther below in the section µReporting results¶ (item d).
5. The operating system must be Windows XP, Windows Vista or Windows 7.
6. The SD provides a variety checks. As a minimum, the test input, basic check and virus scanof the USB MUST be completed. A virus scan of the local hard drive and an advanced
check are also recommended but are not mandatory. Each test is described in this manual.
7. To run the SD, turn on the computer and close any applications running on the computer.
8. Insert the SD USB and open Windows Explorer. Locate and run the executable file in theroot directory of the USB called µPISAmenu.exe¶ (e.g. by double-click on the file).
9. The following control panel will appear:
10. Click on the µStart Diagnosis¶ button and the following screen will appear:
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 22/32
School Co-ordinators Manual MS 12
22
11. The top section of the screen µAbout the System¶ provides general information about the
computer being tested.
"OS" refers to the operating system.
"Service Pack" is the latest installed service pack, if there is no service pack installed -- N/A-- is displayed.
"User" is the user currently logged into the computer.
"USB key size" displays the amount of free memory and total capacity of the USB drive.
12. The buttons on the right of the screen are the three different diagnostic tests that can be
implemented: the basic check, the virus scan, the advanced check and a button for exitingthe diagnostic. Please note that in the home edition of Windows XP the µAdvanced Check¶
button will be disabled.
Basic check
13. Click on the µBasic check¶ button on the right of the screen. This check may take a few
seconds to run. Below is an example of what will appear when the basic check is complete.
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 23/32
School Co-ordinators Manual MS 12
23
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 24/32
School Co-ordinators Manual MS 12
24
14. The following table indicates each type of basic check, what it is checked, the associated requirement for the CBA test and the possible messages that will appear in the centre
section of the screen above:
Label What it tests Requirement for CBA Possible message
CPU The speed of the
CPU installed in
MHz
Must be at least 1500Mhz OK : CPU speed is "n" MHz
OR
Failed : CPU speed is "n" MHz
OS The operating
system
Must beWindows XP, Windows
Vista orWindows 7
OK : Operating system is "one
of Win XP, Win Vista,Win 7"
OR
Failed : Operating system is
"system other thanWin XP,Win
Vista,Win 7"
System
memory
The memory
installed on thecomputer in MB
Required memory forWindows
XP = 512 MB
Required memory forWindows
VISTA = 1024 MB
Required memory forWindows
7 = 1024 MB
OK : System memory
OR
Failed : System memory
(required "n" MB)
Screen
resolution
The current
screen resolution
(width x height)
Minimal screen width = 1024 px
Minimal screen height = 768 px
OK : Screen : Width x Height
OR
Failed : Screen :Width x Height
Account with
admin rights
Whether the
current user is
logged in as an
administrator
Must be logged in as an
administrator
OK : Account with admin rights
OR
Failed : Account with admin
rights required
Skype
running?
If Skype is running
on the computer
The CBA assessment cannot run
with Skype running
OK : Skype is not running
OR
Failed : Skype should not be
running
Systems DPI
setting
The computers
current DPI
setting
DPI setting must be 96 DPI
(100%)
OK : DPI setting is 96 DPI
OR
Failed : DPI setting is "n" DPI
USB key data
transfer rate
The USB key data
transfer rate in
MB/s
Required USB data transfer rate
= 1 MB/s
OK : Speed "n" MB/s
OR
Failed : Speed "n" MB/sOR
Can't run the test - in cases
where the program could not
detect the transfer rate
15. If all basic checks are highlighted in green and labelled µOK¶, the computer is suitable for running the CBA assessment. If any appear in red, the computer may not be suitable.
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 25/32
School Co-ordinators Manual MS 12
25
16. For each computer tested, please complete the test results form on page 29. Please refer tothe section on Reporting Results for more information.
Virus scan
17. The virus scan can be used to check any drive on your computer. The scan must becompleted on the USB drive and will take approximately 30 seconds.
18. It is recommended (but not mandatory) to also run the scan on the local hard drive. Please
note that this may take between two and five hours for each computer.
19. To run the virus scan, click on the µVirus Scan¶ button on the bottom right of the Systems
Diagnostic check screen. All local and network drives will appear as available for
scanning. The following screen shot is an example of what will appear when 8 drives(including USB) are available for scanning.
20. To scan the USB drive, ensure that the correct drive is selected, then click on the µScan¶
button at the bottom of the screen. The following screen will appear and may takeapproximately 30 seconds to run on the USB (or up to 5 hours for the local hard drive
scan).
Field Cod
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 26/32
School Co-ordinators Manual MS 12
26
21. Please note that while the virus scan is running the computer¶s local antivirus software maydetect the virus scan software being used for PISA (ClamWin Free Antivirus) as a virus.
This is normal and should be ignored. Below is an example of the screen that appears
when Trend Micro OfficeScan is the local antivirus software. Dialog screens and options
will vary depending on the type of antivirus software installed locally.
22. In this example, the local virus scanner (Trend Micro Office Scan) has detected theSystems Diagnostic virus scanner (ClamWin Free Antivirus) as a virus. If this occurs click
µOK¶ and the virus scan will continue.
23. The following screen is an example of what will appear when the virus scan is complete.
24. In this example the scan was successful and the computer is suitable for the CBA. Itindicates no infected files were found.
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 27/32
School Co-ordinators Manual MS 12
27
25. If, however, the scan indicates that there are infected files, you will need to clean the USB(or local hard drive) with professional antivirus software or return the USB to EPRD,
MOE. Until the virus scan reveals that there are no infected files on the USB drive, the
USB should not be used to run the CBA.
26. Click on the µClose¶ button to exit the virus scan.
Advanced check optional
27. The advanced check is a more detailed scan of the memory of the computer. By selectingthis option, a text file is written to the USB that contains information regarding the
computer¶s memory. This may take a few minutes to complete. While the check is running,
the cursor changes into an hourglass icon. It is not a requirement to run this check unlessrequested to do so by your national center who may then request some specific information
from this text file.
Test input28. Click on the µExit¶ button and return to the control panel which has the µTest input¶ button
as indicated in the screen shot below.
29. Click on the µTest input¶ button. An automatic virus scan of the memory will commence.
This scan will take two or more minutes depending on the size of the computer¶s memory.
30. If the software indicates that a virus is detected a popup window will appear informing you
of this and asking whether you would like to proceed with the CBA. You may choose to
proceed but it is recommended to clean the computer with professional antivirus software
first. This reduces the likelihood that a virus will be transferred to the USB.
31. Once the virus scan is complete, enter the password:
123456789
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 28/32
School Co-ordinators Manual MS 12
28
The following screen will appear:
32. If this page does not appear, press ALT TAB to return to the PISA 2012 Control Panel andclick on the µExit¶ button. Eject the USB from the computer and start the process of
running the µTest input¶ check again. If the error continues to appear, re-start the computer
before trying again.
33. This µmock item¶ is designed to test if the functionality of the CBA will work on the
computer. Please complete the following:
1. Drag and drop the box as indicated and record whether this function works or not.
2. Enter text into the text box and record whether this function works or not.
34. Once complete press ALT TAB to access the Pisa 2012 Control Panel, click on the µExit¶
button and remove the USB from the computer.
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 29/32
School Co-ordinators Manual MS 12
29
Reporting results
35. For each computer tested, please complete the test results table below. Make photocopies as
required.
36. Please then collate the information from all test results and determine how many computers
are suitable in a single room for CBA testing. Then pass this information onto the <NC>.
CBA SYSTEMS DIAGNOSTIC TEST RESULTS FORM
BASIC CHECKS
CPU OK FAILED
OS OK FAILED
System memory OK FAILED
Screen resolution OK FAILED
Account with adminrights
OK FAILED
Skype running? OK FAILED
System¶s DPI setting OK FAILED
USB key data transfer rate
OK FAILED
VIRUS SCAN OK FAILED
USB Drive OK FAILED but corrected FAILED
Local Hard Drive OK FAILED but corrected FAILED Not Applied
ADVANCED CHECK Not Applied OK FAILED
TEST INPUT
Drag and drop OK FAILED
Enter text OK FAILED
COMMENTS
IS THE COMPUTER
SUITABLE?*
YES NO
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 30/32
School Co-ordinators Manual MS 12
30
* Instructions for establishing if the computer is suitable
Use the information in the summary section of the test results to establish if the computer is
suitable for the CBA test:
a. If all checks are OK (or µNot Applied¶) then the computer is suitable for the CBA test.
b. If µCPU¶, µOS¶ or µSystem memory¶ failed the test, the computer is not suitable for theCBA test.
c. If the µscreen resolution¶ test fails, you may attempt to alter the screen resolution. To do
this, go to µSettings¶ and then µControl Panel¶ from the µStart¶ menu. Open µDisplay¶and go to the µSettings¶ tab. Ensure that the resolution is set to at least 1024 x 768
pixels. If this level of resolution is not available the computer is not suitable for running
the CBA test. If this level of resolution is available, apply the new settings and run the basic check again. If the µscreen resolution¶ test is ok, the computer is suitable with this
setting; if it fails the computer is not suitable for the CBA test.
d. If the µaccount with admin rights¶ test fails it may be possible to change the
administration settings of the computer. To do this, go to µSettings¶ and then µControlPanel¶ from the µStart¶ menu. Open µUser Accounts¶ and change the user group
membership to µAdministrator¶. Note that this setting should be altered using the main
administrator account for the computer. After adjusting the administrator settings on thecomputer, run the basic check again. If the µaccount with admin rights¶ test is ok, thecomputer is suitable with this setting, if it fails the CBA test can not be launched. For
more detailed instructions on adjusting the administration rights on the computer, visit
one of the following websites depending on your operating system.
Operating system Creating user accounts Creating user account group membership
Windows XP http://www.microsoft.com/windowsxp/
using/setup/winxp/accounts.mspx
http://www.microsoft.com/resources/docume
ntation/windows/xp/all/proddocs/en-us/usercpl_change_group.mspx?mfr=true
Windows Vista http://windows.microsoft.com/en-
US/windows-vista/Create-a-user-account
http://windows.microsoft.com/en-
US/windows-vista/Change-a-users-account-
type
Windows 7 http://windows.microsoft.com/en-
us/Windows7/Create-a-user-account
http://windows.microsoft.com/en-
us/windows7/Change-a-users-account-type
e. If the µSkype¶ test fails, ensure that Skype is shut down on the local computer and runthe basic check again. If the µSkype¶ test still fails the computer is not suitable for
running the CBA test.
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 31/32
School Co-ordinators Manual MS 12
31
f. If the µSystem¶s DPI setting¶ fails, it is possible to adjust these settings. The system¶sDPI must be set to 96 DPI (100%). For instructions on adjusting the system¶s DPI
setting visit one of the following websites depending on your operating system.
Operating system Website for instructions for altering the systems DPI settings
Windows XP http://www.microsoft.com/windowsxp/using/setup/personalize/look.mspx
Windows Vista http://windows.microoft.com/en-US/windows-vista/Make-the-text-on-your-
screen-larger-or-smaller
Windows 7 http://windows.microsoft.com/en-us/windows7/Make-the-text-on-your-
screen-larger-or-smaller
After making this adjustment, run the basic check again. If the µSystem¶s DPI setting¶ isok, the computer is suitable however if the test still fails, the computer is not suitable for the CBA test.
g. If the µUSB Key data transfer rate¶ test fails, the USB is not suitable for running the test
and you will need to contact your <NC>. A USB that has a data transfer rate of 1 MB/smust be used.
Exit
37. Once the basic check, virus scan, advanced check and mock item check have been
completed, please exit the SD by clicking on the µExit¶ button on the main screen andremove the USB from the computer.
Return of materials
38. Once all computers have been tested using the Systems Diagnostic, please return the USBs
to the national centre.
8/3/2019 SC Manual MS12 English Ver 2
http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 32/32
School Co-ordinators Manual MS 12
Appendix 3: PISA 2012 Main Survey - List of Eligible Students
School Name: ___________________________________________________________________________
Address: _______________________________________________________________________________
Telephone: ________________________________ Fax: ______________________________________
List Prepared By: ____________________________ Date List Prepared: __________________________
Total Number of Students Listed: _______________
DIRECTIONS: Please list ALL students in your school in Form 1 or higher born between 01.01.1996 and
31.12.1996.
(A)
Student Name
(B)
Grade
(C)
Gender
(Female=1;
Male=2)
(D)
Birth Date
(MM-YYYY)
(E)
Study
Programme
(F)
SEN*
*SEN = Special Education Needs
Top Related