SC Manual MS12 English Ver 2

8/3/2019 SC Manual MS12 English Ver 2

http://slidepdf.com/reader/full/sc-manual-ms12-english-ver-2 1/32

OECD Programme for International Student Assessment 2012

PISA 2012 MAIN SURVEYSCHOOL CO-ORDINATOR·SMANUAL

(CORE PISA)

Consortium:

Australian Council for Educational Research (ACER, Australia)

cApStAn Linguistic Quality Control (Belgium)

Deutsches Institut für Internationale Pädagogische Forschung (DIPF, Germany)

Educational Testing Service (ETS, USA)

Institutt for Lærerutdanning og Skoleutvikling (ILS, Norway)

Leibniz - Institute for Science and Mathematics Education (IPN, Germany)

National Institute for Educational Policy Research (NIER, Japan)

The Tao Initiative: CRP - Henri Tudor and Université de Luxembourg - EMACS (Luxembourg)

Unité d'analyse des systèmes et des pratiques d'enseignement (aSPe, Belgium)

Westat (USA)

Final versionSeptember 2011



School Co-ordinators Manual MS 12




3

TABLE OF CONTENTS

INTRODUCTION ......................................................................................................................... 4

What is PISA? .................................................................................................................................... 4

The PISA assessment ........................................................................................................................ 4

STAGE I: PREPARATION .............................................................................................................. 6

1. Nominate dates for the assessment ............................................................................................. 6

2. Prepare List of Eligible Students ................................................................................................... 9 3. Complete Schools Computer System Diagnostic Report ............................................................ 10

STAGE I I: BEFORE THE ASSESSMENT ....................................................................................... 111

4. Receive and check materials sent by EPRD .............................................................................. 111

5. Notify teachers, students and parents of the assessment ....................................................... 111

6. Review and update Student Tracking Form.............................................................................. 111 7. Give School Questionnaire to appropriate person at your school ............................................. 17

8. Organise and confirm assessment plans with school staff and with Test Administrator ........... 17

9. Collect completed School Questionnaire ................................................................................. 177

STAGE III: DURING/AFTER THE ASSESSMENT ........................................................................... 188

10. Provide Test Administrator with Student Tracking Form and School Questionnaire ..... ...... .... 188 11. Be present throughout the assessment to assist Test Administrator (if possible) ................. 188

12. Arrange for follow-up session (if needed) .............................................................................. 188

13. Arrange assistance for Test Administrator for Computer-Based Assessment session ........... 188

Appendix 1: PISA 2012 Main Survey - Assessment Dates Form ....................................................... 200

Appendix 2: PISA 2012 Main Survey - School's Computer System Diagnostic Report .............. ....... 211 Appendix 3: PISA 2012 Main Survey - List of Eligible Students........................................................... 32

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod




4

Introduction

1. Thank you for agreeing to be a School Co-ordinator for PISA. The purpose of this manual is to help you

step by step to understand how you can assist with the successful implementation of this large scale

international assessment programme.

What is PISA?2. PISA stands for the Programme for International Student Assessment, sponsored by the Organisation

for Economic Co-operation and Development (OECD). PISA 2012 is the fifth PISA study that has been

conducted since 2000 and involves more than 60 participating countries.

3. PISA has the following characteristics:

y It is the worlds largest international survey in education;

y It surveys students aged about 15 years;

y It assesses students preparedness for adult life; and

y It measures students Mathematical, Scientific, Problem Solving and Reading Literacy.

4. Typically, between 4,500 and 10,000 students in each country take part in this programme.

5. Undertaking PISA is important because the results of the assessment can be used:

y to indicate how well prepared students in Malaysia are for learning once they leave school;

y by schools, education systems and governments to identify areas for improvement over time;

and

y to allow a comparison of student performance and the learning environment between

different countries.

6. For more details about PISA, please refer to the information materials that Educational Planning and

Research Division (EPRD) has provided or the OECD website at: http://www.pisa.oecd.org/.

Note 1: All data collected in PISA are kept strictly confidential. No individual or school is

identified in any report released from the assessment programme.

The PISA assessment

7. Thirty-five students from your school will be sampled to complete a two-hour paper-based test

consisting of Mathematics, Science and Reading questions. These students will also be asked to

complete a questionnaire. After the P aper-Based PISA and questionnaire, a sub sample of 14 students

who participated in the print assessment will also participate in a forty-minute Computer-Based

Assessment of P roblem Solving. In addition, schools will be requested to complete one School

Questionnaire.

8. As a School Co-ordinator you will be responsible to act as the liaison between your school and EPRD.

The key activities you will carry out are listed in Table 1Table 1 with their associated dates.

9. Please note that the actual assessment will be conducted by a Test Administrator who will be

appointed by EPRD.

Field Cod

Formatte




5

Table 1: Key Activities of PISA School Co-ordinators

Stage Date Activity Page

number

I. Preparation 6 weeks prior to

assessment

1. Nominate dates for the assessment 6

2. Prepare a List of Eligible Students 9

3. Complete Schools Computer System

Diagnostic Report

10

II. Before the

Assessment

2 weeks prior to

assessment

4. Receive and check materials sent by EPRD 11

5. Notify teachers, students and parents of the

assessment

11

6. Review and update Student Tracking Form 11

1-2 weeks prior to

assessment

7. Give School Questionnaire to appropriate

person at your school

17

8. Organise and confirm assessment plans

with school staff and with TestAdministrator

17

A few days prior to

the assessment

9. Collect completed School Questionnaire 17

III. During/ After

the assessment

Assessment Day 10. Provide Test Administrator with Student

Tracking Form and School Questionnaire

18

11. Be present throughout the assessment to

assist Test Administrator (if possible)

18

12. Arrange assistance for the Test

Administrator for the Computer-Based

Assessment session

18

Same week as the

main session if

possible

13. Arrange for follow-up session (if needed) 18

If you have any questions, please contact us at:

EPRD, MOE. Tel: 03-88846548/6595, Fax:03-88846579, email:[email protected]

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod

Field Cod




6

Stage I: Preparation

1. Nominate dates for the assessment

10. PISA will take place between 09.04.2012 and 11.05.2012. Please provide details of your preferred

assessment dates by completing the attached Assessment Dates Form (see Appendix 1Appendix 1).

Then, e-mail or fax this form to [email protected] or 03-88846579 before 20.02.2012. Please take

into account the issues listed on the Assessment Dates Form when nominating assessment dates. Youwill receive details of your assigned assessment date and time by 19.03.2012. Please inform the

Principal and school staff of the details.

11. The P aper-Based PISA will take approximately 3 hours and 15 minutes to administer as outlined in

Table 2Table 2, and the Computer-Based Assessment (including preparation and administration time)

will take about 1 hour 30 minutes as outlined in Table 3Table 3.

Table 2: Timing of P aper-Based PISA Administration

Activity Time

Distributing the materials and reading the

General Directions10-15 minutes (approximately)

The Test Booklet 1 hour (exactly)

Short break No more than 5 minutes

The Test Booklet 1 hour (exactly)

Break 15 minutes

The Student Questionnaire 35 minutes (approximately)

Collecting the materials and ending the

session3-5 minutes (approximately)

Total 3 hours and 15 minutes (approximately)

Table 3: Timing of Computer-Based Assessment Administration

Activity Time

Computer room setup 15 minutes (approximately)

Student log-ons, passwords and introducing

the test

5 minutes (approximately)

Computer-Based Assessment practice session 15 minutes (approximately)

Completing the Computer-Based Assessment 40 minutes (exactly)

Ending the assessment session, collection and

transfer of data

15 minutes (approximately)

Total 1 hour 30 minutes (approximately)

12. Please note that the Computer-Based Assessment session should take place after the P aper-Based

PISA, and preferably on the same day. Because some students will participate in both the Paper-Basedand Computer-Based sessions, it is best to schedule the start of the P aper-Based PISA at the beginning

of the school day. It is recommended that the Computer-Based Assessment be scheduled for the

afternoon.

13. Please allow an adequate interval of at least 1 hour after the P aper-Based PISA has finished before

beginning the Computer-Based Assessment session. The Test Administrator will need to prepare the

Computer-Based Assessment area and run checks and preparations for each computer. Also, students

participating in the Computer-Based Assessment will need a break between assessments.

Field Cod

Formatte

Formatte

Field Cod

Formatte

Field Cod

Formatte




7

[This page is left blank on purpose]




8

Figure 1: Example of List of Eligible Students

School Name: SMK Putrajaya 2

Address: Presint 9, Putrajaya

Telephone: 03-88887678 Fax: 03-88888768

List prepared by: Maria Adam E-mail: [email protected]

Date List prepared: 17.02.2012 Total Number of Students Listed: 14

DIRECTIONS: Please list ALL students in your school in Form 1 and higher born between 01.01.1996 and

31.12.1996.

(A)Student Name

(B)Form

(C)Gender

(Female=1;Male=2)

(D)Birth Date

(MM-YYYY)

(E)Study

Programme

(F)SEN

*

Ronny Liew 4 2 12 1996 1

M. Muthusamy 3 2 11 1996 1

Salina Ahmad 4 1 12 1996 1

P. Letchumy 4 1 05 1996 1

Ahmad Amir 4 2 04 1996 1 3

Khaw Meng 4 2 09 1996 1 3

M. Mahendran 4 2 07 1996 1 1

Mariah Muda 3 1 04 1996 1

Florence Teoh 4 1 07 1996 1

LaiKwang 4 2 10 1996 1 1

Tammy Lim 4 1 12 1996 1

V. Shahrukhkhan 4 1 08 1996 1 2

Sharifah Azman 3 1 09 1996 1

Kamal Hassan 3 2 07 1996 1

*SEN = Special Education Needs




9

2. Prepare List of Eligible Students

Steps for preparing a List of Eligible Students

Step 1: Identify ALL students at your school who meet the eligibility criteria

14. Criteria for PISA student eligibility are:

y Enrolled in Form 1or higher; ANDy Born between 01.01.1996 and 31.12.1996.

15. PISA needs accurate information about all students at your school who meet the above criteria for

student eligibility. A small number of these students may be unable to complete the PISA assessment.

For now, any such students must be added to your list of students. Later, you may need to identify

students who cannot participate in PISA. This will be covered in the next chapter.

Step 2: List each of the eligible students using the form in Appendix 3Appendix 3, along with

their demographic information (see Figure 1Figure 1 for an example)

y Student name Column A;

y Grade Column B;

y Gender Column C: Indicate 1 (female) or 2 (male); and

y Birth Date Column D: Indicate as MM/YYYY. For example, if an eligible student was born in

September 1996, write 09/1996.

Step 3: Write a Study Programme code for each eligible student Column E

16. Table 4Table 4 below shows a code for each study programme. Please choose the appropriate study

code for each eligible student and fill in column E.

Table 4: Codes for Study Programme

Study Programme Code

Science Upper Secondary 1

Arts Upper Secondary 2

Technical/Vocational Secondary 3

Religious Secondary 4

Lower Secondary 5

Step 4: Identify students with Special Education Needs Column F

17. Column F is used to record the Special Education Needs of eligible students. The codes are defined in

Table 5Table 5 below. Please identify any student who has a special education need by placing the

appropriate code in column F.

Table 5: Codes for Special Education Needs

Description Code

Functional disability student has a moderate to severe permanent physical

disability1

Cognitive, behavioral or emotional disability in the opinion of qualified staff,

student has a cognitive, behavioral or emotional disability2

Limited assessment language experience student is not a native speaker of

any of the languages of the assessment in the country and has limited

proficiency in these languages

3

Field Cod

Formatte

Field Cod

Formatte

grammar

Field Cod

Formatte

Field Cod

Formatte




10

Examples of using Special Education Needs codes

18. Please refer to Figure 1: Example of List of Eligible StudentsFigure 1: Example of List of Eligible

Students, in which the following codes have been applied:

y Ahmad Amir is not a native English speaker and has less than one year of instruction in English.

Therefore, he is coded as 3 in column F.

y Khaw Meng is not a native speaker of English.While he has received instruction in English for

more than one year, he still has some difficulties with English expression and requires some

extra tuition. Therefore, he is also coded as 3 in column F.

y M. Mahendran is blind and is coded as 1 in column F.

y Lai Kwang is physically disabled so he is coded as 1 in column F.

y V. Shahrukhkhan has been professionally assessed as cognitively delayed and is coded as 2

in column F.

y All other students do not have any special education needs and column F is left blank. For most

students column F will be left blank, meaning they have no Special Education Needs.

3. Complete Schools Computer System DiagnosticReport

19. You will need to complete a Schools Computer System Diagnostic Report (Appendix 2Appendix 2).

This provides information about the computer hardware, operating systems and administrativepermissions at your school and will be used to ascertain how many computers are available to

implement the Computer-Based Assessment session. This information will be used for student

sampling to determine the number of students who will participate in the Computer-Based

Assessment . Therefore, it is important that the information you provide is as accurate as possible.

20. The completion of this report will require input from a member of staff who is familiar with the

technical aspects of the schools computer resources and the schools IT policies. Ideally this person will

have responsibility for the schools IT systems.

21. Please email or fax to the Schools Computer System Diagnostic Report , along with the completed List

of Eligible Students to [email protected] or 03- 88846579, EPRD, MOE before 20.02.2012.

About Quality Monitors

22. On the day of the assessment, PISA Quality Monitors will visit some randomly selected schools. Themain task of the PISA Quality Monitors is to document the extent to which testing procedures have

been followed and are being implemented by the Test Administrator. In order to do this, PISA Quality

Monitors will visit some schools, observe the PISA assessment sessions and have a short interview

(approximately 15 minutes) with you after the assessment session. Their task is strictly limited to these

PISA related activities.

23. Should your school be selected for this visit, a Quality Monitor will contact you a few days prior to the

assessment to inform you of his/her visit. On the morning of the assessment he/she will report to the

school office. Please contact EPRD, MOE if you have any questions about the visit of the Quality

Monitor.

Field Cod

Formatte

Field Cod

Formatte




11

Stage II: Before the Assessment

4. Receive and check materials sent by EPRD, MOE.

24. About two weeks prior to the assessment, EPRD, MOE will send you a package of the following

materials:

y The Student Tracking Form listing the students who have been sampled to participate in the

assessment;

y The School Questionnaire; and

y Other materials, e.g., promotional materials, form for reimbursement of expenses,

participation certificates, etc.

25. Please check whether the package includes these materials. If you find any materials missing or

damaged, please contact EPRD, MOE as soon as possible. Please note also that EPRD, MOE will send

all assessment materials to the Test Administrator who has been assigned to your school.

5. Notify teachers, students and parents of theassessment

26. Please inform teachers, students (especially the sampled students), and parents of the sampled

students according to the schools policies.

27. It is very important to introduce the aims of PISA to school staff and students prior to the assessment

in order to engage students and promote their participation. Therefore, please use the informational

and promotional materials that have been provided to assist you with this activity such as posters,

brochures as well as sample covering letters.

28. Please request the assistance of a staff member who has knowledge of the schools computers to

provide technical support for a short duration (i.e. at the beginning and end of the Computer-Based

Assessment session for the initial set-up of the computers, if necessary).

6. Review and update Student Tracking Form

29. You will receive a Student Tracking Form. This form lists sampled students along with their background

data. You will need to review this form and complete it with additional information. An example of the

Student Tracking Form is provided in Figure 2Figure 2. Field Cod

Formatte




12

[This page is left blank on purpose]




13

Figure 2: PISA 2012 Main Survey - Student Tracking Form (example after completion)

School Name: SMK Putrajaya 2 School Coordinator: Maria Adam Test Administrator: Rashid Ishak

RegionStratum

ID

School

ID

Student

ID

LST Line

NumberStudent Name Form

Gender

(F=1; M=2) Birth DateStudy

Prog.SEN

*

N/P

PISA

00 01 010 00004 00003 Ronny Liew 4 2 12 1996 1

00 01 010 00009 00008 M. Muthusamy 3 2 11 1996 1 4

00 01 010 00005 00012 Salina Ahmad 4 1 12 1996 1

00 01 010 00002 00016 P. Letchumy 4 1 05 1996 1

00 01 010 00014 00020 Ahmad Amir 4 2 04 1996 1 3 3

00 01 010 00008 00024 Khaw Meng 4 2 09 1996 1 3

00 01 010 00011 00028 M. Mahendran 4 2 07 1996 1 1 3

00 01 010 00013 00033 Mariah Muda 3 1 04 1996 1

00 01 010 00001 00037 Florence Teoh 4 1 07 1996 1

00 01 010 00007 00041 LaiKwang 4 2 10 1996 1 1

00 01 010 00012 00045 Tammy Lim 4 1 121996

19951 n

00 01 010 00010 00049 V. Shahrukhkhan 4 1 08 1996 1 2 3

00 01 010 00003 00053 Sharifah Azman 3 Y6 1 09 1996 1 n

00 01 010 00006 00057 Kamal Hassan 3 2 07 1996 1


CBA = Computer-Based Assessment

Completed by EPRD, MOETo be checked by School Co-ordinator

To be

completedby School

Co-

ordinator

Codes to enter into SEN column:

1 Functional disability

2 Cognitive, behavioral or emot

3 Limited assessment language




15

Steps for reviewing and completing the Student Tracking Form

Step 1: Check student details and demographics

30. For columns Student Name, Grade, Gender, Birth Date, Study Programme, and SEN,identify and correct missing or incorrect information regarding student name, grade, gender, birth

date, study programme and special education needs (SEN).

Step 2: Identify students who CANNOT participate in PISA

31. Column N/P PISA is used to record sampled students who cannot participate in PISA. The intention

of PISA is to be as INCLUSIVE as possible. However, some students may not be able to participate for

various reasons. These reasons for non-participation have to be recorded in this column of the Student

Tracking Form, using the following specific codes:

Code 2 - Students parents refuse for their child to participate in PISA

32. A small number of parents may refuse to allow their child to participate in PISA. If you have received

such notification from parents, record a code 2 for this student in column N/P PISA.

Code 3 - Student with Special Education Needs who cannot be assessed

33. The guidelines in Table 6Table 6 are provided to assist you in deciding whether a student with Special

Education Needs can be excluded from PISA. If a student with a special education need is to be

excluded from the assessment, record a code 3 for this student in column N/P PISA.

Note 2: Many students with a Special Education Need will be able to be included in the

assessment.

Table 6: Guidelines - Exclusion/inclusion of students with Special Education Needs

Type of SEN Students who may be excluded Students who should be

included

Functional

disability

The student has a moderate to severe permanent

physical disability such that she/he cannot participate

in the PISA testing situation. Code 3 in column N/ P

PISA.

The student can respond

to the assessment.

Cognitive,

behavioral or

emotional

disability

The student has a cognitive, behavioral or emotional

disability such that in the opinion of qualified staff,

she/he cannot participate in the PISA testing situation.

This includes students who are cognitively, behaviorally

or emotionally unable to follow even the general

instructions of the assessment. Code 3 in column N/ P

PISA.

The student can respond

to the assessment.

He/she should NOT be

excluded solely because

of poor academic

performance or

disciplinary problems.

Insufficient

assessment

language

experience

The student meets ALL of the following three criteria:

- not being a native speaker in the assessmentlanguage,

- having limited proficiency in the assessment language,

and

- having received less than one year of instruction in

the assessment language.

Code 3 in column N/ P PISA.

The student meets ONLY

one or two of the

criteria.

Field Cod

Formatte




16

Codes 4 and 5 - Student was transferred to another school or left the school

y If a student has transferred to another school, record a code 4 for this student in column

N/P PISA.

y If a student has left school, but it is not known which school the student has transferred to,

record a code 5 for this student in column N/P PISA.

Code n - Student does not meet student eligibility criteria

y If a student is enrolled in Std 6 or lower, he/she is not eligible to participate in PISA. Record a

code n for this student in column N/P PISA.

y If a student was NOT born between 01.01.1996 and 31.12.1996, he/she is not eligible to

participate in PISA. Record a code n for this student in column N/P PISA.

Summary of non-participant codes

34. All codes to be used in column N/P PISA for non-participants are summarised in Table 7Table 7. If in

doubt about which code to use, leave that column blank and insert a brief note in the Comments

column.

Table 7: Codes for Non-Participant

Reason for non-participation Code

Parent refusal 2

Excluded on SEN (Special Education Needs) basis 3

Now enrolled at another school 4

Not enrolled in this school, and enrollment is unknown 5

Does not meet PISA criteria for eligibility n

Examples of using Non-P articipant codes

35. Please refer to Figure 2Figure 2, in which the following example codes have been applied:

y M. Muthusamy has recently transferred to another school. Therefore, he is coded as 4 in

column N/P PISA.

y Ahmad Amir is coded as 3 in column SEN. He has been taught in English for less than one

year and his teachers believe that he will not be able to participate in the assessment.

Therefore, he is coded as 3 in column N/P PISA.

y While Khaw Mengs experience with English is limited, he has been taught in English for more

than one year and therefore does not meet the PISA criteria for exclusion on the basis of

insufficient language experience. Therefore, column N/P PISA is left blank, and Khaw is

considered to be able to participate in the assessment.

y M. Mahendran is blind and is coded as 1 in column SEN. PISA is not offered in Braille.

Therefore, he is unable to participate in the assessment and is coded as 3 in column N/P

PISA.

y Even though Lai Kwang is functionally disabled, it does not affect his ability to participate. So,

although he is coded as 1 in column SEN, column N/P PISA is left blank.

y The following two students are ineligible according to the PISA eligibility criteria. However,

their wrong demographic information was recorded in the List of Eligible Students, and these

students were subsequently sampled. The School Co-ordinator found the incorrect information

on the Student Tracking Form and corrected it:

- Tammy Lim does not meet the age definition and is coded as n in column N/P PISA.

- Sharifah Azman is in Grade 6 and so is coded as n in column N/P PISA.

Field Cod

Formatte

Field Cod

Formatte




17

y V. Shahrukhkhan has been professionally assessed as cognitively delayed and is coded as 2

in column SEN. She does not participate in other testing programs. Therefore, she will not

participate in the assessment and is coded as 3 in column N/P PISA.

Note 3: Column N/P PISA of Student Tracking Form

The purpose of setting a column N/P PISA is to record the reasons of non-participation for

those students who have no possibility to participate in PISA under any circumstances even if a

follow-up session is provided after the assessment. Therefore, you should NOT use a code 2 if

a student is unable to attend the PISA assessment, for example, due to a competing activity

in/outside the school or illness, as he/she might be able to attend a follow-up session.

Students to be assessed in PISA

36. Only those students who have NO codes placed in column N/P PISA can be assessed in PISA.

Important! Under No circumstances may a sampled student be replaced with any other student.

7. Give School Questionnaire to appropriate person atyour school

37. The School Questionnaire should be completed by the school principal, but she/he may delegate the

task to another person in the school.

8. Organise and confirm assessment plans with schoolstaff and with Test Administrator

38. During the two weeks preceding the assessment, you will need to confirm these plans:

y arranging for a technical support person to prepare computers for the Computer-Based

Assessment ;y asking participating students to bring a: (a) pencil; (b) eraser; (c) ruler; and (d) calculator on

the day of the assessment or preparing the above stationery at the school;

y obtaining a few spare items of the stationery listed above and some books or magazines for

students who finish the assessment ahead of schedule; and

y informing those concerned of any change in the date or time of the assessment. In particular,

it is important to advise EPRD, MOE, so that the Test Administrators and Quality Monitors can

be advised.

39. The Test Administrator assigned to your school should contact you approximately one week before

the assessment date to confirm the updates of the Student Tracking Form and details of the

assessment session.

9. Collect completed School Questionnaire40. Please collect the completed Questionnaire A FEW DAYS BEFORE THE ASSESSMENT DAY. It will need

to be returned to the Test Administrator on the day of the assessment.




18

Stage III: During/After the Assessment

10. Provide Test Administrator with Student Tracking

Form and School Questionnaire41. Please make sure that you have updated the Student Tracking Form before the assessment. There

might be some students who are eligible to participate in the assessment, but are absent from the

assessment. For such cases, please leave column N/P PISA blank. The Test Administrator will record

student attendance during the assessment, using a Session Attendance Form.

42. The Test Administrator will collect your Student Tracking Form as well as the completed School

Questionnaire to return to EPRD, MOE. You should make a photocopy of the Form for yourself to keep

at your school. Please store that copy until the end of the school year.

11. Be present throughout the assessment to assist TestAdministrator (if possible)

43. If it is not possible for you to be present throughout the assessment, you should be present at least atthe beginning of the assessment session. This will help set the tone of the session and demonstrate

the importance of the study.

Note 4:

y Because PISA materials may be used in the future, their security is very important;

y You and other school staff members are allowed to look through unused booklets only after

the assessment, and in the presence of the Test Administrator; and

y DO NOT photocopy or copy the test booklet and Computer-Based Assessment materials in

any way under any circumstances.

12. Arrange for follow-up session (if needed)

44. PISA requires a high level of participation amongst the sampled students. If several students are

absent from the P aper-Based PISA session or the Computer-Based Assessment session, it may

therefore be necessary to arrange a follow-up session. The Test Administrator will guide you through

the process of determining whether or not you will need to arrange a follow-up session.

45. If you and the Test Administrator decide that a follow-up session should be arranged, please select a

date and time that will maximize the number of students attending the session and that is convenient

for the Test Administrator.

Note 5: There can only be ONE follow-up session. Please make every attempt to ensure that

absent students attend the follow-up session.

13. Arrange assistance for Test Administrator for

Computer-Based Assessment session46. If the P aper-Based PISA and Computer-Based Assessment sessions will be conducted by different Test

Administrators, please make sure that the Test Administrator for the Computer-Based Assessment will

obtain from the other Test Administrator:

y The Student Tracking Form to check the consistency; and

y A copy of the Session Attendance Form used for the P aper-Based PISA. This will enable her/him

to check that only students who were present for the P aper-Based PISA are assessed in the

Computer-Based Assessment .




19

Your help with PISA is very important to its success.

EPRD, MOE and the International Project Team appreciate your time and

effort.

Thank you!




20

Appendix 1: PISA 2012 Main Survey - Assessment Dates Form

To: Dr Ihsan Ismail

Fax or e-

mail:

03-88846579 or

[email protected]

From: Fax No.: ( )

Phone No.: ( ) E-mail:

School Name: State:

Date:

Issues to consider when selecting assessment dates for your school

y The PISA will take place between 09.04.2012 and 11.05.2012;

y TheP aper-Based PISA session will take about 3 hours and 15 minutes, including breaks and time for

distributing and collecting materials;

y The Computer-Based Assessment session will take approximately 1 hour 30 minutes, including

time to set-up the test area;

y You are encouraged to schedule the P aper-Based PISA to commence early in the morning, and the

Computer-Based Assessment to be carried out in the afternoon. The Computer-Based Assessment

session should be conducted after the P aper-Based PISA;

y EPRD, MOE will send a trained Test Administrator to the school to carry out both the P aper-Based

PISA and the Computer-Based Assessment sessions;

y For the Computer-Based Assessment session, it is advisable that a member of staff familiar with the

schools computers and IT policies is available to assist the Test Administrator. Otherwise, you

should be available for the beginning of the assessment and/or periodically;

y Please check your School Calendar to ensure there are no other events that coincide with PISA (for

example, tests/exams, sports festival or excursions); and

y Please ensure you have made arrangements for the assessment location. For the P aper-Based PISA,

the room should have a capacity for 35 sampled students sitting at single desks. For the Computer-

Based Assessment , a single room able to accommodate 14 computers should be available.

Please nominate three alternative dates for the PISA assessment to take place at your school:

Preferences Date Time of commencement

First

Second

Third

Please specify any dates which will NOT be suitable for testing:

Please e-mail, fax or post back this form to EPRD, MOE by 20.02.2012. Thank you!




21

Appendix 2: PISA 2012 Main Survey - School's Computer System Diagnostic Report

Introduction

1. Fourteen (14) students in your school will participate in the Computer Based Assessment(CBA) as part of the PISA assessment. It is important to establish whether the computers

students will use for the test have the required capabilities to run the CBA test successfully.

2. This manual provides instructions for the completion of a Systems Diagnostic (SD) which

will test computer capabilities for running the CBA test. The information gained from this

diagnostic will then enable the completion of the CBA Systems Diagnostic test results

forms so that the number of suitable computers available in one room can be determined.This information will need to be provided to EPRD, MOE.

Running the Systems Diagnostic

3. The CBA Systems Diagnostic (SD) runs from a single USB drive.

4. The user must have an account with administrative rights to run the SD. This is explainedfurther below in the section µReporting results¶ (item d).

5. The operating system must be Windows XP, Windows Vista or Windows 7.

6. The SD provides a variety checks. As a minimum, the test input, basic check and virus scanof the USB MUST be completed. A virus scan of the local hard drive and an advanced

check are also recommended but are not mandatory. Each test is described in this manual.

7. To run the SD, turn on the computer and close any applications running on the computer.

8. Insert the SD USB and open Windows Explorer. Locate and run the executable file in theroot directory of the USB called µPISAmenu.exe¶ (e.g. by double-click on the file).

9. The following control panel will appear:

10. Click on the µStart Diagnosis¶ button and the following screen will appear:




22

11. The top section of the screen µAbout the System¶ provides general information about the

computer being tested.

"OS" refers to the operating system.

"Service Pack" is the latest installed service pack, if there is no service pack installed -- N/A-- is displayed.

"User" is the user currently logged into the computer.

"USB key size" displays the amount of free memory and total capacity of the USB drive.

12. The buttons on the right of the screen are the three different diagnostic tests that can be

implemented: the basic check, the virus scan, the advanced check and a button for exitingthe diagnostic. Please note that in the home edition of Windows XP the µAdvanced Check¶

button will be disabled.

Basic check

13. Click on the µBasic check¶ button on the right of the screen. This check may take a few

seconds to run. Below is an example of what will appear when the basic check is complete.




23




24

14. The following table indicates each type of basic check, what it is checked, the associated requirement for the CBA test and the possible messages that will appear in the centre

section of the screen above:

Label What it tests Requirement for CBA Possible message

CPU The speed of the

CPU installed in

MHz

Must be at least 1500Mhz OK : CPU speed is "n" MHz

OR

Failed : CPU speed is "n" MHz

OS The operating

system

Must beWindows XP, Windows

Vista orWindows 7

OK : Operating system is "one

of Win XP, Win Vista,Win 7"

OR

Failed : Operating system is

"system other thanWin XP,Win

Vista,Win 7"

System

memory

The memory

installed on thecomputer in MB

Required memory forWindows

XP = 512 MB


VISTA = 1024 MB


7 = 1024 MB

OK : System memory

OR

Failed : System memory

(required "n" MB)

Screen

resolution

The current

screen resolution

(width x height)

Minimal screen width = 1024 px

Minimal screen height = 768 px

OK : Screen : Width x Height

OR

Failed : Screen :Width x Height

Account with

admin rights

Whether the

current user is

logged in as an

administrator

Must be logged in as an

administrator

OK : Account with admin rights

OR

Failed : Account with admin

rights required

Skype

running?

If Skype is running

on the computer

The CBA assessment cannot run

with Skype running

OK : Skype is not running

OR

Failed : Skype should not be

running

Systems DPI

setting

The computers

current DPI

setting

DPI setting must be 96 DPI

(100%)

OK : DPI setting is 96 DPI

OR

Failed : DPI setting is "n" DPI

USB key data

transfer rate

The USB key data

transfer rate in

MB/s

Required USB data transfer rate

= 1 MB/s

OK : Speed "n" MB/s

OR

Failed : Speed "n" MB/sOR

Can't run the test - in cases

where the program could not

detect the transfer rate

15. If all basic checks are highlighted in green and labelled µOK¶, the computer is suitable for running the CBA assessment. If any appear in red, the computer may not be suitable.




25

16. For each computer tested, please complete the test results form on page 29. Please refer tothe section on Reporting Results for more information.

Virus scan

17. The virus scan can be used to check any drive on your computer. The scan must becompleted on the USB drive and will take approximately 30 seconds.

18. It is recommended (but not mandatory) to also run the scan on the local hard drive. Please

note that this may take between two and five hours for each computer.

19. To run the virus scan, click on the µVirus Scan¶ button on the bottom right of the Systems

Diagnostic check screen. All local and network drives will appear as available for

scanning. The following screen shot is an example of what will appear when 8 drives(including USB) are available for scanning.

20. To scan the USB drive, ensure that the correct drive is selected, then click on the µScan¶

button at the bottom of the screen. The following screen will appear and may takeapproximately 30 seconds to run on the USB (or up to 5 hours for the local hard drive

scan).

Field Cod




26

21. Please note that while the virus scan is running the computer¶s local antivirus software maydetect the virus scan software being used for PISA (ClamWin Free Antivirus) as a virus.

This is normal and should be ignored. Below is an example of the screen that appears

when Trend Micro OfficeScan is the local antivirus software. Dialog screens and options

will vary depending on the type of antivirus software installed locally.

22. In this example, the local virus scanner (Trend Micro Office Scan) has detected theSystems Diagnostic virus scanner (ClamWin Free Antivirus) as a virus. If this occurs click

µOK¶ and the virus scan will continue.

23. The following screen is an example of what will appear when the virus scan is complete.

24. In this example the scan was successful and the computer is suitable for the CBA. Itindicates no infected files were found.




27

25. If, however, the scan indicates that there are infected files, you will need to clean the USB(or local hard drive) with professional antivirus software or return the USB to EPRD,

MOE. Until the virus scan reveals that there are no infected files on the USB drive, the

USB should not be used to run the CBA.

26. Click on the µClose¶ button to exit the virus scan.

Advanced check optional

27. The advanced check is a more detailed scan of the memory of the computer. By selectingthis option, a text file is written to the USB that contains information regarding the

computer¶s memory. This may take a few minutes to complete. While the check is running,

the cursor changes into an hourglass icon. It is not a requirement to run this check unlessrequested to do so by your national center who may then request some specific information

from this text file.

Test input28. Click on the µExit¶ button and return to the control panel which has the µTest input¶ button

as indicated in the screen shot below.

29. Click on the µTest input¶ button. An automatic virus scan of the memory will commence.

This scan will take two or more minutes depending on the size of the computer¶s memory.

30. If the software indicates that a virus is detected a popup window will appear informing you

of this and asking whether you would like to proceed with the CBA. You may choose to

proceed but it is recommended to clean the computer with professional antivirus software

first. This reduces the likelihood that a virus will be transferred to the USB.

31. Once the virus scan is complete, enter the password:

123456789




28

The following screen will appear:

32. If this page does not appear, press ALT TAB to return to the PISA 2012 Control Panel andclick on the µExit¶ button. Eject the USB from the computer and start the process of

running the µTest input¶ check again. If the error continues to appear, re-start the computer

before trying again.

33. This µmock item¶ is designed to test if the functionality of the CBA will work on the

computer. Please complete the following:

1. Drag and drop the box as indicated and record whether this function works or not.

2. Enter text into the text box and record whether this function works or not.

34. Once complete press ALT TAB to access the Pisa 2012 Control Panel, click on the µExit¶

button and remove the USB from the computer.




29

Reporting results

35. For each computer tested, please complete the test results table below. Make photocopies as

required.

36. Please then collate the information from all test results and determine how many computers

are suitable in a single room for CBA testing. Then pass this information onto the <NC>.

CBA SYSTEMS DIAGNOSTIC TEST RESULTS FORM

BASIC CHECKS

CPU OK FAILED

OS OK FAILED

System memory OK FAILED

Screen resolution OK FAILED

Account with adminrights

OK FAILED

Skype running? OK FAILED

System¶s DPI setting OK FAILED

USB key data transfer rate

OK FAILED

VIRUS SCAN OK FAILED

USB Drive OK FAILED but corrected FAILED

Local Hard Drive OK FAILED but corrected FAILED Not Applied

ADVANCED CHECK Not Applied OK FAILED

TEST INPUT

Drag and drop OK FAILED

Enter text OK FAILED

COMMENTS

IS THE COMPUTER

SUITABLE?*

YES NO




30

* Instructions for establishing if the computer is suitable

Use the information in the summary section of the test results to establish if the computer is

suitable for the CBA test:

a. If all checks are OK (or µNot Applied¶) then the computer is suitable for the CBA test.

b. If µCPU¶, µOS¶ or µSystem memory¶ failed the test, the computer is not suitable for theCBA test.

c. If the µscreen resolution¶ test fails, you may attempt to alter the screen resolution. To do

this, go to µSettings¶ and then µControl Panel¶ from the µStart¶ menu. Open µDisplay¶and go to the µSettings¶ tab. Ensure that the resolution is set to at least 1024 x 768

pixels. If this level of resolution is not available the computer is not suitable for running

the CBA test. If this level of resolution is available, apply the new settings and run the basic check again. If the µscreen resolution¶ test is ok, the computer is suitable with this

setting; if it fails the computer is not suitable for the CBA test.

d. If the µaccount with admin rights¶ test fails it may be possible to change the

administration settings of the computer. To do this, go to µSettings¶ and then µControlPanel¶ from the µStart¶ menu. Open µUser Accounts¶ and change the user group

membership to µAdministrator¶. Note that this setting should be altered using the main

administrator account for the computer. After adjusting the administrator settings on thecomputer, run the basic check again. If the µaccount with admin rights¶ test is ok, thecomputer is suitable with this setting, if it fails the CBA test can not be launched. For

more detailed instructions on adjusting the administration rights on the computer, visit

one of the following websites depending on your operating system.

Operating system Creating user accounts Creating user account group membership

Windows XP http://www.microsoft.com/windowsxp/

using/setup/winxp/accounts.mspx

http://www.microsoft.com/resources/docume

ntation/windows/xp/all/proddocs/en-us/usercpl_change_group.mspx?mfr=true

Windows Vista http://windows.microsoft.com/en-

US/windows-vista/Create-a-user-account

http://windows.microsoft.com/en-

US/windows-vista/Change-a-users-account-

type

Windows 7 http://windows.microsoft.com/en-

us/Windows7/Create-a-user-account

http://windows.microsoft.com/en-

us/windows7/Change-a-users-account-type

e. If the µSkype¶ test fails, ensure that Skype is shut down on the local computer and runthe basic check again. If the µSkype¶ test still fails the computer is not suitable for

running the CBA test.




31

f. If the µSystem¶s DPI setting¶ fails, it is possible to adjust these settings. The system¶sDPI must be set to 96 DPI (100%). For instructions on adjusting the system¶s DPI

setting visit one of the following websites depending on your operating system.

Operating system Website for instructions for altering the systems DPI settings

Windows XP http://www.microsoft.com/windowsxp/using/setup/personalize/look.mspx

Windows Vista http://windows.microoft.com/en-US/windows-vista/Make-the-text-on-your-

screen-larger-or-smaller

Windows 7 http://windows.microsoft.com/en-us/windows7/Make-the-text-on-your-

screen-larger-or-smaller

After making this adjustment, run the basic check again. If the µSystem¶s DPI setting¶ isok, the computer is suitable however if the test still fails, the computer is not suitable for the CBA test.

g. If the µUSB Key data transfer rate¶ test fails, the USB is not suitable for running the test

and you will need to contact your <NC>. A USB that has a data transfer rate of 1 MB/smust be used.

Exit

37. Once the basic check, virus scan, advanced check and mock item check have been

completed, please exit the SD by clicking on the µExit¶ button on the main screen andremove the USB from the computer.

Return of materials

38. Once all computers have been tested using the Systems Diagnostic, please return the USBs

to the national centre.




Appendix 3: PISA 2012 Main Survey - List of Eligible Students

School Name: ___________________________________________________________________________

Address: _______________________________________________________________________________

Telephone: ________________________________ Fax: ______________________________________

List Prepared By: ____________________________ Date List Prepared: __________________________

Total Number of Students Listed: _______________

DIRECTIONS: Please list ALL students in your school in Form 1 or higher born between 01.01.1996 and

31.12.1996.

(A)

Student Name

(B)

Grade

(C)

Gender

(Female=1;

Male=2)

(D)

Birth Date

(MM-YYYY)

(E)

Study

Programme

(F)

SEN*


SC Manual MS12 English Ver 2

Documents

Transcript of SC Manual MS12 English Ver 2