Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing...
Transcript of Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing...
![Page 1: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/1.jpg)
December 11, 2015 Washington D.C.
Presented by Lydia Malley and Dana Kelly, NCES
Testing Sampler: Trying Out TIMSS and PISA
![Page 2: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/2.jpg)
NCES International Assessments
4th grade PIRLS, TIMSS
8th grade TIMSS
15-year-olds PISA
12th grade TIMSS Advanced
Adults 16-65 PIAAC
Middle grades TALIS
![Page 3: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/3.jpg)
What is TIMSS? § The Trends in International Mathematics and Science
Study (TIMSS) is an international large-scale student assessment sponsored by the International Association for the Evaluation of Educational Achievement (IEA).
§ Assessment of students in grades 4 and 8 § Grade 12 also assessed in 2015 in TIMSS Advanced
§ Mathematics and science § Every 4 years, beginning in 1995
![Page 4: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/4.jpg)
What is PISA? § The Program for International Student Assessment
(PISA) is an international large-scale student assessment sponsored by the Organization for Economic Cooperation and Development (OECD).
§ Assessment of 15-year-old students § PISA assesses applied knowledge/literacy:
• “How well can students nearing the end of compulsory schooling apply their knowledge to real-life situations?”
§ Mathematics, reading, science literacy § Other subjects: collaborative problem solving and financial literacy
§ Every 3 years, beginning in 2000
![Page 5: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/5.jpg)
TIMSS and PISA TIMSS PISA
Subjects Mathematics and science Mathematics, reading, and science literacy Collaborative problem solving and financial literacy
Year of first assessment
1995 2000
Frequency Every 4 years Every 3 years
Target population 4th- and 8th-graders 12th-graders in 2015
15-year-old students
Participation in 2015 65 education systems (incl. 1 U.S. state (FL))
77 education systems (incl. 2 U.S. states (MA, NC))
Context questionnaires
Student, school, teacher, curriculum
Student, school, teacher (2015)
Format Paper-based until 2019 Computer-based as of 2015
![Page 6: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/6.jpg)
Sample Math Items from TIMSS and PISA
![Page 7: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/7.jpg)
TIMSS 8th Grade Math Content and Cognitive Areas
Content domains: – Number – Algebra – Geometry – Data and Chance
Cognitive domains: – Knowing – Applying – Reasoning
![Page 8: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/8.jpg)
PISA Math Content Areas and Processes
Content domains: – Change and
relationships – Space and shape – Quantity – Uncertainty and data
Processes: – Formulating situations
mathematically – Employing
mathematical concepts, facts, procedures and reasoning
– Interpreting, applying and evaluating mathematical outcomes
![Page 9: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/9.jpg)
TIMSS 8th Grade Math Item #1
9
Percentage of 8th-graders answering correctly: US: 66% Int’l Avg: 45%
Correct Answer: A
Content Domain Cognitive Domain Data and Chance Reasoning
Source: TIMSS 2011
![Page 10: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/10.jpg)
TIMSS 8th Grade Math Item #2
10
Percentage of 8th-graders answering correctly: US: 27% Int’l Avg: 48%
Content Domain Cognitive Domain Geometry Applying
Correct Answer:
Source: TIMSS 2011
![Page 11: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/11.jpg)
TIMSS 8th Grade Math Item #3
11
Percentage of 8th-graders answering correctly: US: 37% Int’l Avg: 40%
Correct Answer: B
Content Domain Cognitive Domain Algebra Applying
Source: TIMSS 2011
![Page 12: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/12.jpg)
PISA Math Item #1 (paper-based)
12 Source: PISA 2012
Content Domain Process Space and Shape Employ
Correct Answer: 120
Percentage of students answering correctly in PISA 2012 US: 47% OECD avg: 58%
![Page 13: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/13.jpg)
PISA Math Item #2 (paper-based)
13 Source: PISA 2012
Content Domain Process Space and Shape Formulate
Correct Answer: Answers in the range from 103 to 105 Percentage of students answering correctly in PISA 2012 US: 2% OECD avg: 4%
![Page 14: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/14.jpg)
PISA Math Item #3 (paper-based)
14 Source: PISA 2012
Content Domain Process Quantity Formulate
Correct Answer: 720
Percentage of students answering correctly in PISA 2012 US: 45% OECD avg: 46%
![Page 15: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/15.jpg)
Sample Science Items from TIMSS and PISA
![Page 16: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/16.jpg)
TIMSS 8th Grade Science Content and Cognitive Areas Content domains:
– Biology – Chemistry – Physics – Earth Science
Cognitive domains: – Knowing – Applying – Reasoning
![Page 17: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/17.jpg)
PISA Science Knowledge Areas and Competencies
Knowledge: - Content
• Physical systems • Living systems • Earth and space systems
– Procedural – Epistemic
Competencies: – Identifying scientific
issues – Explaining phenomena
scientifically – Using scientific evidence
![Page 18: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/18.jpg)
TIMSS 8th Grade Science Item #1
18
Percentage of 8th-graders answering correctly: US: 32% Int’l Avg: 17%
Correct Answer: Potential energy or gravitational energy or stored energy
Content Domain Cognitive Domain Physics Knowing
Source: TIMSS 2011
![Page 19: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/19.jpg)
TIMSS 8th Grade Science Item #2
19
Percentage of 8th-graders answering correctly: US: 37% Int’l Avg: 24%
Correct Answer: Kinetic energy
Content Domain Cognitive Domain Physics Knowing
Source: TIMSS 2011
![Page 20: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/20.jpg)
TIMSS 8th Grade Science Item #3
20
Percentage of 8th-graders answering correctly: US: 28% Int’l Avg: 27%
Content Domain Cognitive Domain Physics Reasoning
Correct Answer: reason related to increasing the flow of water. Example: More water coming out at once; a bigger opening.
Source: TIMSS 2011
![Page 21: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/21.jpg)
PISA Science Item #1 (paper-based)
21
Content Knowledge Competency Physical Systems Explaining Phenomena
Scientifically Source: PISA 2006
![Page 22: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/22.jpg)
Scoring for PISA Science Item #1 (paper-based)
22 Source: PISA 2006
Percentage of students answering correctly in PISA 2006 US: 54% OECD avg: 58%
![Page 23: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/23.jpg)
PISA Science Item #2 (paper-based)
Correct Answer: A
23 Source: PISA 2006
Content Knowledge Area
Competency
Physical Systems Using Scientific Evidence
Percentage of students answering correctly in PISA 2006 US: 66% OECD avg: 67%
![Page 24: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/24.jpg)
PISA Science Item #3 (paper-based)
24 Source: PISA 2006
Knowledge Area Competency Scientific Inquiry Identifying Scientific
Issues
Percentage of students answering correctly in PISA 2006 US: 35% OECD avg: 36%
![Page 25: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/25.jpg)
PISA Computer-Based Science Sample Item
Source: PISA 2015
![Page 26: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/26.jpg)
PISA Computer-Based Science Sample Item - continued
Source: PISA 2015
![Page 27: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/27.jpg)
PISA Computer-Based Science Sample Item - continued
Knowledge Area Competency Procedural Interpret Data and
Evidence Scientifically Source: PISA 2015
![Page 28: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/28.jpg)
PISA Computer-Based Science Sample Item - continued
Content Knowledge Competency Living Systems Explain Phenomena
Scientifically Source: PISA 2015
![Page 29: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/29.jpg)
PISA Computer-Based Science Sample Item - continued
Content Knowledge Competency Living Systems Explain Phenomena
Scientifically
Knowledge Area Competency Procedural Evaluate and Design
Scientific Enquiry
Source: PISA 2015
![Page 30: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/30.jpg)
Sample Reading Items from PISA
![Page 31: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/31.jpg)
PISA Reading Situation, Text, and Aspect Areas
Situation: – Personal – Educational – Occupational – Public
Aspects: – Access and
retrieve – Integrate and
interpret – Reflect and
evaluate
Text: – Medium: print and digital – Environment: authored,
message-based and mixed – Text format: continuous,
non-continuous, mixed and multiple
– Text type: description, narration, exposition, argumentation, instruction and transaction
![Page 32: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/32.jpg)
PISA Reading Item #1 (paper-based)
32 Source: PISA 2009
![Page 33: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/33.jpg)
Correct Answer: D
33
Text Aspect Text Format: Multiple Integrate and Interpret
PISA Reading Item #1 (paper-based)
Percentage of students answering correctly in PISA 2009 US: 55% OECD avg: 52%
Source: PISA 2009
![Page 34: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/34.jpg)
PISA Reading Item #2 (paper-based)
Percentage of students answering correctly in PISA 2009 US: 60% OECD avg: 56%
Text Aspect Text Format: Continuous Reflect and Evaluate
Source: PISA 2009
![Page 35: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/35.jpg)
PISA Reading Item #3 (paper-based)
Correct Answer: B
35
Text Aspect Text Format: Multiple Integrate and Interpret
Percentage of students answering correctly in PISA 2009 US: 52% OECD avg: 60%
Source: PISA 2009
![Page 36: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/36.jpg)
Sample items from TIMSS Advanced
![Page 37: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/37.jpg)
TIMSS Advanced Math Item #1
Source: TIMSS Advanced 1995
![Page 38: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/38.jpg)
Scoring TIMSS Advanced Math Item #1
Source: TIMSS Advanced 1995
![Page 39: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/39.jpg)
Scoring TIMSS Advanced Math Item #1 – cont.
![Page 40: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/40.jpg)
TIMSS Advanced Physics Item #1
International average 40.9% 22.3% 25.5% 10.2% 1.1% Source: TIMSS Advanced 2008
![Page 41: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/41.jpg)
Coming Soon
TIMSS 2015 and TIMSS Advanced Results – Released November 29th, 2016
PISA 2015 Results –
Released December 6th, 2016
![Page 42: Testing Sampler: Trying Out TIMSS and PISA - EWA.org · Lydia Malley and Dana Kelly, NCES Testing Sampler: Trying Out TIMSS and PISA . NCES International Assessments 4th grade PIRLS,](https://reader030.fdocuments.in/reader030/viewer/2022041210/5dd0ba3fd6be591ccb6266d8/html5/thumbnails/42.jpg)
Resources at NCES For more information about TIMSS and PISA, data, and
publications: http://nces.ed.gov/timss/
http://nces.ed.gov/surveys/pisa/
TIMSS: Lydia Malley ([email protected]) and Stephen Provasnik ([email protected])
PISA: Patrick Gonzales ([email protected])
And Dana Kelly ([email protected])