Critiquing CS Assessment from a CS for All lens: Dagstuhl Seminar Poster
Classroom Assessment for Student Learning March 2009 Assessment Critiquing.
-
Upload
marshall-simon -
Category
Documents
-
view
220 -
download
0
Transcript of Classroom Assessment for Student Learning March 2009 Assessment Critiquing.
![Page 1: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/1.jpg)
Classroom Assessment for
Student Learning
March 2009
Assessment Critiquing
![Page 2: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/2.jpg)
Today’s outcomes
Review new ISS learning triangle
Review Key 3: Sound design: Stages of Assessment development
Understand bias, how bias looks in an assessment
Critique an assessment (CFA) for sound design
Pre-HYIS input re: graphic organizers
![Page 3: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/3.jpg)
![Page 4: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/4.jpg)
Keys to Quality Classroom Assessment
Clear PurposesWhy Assess?
What’s the purpose?Who will use results?
Clear TargetsAssess What?
What are the learning targets?Are they clear?Are they good?
Good DesignAssess How?
What method?Sampled how?
Avoid bias how?
Sound CommunicationCommunicate How?
How manage information?How report?
Accurate Assessment
Effectively Used
Student InvolvementStudents are users, too.
Students need to understand learning targets, too.Students can participate in the assessment process, too.
Students can track progress and communicate, too.
![Page 5: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/5.jpg)
Overview of Stages in Assessment Development
All assessments, regardless of method selected, go through the same five stages of development:
1. Planning
2. Developing
3. Critiquing
4. Administering
5. Revising
![Page 6: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/6.jpg)
Stage One - Planning
Assess WHY? Determine the intended use of an
assessment Identify the learning targets to be assessed Select the proper assessment method
![Page 7: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/7.jpg)
Stage Two - Developing
Select or create test items or tasks Select or create scoring mechanisms (rubric,
scantron, etc.)
**we used the test planning document for this.
![Page 8: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/8.jpg)
Stage Three - Critiquing
Evaluate to avoid bias or misrepresentation
Today’s focus!
![Page 9: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/9.jpg)
Today’s focus: Critique A Working Definition
Going back over the assessment to see if you have completed or addressed all the necessary components of sound assessment design.
![Page 10: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/10.jpg)
Looking for BiasWorking Definition of Bias
Anything in the assessment, or the conditions under which the assessment was given, including student barriers, that would lead to inaccurate measurements of student learning.
See handout
![Page 11: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/11.jpg)
Critiquing activity
Get with your PLC members. **If you’re in a virtual PLC, find another VPLC
person to work with or sit in with a small PLC group.
Each PLC should use one check-off sheet to critique your CFA. (VPLC—use a sep. sheet)
![Page 12: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/12.jpg)
Basic Components of Sound Assessment Design1. Are the student learning targets that are being measured by the
assessment stated? Clear?2. Is there a match between the stated learning targets and what is ON
the assessment?3. Does the method used match the target being assessed?4. Does the number of items for each target give you the information that
you need to determine student mastery of the target?5. Is the amount of instructional time spent on each target reflected in the
assessment?6. Is there anything in the assessment or conditions under which
administered that could lead to inaccurate estimates of student learning?
7. Will accommodations made for diverse student characteristics result in any distortions in the final judgment of student learning?
8. Are instructions present, clear, concise?
![Page 13: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/13.jpg)
Question 1
Are the student learning targets measured by the assessment stated? Are they clear?
Look at samples provided. Now look at YOURS.
If the answer is yes, put a check in the box. If it’s no, then make notes as to how
you will make corrections.
![Page 14: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/14.jpg)
Question 2
Is there a match between the stated learning targets and what is ON the assessment?
Look at samples provided. Now look at YOURS.
If the answer is yes, put a check in the box. If it’s no, then make notes as to
how you will make corrections.
![Page 15: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/15.jpg)
Question 3
Does the method used match the target being assessed?
Look at the test planning document and your curriculum guide.
Now look at your CFA. If the answer is yes, put a check in the box. If it’s no, then make notes as to how you will make corrections.
![Page 16: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/16.jpg)
Question 4
Does the number of items for each target give you the information that you need to determine student mastery of the target?
Look at samples provided. Now look at YOURS.
If the answer is yes, put a check in the box. If it’s no, then make notes as to how you will
make corrections.
![Page 17: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/17.jpg)
Planning Backwards:Utilize Your “Planning To Assess” Document to ensure proper Sampling, representation and balance
Target Target Type (K, R, S, P)
Assessment Method (SR, PC,
EWR, PFA)
Percent of Importance In
The Overall Unit/Section
Number Of Assessment Questions Needed To
Measure This Target
1.
2.
3.
4.
5.
6.
![Page 18: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/18.jpg)
You can also take a look at the key with the objectives connected to the answers or the test itself to see if there is a match.DASH reports also give you good information on this question as well!
XXXXXX Predictive Assessment Answer Key Ans Goal 1. B NC 1.01 2. D NC 1.01 3. C NC 1.01 4. B NC 1.01 5. D NC 1.02 6. C NC 1.02 7. A NC 1.02 8. B NC 1.02 9. C NC 1.02 10. C NC 1.02 11. B NC 1.02 12. A NC 1.03 13. B NC 1.03 14. A NC 1.03 15. D NC 1.03 16. B NC 2.01 17. A NC 2.01 18. C NC 2.01 19. D NC 2.01 20. D NC 2.02 21. C NC 2.02 22. C NC 2.02 23. C NC 2.02 24. D NC 2.02 25. B NC 2.02 Use this information to determine whether the balance and sampling of all objectives is accurate…..
![Page 19: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/19.jpg)
Question 5
Is the amount of instructional time spent on each target reflected in the assessment?
![Page 20: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/20.jpg)
Question 6
Is there anything in the assessment or conditions under which administered that could lead to inaccurate estimates of student learning?
Bias? (see handout)
![Page 21: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/21.jpg)
Question 7
Will accommodations made for diverse student characteristics result in any distortions in the final judgment of student learning
Bias? (see handout)
![Page 22: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/22.jpg)
Question 8
Are instructions present, clear, concise?
![Page 23: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/23.jpg)
Stage Four - Administering
Simply administer the assessment to students
This will happen between this session and our April CASL training session scheduled for 4.28.09
![Page 24: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/24.jpg)
Stage Five - Revising
Problems with questions Problems with tasks Problems with scoring
This will happen during our last CASL training session on April 28th.
![Page 25: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/25.jpg)
CASL Content Connects to the Following NC Professional Teaching Standards:
Standard II bStandard III a, bStandard IV a, b, c, hStandard V a, b, c
![Page 26: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/26.jpg)
Standard II b - Teachers strive to understand how a student’s culture and background may influence her school performance.
Knowing how to assess - Assessment should be sensitive to cultural bias/be careful of wording on assessment (possible example: writing prompt on American Patriotism - ESL students could not write to this prompt because they were not born in America and came when they were much older, so they could not write to the prompt because it would not be meaningful to them.) Assessment bias is the focus on our CASL session in March.
![Page 27: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/27.jpg)
Standard III a –Teachers develop and apply strategies.
Assessment development is a strategy teachers use to help students understand performance on requirements and is a strategy used to inform instruction.
Standard III b – Teachers know there subject beyond what they are required to teach.
Teachers know their content when they are able to design an assessment that accurately measures student achievement levels on identified content, reviews previously learned content, and previews content not yet taught.
![Page 28: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/28.jpg)
Standard IV a – Teachers keep abreast of evolving research about student learning. They adapt resources to address to address the strengths and weaknesses of their students.
CASL is a research based best practice on how to improve assessment development, analysis, and providing feedback. With CASL, we are learning how to identify strengths and weaknesses in our own assessments, adapting our own resources to better inform ourselves and our students regarding their academic achievement.
![Page 29: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/29.jpg)
Standard IV b – Teachers use a variety of data sources short and long term based on NCSCOS. Teaches engage students in the learning process. Teachers understand that instructional plans must be consistently monitored and modified to enhance learning.
CASL helps teachers develop assessments that engage learners. If students are involved in the creation and development of assessments from the beginning, their performance on the assessment increases. CASL provides information on how monitoring timely and corrective feedback on assessment enhances student learning.
![Page 30: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/30.jpg)
Standard IV c- Teachers choose the methods and techniques that are most effective in meaning as they strive to eliminate achievement gaps.
This refers to identifying and communicating clear learning targets, types of targets, and target/method match
Standard IV h – Teachers use a variety of methods to assess what each student has learned, 21st century knowledge, skills, performance, and dispositions and to use the assessment information to adjust their instructional practice.
This is the basis of all CASL content.
![Page 31: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/31.jpg)
Standard V a -Teachers think systematically and critically about student learning in their classroom and school: why learning happens and what can be done to improve achievement.
CASL provides the research to support data analysis and classroom instructional practice at classroom and school level.
Standard V b Teachers participate continued, high quality professional development that reflects global view of educational practices ….that meets the needs of students and their own personal growth.
CASL helps to apply and implement knowledge gained from
professional development that impacts student learning.
![Page 32: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/32.jpg)
Standard V c – Teachers adapt their practice based on research and data to best meet the needs of their students.
CASL equips teachers to use assessment results as information that drives instruction. Assessment results are the data that informs teaching and learning.
![Page 33: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/33.jpg)
Pre-HYIS planning
Please put a dot on each consensogram to indicate your knowledge level of the specified thinking maps/graphic organizers.
Thank you!
![Page 34: Classroom Assessment for Student Learning March 2009 Assessment Critiquing.](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649ee95503460f94bfac28/html5/thumbnails/34.jpg)
Plus, delta, Rx
Please leave feedback as you depart. Have a wonderful day!