Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.
-
Upload
cora-daniels -
Category
Documents
-
view
214 -
download
0
Transcript of Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.
![Page 1: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/1.jpg)
Computer Science Course Assessment
Feb 15, 2012 / Dan Duchamp
![Page 2: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/2.jpg)
Purpose
• To improve the quality of education
• To improve instructors
• ABET requires it (for BS-CS program)
• Middle States requires it (for MS programs)
Why do assessment?
![Page 3: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/3.jpg)
Program Outcomes
Each program (i.e., BS major or MS degree) has PROGRAM OUTCOMES
Example program outcome:a program graduate has the “ability
to apply knowledge of computing and mathematics appropriate to the discipline.” (BS-CS outcome A)
![Page 4: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/4.jpg)
Program Outcomes
Outcomes for all CS programs listed at http://www.stevens.edu/compsci/accreditation/prog_out.html
![Page 5: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/5.jpg)
Course Outcomes
Each course has COURSE OUTCOMES
Example course outcome:“Explain how memory is
allocated among multiple resources.”(CS 520 outcome #1)
![Page 6: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/6.jpg)
Course Outcomes
Outcomes for all CS courses listed at http://www.stevens.edu/compsci/undergrad/ugrad_courses.phpand http://www.stevens.edu/compsci/graduate/masters/grad_courses.php
![Page 7: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/7.jpg)
Outcome Mapping
Each program outcome is supported by one or more course outcomes
Course 1 Course 2 Course 3
Program 1
Program 2
![Page 8: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/8.jpg)
Course Outcomes
Mapping of program outcomes to course outcomes listed with program’s outcomes at http://www.stevens.edu/compsci/accreditation/prog_out.html
![Page 9: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/9.jpg)
Example Mapping
![Page 10: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/10.jpg)
Course Assessment
• Direct: measured student performance
• Indirect: student opinions about their performance (ACE survey)
Two kinds of data:
![Page 11: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/11.jpg)
Measuring Student Performance
For each course outcome there is an “assessment instrument” (i.e., graded piece of work)
Example: homework assignment, exam question, project
![Page 12: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/12.jpg)
Course Assessment
1. Compute average performance on each instrument (0-4 scale)2. Enter average onto SPAD form inside ACE system3. Instructor also writes his/her opinions on ICE form inside ACE system4. Produce PDF versions of SPAD & ICE5. Post PDFs at http://www.stevens.edu/compsci/accreditation/forms.php
![Page 13: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/13.jpg)
SPAD Form
![Page 14: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/14.jpg)
ICE Form
![Page 15: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/15.jpg)
Course Improvement
1. Before semester, instructor reads SPAD and ICE forms from previous semesters2. From this data, instructor determines how to improve the course; instructor documents his/her plans on PCR form3. After semester, instructor produces and posts SPAD & ICE forms – for use by future instructors
![Page 16: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/16.jpg)
PCR Form
![Page 17: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/17.jpg)
Important Web Sites
ACE system (to produce SPAD and ICE forms): https://www.stevens/assess
CS forms page (to get PCR form, save PCR, SPAD, ICE): http://www.stevens.edu/accreditation/forms.php
![Page 18: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/18.jpg)
ACE
![Page 19: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/19.jpg)
CS Forms Page
![Page 20: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/20.jpg)
Mid-semester Survey
Also … around mid-semester, during class time students fill out very simple “mid-term survey” form
Instructor reads surveys and immediately makes any needed improvements
Mid-term survey forms are not saved
![Page 21: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/21.jpg)
Mid-term Survey
![Page 22: Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56649e155503460f94afef9f/html5/thumbnails/22.jpg)
What You Can Do To Help
1. Learn course outcomes2. Discuss with instructor: which instrument will measure each outcome?3. Create grade item in Moodle for each instrument4. For each instrument, compute average, convert to 0-4 scale (e.g., 79% = 3.16/4)5. Report instrument averages to instructor for entry onto SPAD