ASys: Demo Problem to solve ASys (Assessment system) Analisys of the properties Architecture of the...
-
Upload
rosalyn-edwards -
Category
Documents
-
view
218 -
download
0
Transcript of ASys: Demo Problem to solve ASys (Assessment system) Analisys of the properties Architecture of the...
Semi-Automati c Assessmentof Unrestrained Java Code
David Insa CabreraUniversitat Politècnica de Vàlencia (UPV)
ASys: Demo
Outline
Problem to solve
ASys (Assessment system)
Analisys of the propertiesArchitecture of the system
DFD to mark one examTesting using test cases
Future work
The beginning of the project
Inconsistency in marks awarded by different examiners
Detected problems
Different interpretation of the marking criteria Mark errors cancel each others Teacher bias in awarding marks to different students
Reduce marking time
Objectives to achieve
Remove marking subjectiveness Increase marking precision Ensure the same marking criteria are applied to all students irrespective of their group, time, location, and examiner
Pilot project (2014-2015)
We implemented ASys (Assessment System)All final exams of one subject were marked twiceo Normally and without knowledge of the pilot projecto With ASys (without any assessment impact)
ASys: Demo
Outline
Problem to solve
ASys (Assessment system)
Analisys of the propertiesArchitecture of the system
DFD to mark one examTesting using test cases
Future work
ASys: Architecture
Student’s solution
Marking template
Code analisys using Java Reflection
Report
ASys: Analisys
JavaCompiler
Student’s solution
Teacher’s solution
Student’s solution
Teacher’s solution
Test cases generator
JVM
InputInputInputInput
OutputOutputOutputOutput
Test cases validator
Report
ASys: Testing
ASys: DFD
ASys: Demo
Outline
Problem to solve
ASys (Assessment system)
Analisys of the propertiesArchitecture of the system
DFD to mark one examTesting using test cases
Future work
ASys: Demo
ASys: Demo
Figure Volume
ASys: Demo
Outline
Problem to solve
ASys (Assessment system)
Analisys of the propertiesArchitecture of the system
DFD to mark one examTesting using test cases
Future work
Future work
Version of ASys for the students
o Can solve their questions without waiting for the teachero Correct on their own the exams after the submission
Evaluate the usefulness of the tool with 1500 students
o To do the exerciseso To take the examso Poll at the end of the year
Thank you
David Insa Cabrera