[ITICSE 2013] COLMENA: Assistance in computer programming learning using educational data mining and...

COLMENA: Assistance in computer programming learning using educational data

mining and learning analytics

ITICSE 2013

Carlos Fernández MedinaJuan Ramón Pérez-Pérez

Mª Puerto Paule-RuizVíctor Manuel Álvarez-García

Pulso research team · University of Oviedo · www.pulso.uniovi.es

miércoles 10 de julio de 13

http://www.pulso.uniovi.es


Lahtinen, E. et al. (2005)

MOTIVATION

How much do students know about their own learning process?

How much do teachers know about the learning process of their students?

Programming is DIFFICULT for students


ASSISTANCE• Programming tasks require some

ASSISTANCE.

• Traditionally: unaid environments (notepad, pen and paper).

• Integrated Development Environments (IDEs), do they give us assistance?

• Some implementations are oriented to learning (BlueJ)

• Most are not (Eclipse, Visual Studio, NetBeans)

• IDE + assistance = improvement of Teaching-Learning process

Zeller (2007)

Jadud (2006)


GOALTo enhance knowledge about the programming learning process for teachers and students

Generate feedbackMory, E.H. (2004)


LEARNING ANALYTICS

DATA MINING

SUPPORT &GUIDANCE

teachers &

PROGRAMMINGLEARNINGACTIVITIES

students

COLMENA


Fernández-Medina, C. et al. (2011)

Glahn, C. et al. (2008)

PROPOSED MODEL


•Collect compiler errors and warnings

• Each compilation/save event starts data collection

EXTRACTION LAYER


EXTRACTION LAYER


• Redundances filter

• Discard errors present in last collection

• (Unless error line has been edited)

• Persistence mechanisms

FTP, DB, files

PROCESSING LAYER


PROCESSING LAYER


compiler familyCompiler

Taxonomy

explanation and hints

global group of errors

The output

error id concept

Ben-Ari, M. (2007)

conceptual familyglobal group

of errors

ANALYSIS LAYER


ANALYSIS LAYER


error

conceptfamilies

Teachers

Students

VISUALISATION LAYER


• 43 students

• Algorithms, CS2, 6 weeks

• dynamic programming, backtracking, branch and bound, divide and conquer

• OOP basics

• 1 practical lesson = 1 session

• Eclipse + Java

APPLICATION CONTEXT

Study of processed errors and creation of conceptsmiércoles 10 de julio de 13

Error/WarningFamilyFamily

ConceptError/WarningCompiler error Conceptual

Concept

Value of field/local variable X is not used Internal Type Warning A variable or field was declared but never was used (Variables Definition, Scope of Variables)

Syntax error, insert X to complete statement. Syntax Syntax Error Incomplete code structure, is missing a final semicolon, bracket, etc. (Code Blocks usage)

X cannot be resolved to a variable Field Syntax Error A used variable is never declared before (Variables Definition, Scope of Variables)

X cannot be resolved to a type Type Syntax Error It is trying to use a variable of a type that does not exist (Variables Definition, Import Usage)

Type mismatch: cannot convert from X to X Type Semantic Error Possible loss of precision between variables (Types, Conversion of Types)

X is a raw type. References to generic type X<T> should be parameterized Type Genericity Warning

X interface is used but it is never parameterized with the type of the object that implements the interface (Genericity, Types,

Types Checking)

The import X is never used Import Import Warning A class not existent in the package or project was imported

References to generic type Y<T> should be parameterized Type Genericity Warning Method X returns a generic type. X return type should be

parameterized

The method X(parameters) is undefined for the type Y Method Semantic Error Method X is called, but it is not declared in the Class Y

º


syntax errors decreaseerrors depend of the task typeerrors related to variables are most frequent.

0

10

20

30

40

50

Field Syntax Type Import Method Constructor Internal

1 2 3 4 5 6Sessions


• Most IDEs provide insufficient information to adequately support the learning of programming.

• We propose a flexible assistance model for programming learning

• Our model collects and provides quantitative and qualitative feedback on students’ programming learning experiences

• Teachers can use their knowledge to facilitate the learning process.

TO SUM UP


FUTURE WORK

Combine more variables and indicators of the programming learning process

Analyse student behavioural patterns

Make it available to students


COLMENA: Assistance in computer programming learning using educational data

mining and learning analytics

Carlos Fernández [email protected]



mailto:[email protected]

mailto:[email protected]

[ITICSE 2013] COLMENA: Assistance in computer programming learning using educational data mining and...

Technology

Transcript of [ITICSE 2013] COLMENA: Assistance in computer programming learning using educational data mining and...