1

Assessment and Assessment and Evaluation for Online Evaluation for Online

CoursesCourses

Assessment and Assessment and Evaluation for Online Evaluation for Online

CoursesCoursesAssociate Professor Dr.Associate Professor Dr.

Annabel Bhamani Kajornboon Annabel Bhamani Kajornboon (kannabel@chula.ac.th)(kannabel@chula.ac.th)

CULI’s 6CULI’s 6thth Intl Conference: Facing ELT Intl Conference: Facing ELT Challenges Challenges

Nov. 27- 29, 2006Nov. 27- 29, 2006

2

Focus•Assessment•Evaluation

3

Introduction• Computers a part of education• T technology & pedagogical problems• T concern attend seminars, conferences etc.• “In keeping with a learner-centered approach,

evaluation and assessment should be part of the learning-teaching process, embedded in class activities and in the interactions between learners and teachers” (Harasim et al. 1996:167).

4

Terminology• E-learning and online – interchangeably• Assessment– -the act of judging or assessing a

person, situation or event -learning outcomes assessment

provides what ss know and can do at specific points

designed to improve learning

5

Evaluation (1)

• Assess effectiveness of an ongoing program in achieving its objective(s)

• Relies on standards of project design to distinguish a program’s effect from those of other forces

• Aims at program improvement through a modification of current operation

6

Evaluation (2) • Collect infor. (assessments) to make

informed decisions about continued instruction, programs, or activities.

• Evaluation can assess both the process and outcomes.

• Judging the quality, value or worth of a program or student performance using established criteria, using gathering data.

7

Evaluation (3)• Process of determining the

adequacy, value, outcomes and impact of instruction & learning,

• Assessment at a point in time of the value, worth of impact of a project or program,

• Can be conducted at various points in a project.

8

Technology

E-learning course

Teacher Students

Chart 1: Linkage of e-learning courses to assessment and evaluation

Assessment &Evaluation

s

9

Action-Reflection Cycle Planning

Reflecting Acting

Observing

10

Websites Assessments• Quiz• Test• Papers

Let's look at examples of websites assessment

11

Examples of Websites Assessments

2Example A: About English as a nd Langua PPPPP P PPPPPPPP-–//

• There are15 questions. Ss click the m ouse to answer the question.

• Ss are given 10 seconds to answer eac h question with only one correct answer.

• Feedback is provided at the end of the quiz.

12

Example A: About English as a 2nd Language Prepositions of

Place – in/at/on

13

Example A: About English as a 2nd Language Prepositions of Place –

in/at/on (2)

Last line from previous example: More prepositions quizzes

• Example B 2: About English as a nd La PPPPP P PPPPPPPP-–//

• Feedback is given for correct answer

14

Example B : About EnglishLanguage Prepositions of Place –

in/at/on-

15

Example C: About English as a 2nd Language Prepositions of Place – in/at/on- If ss do not click an answer the following

appears

16

If students click the incorrect answer the foll owing appears

look at Example D: 2About English as a nd Lang PPPPP P PPPPPPPP-–//

17

Example D: Prepositions of Place

That answer was not correct.

18

Example E: Lang. Prep. of Place (1)

• When students complete the quiz, the score will appear and other quizzes are offered.

• Let’s look at the score and what else is offered.

19

Example E: Lang. Prep. of Place (2)

20

Other form of assessments

• Electronic portfolios• Computer-based work checklist• Peer review• Sheets• Close texts• Learning logs• Multimedia projects

21

Example G: Example of Portfolio Scoring Rubric

22

E-portfolio• It is a collection of students’ work

that shows students’ efforts, progress, and achievements in more or more areas or the curriculum.

23

Example H: E-portfolio

24

Example I: E-portfolio

25

What to include in an e-portfolio?

Collection can include:• Ss participation in selection content• Criteria for selection• Criteria for judging merits• Evidence of ss self-reflection• A collection of ss best work or efforts,

ss choose samples to meet assignment. Show growth & development.

26

What is necessary to create e-portfolio?

• Equipment• Software• Training• Play• Plan

• An assessment tool depending on knowledge level of T, time T have & can invest

27

Example J: Example of an e-portfolio

28

E-Portfolio• An e-portfolio is an organized,

purposeful collection of students’ work that displays knowledge, understanding, skills, accomplishments, interest and achievement over a period.

• Time and planning is essential.

29

Example l: Sarah’s work

30

Example M: T’s feedback (1)

31

Evaluation(1)

• The evaluation can be conducted via qualitative methods which are often used.

• They tell the program’s story by capturing and communicating the participants’ stories.

• The action-reflection cycle can be used.

32

Evaluation (2)

It would be assessing the program.• Systematic collection of information

about the activities characteristics, and outcomes of programs to make judgments about the program, improve program effectiveness and/or inform decisions about future programs.

33

An Example of Evaluation

(Research) (1)

• Aj arns teaching oral com. courses were interviewed to find out the pr

edicaments they were facing.• W hat were some of the problem s t

hey had encountered teaching,• The interviews were analyzed.• The data was presented in a matrix

form to find a common thread.

34

An Example of Evaluation

(Research) (2)

• Kajornboon (2005) investigated issues th at teachers face in teaching oral com. in t he Thai context and examined existing te

aching method in oral communication th at teachers found effective and productiv

e. • T he study aimed to provide a practical gui

deline or checklist to assist ajarns in teac hing oral communication in order to impro

ve students’ language development.

35

Conclusion• Web assessment & evaluation can take

many dimensions.• T set their goal and know what they wan

t to measure, such as the course, studen ts, or program.

• T choose to do assessment or evaluatio n that is best for their students and cour

se.

36

Q & A• Comments• Questions• Thank youEmail: kannabel@chula.ac.th annabelbk@yahooSubj.: assessment/evaluation