Correlation of Time on Task and TOEIC Change

14
Correlation of Time on Task and TOEIC Change Dubhgan Hinchey Moodle Moot Japan 2014. Okinawa International University, Okinawa. February 19-21, 2014.

description

In view of the fact that the online services iKnow! and EnglishCentral track student use, it is possible to pinpoint how much time students spend on task. Both services provide more appropriate, lexically graded, comprehensible input for individual students outside of class time. This longitudinal study of 20 students examines changes in TOEIC scores over a period of 6 months. Two cohorts of 10 students were identified by change in TOEIC score. Their respective TOEIC scores were compared with cumulative time spent on task. Time on task was calculated from student utilization of iKnow!, EnglishCentral, and a local installation of MoodleReader. Monthly reports of study time for iKnow! were created. EnglishCentral class completion reports of the weekly 2000 point (78 min.) goal were downloaded. Mean reading speed of 75 words-per-minute was estimated from time reading of graded readers for 10 students. The time on task for reading was then calculated by dividing the total number of words read by the mean reading speed. Preliminary, results show a mean positive correlation in TOEIC with the upper cohort spending double the amount of time on task for a 3-fold improvement in TOEIC score.

Transcript of Correlation of Time on Task and TOEIC Change

Page 1: Correlation of Time on Task and TOEIC Change

Correlation of Time on Task

and TOEIC Change

Dubhgan Hinchey

Moodle Moot Japan 2014. Okinawa International University, Okinawa. February 19-21, 2014.

Page 2: Correlation of Time on Task and TOEIC Change

Is there a correlation between time on task (outside of class)

and positive changes in students’ TOEIC scores?

Page 3: Correlation of Time on Task and TOEIC Change

E011 Class iknow! 1 hour a weekMoodleReader 2 books a weekClasstime 90min. 2x a week

E111 Class EnglishCentral 78 min. a weekMoodleReader 2 books a week

Classtime 90min. 2x a week

Class structure

Page 4: Correlation of Time on Task and TOEIC Change
Page 5: Correlation of Time on Task and TOEIC Change
Page 6: Correlation of Time on Task and TOEIC Change

80% or more to pass a quiz. Students could retry a quiz if they asked the instructor.

Page 7: Correlation of Time on Task and TOEIC Change

4 months results

• Initially 53 students tracked• 30 students only took TOEIC once• 3 students sick or fatigued in 2nd test (extreme negative changes in scores)• Culled to core group of 20

Page 8: Correlation of Time on Task and TOEIC Change

No correlation between time on task and change in TOEIC score. Non-Monotonic relationship. (Correlation Coefficient = 0.324060)

Wessa, P. (2013), Free Statistics Software, Office for Research Development and Education, version 1.1.23-r7, URL http://www.wessa.net

Page 9: Correlation of Time on Task and TOEIC Change

Upper cohort 71 hrs.

Entire cohort 53 hrs.

Lower cohort 35 hrs.

0

500

1000

1500

2000

2500

3000

3500

4000

4500

5000

Time on task: Minutes

TOEIC Improvement The upper cohort spent twice as much time on task than the

lower.Upper cohort = 10 SsEntire cohort = 20 SsLower cohort = 10 Ss

Page 10: Correlation of Time on Task and TOEIC Change

Upper Cohort Entire Cohort Lower Cohort0

20

40

60

80

100

120

140Mean of TOEIC change

122 points

77 points

33 points

TOEIC Improvement

Page 11: Correlation of Time on Task and TOEIC Change

3 Self-access Students

Aug. 1st 2013 –Jan. 15 2014

TOEIC

Student A350 – 485

EnglishCentral iKnow!MoodleReader

51 hrs. 17hrs. 20 books

No score after Aug.

Student B385 - 470

iKnow! 53 hrs. Feb. 525+140

Student C370 - 430

iKnow!MoodleReader

9 hrs.21 books

Feb. 460+90

Page 12: Correlation of Time on Task and TOEIC Change

Students April June Aug. Oct. Feb. + / -

A 370 500 580 500 130B 355 445 110C 470 535 65D 525 670 585 60E 410 490 445 35F 415 430 15G 450 475 560 445 -5H 305 340 265 -40I 425 435 365 -60J 505 510 570 415 -90

8 students with no scores

Page 13: Correlation of Time on Task and TOEIC Change

• TOEIC offered less frequently

• E011 and E111 to be merged into a continuous class.

• Poster children

• Student database for tracking students

Conclusions

Page 14: Correlation of Time on Task and TOEIC Change

Questions or comments?

Dubhgan [email protected]

Moodle Moot Japan 2014. Okinawa International University, Okinawa. February 19-21, 2014.