Using MOOCs for teaching analytical...
Transcript of Using MOOCs for teaching analytical...
1
sisu.ut.ee/measurement
1
Using MOOCs for teaching analytical chemistry
Ivo Leito, Irja Helm, Lauri Jalukse
13.09.2016 EuCheMS 2016 Seville
I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281
Massive Open Online Courses
• Term coined in 2008– by D. Cormier and G. Siemens
• MOOCs were hailed asthe future of higher education– 2012: „Year of the MOOC“
by NYT• Since then, a lot of criticism
– insufficient interaction between teachers and students, low course completion rates, etc
– It is now acknowlegded that MOOCs were orginallyoverhyped
13.09.2016 EuCheMS 2016 Seville 2
Cormier D (2008) The CCK08 MOOC – connectivism course, 1/4way. Available from Dave Cormier’s blog. http://davecormier.com/edblog/2008/10/02/the-cck08-mooc-connectivism-course-14-way/
Pappano L (2012) The year of the MOOC. The New York Times, Nov2, 2012
I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281
2
MOOCs: stillvery promising
• MOOCs have undoubted advantages• Offered by many leading universities• Offered by many online providers
– Coursera, edX, Udacity, …13.09.2016 EuCheMS 2016 Seville 3
"Gartner Hype Cycle" by Jeremy Kemp at Wikipedia.Licensed under CC BY-SA 3.0 via Wikimedia Commons
MOOCs areapproximately here
sisu.ut.ee/measurement
13.09.2016 EuCheMS 2016 Seville 4
On-line course: Estimation of measurement uncertainty in chemical analysis
3
5
Measurand, C
„TrueValue“
Value, error and uncertainty
Measured value
CmCT
Error
Δ = Cm - CT
Cm+UCm-U
Uncertainty rangeCm – U … Cm + U
13.09.2016 EuCheMS 2016 Seville
Measurement result
• This way of writing:
The benzene content of a fuel isCbenzene = (32 ± 6) mg/kg, k = 2, norm.
• Is a measurement result and means the following:The true content of benzene in the fuel is in the range of 26 … 38 mg/kg with the approximateprobability 95%
• The “± 6 mg/kg” is the measurement uncertainty– It is the expanded uncertainty
13.09.2016 EuCheMS 2016 Seville 6
Estimate of measurementuncertainty
4
Why do we need measurementuncertainty estimates?
13.09.2016 EuCheMS 2016 Seville 7
Comparison withpermissible limits
Necessary forenforcing legislation
Optimizingmeasurementprocedures
Quality assurance of decisions
Required in legislation
Comparing tworesults
Following temporal trends in environment, labs, etc
Measurement uncertainty
Required byISO 17025
Measurement uncertainty inChemistry
• „Notoriously difficult“
• Needs:– In-depth understanding of the particular chemical
analysis procedure: physical-chemical pronciples, influencing factors
– Knowledge and skills in mathematics (randomquantities, distribution functions, …)
• Chemical analysis usually cannot be modeled well13.09.2016 EuCheMS 2016 Seville 8
In practice: oftenunderestimated
uncertainties
5
Teaching measurementuncertainty
• Very difficult
• Usually taught in connection with analyticalchemistry
• Many guideline materials and courses• Most of them stop exactly at the moment when
it starts getting interesting and useful
13.09.2016 EuCheMS 2016 Seville 9
It is usually taught at the level of basics but
difficulties emergefirst of all with
practical applications
Consequences?
13.09.2016 EuCheMS 2016 Seville 10EstOil-5 Final report, 2009
http://www.ut.ee/katsekoda/ILC/
6
13.09.2016 EuCheMS 2016 Seville 11
Our goal• Web-based teaching material for
– Independent learning to estimate measurement uncertainty in real-life situations
– On-line reference point of explanations of concepts and approaches
– Support for auditorial teaching of metrology inchemistry at UT, summer schools, etc
– Offering as MOOC
• Required previous knowledge– General analytical chemistry knowledge
Course contents
• Theoretical basis as well as practical skills• Detailed and example-based treatment
– Modeling (ISO GUM)– Within-lab validation (Nordtest)
• Close to 50 short video lectures– Supplemented by textual explanations and downloadable
slides and calculation files• Numerous tests and calculation exercises
– Understanding of main concepts– Calculation exercises from real life situations– Feedback is given
13.09.2016 EuCheMS 2016 Seville 12
7
13.09.2016 EuCheMS 2016 Seville 13
sisu.ut.ee/measurement
13.09.2016 EuCheMS 2016 Seville 14sisu.ut.ee/measurement
8
13.09.2016 EuCheMS 2016 Seville 15
sisu.ut.ee/measurement
sisu.ut.ee/measurement
13.09.2016 EuCheMS 2016 Seville 16
9
13.09.2016 EuCheMS 2016 Seville 17sisu.ut.ee/measurement
13.09.2016 EuCheMS 2016 Seville 18sisu.ut.ee/measurement
10
13.09.2016 EuCheMS 2016 Seville 19
sisu.ut.ee/measurement
13.09.2016 EuCheMS 2016 Seville 20sisu.ut.ee/measurement
11
13.09.2016 EuCheMS 2016 Seville 21sisu.ut.ee/measurement
Platforms
• Course contents:sisu.ut.ee
• Admin, forums,knowledge evaluation(graded tests):moodle.ut.ee
13.09.2016 EuCheMS 2016 Seville 22
12
MOOC: UT Moodle Environment
13.09.2016 EuCheMS 2016 Seville 23
Divided into 6 weeks1. The concept and origin of measurement uncertainty2. The basic concepts and tools3. The first uncertainty quantification
– On the example of pipetting
4. The principles of measurement uncertainty estimation (random and systematic effects and definitions for precision, trueness, accuracy)
5. Overview of the measurement uncertainty estimation approaches. The ISO GUM modeling approach– On the example of photometric determination of NH4
+
6. The single lab validation approach. Comparison of different approaches. Comparing measurement results.– On the example of LC-MS determination of acrylamide
13.09.2016 EuCheMS 2016 Seville 24
13
Weeks in Moodle
13.09.2016 EuCheMS 2016 Seville 25
„Easy“ Test
13.09.2016 EuCheMS 2016 Seville 26
14
„Difficult“ Test
13.09.2016 EuCheMS 2016 Seville 27
MOOC: Spring 2014 edition270 participants from 40 countries!
13.09.2016 EuCheMS 2016 Seville 28
15
High participation activity– More than 300 posts to the forums– Constant counseling by our team
Overall completion rate: 52%Completion rate of those who started: 67%13.09.2016 EuCheMS 2016 Seville 29
MOOC: Spring 2015 edition489 participants from 70 countries
3013.09.2016 EuCheMS 2016 Seville
Overall completion rate: 34%Completion rate of those who started: 60%
16
MOOC: Spring 2016 edition757 participants from 85 countries
Around 600 forum posts
3113.09.2016 EuCheMS 2016 Seville
Overall completion rate: 40%Completion rate of those who started: 67%
MOOCs vs „traditional“ teaching
13.09.2016 EuCheMS 2016 Seville 32
Aspect Conventional university course
Practitioner training (short) course MOOC
Interaction between students and teachers Direct Direct Remote
Possibility to deliver the course simultaneously to many participants Low Low High
Level of self-discipline needed from participants Average Average High
Time constraints, time to “digest” the knowledge Not a problem Serious time
constraintsNot a
problem Possibility of independent homework Possible Usually impossible Possible Possibility of hands-on problem-solving Possible Possible (within the
time constraints) Possible
Possibility of teamwork Possible Possible (within the time constraints) Not easy
Possibility of experimental work Easy Possible, but not easy Not possible
Possibility of working with participants of uneven level or preparation Difficult but doable Difficult Possible
Possibilities of meaningful assessment of obtained knowledge Wide possibilities Difficult Possible
Danger of cheating during knowledge assessment Can be made low Can be made low Can be
high Costs of setting up the coursea Medium Medium Medium Costs of running the coursea High High Low Travel and accommodation costs Can be high Can be high None
I. Leito, I. Helm, L. JalukseAnal Bioanal Chem, 2015,407,1277–1281
17
„Usage modes“
13.09.2016 EuCheMS 2016 Seville 33
Estimation of MeasurementUncertainty in Chemical analysis
sisu.ut.ee/measurement
On-line course forindependent
learningavailable any time
anywhere
On-line referencepoint
of terminology, explanations and
self-testingpossibilities
Running asMOOC
with registeredparticipation, on-linecounseling, gradedtests and certificate
Course materialfor running trainingcourses e.g. by labs
Support touniversity teaching
Students can bedirected here e.g. for
self-testing
I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281
Visiting statistics
13.09.2016 EuCheMS 2016 Seville 34
18
Many thanks to the team!Materials development
Lauri JalukseIrja Helm
VideoEnno Kaasik
Web design, study administrationTriin Marandi
Lehti PiltEsta Pilt
13.09.2016 EuCheMS 2016 Seville 35
13.09.2016 EuCheMS 2016 Seville 36
sisu.ut.ee/measurement
MOOC – Fourth edition: Spring 2017Registration will open in the beginning of 2017
Thank you for your attention!
I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281