Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 1
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 1
Written by Michael Masser and Linda Creed (lyrics) and originally recorded by George Benson for the 1977 Muhammad Ali biopic The Greatest. Popularized by Whitney Houston. The words describe Creed’s feelings about coping with great challenges that one must face in life, being strong during those challenges whether you succeed or fail, and passing that strength on to children to carry with them into their adult lives. She died in 1986.
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 2
How do we How do we rise above challengesrise above challenges , announce “here I am”, announce “here I am”
To To see hopesee hope where others see nonewhere others see none ..To find our own way, to To find our own way, to step into the unknownstep into the unknown ..
To discover new wonders and new horizon. To discover new wonders and new horizon. To To never say i can’tnever say i can’t ..To To be the one that makes a differencebe the one that makes a difference .. The one who dares to dreamThe one who dares to dream
How do we surpass our limitsHow do we surpass our limits . . To find the strength we never knew we hadTo find the strength we never knew we hadTo keep learning and keep growingTo keep learning and keep growing . . With no fear of failureWith no fear of failure
To To reach out to othersreach out to others , , no matter who they areno matter who they areTo To stand tall and stand firm for what we believe instand tall and stand firm for what we believe inTo To keep tryingkeep trying , to , to color the lives of otherscolor the lives of others
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 2
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 34/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 3
http://drjj.uitm.edu.my
The The ProblemProblem--Posing Approach (The Learning Paradigm)Posing Approach (The Learning Paradigm) ????
Which approach of education have you/we and will yo u/we Which approach of education have you/we and will yo u/we embrace, practice and assess?embrace, practice and assess?
Hope this talk will motivate you to Hope this talk will motivate you to reflect on your reflect on your L&T L&T approaches and methodsapproaches and methods
to its alignment on the targeted taketo its alignment on the targeted take--awayaway
Philosophical Approach to L&T Philosophical Approach to L&T Do We Understand How Students Learn??Do We Understand How Students Learn??Do We Understand Why We Teach the Way We Do?Do We Understand Why We Teach the Way We Do?
Banking Approach (Instruction Paradigm)Banking Approach (Instruction Paradigm) oror
Are We Contented with the Way We Teach??Are We Contented with the Way We Teach??
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 4
email: [email protected], [email protected]; [email protected]. Website: email: [email protected], [email protected]; [email protected]. Website: email: [email protected], [email protected]; [email protected]. Website: email: [email protected], [email protected]; [email protected]. Website: http://drjj.uitm.edu.myhttp://drjj.uitm.edu.myhttp://drjj.uitm.edu.myhttp://drjj.uitm.edu.my; ; ; ;
HP#:+60193551621HP#:+60193551621HP#:+60193551621HP#:+60193551621
Dr JJ was conferred the coveted & prestigious (HE) 2010 AAN Science Teaching Award, Oct 10th, 2011
OutcomesOutcomes--Based TeachingBased Teaching--LearningLearning--AssessmentAssessmentExecuting Constructive AlignmentExecuting Constructive AlignmentJaafar JantanJaafar Jantan (Assoc Prof, Dr.)(Assoc Prof, Dr.) aka aka Dr JJDr JJ
Recipient of 2010 Recipient of 2010 HE Teaching HE Teaching AwardAward(Pure Sciences), (Pure Sciences), National Academic AwardNational Academic Award
A 1A 1--day Workshop for the Polytechnic Department , KPMday Workshop for the Polytechnic Department, KPM0909thth Apr Apr 20142014
Howard Gardner
EdwardDeBonoEdwardDeBono
Koïchiro MatsuuraDirector General of UNESCO 1999-2009
“If we always do what we've always done, “If we always do what we've always done, we will we will
get what we've always gotget what we've always got.” Adam Urbanski
“You have to learnlearn the rules of the gamethe rules of the game , andthen you have to play better than anyone then you have to play better than anyone elseelse .” - Einstein
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 3
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 5
http://drjj.uitm.edu.my
GOAL (long term)GOAL (long term) : Inspire & nurtureInspire & nurture Higher Education teachers to value and practiceto value and practice innovative innovative and holistic and holistic instructional and assessment strategies (constructi vely instructional and assessment strategies (constructi vely aligningaligning curriculum, curriculum, learninglearning--teaching activitiesteaching activities and and assessment assessment approachesapproaches ).
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 64/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 6
http://drjj.uitm.edu.my
““ Life presents us & the graduates as Life presents us & the graduates as ill definedill defined , complex, , complex, unreliableunreliable , , andand contradictorycontradictory with difficult practical with difficult practical problemsproblems andand moral,moral, socialsocial , , andand personal choicespersonal choices . .
Richard J. Shavelson (2007). Assessing Student Lear ning Responsibly:From History to a Bodacious Proposal1. Stanford Uni versity. CHANGE magazine. http://www.changemag.org/Archives/Back%20Issues/Jan uary-February%202007/abstract-assessing-responsibly.html . Accessed July 3 rd, 2007.
Graduates need Graduates need the the capacity to capacity to identifyidentify and and define define problemsproblems , , recognize reliable from unreliable informationrecognize reliable from unreliable information , ,
analyze this informationanalyze this information , and , and integrate it from diverse, often integrate it from diverse, often conflicting sources,conflicting sources, making logical,making logical, concise argumentsconcise arguments for for
or against specific positions...or against specific positions... ””
Dean Zollman, Supervisor, Millikan Award (1995) & Oersted Award Recipient (2014)
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 4
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 74/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012
http://drjj.uitm.edu.my
Paulo Freire (1993): Chapter 2, PEDAGOGY OF THE OPP RESSED. New York: Continuum Books, 1993.. http://www2.webster.edu/~corbetre/philosophy/educat ion/freire/freire-2.html . Accessed Oct 28 th, 2013.
“KnowledgeKnowledge emerges only throughinvention (learn, unlearn, construct, understand invention (learn, unlearn, construct, understand
concepts and its application)concepts and its application) , and
rere--invention (reinvention (re--learn, relearn, re--configure, innovate, create)configure, innovate, create)through the restless, impatient, continuingrestless, impatient, continuing,hopeful inquiry human beings pursuehopeful inquiry human beings pursue
in the world, with the world, andin the world, with the world, andwith each otherwith each other .”.”
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 84/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012
http://drjj.uitm.edu.my
Paulo Freire (1993): Chapter 2, PEDAGOGY OF THE OPP RESSED. New York: Continuum Books, 1993.. http://www2.webster.edu/~corbetre/philosophy/educat ion/freire/freire-2.html . Accessed Oct 28 th, 2013.
The “banking conceptThe “banking concept ,” as termed by Freire, is essentially an act that an act that hinders the intellectualhinders the intellectual growthgrowth of students by turning them into, of students by turning them into, figuratively speaking, comatose “receptors” and “colle ctors” of figuratively speaking, comatose “receptors” and “colle ctors” of information that have no real connection to their l ivesinformation that have no real connection to their l ives .
"Implicit in the banking concept is the assumption of a dichotomy between human beings and the world: a person is merely in the world, not with the world a person is merely in the world, not with the world or with others; the individual is a spectator, not reor with others; the individual is a spectator, not re--creatorcreator . …"
Education thus becomes an act of depositingEducation thus becomes an act of depositing , in which the students are in which the students are the depositories and the teacher is the depositorthe depositories and the teacher is the depositor . Instead of communicating, the teacher issues communiques and makes deposits which the students patiently the students patiently receive, memorize, and repeatreceive, memorize, and repeat ..”
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 5
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 9
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 6
11Copyright DrJJ, ASERG, FSG, UiTM. March 2012 11
“...Many of our students are epistemological Dualists: They view the world They view the world in rigid categories of blackwhite, rightin rigid categories of blackwhite, right--wrong, an d goodwrong, and good--bad, and their knowledge is passively received from bad, and their knowledge is passively received from “Authorities.”“Authorities.” These students, and many othersThese students, and many others—— the the MultiplistsMultiplists——don’t understand that don’t understand that knowledge is knowledge is constructed by a very active, personal constructed by a very active, personal making of meaningmaking of meaning . They don’t understand the role played by evidence when they select from among competing hypotheses, opinions, and values.
In other words, they do not understand critical thinking they do not understand critical thinking processesprocesses ...”
Lion F. Gardiner. “Why We Must Change: The Research Evidence”. THE NEA HIGHER EDUCATION JOURNAL.
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 124/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 12
“...All three of these important dimensions of cognition—using abstract using abstract symbols, symbols, epistemologyepistemology , , and principled, ethical reasoningand principled, ethical reasoning— as well as the ability to work cooperatively in te ams with people as well as the ability to work cooperatively in te ams with people different from oneself, different from oneself, require for their development that require for their development that
students be actively involved in learningstudents be actively involved in learning . It is It is unlikely that lectures aloneunlikely that lectures alone can bring about the profound can bring about the profound cognitive reorganizations required, cognitive reorganizations required, produce the produce the interpersonal skills that must be developedinterpersonal skills that must be developed , and , and foster the foster the substantial changes in disposition toward learning and substantial changes in disposition toward learning and human diversity required for these important change s to human diversity required for these important change s to occuroccur ...”
Lion F. Gardiner. “Why We Must Change: The Research Evidence”. THE NEA HIGHER EDUCATION JOURNAL.
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 7
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 13
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 14
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 8
4/10/2014Copyright DrJJ, ASERG, FSG, UiTM. March 2012 15
4/10/2014Copyright DrJJ, ASERG, FSG, UiTM. March 2012 16
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 9
4/10/2014Copyright DrJJ, ASERG, FSG, UiTM. March 2012 17
4/10/2014Copyright DrJJ, ASERG, FSG, UiTM. 2011 18
Activity: Visit http://padlet.com/wall/DrJJ-JPP-ta sk1. Respond to the questions.
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 10
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 19
To manyTo many, the word “assessmentassessment” simply means the process by process by which we which we ““ measuremeasure”” learning & assign students gradeslearning & assign students grades.
However, assessment is much more than this:
Assessment is a mechanism for providing faculty staff with Assessment is a mechanism for providing faculty staff with
datadata for improving their teaching methodsfor improving their teaching methods andand for for
guiding guiding and and motivating students to be motivating students to be actively involvedactively involvedin their own learningin their own learning. .
As such, As such, assessment provides important feedback assessment provides important feedback to both instructors and studentsto both instructors and students.
SOURCE: Excerpted from National Institute for Science Education (2001b)
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 20
Assessment gives us essential information about what our Assessment gives us essential information about what our
studentsstudents are learningare learning and about theand about the extent to which extent to which
we are meeting our teaching goalswe are meeting our teaching goals.
But the true power of assessment comes in also using it to give using it to give feedback to our studentsfeedback to our students. Improving the quality of Improving the quality of learninglearning in our courses involves not just determining to what extent students have mastered course contentmastered course content at the endat the end of of the coursethe course; improving the quality of learningimproving the quality of learning also involvesdetermining to what extent students are determining to what extent students are mastering mastering
contentcontent throughoutthroughout the coursethe course.
SOURCE: Excerpted from National Institute for Science Education (2001b)
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 11
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 21
http://drjj.uitm.edu.my
� provide information about the knowledge and skills students have
as they enter a course… ( prior knowledgeprior knowledge--diagnosticdiagnostic )
� provide reliable data on student learningreliable data on student learning … � make available richer data about the effects of the curriculum effects of the curriculum
(program level) or teaching methods (course level)(program level) or teaching methods (course level) …
�� yield more reliable data about instructionyield more reliable data about instruction …� provide evidence that faculty make a difference in student
learning…� offer a larger view of student needs and accomplish ments…
*Adapted from the University of Nebraska, Lincoln T eaching and Learning Center, Teaching at UNL, Vol. 21, No. 2 (Oct, 1999).
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 22
"Anything not understood in more than one way is not understood at all" "Anything not understood in more than one way is not understood at all"
A wise man is not governed by others, nor does he try to govern them; he A wise man is not governed by others, nor does he try to govern them; he
prefers that reason alone prevailprefers that reason alone prevail~La Bruyère, Characters, 1688
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 12
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 23
http://drjj.uitm.edu.my
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 24
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 13
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 25
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 26
Killen R., & Hattingh. S.A. (2004. “A theoretical fr amework for measuring the quality of student learni ng in outcomes-based education”.' SAJHE, Vol18 No. 1. Uniza Press.
An important consequence of directing our attention towards the assessment of complex outcomes is that it changes the focus of assessment it changes the focus of assessment from quantity to qualityfrom quantity to quality .
�� It changes our focus from asking `How many objectiv e questions can It changes our focus from asking `How many objectiv e questions can the learner answer?' or How many marks are awarded for a question the learner answer?' or How many marks are awarded for a question and test or `Which particular skills can the learne r demonstrate?'and test or `Which particular skills can the learne r demonstrate?' to to asking `asking ` How well does the learner understand important How well does the learner understand important concepts, theories and principles?' and `How expert ly can concepts, theories and principles?' and `How expert ly can the learner integrate a range of skills into a comp lex the learner integrate a range of skills into a comp lex performanceperformance ??
�� judge the quality of students' learning in words ra ther than numbersjudge the quality of students' learning in words ra ther than numbers to describe the difference between high-quality and low-quality achievement of complex outcomes (Killen 2003:10).
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 14
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 27
Killen R., & Hattingh. S.A. (2004. “A theoretical framework for measuring the quality of student learning in outcomes-based education”.' SAJHE, Vol18 No. 1. Uniza Press.
From this quality perspective,�� understandingunderstanding (rather than memorisation),�� creativitycreativity (rather than reproduction),�� diversitydiversity (rather than conformity),�� initiativeinitiative (rather than compliance) and�� challengechallenge (rather than blind acceptance) become the yardsticks by become the yardsticks by
which we try to measure, describe and report studen t learningwhich we try to measure, describe and report studen t learning ' (Killen 2003:10).
An important consequence of directing our attention towards the assessment
of complex outcomes is that it changes the focus of it changes the focus of assessment from quantity assessment from quantity to qualityto quality
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 28
http://drjj.uitm.edu.my
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 15
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 29
If students are to If students are to learn desired outcomes in a learn desired outcomes in a reasonably effective mannerreasonably effective manner , then the teacher’s , then the teacher’s
fundamental task is tofundamental task is to get students to get students to engageengage in in learning activities that are likely to result in learning activities that are likely to result in their achieving those outcomestheir achieving those outcomes ...It is helpful to
remember that what the student does is actually more important in determining what is learned than what the teacher does.Thomas J. Shuell (1986) cited in Biggs and Tang (2007)
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 30
http://drjj.uitm.edu.my
Source: Glickman, C. (1991). Pretending not to know what we know. Educational Leadership, 48(8), 4-10
"" Effective teachingEffective teaching is is not a set of generic practicesnot a set of generic practices , but , but
instead instead is a set of contextis a set of context--driven decisions about driven decisions about teachingteaching . . Effective teachers do not use the same Effective teachers do not use the same set of practices for every lessonset of practices for every lesson (Pedagogical Content (Pedagogical Content Knowledge Knowledge -- the art & craft of teaching). . . the art & craft of teaching). . .
Instead, what Instead, what effective teachers do is effective teachers do is constantly reflect constantly reflect about their workabout their work , , observe whether students are observe whether students are learning or not,learning or not, and, then and, then adjust their practice adjust their practice accordinglyaccordingly ””
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 16
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 314/10/2014
http://drjj.uitm.edu.my
“Student-Centred Learning represents both a mindseta mindset and a culturea culturewithin a given educational institution and is a learning approach which a learning approach which is broadly related to, and supported by, constructi vist is broadly related to, and supported by, constructi vist theories of learningtheories of learning . It is characterised by innovative methods characterised by innovative methods of teachingof teaching which aim to promote learning in communication aim to promote learning in communication with teachers and other learners and which take stu dents with teachers and other learners and which take stu dents seriously as active participants in their own learn ingseriously as active participants in their own learn ing , fostering transferable skills such as problemfostering transferable skills such as problem--solv ing, critical solving, critical thinking and reflective thinkingthinking and reflective thinking .
Source: Student-Centred Learning: Toolkit for students, staff and higher education institutionsEuropean International & The European Students Union. Brussels 2010. Accessed Jan 5th, 2012. http://www.esu-online.org/resources/6068/Student-Centred-Learning-Toolkit/
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 32
http://drjj.uitm.edu.my
This notion is erroneous just as is the idea thatThis notion is erroneous just as is the idea thatexpertise in a discipline is a general set of probl emexpertise in a discipline is a general set of probl em--solving skills that lack a content knowledge base t o solving skills that lack a content knowledge base t o
support themsupport them
that effective teaching consists of a set of genera l that effective teaching consists of a set of genera l teaching strategies that apply to all content areasteaching strategies that apply to all content areas
A commonly held misconception about teachingA commonly held misconception about teaching :
How People Learn: Brain, Mind, Experience, and Scho ol: Expanded Edition. National Academies Press onli ne. http://www.nap.edu/catalog/9853.html
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 17
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 33
Science of learningScience of learning – Using science to guide learningUsing science to guide learning, , Research evidences on how students learn:
�� Cognitive ScienceCognitive Science--Memory Memory –– evidences from neuroscience evidences from neuroscience ((fMRIfMRI, Positron , Positron EmisionEmision Tomography Tomography –– PET)PET)
�� ConstructivismConstructivism – “LearnLearn--UnlearnUnlearn--RelearnRelearn ”; Uncover-Discover. The role of existing/prior knowledge in learning role of existing/prior knowledge in learning new knowledgenew knowledge
�� Learner DiversitiesLearner Diversities - Learner preferences & Multiple Learner preferences & Multiple InteligencesInteligences
�� technology are effective agents of changetechnology are effective agents of change
http://drjj.uitm.edu.my
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 34
Thinking about Teaching Level 3: SCL-What the stude nt does..
Source: Biggs & Tang (2007). “Teaching for Quality Learning at University”. Third Edition. McGraw Hill Companies.
http://drjj.uitm.edu.my
� What the student does and how that relates to teaching. Teaching supporting learning. No longer is it possible to say: ‘I taught them, but they didn’t learn.’‘I taught them, but they didn’t learn.’ Expert teaching includes Expert teaching includes mastery over a variety of teaching techniques, but unless learning takes place, they mastery over a variety of teaching techniques, but unless learning takes place, they are irrelevant; are irrelevant; the focus is on what the student does and on how we ll the intended the focus is on what the student does and on how we ll the intended outcomes are achievedoutcomes are achieved .
� This implies a view of teaching that is not just about facts, concepts and principles to be covered and understood, but also to be clear about:1.1. What it means to ‘understand’ content in the wa y that is stipulated in the intended What it means to ‘understand’ content in the way th at is stipulated in the intended
learning outcomeslearning outcomes .2.2. What kind of teaching/learning activities are r equired to achieve those stipulated What kind of teaching/learning activities are requi red to achieve those stipulated
levels of understandinglevels of understanding .� Then follow the key questions:
1.1. How do you define those levels of understanding as outcome statements?How do you define those levels of understanding as outcome statements?2.2. What do students have to do to reach the level specified?What do students have to do to reach the level spec ified?3.3. What do you have to do to find out if the outco mes have been reached at the What do you have to do to find out if the outcomes have been reached at the
appropriate level or not?appropriate level or not?
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 18
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 35
http://drjj.uitm.edu.my
Level 2 Level 3
Level 1Level 1BlameBlameStudentsStudents
Level 2Level 2Blame TeachersBlame Teachers
Pictures from the Video Pictures from the Video Understand Understanding & Understand Understanding & Teach TeachingTeach Teaching
Level 2
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 36
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 19
Howard Gardner
JJourneyourney towards
EEnrichmentnrichment andBBalancealance utilizing
AArts and Sciencesrts and Sciences in
TTeaching & Learningeaching & LearningTSWZ, DIB, me
Copyright DrJJ, ASERG, FSG, UiTM. March 2011 38
Sebuah lori mengalami kerosakan dan menerima tolakan dari belakang oleh sebuah kereta kecil untuk menghantarnya ke bandar seperti yang digambarkan di bawah.
Sewaktu kereta kecil tersebut menolak lori dan memecut untuk mencapai kelajuan seragam
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 20
Copyright DrJJ, ASERG, FSG, UiTM. March 2011 39
(A) daya tolakan yang dikenakan oleh kereta terhadap lori adalah sama dengan daya lori menolak kereta.
(B) daya tolakan yang dikenakan oleh kereta terhadap lori adalah lebih kecil berbanding dengan daya lori menolak kereta.
(C) daya tolakan yang dikenakan oleh kereta terhadap lori adalah lebih besar berbanding dengan daya lori menolak kereta.
(D) oleh kerana enjin kereta hidup, maka ia mengenakan tolakan terhadap lori tetapi lori tidak mengenakan tolakan terhadap kereta kerana enjin lori tidak dihidupkan. Lori tersebut ditolak hanyalah kerana ia mengganggu laluan kereta.
(E) tidak ada daya dikenakan oleh kereta dan oleh lori. Lori tersebut ditolak hanyalah kerana ia mengganggu laluan kereta.
Copyright DrJJ, ASERG, FSG, UiTM. March 2011 40
Comparing Pre (N=1354) & Posttest (N=1145) FCI chan ge in scores for question 15 . Answer is A.
0%
10%
20%
30%
40%
50%
60%
70%
80%
Pre A Post A Pre B Post B Pre C Post C Pre D Post D Pre E Post E
Answer Options for P re & P ost Test
Pre APost APre BPost BPre CPost CPre DPost DPre EPost E
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 21
Scores from overseas
Scores from Malaysian Public Universities (DrJJ’s unpublished work)
USA27% - 73%
Overall for ALL bumi: 21.3% (N=1792). Overall for non-bumi: 27.4% (N=308).
UKM (N=177) overall: 22.3%Bumi: 20%; Non-bumi: 30%
UPSI (N=414) overall: 20.1% (T-test at the 95% confidence shows no significant difference in scores between bumi & non-bumi)
UK28% - 33% Finland: 45.7 %
USM: 36.6%Bumi: 25%; Non-bumi: 40%
UiTM (N=1343) overall:21.4%UiTM’s American Degree
Foundation Program (N=47) overall: 38%
Russia: 46.5 % UPM: 21%, *23%
Score Frequency Univ
76% 3 UiTM ADP (bumi)
73% 1 UKM (non-bumi)
70% 3 (non-bumi)
67% 3 USM (bumi)
60% 4 USM (non-bumi)
60% 4 UiTM ADP (bumi)
Table of Frequency of Malaysian university students showing competency (score ≥60%) in FCI.
N=2100. Only 1% scored at and above competency
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 22
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 43Copyright DrJJ, ASERG, FSG, UiTM. March 2012 43
FCI - Force Concept Inventory, a research vaidated conceptual inventory assessment instrument published in1992 by Hestenes et. al. 30 items, 5 options MCQ. Choices were selected from participants’ responses during F2F interviews. The The average normalized gain for a average normalized gain for a course is <g>course is <g>
<g> = [%<G> / %<G>max
= [%<Sf>-%<Si>] /[100 - %<Si>]
<Sf> = post class avg
<Si> = pre class avg
N=6542
N14T=2084
Source: Hake, R. (1998). Interactive-engagement versus traditional methods: A six-thousand-studentsurvey of mechanics test data for introductory physics courses . Am. J. Phys. 66 ~1!, January 1998
<g>14T=0.23
N48IE=4458
<g>48IE=0.48
Copyright DrJJ, ASERG, FSG,
444/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 44
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 23
10/04/2014 DR JJ-AAN 2010-Copyright DrJJ, ASERG, FSG, UiTM. June 2011 45
http://drjj.uitm.edu.my
10/04/2014 46
http://drjj.uitm.edu.my
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 24
Copyright DrJJ, ASERG, FSG, UiTM. March 2011 47
Bef:61%, Aft:37%
Bef:9%, Aft:10%
Bef:15%, Aft:23%
Bef:9%, Aft:13%
Bef:6%, Aft:17%
CRI=2,3
CRI 0 = have no clue
CRI 5 = very certain
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 48
The TWSIA committee defines an innovative course or educational
experience as one that, by design, engages and challenges design, engages and challenges studentsstudents , resulting in greater student interest, a resulting in greater student interest, a deeper level of understanding and/or a lasting chan ge deeper level of understanding and/or a lasting chan ge in the students' perception of an issue or topicin the students' perception of an issue or topic .The innovative method, practice or strategy used ma y not be new in the
world, but its implementation may be out of the ordinary its implementation may be out of the ordinary in your field of practice or new to youin your field of practice or new to you . It is more than simply
using new technologies; rather it is an approach to teaching and it is an approach to teaching and learning that results in a muchlearning that results in a much--enhanced, even tra nsformative, enhanced, even transformative, educational experience for studentseducational experience for students .
Source: SAKAI (vibrant community cretating tech that enhances teaching, learning & research) project. TWSIA (teaching With SAKAI Innovation Award) 2011 Definition of Innovation.https://confluence.sakaiproject.org/display/PED/TWSIA+2011+Definition+of+Innovation. Accessed March 28th, 2012
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 25
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 49
Awards for Teaching Excellence celebrate teacherscelebrate teachers (individuals
and teams) renowned for teaching excellenceteaching excellence , who have
outstanding presentation skillsoutstanding presentation skills and who have made a
significant contribution to enhancing the quality significant contribution to enhancing the quality of learning and teaching in higher educationof learning and teaching in higher education .
Many Many academic staff go out of their way to deliver exce llent academic staff go out of their way to deliver exce llent teaching to their studentsteaching to their students . We think that this should be rewarded.. We think that this should be rewarded.Awards are to Awards are to recognise such people and to demonstr ate that recognise such people and to demonstrate that students appreciate the value that good teaching ad ds to their learningstudents appreciate the value that good teaching ad ds to their learning
Videos of the 2009-2010 AAN recipients. http://web.usm.my/aan2010/video.htm
Awards for Teaching Excellence - WHY
Awards for Teaching Excellence – WHAT
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 50
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 26
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 51
http://drjj.uitm.edu.my
Source: Tools and Techniques for course improvement: A handbook for course review and assessment of Student learning Compiled, adapted, and edited by Richard Frye Gary R. McKinney Joseph E. Trimble
Domain: Learner-centered
Knowledge:Student participation:Role of professor:Role of Assessment:Emphasis:Assessment methodAcademic culture:
Constructed by studentsActiveFacilitator/learning partnerMany tests—for ongoing feedbackDeveloping deeper understandingMultidimensional productsCollaborative and supportive
Teacher-centered versus Learner-centered (from Huba & Freed (2000).
Teacher-centered
Transmitted by instructor PassiveLeader/authorityFew tests—mainly for gradingLearning correct answersUnidimensional testingIndividualistic and competitive
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 52
"If a child can’t learn the way we teach, maybe we should "If a child can’t learn the way we teach, maybe we should
teach the way they learn."teach the way they learn." Ignacio ‘Nacho’ Estrada
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 27
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 53
� Functions of brain (neopiagetian), neurons, synapses. MRIf
�� Gardner Multiple IntelligencesGardner Multiple Intelligences – beyond literacy, numeracy, analytical-mathematical
�� Learning PreferencesLearning Preferences – what & how learners respond to information
� Epistemology - Theories of learning - Brunner, Vygotsky, Piaget (abstraction & formalformal -concrete reasoningreasoning ),
� Approaches to Learning – Meaningful & DeepMeaningful & Deep - Strategic-Surface
�� ConstructivismConstructivism (prior knowledge knowledge assimilation) – Mental models & Schemata - Conceptual Inventories (CIs)
�� AssessmentAssessment FORFOR & ASAS learninglearning - Feedback, appropriate (valid, reliable, fair, practical), self-reflection (metacognition)
�� PedagogyPedagogy means “ to lead the childto lead the child ” - (science & art of teachingscience & art of teaching )
�� ScienceScience -the research done, knowledge & knowhow collected
�� AArt-knowing where to apply the skills (science) of teaching-crafting
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 54
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 28
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 55
If you are, you breath.If you breath, you talk.
http://drjj.uitm.edu.my
If you understand, you If you understand, you knowknow ..If you know, you want to know more…If you know, you want to know more…And if you want to know more, And if you want to know more, you are aliveyou are alive ..
If you talk, you If you talk, you askask ..If you ask,If you ask, you you thinkthink ..If you think, you If you think, you searchsearch ..If you search, you If you search, you experienceexperience ..If you experience, you If you experience, you learnlearn ..
If you find, you If you find, you doubtdoubt ..If you doubt, you If you doubt, you questionquestion ..If you question, you If you question, you understandunderstand ..
If you learn, you growgrow .If you grow, you wish.If you wish, you findfind .
WISWIS--DOMDOM
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 56
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 29
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 57
http://drjj.uitm.edu.my
Linda Suskie, Towson University, Maryland. “What ar e good (appropriate) assessment practices?”
“What is a good (appropriateappropriate ) assessment?
More than anything else, it is an assessment that gives us assessment that gives us truthful informationtruthful information ; it tells us what our students ; it tells us what our students have truly learnedhave truly learned . Students who have truly learned what we want them to will do well on a good assessment; students who truly have not learned what students who truly have not learned what we want them to will not do well on it.we want them to will not do well on it. ”
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 58
http://drjj.uitm.edu.my
Linda Suskie, Towson University, Maryland. “What ar e good assessment practices?”
“Unfortunately, it's not possible to determine with complete confidence exactly what
our students have learned. We can't get inside their heads to find out We can't get inside their heads to find out what they truly know and what they don't. The best we can do what they truly know and what they don't. The best we can do is to look at samples of their behaviour is to look at samples of their behaviour -- what the y write, what they write, produce, say and perform produce, say and perform -- and from those samples t ryand from those samples tryto estimate or infer what they truly knowto estimate or infer what they truly know . Even under the best of circumstances, making an inference from these snapshots of behaviour is bound to be at least somewhat inaccurate because of what psychometricians call 'measurement error' - fluctuations in human performance that we can't completely control.”
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 30
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 59
http://drjj.uitm.edu.my
�� Valid:Valid: describes a condition where an assessment method, such as a paper-and-pencil test, assesses what it claims to assess and thus produces results that can produces results that can lead to valid inferences usable in decision makinglead to valid inferences usable in decision making . For example, a classroom test claiming to measure higher-order thinking skill but actually assessing only memorized knowledge lacks validity. Inferences and decisions concerning students' thinking skills cannot justifiably be made from evidence produced by such an assessment.
�� Reliable:Reliable: means that the assessment tool and process will produce consistentconsistentoutcomes when applied by a range of assessors in a range of contexts.� the capacity of an assessment method to perform in a consistent, stable fashion
during successive uses. Reliability is a prerequisite for validityReliability is a prerequisite for validity . An An unreliable indicator cannot produce trustworthy res ultsunreliable indicator cannot produce trustworthy res ults .
�� Fair:Fair: means that the assessment will not disadvantage any person and will take will not disadvantage any person and will take into account the characteristics of the person bein g assessedinto account the characteristics of the person bein g assessed .�� Flexible:Flexible: means that the assessment tool and process allows for assessment tool and process allows for
assessment in a range of assessment contextsassessment in a range of assessment contexts .
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 60
http://drjj.uitm.edu.my
�� FAIR FAIR --COURSE LEVELCOURSE LEVEL� Constructive alignment-designing courses that link assessment, learning
outcomes and teaching methods.� Assessment tasks are described via clear, specific briefs that explain what the
student must do and how it will be judged� students are taught the skills they will need to do those tasks.
� if teachers spend time and effort marking what the students have produced reliably, then students may even read the feedback and see their teachers' judgments as worthy of notice if the feedback is timely, legible, and includes comments linked to the assessment criteria. The literature about assessment, confirm the practices that encourage students to see assessment as a valuable and integral part of their own learning.
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 31
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 61
http://drjj.uitm.edu.my
�� FAIR FAIR --COURSE LEVELCOURSE LEVEL� A fair assessment is one in which students are given equitable opportunities to
demonstrate what they know. This does not necessarily mean that all students
should be treated exactly the same. Equitable assessment Equitable assessment means that students are assessed using appropriate means that students are assessed using appropriate methods and procedures, which may vary from one methods and procedures, which may vary from one student to the next depending on the student's prio r student to the next depending on the student's prio r knowledge, cultural experience and learning knowledge, cultural experience and learning preferencespreferences .
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 62
http://drjj.uitm.edu.my
Examples of students with differing learning preference� Anis is not a strong writer but great at visualising concepts. She will better
demonstrate her understanding of a complex concept if she can draw a diagram rather than write an explanation.
� Hassan's culture values collaboration and he learns more from working with others than by studying alone. He will better demonstrate his understanding if he can work with others on a group presentation rather than make a solo presentation.
� Asma is not a good test taker but very creative. She will better demonstrate her nderstanding if she can create a video explaining a complex concept rather than take test.
� Abu has poor test-taking skills. If question 2 stumps him, he'll likely spend the whole testing period on that question and never answer the remaining questions. He will better demonstrate his understanding by writing a term paper than by taking a multiple-choice test.
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 32
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 63
http://drjj.uitm.edu.my
�� FAIR FAIR --PROGRAMME LEVELPROGRAMME LEVEL�� increasing the range and variety of assessment meth ods but increasing the range and variety of assessment meth ods but
ensuring that it is not burdeningensuring that it is not burdening .� Good induction programmes inform students of how their programmes will
work, including assessment matters and early diagnostic exercises to identify those needing additional help
�� FAIR FAIR ––INSTITUTIONAL LEVELINSTITUTIONAL LEVEL� requires policies and procedures that explain, police and uphold the rules in
ways that treat students equitably, consistently and transparently.� At this level, good practice relies on rules being clear, on efforts to enforce
the rules, and on procedures that ensure students have had ample opportunity to learn what their responsibilities are.
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 64
What is Assessment?What is Assessment?
Assessment is one or more processes that identify, collect, and prepare data to evaluate the attainment of student outcomes and program educational objectives . Effective Effective assessment uses relevant direct, assessment uses relevant direct, indirect, quantitative and qualitative indirect, quantitative and qualitative measures as appropriate to the measures as appropriate to the objective or outcome being objective or outcome being measuredmeasured . Appropriate sampling Appropriate sampling methods may be used as part of an methods may be used as part of an assessment processassessment process .
http://drjj.uitm.edu.my
What is EvaluationWhat is Evaluation ??
Evaluation is one or more processes for interpreting the interpreting the data and evidence accumulated data and evidence accumulated through assessment processesthrough assessment processes . Evaluation determines the extent determines the extent to which student outcomes and to which student outcomes and program educational objectives program educational objectives are being attainedare being attained . Evaluation results in decisions and actions results in decisions and actions regarding program improvementregarding program improvement
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 33
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 65
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 66
http://drjj.uitm.edu.my
Good assessments: Good assessments: �� give us useful informationgive us useful information�� give us reasonably accurate, truthful informationgive us reasonably accurate, truthful information�� are fair to all studentsare fair to all students�� are ethical and protect the privacy and dignity of those involvedare ethical and protect the privacy and dignity of those involved�� are systematisedare systematised�� are costare cost--effective, yielding value that justifies the time and expense we put effective, yielding value that justifies the time a nd expense we put
into theminto them
Linda Suskie, Towson University, Maryland. “What ar e good assessment practices?”
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 34
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 67
http://drjj.uitm.edu.my
Linda Suskie, Towson University, Maryland. “What ar e good assessment practices?”
� Likewise, before writing test questions, create a test 'blueprint'create a test 'blueprint' : a list of the key learning outcomes to be assessed by the test and the number of points or questions to be devoted to each learning goal.
�� Make assignments and test questions crystal clearMake assignments and test questions crystal clear . Write them so that all students will interpret them in the same way and know exactly what you want them to do.
�� Make sure that your assignments and test questions clearly relate to your key Make sure that your assignments and test questions clearly relate to your key learning outcomeslearning outcomes . Each test question, for example, should clearly correspond to the learning outcomes you've identified for it in your test blueprint. A writing assignment intended to assess how well students organise an essay shouldn't be graded primarily on grammar and spelling.
�� Ask colleagues and students to review draftsAsk colleagues and students to review drafts of your assignments, rubrics and (using former students) test questions to make sure they're clear and appear to assess what you want them to.
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 68
http://drjj.uitm.edu.my
Linda Suskie, Towson University, Maryland. “What ar e good assessment practices?”
�� Try out surveys and similar tools with a small grou p of students Try out surveys and similar tools with a small grou p of students before using them on a larger scalebefore using them on a larger scale . Check students' responses to make sure they are giving answers that make sense. Ask them if they found anything unclear or confusing. Ask some students to 'think out loud' as they nswer a test question; their thought processes should match those you intended.
�� Collect enough evidence to get a representative sam ple of what Collect enough evidence to get a representative sam ple of what your students have learned and can doyour students have learned and can do . Collect a sufficiently large
sample that you will be able to use the results with confidence to you will be able to use the results with confidence to make decisions about a course or programmemake decisions about a course or programme .
�� Score student work fairly and consistentlyScore student work fairly and consistently . Before scoring begins, have a clear understanding of the characteristics of meritorious, satisfactory and inadequate papers. Then use a rubric to help score assignments, papers, projects etc consistently.
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 35
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 69
http://drjj.uitm.edu.my
Linda Suskie, Towson University, Maryland. “What ar e good assessment practices?”
�� Use assessment and quality assurance results approp riately. Use assessment and quality assurance results approp riately. Never base any important decision on only one asses smentNever base any important decision on only one asses sment . (Failure to adhere to this maxim is one of the major Failure to adhere to this maxim is one of the major shortcomings of many highshortcomings of many high--stakes testing programme sstakes testing programmes .) Assessments shouldn't make decisions for us or dictate what we should teach; they should only advise us as we use our professional judgment to make suitable decisions.
�� Evaluate the outcomes of your assessment efforts an d revise Evaluate the outcomes of your assessment efforts an d revise your strategies to address any shortcomingsyour strategies to address any shortcomings .
4/10/2014Copyright DrJJ, ASERG, FSG,
70
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 36
4/10/2014Copyright DrJJ, ASERG, FSG,
71
Direct EvidenceDirect Evidencecompelling case for the extent to which
students have achieved expected learning outcomes gathered through
faculty’s systematic analysis of student projects, exams, or sets of specified
course assignments.
Indirect Indirect EvidenceEvidence
self-perceptions of their learning and
their perspectives on program structure
and curricular content
Quantitative � Entrance Diagnostic Exams
� Standardized Tests
� Faculty-made tests
� Collegiate Learning Assessment
� Faculty/Program developed Exit Exam
Course Grades
4/10/2014Copyright DrJJ, ASERG, FSG,
72
Direct EvidenceDirect Evidencecompelling case for the extent to which
students have achieved expected learning outcomes gathered through faculty’s
systematic analysis of student projects, exams, or sets of specified course
assignments.
Indirect EvidenceIndirect Evidenceself-perceptions of their
learning and their perspectives on
program structure and curricular content
Qualitative Capstone courses
Portfolio-faculty created “program portfolios” - samples of students’ work for each learning outcomes. (course assignments, exam questions, entire tests, in-class activities, fieldwork , activities, and/or homework assignment) from selected courses,
� Surveys (Exit, Alumni)
� Exit Interviews
� Focus Group
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 37
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 73
http://drjj.uitm.edu.my
Direct demonstration/observation
Performance of a task, or range of tasks, either in the workplace or in a simulated work environment, witnessed directly by an assessor
Indirect demonstration Use of photographs, videos, etc. showing performance of a task when the assessor cannot be present
Products Models, items, objects that have been made, fixed or repaired by the candidate
Workplace documents Rosters, budgets, reports, standard operating procedures etc. developed by the candidate
Questions - written and oral Asking the candidate about real or hypothetical situations to check understanding, task management and contingency management skills. May be short answer, discussion, multiple choice, etc.
Adapted from Training Package Assessment Materials Kit, 2001. Department of Education, Training & Youth Affairs . Source accessed from http://learnline.cdu.edu.au/t4l/teachinglearning/assessmentvet.html. Sept 29th, 2011
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. 2011 74
http://drjj.uitm.edu.my
Assignments Projects, reports, essays, etc. relevant to the LLN requirements of the unit of competency
Third party reports Documented and verified reports from supervisor, colleague, subject expert, trainer or others
Self-assessment A candidate’s personal statement on their performance (not generally sufficient in isolation)
Simulation Simulated activity to accommodate difficult to demonstrate criteria e.g. emergencies, contingencies, difficult behaviours etc.
Portfolios Collections of evidence compiled by the candidate
Adapted from Training Package Assessment Materials Kit, 2001. Department of Education, Training & Youth Affairs . Source accessed from http://learnline.cdu.edu.au/t4l/teachinglearning/assessmentvet.html. Sept 29th, 2011
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 38
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 75
TraditionalTraditional OBAOBA
Summative FormativeFormative
Norm-referenced CriterionCriterion--referencedreferenced
Decontextualized (unauthentic)
Contextualized Contextualized (authentic)(authentic)
Measurement Model Standards ModelStandards Model
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 76
��ContinuousContinuous��OnOn--going during learning / teachinggoing during learning / teaching . . ��Not about giving many quizzes or tests but to Not about giving many quizzes or tests but to use of a variety of use of a variety of assessment instruments, assessing various component s of assessment instruments, assessing various component s of learning, not only the thinking processes but inclu ding behaviours, learning, not only the thinking processes but inclu ding behaviours, personality traits and manual dexteritypersonality traits and manual dexterity . . PLOs attainment from PLOs attainment from courses are formative data to the program assessmen tcourses are formative data to the program assessmen t
��DiagnosticDiagnostic��Provides feedback to students and teachersProvides feedback to students and teachers onon
��strengths and areas for improvementstrengths and areas for improvement��DifficultiesDifficulties��MisconceptionsMisconceptions
��RemedialRemedial��Provides opportunities for modification / improveme ntProvides opportunities for modification / improveme nt
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 39
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 77
�� TerminalTerminal��At the endAt the end of learning / teachingof learning / teaching
��DescriptiveDescriptive��How well materials / knowledge / skills have been learnedHow well materials / knowledge / skills have been learned
�� For ranking and selectionFor ranking and selection�� No provision for modification / improvementNo provision for modification / improvement
Copyright DrJJ,
78
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 40
Copyright DrJJ,
79
LO1
LOTS
LO3
HOTS
&
Under-standing
Copyright DrJJ,
80
Assessment Is More Than Grades
Perfor-mance
LO2
LO4
LO3
LO5,6,7,8,9
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 41
Copyright DrJJ,
81Copyright DrJJ, ASERG, FSG, UiTM. March 2012 81
http://drjj.uitm.edu.my
Assessing declarativeAssessing declarativeknowledge:knowledge:��Essay examinationsEssay examinations��Multiple choice questionsMultiple choice questions��OpenOpen--book examinationsbook examinations��ClosedClosed--book examinationsbook examinations��Tests and quizzesTests and quizzes��AssignmentsAssignments��Ordered outcome itemsOrdered outcome items��Letter to a friendLetter to a friend��PresentationsPresentations
Source: Biggs & Tang (2007). “Teaching for Quality Learning at University”. Third Edition. McGraw Hill Companies.
Assessing functioningAssessing functioningknowledge:knowledge:��Projects (individual)Projects (individual)��Projects (group)Projects (group)��PortfoliosPortfolios��PracticumsPracticums��LaboratoriesLaboratories��Reflective journalsReflective journals��Case studiesCase studies��PresentationsPresentations��AssignmentsAssignments
Rapid assessments Rapid assessments methods (for large methods (for large classes):classes):�Concept maps�Venn diagrams�Three-minute essays�Gobbets
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 824/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 82
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 42
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 834/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2012 83
An “A” student’s responseAn “A” student’s response : As like a “C” student plus
Newton’s laws of motion best describes how these changes occur. In fact, he asserts that forces cause an object’s position and hence its speed to change. Prolong and constant exertion of the force will cause a constant change of its speed or direction or both. But in the world of atoms and subatomic particles, Newton’s laws begin to breakdown especially at speeds close to the speed of light… In addition to visible forces, invisible forces also exist. …. & more
A “C” student’s responseA “C” student’s response could be:Forces are agents of change. Physically, a force ca n be visually observed as changing the position of a sta tionary object or changing either the speed or the directio n or both if the object was initially in motion.
SYLLTestLab
SYLLTestLab
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 844/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. March 2012 84
As he was talking about MQF, he put up these words that were circled and As he was talking about MQF, he put up these words that were circled and connected these words with other words.. He claimed the linking between these connected these words with other words.. He claimed the linking between these words, a term he coined proposition is a very strong visual representation of what is words, a term he coined proposition is a very strong visual representation of what is in our mind. He indicated the similarity and difference between this so called in our mind. He indicated the similarity and difference between this so called knowledge representation with the mind map. I wasn’t’ quite sure what it all meant knowledge representation with the mind map. I wasn’t’ quite sure what it all meant and then it struck me like a lightning bolt how these very familiar terms I had always and then it struck me like a lightning bolt how these very familiar terms I had always argued with you. Amazingly, they were linked up smoothly in this visual argued with you. Amazingly, they were linked up smoothly in this visual representation called Concept Map….. Linking 2 terms or concepts together by representation called Concept Map….. Linking 2 terms or concepts together by using linkwords not only clarify the connection between them but also appeared to using linkwords not only clarify the connection between them but also appeared to be a scientific claim of some sort..be a scientific claim of some sort..
My dear EF, it has been a while since we last wrote to each other. So, I decide to My dear EF, it has been a while since we last wrote to each other. So, I decide to enlighten you with an interesting character I met today..enlighten you with an interesting character I met today..
He puts on a contagious smile and his outlook is quite dashing I must say.. But what He puts on a contagious smile and his outlook is quite dashing I must say.. But what I really wanted to share with you today is the new and interesting learning I really wanted to share with you today is the new and interesting learning experience I had while with him… Oh, did I mention that he knows CK??... Will write experience I had while with him… Oh, did I mention that he knows CK??... Will write to you about that in another letter..to you about that in another letter..
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 43
Copyright DrJJ, ASERG, FSG, UiTM. 2011 85
Attributes to be
Assessed
Examples of Outcomes to
be Measured
Examples of Assessment Tasks Suggested Grading
Instruments
Creativity Ability to generate new
creation/ design e.g.
unique, original,
outstanding
• Creative project - product (art
and design, architecture,
engineering)
• Performance (music, theatre)
Rubric
Leadership Ability to lead a group of
students to undertake a
project.
• Group project e.g. organising
an event, conducting mini
research
• Presentation
• Debate
Critical thinking
and problem
solving
Ability to diagnose,
analyse, implement and
suggest solution to
broadly-defined or
vaguely-defined problems
• Lab experimentation
• Projects
• Presentation
• Studio work
Answer scheme
Rubric
Copyright DrJJ, ASERG, FSG, UiTM. 2011 86
Elements to be
Assessed
Examples of Outcomes to
be Measured
Examples of Assessment Tasks Suggested Grading
Instruments
Values Ability to show a
person’s/team’s principles
or standards of behaviour.
• Presentation
• Poster
• Reflection paper
Rubric
Entrepreneurial
skill
Ability to develop a feasible
business plan.
Ability to apply knowledge,
skills and critical
understanding of the
theories, concepts, issues
and challenges in
conducting a business
project.
• Proposal of business plan
• Conducting business project
Rubric
Checklist
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 44
Copyright DrJJ, ASERG, FSG, UiTM. 2011 87
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 88
http://oregonstate.edu/instruct/coursedev/models/id/taxonomy/#table
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 45
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. March 201089
http://drjj.uitm.edu.my
Level 1Level 1 :Recal l or recognition of fact, information or concept
Level2Level2 :Basic application of skill/concept : Use info, conceptual knowledge, follow procedures
Level 3Level 3 :Strategic thinking/reasoning :Develop plan to solve probs; require justification & decision-making
Level 4Level 4 :Extended ThinkingSolving authentic real-world problem requiring time & research, patience, perseverance..
Webb’s DOKWebb’s DOK
Create
Evaluate
Analyze
Apply
Understand
Remember
Revised Bloom’s TaxonomyRevised Bloom’s Taxonomy
Source for the revised Bloom Taxonomy: A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives, 2001.
Evaluation
Synthesis
Analysis
Application
Comprehension
Knowledge
Bloom’s TaxonomyBloom’s Taxonomy
Higher order
Lower order
Biggs SOLO TaxonomyBiggs SOLO Taxonomy
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. March 201090
http://drjj.uitm.edu.my
Set
Origination
Adaptation
Complete Overt Response
Mechanism
Guided Response
Perception
Simpson’s TaxonomySimpson’s Taxonomy--SkillsSkills
Higher order
Lower order
PSYCHOMOTOR DOMAIN INCLUDES PHYSICAL
MOVEMENT, COORDINATION & USE OF THE
MOTOR SKILL AREAS
LO2, LO4, LO5, LO7,LO8, LO9LO2, LO4, LO5, LO7,LO8, LO9
Krathwohl’s TaxonomyKrathwohl’s Taxonomy--AffectiveAffective
Internalizing
Organisation
Valuing
Responding
Receiving
Higher order
Lower order
AFFECTIVE DOMAIN – INCLUDES MANNER WE DEAL
WITH THINGS EMOTIONALLY (e.g. FEELINGS,
INTERESTS, ATTITUDES, APPRECIATION,
ENTHUSIASMS, MOTIVATIONS) - THAT MIGHT
RESULT FROM INSTRUCTION): LO4,LO5,LO6,LO9LO4,LO5,LO6,LO9
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 46
4/10/2014
Copyright DrJJ, ASERG, FSG, UiTM. March 201091
http://drjj.uitm.edu.my
Evaluation
Synthesis
Analysis
Application
Comprehension
Knowledge
Level 1Level 1 :Recal l or recognition of fact, information or concept
Level2Level2 :Basic application of skill/concept : Use info, conceptual knowledge, follow procedures
Level 3Level 3 :Strategic thinking/reasoning :Develop plan to solve probs; require justification & decision-making
Level 4Level 4 :Extended ThinkingSolving authentic real-world problem requiring time & research, patience, perseverance..
Webb’s DOKWebb’s DOK
Bloom’s TaxonomyBloom’s Taxonomy
Origination
Adaptation
Complete Overt Response
Mechanism
Guided Response
Set
Perception
Krathwol’s TaxonomyKrathwol’s TaxonomySimpson’s TaxonomySimpson’s Taxonomy
Internalizing
Organisation
Valuing
Responding
Receiving
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 2011 92
http://drjj.uitm.edu.my
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 47
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. March 20109384
http://drjj.uitm.edu.my
Source: Biggs & Tang (2007). “Teaching for Quality Learning at University”. Third Edition. McGraw Hill Companies.
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 94
http://drjj.uitm.edu.my
1.1. Knowledge in Fundamentals Knowledge in Fundamentals –– ContentContent2.2. Knowledge in Specific Engineering DisciplineKnowledge in Specific Engineering Discipline3.3. Thinking & Problem SolvingThinking & Problem Solving4.4. Systems ApproachSystems Approach5.5. Principles of Design for Sustainable DevelopmentPrinciples of Design for Sustainable Development6.6. Ethics, Responsibilities & ProfessionalismEthics, Responsibilities & Professionalism7.7. CommunicationCommunication8.8. TeamworkTeamwork9.9. Professional Engineering ResponsibilitiesProfessional Engineering Responsibilities10.10.LifeLife--long Learninglong Learning
Learning Innovations & Instructional Leadership 10/04/2014
Copyright DRJJ, ASERG, FSG, UiTM. March 2010Copyright DR JJ, ASERG, UiTM, Shah Alam 48
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 95
http://drjj.uitm.edu.my
Knowledge in Fundamentals Knowledge in Fundamentals –– Content. PLO #1:Content. PLO #1:•• An ability to apply knowledge of mathematics, science, and engineering An ability to apply knowledge of mathematics, science, and engineering
(ABET) (ABET) • ability to acquire and apply knowledge of science a nd engineering
fundamentals (EAC)• An ability to apply science and engineering fundame ntals (FKE)
1.1. combine and explain mathematical and/or physics (science) concepts and combine and explain mathematical and/or physics (science) concepts and principles to formulate models of electrical, computer and power processes principles to formulate models of electrical, computer and power processes and systems relevant to electrical engineering,and systems relevant to electrical engineering,
2.2. apply concepts of integral, differential calculus, complex numbers, differential apply concepts of integral, differential calculus, complex numbers, differential equations and/or statistics to solve electrical engineering problemsequations and/or statistics to solve electrical engineering problems
3.3. apply the governing equations and underlying concepts of (apply the governing equations and underlying concepts of (specify the specify the themes in electrical engineeringthemes in electrical engineering ), and/or process control to electrical ), and/or process control to electrical engineering problems.engineering problems.
4/10/2014 Copyright DrJJ, ASERG, FSG, UiTM. 2011 96
http://drjj.uitm.edu.my
Knowledge in Fundamentals Knowledge in Fundamentals –– Content. PLO #1:Content. PLO #1:•• An ability to apply knowledge of mathematics, science, and engineering An ability to apply knowledge of mathematics, science, and engineering
(ABET) (ABET) • ability to acquire and apply knowledge of science a nd engineering
fundamentals (EAC)• An ability to apply science and engineering fundame ntals (FKE)
1. Apply mathematics and physics principles to obtain solutions to well-defined engineering problems.
2. Apply mathematics and chemistry principles to obtain solutions to well-defined engineering problems
3. Uses principles of chemistry, physics and engineering in solving well-defined electrical engineering problems
4. Combines scientific and engineering principles to formulate models of processes and systems.
5. Combines mathematics principles to formulate models of processes and systems
Top Related