Integrating Integrating TechnologyTechnology

When TeachingWhen TeachingLarge ClassesLarge ClassesWendy L. Keeney-KennicuttWendy L. Keeney-Kennicutt

Associate Director, First Year Chemistry ProgramAssociate Director, First Year Chemistry ProgramPresidential Professor for Teaching ExcellencePresidential Professor for Teaching Excellence

Texas A&M UniversityTexas A&M UniversityK-keeney@tamu.eduK-keeney@tamu.edu

1120102010

Technologies I UseTechnologies I Use

Web assessments for student feedbackWeb assessments for student feedback EmailEmail Excel SpreadsheetExcel Spreadsheet Ebook, e-solution manual and e-homeworkEbook, e-solution manual and e-homework Class Websites – public and privateClass Websites – public and private Calibrated Peer Review – on-line writing/reviewingCalibrated Peer Review – on-line writing/reviewing TurnitinTurnitin ClickersClickers Office hours/review sessions in Second LifeOffice hours/review sessions in Second Life

22

My BackgroundMy Background

Taught first year chemistry at TAMU since 1984Taught first year chemistry at TAMU since 1984

– Off sequence students for >10 yearsOff sequence students for >10 years Class size: 2 classes of 230-300 students eachClass size: 2 classes of 230-300 students each Always had excellent student evaluations, Always had excellent student evaluations,

university teaching awards, but…university teaching awards, but… I was unhappy with rigidity of class structure, felt I was unhappy with rigidity of class structure, felt

I wasn’t serving my students…I wasn’t serving my students… What could I do? I used technology to…….What could I do? I used technology to…….

ASK THEM! LISTEN! BE CREATIVE!ASK THEM! LISTEN! BE CREATIVE!

33

Tools for StudentTools for StudentFeedbackFeedback

Myers Briggs/Kiersey Temperment Sorter/Jung Typology Myers Briggs/Kiersey Temperment Sorter/Jung Typology Test (output – 4 letters e.g. INTJ)Test (output – 4 letters e.g. INTJ)

– Free quiz: Free quiz: www.humanmetrics.com/www.humanmetrics.com/

Learning Style Test (VARK)Learning Style Test (VARK)– Free quiz: Free quiz: www.vark-learn.com/www.vark-learn.com/– Provides learning styles (Visual, Aural, Read/Write, Provides learning styles (Visual, Aural, Read/Write, Kinesthetic) with hints for studentsKinesthetic) with hints for students

SALG (Student Assessment of Learning Gains)SALG (Student Assessment of Learning Gains)– Updated website: www.salgsite.orgUpdated website: www.salgsite.org– Free & easy assessment toolFree & easy assessment tool

4420102010

SALG SALG ((www.salgsite.orgwww.salgsite.org))

Developed in 1997 for undergraduate chemistry Developed in 1997 for undergraduate chemistry courses – funded by NSF, then revised in 2007courses – funded by NSF, then revised in 2007

focuses exclusively on the degree to which a course focuses exclusively on the degree to which a course has enabled student learninghas enabled student learning

asks students to assess/report on own learning:asks students to assess/report on own learning:

1.1. How much of the following aspects of the course helped you How much of the following aspects of the course helped you in your learning?in your learning?

2.2. As a result of your work in this classAs a result of your work in this classa.a. What gains did you make in your understanding of …What gains did you make in your understanding of …b.b. What gains did you make in the following skills …What gains did you make in the following skills …c.c. What gains did you make in the following attitudinal What gains did you make in the following attitudinal

changes …changes …d.d. What gains did you make in integrating the following What gains did you make in integrating the following … …

5520102010

SALGSALG

Benefits Benefits Free and Free and easy to use and modifyeasy to use and modify Can add questions, including demographicsCan add questions, including demographics

− I’ve used this for many semesters for classroom I’ve used this for many semesters for classroom researchresearch

Provides easy-to-read outputProvides easy-to-read output Provides raw numeric data for your own correlationsProvides raw numeric data for your own correlations Students can log in with their name so credit can be givenStudents can log in with their name so credit can be given SALG dissociates names from responses to ensure anonymitySALG dissociates names from responses to ensure anonymityHow do I incorporate it?How do I incorporate it? worth 5 points on their final exam (~95% worth 5 points on their final exam (~95% compliance)compliance)

What do I get out of it?What do I get out of it? Reliable, consistent information from my class over Reliable, consistent information from my class over timetime

6620102010

Personality TestPersonality TestJung Typology TestJung Typology Test free free students like itstudents like it

− can understand wordscan understand words− results usually agree results usually agree

with self-assessmentwith self-assessment

How do I incorporate it?How do I incorporate it? worth a quiz grade (3 pts)worth a quiz grade (3 pts) students email me their results and commentsstudents email me their results and comments

− encourages students to email me; I respondencourages students to email me; I respond− tells students that communication is important to metells students that communication is important to me

What do I get out of it?What do I get out of it? data on learning styles (next slide) – I share with the classdata on learning styles (next slide) – I share with the class reminder to me that class is heterogeneous in how they learnreminder to me that class is heterogeneous in how they learn

(72 questions)

7720102010

Personality TestPersonality TestFour Learning Styles: NT:NT: interested in principles and logic, enjoy developing own ideas, interested in principles and logic, enjoy developing own ideas,

like technology, do not enjoy meaningless assignmentslike technology, do not enjoy meaningless assignments

NFNF:: need acceptance, caring and support, enjoy group activities, need acceptance, caring and support, enjoy group activities, prefer cooperation over competition, learn best face-to-faceprefer cooperation over competition, learn best face-to-face

SPSP:: value physical involvement and activity in the learning process, value physical involvement and activity in the learning process, are free-spirited and resourceful, may be restless in classare free-spirited and resourceful, may be restless in class

SJSJ:: value responsibility, dependability, conformity, prefer structure value responsibility, dependability, conformity, prefer structure in the classroom, like and need organization & a schedulein the classroom, like and need organization & a schedule

Normal Pop.:Normal Pop.: NT = 13% SP = 38% NF = 13% SJ = 38% NT = 13% SP = 38% NF = 13% SJ = 38%My Class (F07): NT = 23% SP = 7% NF = 26% SJ = 44%My Class (F07): NT = 23% SP = 7% NF = 26% SJ = 44%

8820102010

VARKVARKWhat is VARK?What is VARK? a 16 question quiz providing users with profile of learning a 16 question quiz providing users with profile of learning preferencespreferences

− the ways that they want to take-in and give-out information. the ways that they want to take-in and give-out information. − VVisual vs. isual vs. A Aural vs. ural vs. RReading/Writing vs. eading/Writing vs. KKinestheticinesthetic− Remember, preferences are not the same as strengthsRemember, preferences are not the same as strengths

developed by Neil Fleming, Lincoln University, New Zealanddeveloped by Neil Fleming, Lincoln University, New Zealand one can choose more than one answer to a question:one can choose more than one answer to a question:

KinestheticKinesthetic

Read/WriteRead/Write

AuralAural

VisualVisual

My Fall 2007 class:My Fall 2007 class:− 67% are multimodal learners (VARK), but what about the rest?67% are multimodal learners (VARK), but what about the rest?

9920102010

VARKVARKMy Fall 2007 Class (N=425 responses):My Fall 2007 Class (N=425 responses): Represents 100% of the students who took the final Represents 100% of the students who took the final examexam Although 67% of the students have no preference for Although 67% of the students have no preference for

learning modality (VARK),learning modality (VARK),Learning Preferenc

e

N Learning Preferenc

e

N

VARK

VAVRVK

9132528259

AKRK

VARVAKVRK

VARK

1031169

286

79% like Visual79% like Visual

79% like Aural79% like Aural

80% like Read/Write80% like Read/Write

87% like Kinesthetic87% like Kinesthetic

Where does Where does that leave us as that leave us as

instructors?instructors?101020102010

Technology helps us meet student needs.

My Syllabus:My Syllabus: Exams 1, 2, 3 - 100 pts each (80% MC)Exams 1, 2, 3 - 100 pts each (80% MC)

– Each has makeup 10 days later (0% MC) and any reason worksEach has makeup 10 days later (0% MC) and any reason works ““Exam 4” – average of best 3 scores of 3 exams and 3 writing Exam 4” – average of best 3 scores of 3 exams and 3 writing

assignments (Calibrated Peer Reviewassignments (Calibrated Peer ReviewTMTM) – 100 pts) – 100 pts Ebook includes on-line homework (OWL) – 20 or 100 ptsEbook includes on-line homework (OWL) – 20 or 100 pts

– Individual student choiceIndividual student choice Written homework – 0,1,2 pts added to final averageWritten homework – 0,1,2 pts added to final average

– All HW due next class period after exams; All HW due next class period after exams; – 10% penalty when done by makeup exam10% penalty when done by makeup exam

In-class quizzes – best 20/25+ – 30 pts (mostly with clickers)In-class quizzes – best 20/25+ – 30 pts (mostly with clickers)– Open book, open notes, talk to your neighborsOpen book, open notes, talk to your neighbors

Final Exam – 170 pts (150 pts MC)Final Exam – 170 pts (150 pts MC)1111

More on Exams

I give partial credit on multiple choice part!I give partial credit on multiple choice part! Each question is really 2 questions. For example:Each question is really 2 questions. For example:

The entire question is worth 5 pointsThe entire question is worth 5 points– Question 1 is 3 pts and Question 2 is 2 pointsQuestion 1 is 3 pts and Question 2 is 2 points

If the student is sure of the answer, he/she bubbles the If the student is sure of the answer, he/she bubbles the same answer twice for the full 5 pointssame answer twice for the full 5 points

Students who narrow the choice to two answers can split.Students who narrow the choice to two answers can split. C is correct, so if they put C for (1) and D for (2), they would get 3 C is correct, so if they put C for (1) and D for (2), they would get 3 points.points.

121220102010

Technologies I UseTechnologies I Use

Web assessments for student feedbackWeb assessments for student feedback EmailEmail Excel SpreadsheetExcel Spreadsheet Ebook, e-solution manual and e-homeworkEbook, e-solution manual and e-homework Class Websites – public and privateClass Websites – public and private Calibrated Peer Review – on-line writing/reviewingCalibrated Peer Review – on-line writing/reviewing TurnitinTurnitin ClickersClickers Office hours/review sessions in Second LifeOffice hours/review sessions in Second Life

1313

Technology is Your Ally!

Web evaluations & personality testsWeb evaluations & personality tests Email & MS Excel (Grades and Grade Calculator)Email & MS Excel (Grades and Grade Calculator)

1414

Details:Details:

Technology is Your Ally!

Ebook Ebook – Hardcopy is optionalHardcopy is optional– Comes with on-line homework (OWL) and solution manualComes with on-line homework (OWL) and solution manual– Cost: $45/semesterCost: $45/semester– Due to lower book costs, we can ask students to buy Due to lower book costs, we can ask students to buy

clickersclickers

– With $$ for graders decreasing and university costs With $$ for graders decreasing and university costs increasing, ebooks are the futureincreasing, ebooks are the future

151520102010

Technology is Your Ally!

Two websites – public and at elearning.tamu.eduTwo websites – public and at elearning.tamu.edu Public - www.chem.tamu.edu/class/fyp/wkk-chem.htmlPublic - www.chem.tamu.edu/class/fyp/wkk-chem.html

– Info source – syllabus, office hours, handouts, HW assignmentsInfo source – syllabus, office hours, handouts, HW assignments– Course notes, learning objectives, old exams, Camtasia videosCourse notes, learning objectives, old exams, Camtasia videos– Links to all technology websites we useLinks to all technology websites we use– Powerpoint: “How to do well in First Year Chemistry”Powerpoint: “How to do well in First Year Chemistry”– Math Skills Review selected as NSTA SciLinksMath Skills Review selected as NSTA SciLinks– Links to other chemistry/science-related sitesLinks to other chemistry/science-related sites

Elearning websiteElearning website– Link to my public webpageLink to my public webpage– Link to register clickerLink to register clicker– Link to Turnitin for my writing assignments (Calibrated Peer Review)Link to Turnitin for my writing assignments (Calibrated Peer Review)– GradesGrades

161620102010

Calibrated Peer Review (CPRCalibrated Peer Review (CPRTMTM) – cpr.tamu.edu) – cpr.tamu.edu– Read FAQs on website for more infoRead FAQs on website for more info– Free online writing/peer assessing toolFree online writing/peer assessing tool– Sits on TAMU server (meets FERPA Guidelines)Sits on TAMU server (meets FERPA Guidelines)– I’m the TAMU Master AdministratorI’m the TAMU Master Administrator– Used by >25,000 students at TAMU in last 7 years in 30+ majorsUsed by >25,000 students at TAMU in last 7 years in 30+ majors

How does it work?How does it work?– The students write an assignment as per detailed instructionsThe students write an assignment as per detailed instructions– They pass a calibration step, where they learn to recognize and rank 3 essays of They pass a calibration step, where they learn to recognize and rank 3 essays of

different quality on the same topic (instructor provides these essays)different quality on the same topic (instructor provides these essays)– Your students anonymously critique 3 of their peers’ essays and their own workYour students anonymously critique 3 of their peers’ essays and their own work– You (the instructor) can see all grades and can change if necessaryYou (the instructor) can see all grades and can change if necessary

171720102010

Technology is Your Ally!

Turnitin thru elearning.tamu.edu – for CPR assignmentsTurnitin thru elearning.tamu.edu – for CPR assignments– Plagiarism controlPlagiarism control– Students check their own work before submitting to CPRStudents check their own work before submitting to CPR– I spot check to see if they actually turned in their CPR essayI spot check to see if they actually turned in their CPR essay

Clicker quizzesClicker quizzes– Used daily to promote learning and attendanceUsed daily to promote learning and attendance– Open book, open notes, talk to your neighborOpen book, open notes, talk to your neighbor

Student learn more when they teach someone elseStudent learn more when they teach someone else– Test on topics taught that dayTest on topics taught that day– Students get instant feedbackStudents get instant feedback– Low stakes assessmentLow stakes assessment– Take timeTake time

Must allow students to log into the systemMust allow students to log into the system Must give them time to figure out problemMust give them time to figure out problem Must allow students send in their answer.Must allow students send in their answer.

1818

Technology is Your Ally!

More on Clickers

Survey Results of 322 Students from My Classes - Fall 2009Survey Results of 322 Students from My Classes - Fall 2009

1919

I think the clickers made the class be more enjoyable.

Clickers helped me pay attention and

learn in class.

Second Life at TAMU

Virtual persistent 3-D worldVirtual persistent 3-D world

2020

Aggieland Island and 12Aggieland Island and 12thth Man Island Man Island

TrainDepot

MSC

SL Orientation Aggie Beach

Academic Bldg

ClassroomsDr. K’s Chemistry

PlaceBonfireMemorial

ClockTower

CushingLibrary

Nagle Hall

Bolton HallAmphitheater

Sul Ross Statue

SeasonalActivity Area

Second Life at TAMU

2121

Dr. K’s Chemistry Place - OverviewDr. K’s Chemistry Place - Overview

Second Life at TAMU

2222

Dr. K’s Chemistry Place – Classroom AreaDr. K’s Chemistry Place – Classroom Area

BlackboardMovie Screen

Streaming DesktopClickerSystem

QuizSystem

Seats that allow students to raise their hands

Notice Board

Obelisk QuizObelisk Quiz− 4 choices4 choices− if pick correctly, if pick correctly, get 4 more choicesget 4 more choices

MC QuizMC Quiz

Both can be done Both can be done by students on their by students on their ownown

2323

Second Life at TAMU

Dr. K’s Chemistry Place – QuizzesDr. K’s Chemistry Place – Quizzes

Technology Caveat: you must spend time inside/outside class to help with tech learning

curves.

Second LifeSecond Life– Office hour/review session/SL activity for 1 quiz gradeOffice hour/review session/SL activity for 1 quiz grade– Cannot be mandatory – there is a population density problemCannot be mandatory – there is a population density problem

An island can only handle about 50 people; I have 550 studentsAn island can only handle about 50 people; I have 550 students– A way to reach technically-savvy studentsA way to reach technically-savvy students– More personal than email or telephoneMore personal than email or telephone– Can work with groups at a distanceCan work with groups at a distance– No need for students to come to campusNo need for students to come to campus

SL IssuesSL Issues– TechnologyTechnology– Lack of student computer literacyLack of student computer literacy

2424

Technology is Your Ally!

Tech Learning Curve

Data on Calibrated Peer Review studyData on Calibrated Peer Review study

2525

“Overcoming Student Resistance to a Teaching Innovation” by Wendy Keeney-Kennicutt, Baris Gunersel and Nancy Simpson. http://www.georgiasouthern.edu/ijsotl/issue_v2n1.htm

0

10

20

30

40

50

60

70

80

CPR isEnjoyable

Helps us LearnChemistry

Helps ImproveWriting

Helps ImproveCritiquing

Others ShouldDo CPR

Survey Questions

Pe

rce

nt

of

Stu

de

nts

W

ho

Ag

ree

or

Str

on

gly

Ag

ree

Fall 2002

Spring 2003

Spring 2004

Fall 2004

Spring 2005

Fall 2005

Spring 2006

But you are not tied to technology!

My lectures are not powerpointMy lectures are not powerpoint– I have 3 overhead projectorsI have 3 overhead projectors– I write/talk at the same timeI write/talk at the same time

My notes are handwrittenMy notes are handwritten– Available on the public website and at Copy CornerAvailable on the public website and at Copy Corner– I tack $1 onto Copy Corner notes to support the Chemistry Road ShowI tack $1 onto Copy Corner notes to support the Chemistry Road Show

Student notecard with pictureStudent notecard with picture– Counts as a quiz gradeCounts as a quiz grade– Includes hometown, chemistry background etc. plus something specialIncludes hometown, chemistry background etc. plus something special– My opportunity to share my backgroundMy opportunity to share my background

Written homework from the textbook (counted, not graded)Written homework from the textbook (counted, not graded) Paper quizzesPaper quizzes

– See student thought processes See student thought processes

262620102010

Examples from my class:Examples from my class:

The personal touch!

Weekly review sessions – Sundays at 2pm – in real lifeWeekly review sessions – Sundays at 2pm – in real life– Review the week’s workReview the week’s work– Answer queriesAnswer queries– Give more examples at a slower paceGive more examples at a slower pace– Why?Why?

I teach an off-sequence courseI teach an off-sequence course Student chemistry backgrounds are very non-homogeneousStudent chemistry backgrounds are very non-homogeneous I was bored with answering the same questions over and overI was bored with answering the same questions over and over Some students are too shy to ask questionsSome students are too shy to ask questions

Weekly review sessions – Sundays at 5pm – in Second LifeWeekly review sessions – Sundays at 5pm – in Second Life– For students who like that technology and cannot make it to campusFor students who like that technology and cannot make it to campus– Students and I can speak using microphone or chat via our avatarsStudents and I can speak using microphone or chat via our avatars

Office hours – my office is in back of Chemistry Help Desk areaOffice hours – my office is in back of Chemistry Help Desk area

2727

Examples from my class:Examples from my class:

Benefits of Technology for Me

Allows me to meet needs of different learning styles Allows students to design their own course assessments (within reason) Gives me more time to spend doing fun activities with my students

−Clickers are amazing time-savers (no grading/alphabetizing/recording)

Learning environment is converted from teacher-Learning environment is converted from teacher-centered to centered to student-centered.student-centered.

Allows me to be imaginative in my syllabus and Allows me to be imaginative in my syllabus and stay true to stay true to my teaching style.my teaching style.

Think about choosing another Think about choosing another fun tech method for your classes!fun tech method for your classes!2828