GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the...

43
GETTING STARTED ON COURSE REDESIGN

description

TRADITIONAL INSTRUCTION Seminars Lectures

Transcript of GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the...

Page 1: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

GETTING STARTED ON COURSE REDESIGN

Page 2: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

• Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts

• Became an independent non-profit organization in 2003

• Mission: help colleges and universities learn how to use technology to improve student learning outcomes and reduce their instructional costs

Page 3: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

TRADITIONAL INSTRUCTION

SeminarsLectures

Page 4: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

“BOLT-ON” INSTRUCTION

Page 5: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

WHAT’S WRONG WITH THE LECTURE?

• Treats all students as if they are the same

• Ineffective in engaging students

• Inadequate individual assistance

• Poor attendance and success rates

• Students fail to retain learning

Page 6: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

WHAT’S WRONG WITH MULTIPLE SECTIONS?

• In theory: greater interaction• In practice: large class size• In practice: dominated by the

same presentation techniques• Lack of coordination• Inconsistent outcomes

Page 7: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

WHAT DOES NCAT MEAN BY COURSE REDESIGN?

Course redesign is the process of redesigning whole courses (rather than individual classes or sections) to achieve better learning outcomes at a lower cost by taking advantage of the capabilities of information technology.

Page 8: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

WHY REDESIGN?Look for courses where redesign will have a high

impact – let’s make a difference!Improving Student learning• High withdrawal/failure rates• Inconsistency of preparation • Difficulty in subsequent courses

Reducing Instructional Costs• Students on waiting lists• Students turned away – graduation bottleneck• Over enrollment of courses leading to multiple majors • Difficulty getting qualified adjuncts

Page 9: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

TEAM EFFORT IS KEY

Each team included– Administrator– Faculty experts– Technology expertise– Assessment assistance– Instructional Designer

Page 10: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

NCAT METHODOLOGY:Relevance and Utility

• Discipline: math & literature

• Age: traditional & working adults

• Institution: small & large• Location: on-campus &

at a distance • Redesign: current & new

courses• Level: introductory &

advanced

Page 11: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

250+ REDESIGNED COURSES

• ~250,000 students nationwide annually• Improved student learning: 72%

Equivalent student learning: 28%• Cost reduction: 34% (5% to 81%) • Other outcomes

– Increased course-completion rates– Improved retention– Better student attitudes toward the subject– Increased student satisfaction with the mode of

instruction

Page 12: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

QUANTITATIVE

• Mathematics– Developmental Math– Pre-calculus Math – College Algebra – Discrete Math – Introductory Algebra – Elementary Algebra – Beginning Algebra – Intermediate Algebra – Linear Algebra

• Statistics– Business Statistics– Introductory Statistics – Elementary Statistics – Economic Statistics

• Computing– Computer Programming– Information Technology

Concepts – Computer Literacy – Information Literacy – Tools for the Information

Age

Page 13: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

• SCIENCE– Anatomy and

Physiology– Astronomy – Biology – Ethnobotany – Chemistry – Geology

• SOCIAL SCIENCE– American

Government – Macro and

Microeconomics – Psychology – Sociology – Urban Affairs

Page 14: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

• HUMANITIES– Developmental Reading– Developmental Writing– English Composition– Communication Studies – Understanding the Visual

and Performing Arts – History of Western

Civilization – Great Ideas in Western

Music – Spanish– World Literature – British Literature– Women and Gender Studies

• PROFESSIONAL– Elementary Education– Education: The Curriculum – Engineering– Organizational Behavior– Public Speaking– Accounting– Nursing– Nutrition

Page 15: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

WHAT DO THE FACULTY SAY?• “It’s the best experience

I’ve ever had in a classroom.”

• “The quality of my worklife has changed immeasurably for the better.”

• “It’s a lot of work during the transition--but it’s worth it.”

Page 16: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

REDESIGN MODELS• Supplemental – Add to the current structure and/or

change the content • Replacement – Blend face-to-face with online

activities• Emporium – Move all classes to a lab setting

Fully online – Conduct all (most) learning activities online• Buffet – Mix and match according

to student preferences• Linked Workshop – JIT workshops

linked to a college level course

Page 17: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

REDESIGN CHARACTERISTICS • Redesign the whole course—not just a

single class• Emphasize active learning—greater

student engagement with the material and with one another

• Rely heavily on readily available interactive software—used independently and in teams

• Mastery learning—not self-paced• Increase on-demand, individualized

assistance • Automate only those course

components that can benefit from automation—e.g., homework, quizzes, exams

• Replace single mode instruction with differentiated personnel strategiesTechnology enables good pedagogy with large #s of students.

Page 18: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

SUPPLEMENTAL MODEL• Maintain the basic current structure• Change the content so that more is available

on line• Change interaction so that students are

interacting more with the material• Change the use of the time to reduce or

eliminate lecturing and increase student interaction

Page 19: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

BIOLOGYUniversity of Massachusetts

CHALLENGES• Inconsistent student preparation• Poor class attendance• Lectures that repeated the contents of the

textbook• High dissatisfaction with course by both

faculty and students

Page 20: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

BIOLOGYUniversity of Massachusetts

• Continue to have large class meetings• Require short pre-tests before the start of the

first class each week and these are available for the entire term as review

• Receive small number of points for taking the online quiz

• Provide 24/7 online study materials• Include small group interactions during class

focused on applied biology problems• Class periods are now used to discuss

biology problems, rather than lecture

Page 21: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

BIOLOGYUniversity of Massachusetts

Student Outcomes

• In spite of more difficult questions, scores on exams in the redesigned course averaged 73% vs. 61% in the traditional course.

• 23% of the exam questions in the traditional model required reasoning or problem solving skills vs. 67% in the redesigned course.

• Attendance averaged 89.9% in the redesigned course vs. 67% in the traditional course.

Page 22: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

REPLACEMENT MODEL• Blend face-to-face with online activities• Determine exactly what activities

required face-to-face and reduce the amount of time to focus only on those activities in class

• Provide 24/7 online interactive learning materials and resources

• Include online self-assessment activities with immediate feedback

Page 23: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

ENGLISH COMPOSITION Tallahassee Community College

• Primary goals– Increase writing skills– Improve student success (<60%)– Increase consistency (100 sections)

• Replace classroom time with lab time and online activities

• Integrate reading and writing, provide immediate feedback and support collaborative learning

• Success rates Increased to 68.4%• Final essay scores increased (8.35 in

redesign vs. 7.32 in traditional)• Cost-per-student declined by 43%

Page 24: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

EMPORIUM MODEL• Move all classes to a lab setting• Permit the use of multiple kinds of personnel• Allow students to work as long as they need

to master the content• Can be adapted for the kinds of students at a

particular institution• Allow multiple courses the same time• Include multiple examples in math

Page 25: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

THE EMPORIUM MODEL

Page 26: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

urviveurvive

Page 27: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

THE MATH EMPORIUM:ACADEMIC GOALS

• Enhance quality by individualizing instruction• Assess students’ knowledge in much smaller

subject-matter chunks• Provide feedback and direction to allow

students to make up for specific deficiencies• Provide help 75 - 80 hours per week• Incorporate examples and information from

other disciplines• Make changes in the course as it proceeds;

continuous improvement as a built-in feature

Page 28: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

THE MATH EMPORIUM Characteristics

• Move classes to a lab setting• Permit the use of multiple kinds of personnel• Allow students to work as long as they need

to master the content• Can be adapted for the kinds of students at a

particular institution• Allow multiple courses the same time• Include multiple examples in math

Page 29: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

CLEVELAND STATE COMMUNITY COLLEGE

Developmental Math– Success rate in developmental math courses went from 54% to 72% – Each course showed significant improvement in Fall 2008– Intermediate Algebra had a 79% success rate in Fall 2008

College Level Math– Success rate in three redesigned courses increased from 72% to 75%– College Algebra improved, Finite Math & Statistics stayed same– 33% increase in students passing a college level math course 2008-09– More students passed a college level math course in Spring 2009 than

were enrolled in a college level math course in Spring 2008Developmental Students In College Level Math

– Before redesign 71% success for developmental students in math– After redesign 76% success rate for developmental students in math– Fall 2008 developmental students 79% success rate in math while

college math success rate was unchanged at 72%

Page 30: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

New Solutions to Old Problems

at Cleveland Community CollegeContinuous Enrollment Plan

– Students may start in any redesigned math course when they finish the course they are currently enrolled in, without switching classes

– Students add second class to schedule if they complete it – 46 students completed multiple math courses in Fall

2008– 33 of these exited developmental math in one semester– 2 students completed 3 courses in one semester

Back to the One Room Schoolhouse– Low enrollment classes always a problem – Solution: Two classes in same room at the same time– New course offerings at all campuses in Fall 2009– Scheduling flexibility increase due to this strategy

Page 31: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

DEVELOPMENTAL READINGNortheast State Community College

• Reading Emporium• Annual enrollment 500-550• Problems: High failure rate, course drift, one size

fits all• Goals: improve outcomes, individualized student

programs, reduce cost course costs• Weekly group meetings, required lab hours,

course notebook, early exit possible• Results: Nelson Denny test – redesign increase

20 points, 12 points more than traditional

Page 32: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

FULLY ONLINE MODEL

• Moves all or most of the learning environment online

• Provides access to anyone, anywhere, anytime – on demand

• Allows international groups of students to interact easily and learn from each other

Page 33: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

U. OF S. MISSISSIPPIWorld Literature

Traditional• 16 – 20 sections (~65)• Taught by 8 faculty

and 8 adjuncts• Faculty do all grading• $70 cost-per-student

Redesign• Single online section• Team-taught by 4

faculty and 4 TAs• 50% automated grading

via WebCT; 50% TAs• $31 cost-per-student

Redesign triples course capacity.

Page 34: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

PRE-CALCULUS MATHRio Salado College

Traditional• 4 courses taught by

4 instructors • Student interaction

= each instructor

• $49 cost-per-student• Retention = 59%

Redesign• 4 courses taught by 1

instructor• Student interaction =

interactive software, 1 course assistant, and 1 instructor

• $31 cost-per-student• Retention = 65%

Page 35: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

BUFFET MODEL• Assess each student’s knowledge/skill level

and preferred learning style• Provide an array of high-quality, interactive

learning materials and activities• Develop individualized study plans• Built in continuous assessment to provide

instantaneous feedback • Offer appropriate, varied human interaction

when needed

Page 36: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

STATISTICSOhio State University

• Redesign students outscored traditional students on common exams (mean = 78.3 vs. 70)

• Percentage of students needing to retake the course reduced from 33% to 12%.

• Cost-per-student reduced from $191 to $132

Page 37: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

LINKED WORKSHOP MODEL• Retain basic structure of the college-level course, particularly

the number of class meetings• Replace remedial/developmental course with just-in-time

(JIT) workshops• Design workshops to remove deficiencies in core course

competencies• Workshops consist of computer-based instruction, small-

group activities and test reviews to provide additional instruction on key concepts

• Students individually assigned software modules based on results of diagnostic assessments

• Workshops facilitated by students who have previously excelled in core course; students trained and supervised by core course faculty

• JIT workshop activities designed so students use concepts during next core course class session, which in turn helps them see the value of the workshops and motivates them to do workshop activities

Page 38: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

DEVELOPMENTAL MATHAustin Peay State University

Fundamentals of Math• Traditional: 33% of

students who took the developmental and the college-level course sequentially were successful.

• Redesign: 70% of students who would have been assigned to a developmental course were successful in the course linked to a workshop.

Elements of Statistics• Traditional: 23% of

students who took the developmental and the college-level course sequentially were successful.

• Redesign: 52% of students who would have been assigned to a developmental course were successful in the course linked to a workshop.

Page 39: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

FACULTY BENEFITS• Increased opportunity to work directly with

students who need help• Reduced grading • Technology does the tracking and monitoring• More practice and interaction for students

without faculty effort• Ability to try different approaches to meet

different student needs• Opportunity for continuous improvement of

materials and approaches

Page 40: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

A STREAMLINED REDESIGN METHODOLOGY

“A Menu of Redesign Options”• Six Models for Course Redesign• Five Principles of Successful Course

Redesign• Cost Reduction Strategies• Course Planning Tool• Course Structure Form• Four Models for Assessing Student

Learning• Five Critical Implementation Issues• Planning Checklist

Page 41: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

GUIDES TO REDESIGN• How to Redesign a College Course Using

NCAT’s Methodology• How to Redesign a Developmental Math

Program Using the Emporium Model• How to Redesign a College-Level or

Developmental Math Course Using the Emporium Model

• How to Organize a Campus-Wide Redesign Program Using NCAT’s Methodology

Visit: www.theNCAT.org

Page 42: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

GETTING STARTED ON COURSE REDESIGN

Carolyn Jarmon, [email protected]

www.theNCAT.org

Page 43: GETTING STARTED ON COURSE REDESIGN. Established in 1999 as a university Center at RPI funded by the Pew Charitable Trusts Became an independent non-profit.

QUESTIONS?