Assessing Student Assessing Student Learning:Learning:

A Good IDEA!A Good IDEA!

– Allyson Dickie, Assoc. Dean Distributed Learning

• dickiea@northpark.edu

– Robert Stanley, Dir. Institutional Research & Effectiveness

• rstanley@northpark.edu

Assessing Student Learning:Assessing Student Learning:A Good IDEA!A Good IDEA!

• Brief Overview: Online Course Design @ NPU

– Allyson Dickie

• Overview of IDEA Student Course Rating System

– Robert Stanley

• Demonstration of IDEA Implementation @ NPU

– Allyson Dickie

Online Course Design @ NPUOnline Course Design @ NPUTwo CornerstonesTwo Cornerstones

• Focused on Student Learning

–Strong Assessment of Student Learning

–Primary Objective – Improve Teaching Practice

• Cornerstone #1 -- Quality Matters

–Faculty Peer Reviewed Process

–Research Based Rubric

Online Course Design @ NPUOnline Course Design @ NPUCornerstones continuedCornerstones continued

• Cornerstone #2 – Student Course Ratings

–One Possibility

–Interesting but is there another way?

–NPU uses the IDEA Student Rating Systems

• Aligns with Quality Matters Design Process• Closes the assessment loop

ASSESSMENT OF STUDENT LEARNINGASSESSMENT OF STUDENT LEARNING

CENTERPIECECENTERPIECEONLINE COURSE DESIGNONLINE COURSE DESIGN

Assessment of

Student Learning

COURSE OBJECTIVES

IDEACOURSE

EVALUATIONS

LEARNINGACTIVITIES

COURSE ASSESSMENTS

INSTITUTIONAL & PROGRAM QUESTIONS:

• How do we capture data?

– On-line courses

– F2 F courses

• INSTITUTIONAL & PROGRAM QUESTIONS:

• Will the data be informative?

• What is wrong with our current system?

• Do we really need this information?

Overview:Overview:

• North Park University

• A four-year liberal arts university located on the north side of Chicago

• Estimated student enrollment is 3,000 students

• Over 300 faculty

Academic Programs:Academic Programs:

• Undergraduate College

• North Park Theological Seminary

• School of Adult Learning

• School of Business & Nonprofit Management

• School of Education

• School of Music

• School of Nursing

•IDEA:

What an odd term for assessing student learning.

IDEA:

Individual Development and Educational

Assessment

The IDEA Center was established in 1975

Adjusts for extraneous circumstances

Student learning is the focus

Centered around 12 objectives

Focused on student learning and methods used to facilitate it

Provides national comparison as well as group comparison

Provides national evidence of validity and reliability

Analysis the expectation for the class

Good practices suggests 3-5 objectives

Connect all activities to the objectives

Provides national evidence of validity and reliability

Teaching: Pulling it together

Faculty information form

Effective teaching

Learning

Data: quality improvement

Practices for selecting the objectives:

Consider the over-all goals Identify key methods of delivery Content, end product and activities Match the above with the best objectives

that follow

Objectives 1-3

Gain factual knowledge (terminology, classifications, methods, trends).

Comprehend learning of fundamental principles, generalizations, or theories.

Learn to apply course material to improve thinking, problem solving, and decisions.

IDEA Supports Quality Matters

Learning Objectives

Assessment and Measurement Focused

Learner Engagement

Delivered face-to-face or on-line

IDEA Supports Quality Matters

Work together to ensure that students achieve the desired learning outcomes.

Objectives 4-6

Develop specific skills, competencies, and points of view needed by professionals in the field most closely related to this course.

Acquire skills in working with others as a member of a team.

Develop creative capacities (writing, inventing, designing, performing in art, music, drama, etc.).

Objectives 7-9

Gain a broader understanding and appreciation of intellectual/cultural activity (music, science, literature, etc.).

Develop skill in expressing themselves orally or in writing.

Learn how to find and use resources for answering questions or solving problems.

Objectives 10-12

Develop a clearer understanding of, and commitment to, personal values.

Learn to analyze and critically evaluate ideas, arguments, and points of view.

Acquire an interest in learning more by asking questions and seeking answers for further learning. 

Using Extra Questions

20 extra questions can be added.

May be used to address questions at various levels:InstitutionDepartmentCourse

ADMINISTERING IDEA Faculty are required to leave the room

Final forms are sent to one location

Pre-processing

Tabulation and analysis

Reports

Quality Improvement Model

Using IDEA Learner focused

As a tool for reflection about your teaching

As a source of evidence in the evaluation process

Assessing Student Learning:A Good IDEA!

Conclusion and Reflections

Allyson Dickie, Assoc. Dean Distributed Learning• dickiea@northpark.edu

Robert Stanley, Dir. Institutional Research & Effectiveness• rstanley@northpark.edu