Download - Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Transcript
Page 1: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance
Page 2: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Capstone & Experiential Learning at

NEU’s College of Professional Studies

2

Academic Quality AssuranceDirector, Assessment: Mamta Saxena

Associate Director, Assessment: Melanie Kasparian

Page 3: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Capstone & Experiential Learning at NEU’s College of Professional Studies

3

Academic Quality AssuranceDirector, Assessment: Mamta Saxena

Associate Director, Assessment: Melanie Kasparian

Page 4: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

4

Page 5: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Workshop Outcomes:

5

• Develop a capstone framework that integrates experiential learning

• Activity # 1

• Create authentic assignments that emulate real world experiences

• Activity # 2

• Identify measures of experiential learning • Activity # 3

Page 6: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Academic Quality Assurance

• Collect data about program outcomes to inform the teaching and learning at the program level

• Promote a culture of assessment and inquiry to achieve college and program goals and mission

• Provide a shared understanding of good assessment practices

6

Assessment CycleDefine

Gather

Analyze

Improve

Page 7: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

7

Annual Report Stages

IV: Act

• Plan for implementing PRP goals

• Implement goals

I: Define

• Mission• SLOs• Course map• Measures• Benchmarks• Data collection

strategy

III: Analyze

• Direct measures• Indirect measures• Previous year’s PRP• Write-up Results & new PRP goals

to align outcomes

II: Collect

• Collect data from multiple sources

• Aggregate data

Annual Assessment Cycle

Page 8: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

8

Overarching Vision: 2020

Page 9: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Northeastern and Change

• Known for Co-op

program

• Experiential learning

focused on co-op for

undergraduates

• In 2013 CPS took on

the challenge to offer

experiential learning to

adult online learners

• Challenges we face

Page 10: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

“process where knowledge is created

through the transformation of experience”

Kolb (1984)

10

Definition of Experiential Learning

Page 11: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Curricular, co-curricular, and pedagogical experiences that provide students with opportunities to develop the

kinds of learning they need … High impact practices are cumulative experiences that increase rates of

student retention and student engagement

Kuh (2008)

Connection to High Impact Practices

Page 12: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

High Impact

Practices

First Year Experience Common

Intellectual Experiences

Learning Communities

Writing-Intensive Courses

Collaborative Work

Research

Diversity/Global Learning

Community-Based

Learning

Internships(also co-op)

Capstone

Page 13: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Shared Understanding of “Experiential”

Page 14: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Making Experiential More Explicit: Levels of Incorporation

14

Institutional

Program

Curriculum

Page 15: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Institutional: Strategic Partnerships

15

Page 16: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Framework Selected in 2012:

• Specialized Knowledge

• Broad and Integrative Knowledge

• Applied and Collaborative Knowledge

• Civic, Global, Intercultural Learning

• Intellectual Learning

Program: Outcomes Framework

Page 17: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Program: Updated Outcomes Framework

In 2016, added category

• Specialized Knowledge

• Broad and Integrative Knowledge

• Applied and Collaborative Knowledge

• Civic, Global, Intercultural Learning

• Experiential Learning

Page 18: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Program: Updated Capstone Framework

18

• Undergraduate:XXX4850 Capstone Seminar

• Graduate: XXX7980 Capstone Project

Every program culminates in a capstone:

Summative

Formative

Capstone

Page 19: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Program: Updated Capstone Framework

19

Summative

Formative

Capstone

Thesis, research report, essay, exhibit, composition, portfolio, oral presentation, performance show or recital, ePortfolio review and revision, case studies, conference presentations

Signature Assignments and Projects: Final exams, artifacts such as report, presentation, action plan, research paper, art work, recital, speech, proposals

Quizzes, Discussion forums, wikis, blogs, or group work/activities, journals, oral exams, milestones

Page 20: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Activity

Draft a program outcome pertaining to real-world experiences

• What’s the guiding framework?

• How would you define experiential?

Page 21: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Examples: SLOS Related to Experiential Learning

21

Broad: • Connect theory to practice via experiential opportunities including

integrative co-op, research, or simulated activities.

• Synthesize and transfer learning to new, complex situations within course work or beyond the classroom.

Specific: • BS Biotechnology: Integrate acquired biotechnology skills, principles,

best practices, techniques, and tools into a hands-on, real-world project in a local biotech company.

• MPS Analytics: Apply the principles and tools of analytics to a project within a sponsoring organization to assist with the delivery, development, and successful implementation of data analysis for strategic decision making in organizations.

Page 22: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Experiential Learning

ConcreteExperience

ReflectiveObservation

AbstractConceptualization

Active Experimentation

Curriculum: A Model For Experiential Course Design

Page 23: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

High Impact

Practices

Experiential Learning

How many of the high impact strategies and experiential learning concepts are at play in the following examples?

Page 24: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

ConcreteExperience

AbstractConceptualization

Page 25: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

AbstractConceptualization

ReflectiveObservation

Page 26: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

ConcreteExperience

AbstractConceptualization

Page 27: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

ReflectiveObservation

Page 28: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Activity

Create a list of authentic assignments

• Consider the Experiential Learning Spectrum, High Impact Practices, or examples of models of design.

• What are you already doing that is experiential?

Page 29: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Steps Online ActivitiesConcrete

Experience• Virtual labs or field trips• Simulations• Games• Role-playing

ReflectiveObservation

• Online blogs and journals • E-portfolio• Concept-checks interactive lessons

Abstract Conceptualization

• Interactive lectures• Multimodal Content

Active Experimentation

• Simulations• Games• Role-playing• Wikis

Examples: A Model For Experiential Course Design

Page 30: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

30

Institutional

Program

Curriculum

All Levels of Incorporation: “XN Projects”

XN – The Experiential Network:

Students work virtually with a sponsoring business or nonprofit organization on a short-term project (six-week period.)

Companion course within Capstone INT6943

Page 31: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Companies sponsor a

project

Students enroll in

course and are matched to a project

Students complete

projects with sponsor

Students receive

sponsor and faculty

feedback

Project Characteristics

• Projects completed remotely

• 25-30 hours over 6 weeks

• Projects scoped by sponsors with

assistance from NU staff

• Crafted to be completed alongside full

course load

Program Characteristics

• Non-credit and For-credit formats

• Work on real project directly with sponsor

• Course materials along the way

• Get feedback & support from sponsor,

NU faculty and staff

How XN Works

Page 32: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Sponsor Relations Manager

Where does XN fit?

Generic XN projects

Co-curricular

Facilitated COP5003 course

Project recruitment

Student Success Manager

0 Credit

Capstones

Electives

Curricular

For-credit

XN as a service

Custom build to meet

academic program needs

Independent Study

Page 33: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Where does XN fit?

Page 34: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Measuring Experiential Learning- KPI

Goal: Ensure a full spectrum of experiential learning opportunities that best exercise students in real-world contexts and challenges.

Initiative: 100% Experiential Portfolio

Page 35: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Measures for Experiential Learning

Direct Measure: Student performance in capstones and/or XN projects (Rubrics)

Indirect Measure: Employer and Student Surveys

Page 36: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

36

Consistent Use of Rubrics

Page 37: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Presenting the Data: Direct Measures

Page 38: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Presenting the Data: Indirect Measures

Presenting the Data: Indirect Measures

Page 39: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Activity

Draft a plan to measure experiential learning.

• What are you measuring?

• Is it direct/indirect?

• How do you define success-what is your Benchmark?

Page 40: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

Examples: Measuring Experiential Learning

Measure Direct/Indirect BenchmarkBusiness Plan Direct All students will achieve at least a 75%

Reflective Essay Direct/Indirect 85% of students will meet the standards for “connections” and “integrative learning” in their rubric.

Portfolio Presentation

Direct All students will achieve at least a B.

XN Survey Indirect 90% of supervisors will be satisfied with their student’s performance.

Alumni survey Indirect 75% of respondents will state they were able to transfer what they learned to their current job.

Page 41: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance
Page 42: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

42

Q & ADiscussion

Melanie Kasparian

[email protected]

Mamta Saxena

[email protected]

Page 43: Capstone & Experiential Learning - Assessment Institute · 2019-09-17 · Capstone & Experiential Learning at NEU’s College of Professional Studies 2 Academic Quality Assurance

ReferencesBass, R. . (2012) Disrupting Ourselves: The Problem of Learning in Higher Education. Educause Review. 47(2), 23-33.

Bass, R., Eynon, B. (forthcoming). Liberal education re-bound :The digital opportunity for higher learning. Washington, D.C.: Association of American Colleges and Universities.

Bruff, D. (2013) . Students as Producers. Retrieved from https://cft.vanderbilt.edu/2013/09/students-as-producers-an-introduction

Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development. New Jersey: Prentice-Hall.

Kuh, G. D. (2008). High-impact educational practices: What they are, who has access to them, and why they matter. Washington, D.C.: Association of American Colleges and Universities.

Lewis, L.H. & Williams, C.J. (1994). In Jackson, L. & Caffarella, R.S. (Eds.). Experiential Learning: A New Approach (pp. 5-16). San Francisco: Jossey-Bass.

Matthews-DeNatale, G., Poklop, L. (2015). Making Student Learning Visible: Using Concept Map Analysis as an Assessment Tool. Retrieved from http://www.slideshare.net/gmdenatale/making-student-learning-visible-using-concept-map-analysis-as-an-assessment-tool

Moore, E. T. (2013). Applying the Kolb experiential learning model (ELM) to distance learning. Retrieved from http://www.facultyfocus.com/articles/online-education/applying-the-kolb-experiential-learning-model-elm-to-distance-learning

Puentedura, R. (2012). The SAMR Model: Background and Exemplars. Retrieved from http://www.hippasus.com/rrpweblog/archives/2012/08/23/SAMR_BackgroundExemplars.pdf

Ritchhart, R., Perkins, D. (2008). Making Thinking Visible. Educational Leadership. 65(5), 57-61.