Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based...

26
Maureen Andrade Maureen Andrade Associate Vice President, Associate Vice President, Academic Programs Academic Programs Utah Valley University Utah Valley University Leading Assessment-Based Change: Strategies for Faculty Buy-In and Development Gaining involvement and support for assessment efforts can be a major challenge for institutions. Examining this challenge through a multi-frame perspective results in new insights and strategies. Challenges Strategy Duplication of effort Unclear processes and roles Lack of infrastructure Not using data for decision-making Synthesize reporting requirements and formats Establish clear reporting structures, timelines, and mechanisms for aggregating, analyzing, and using data Challenge Strategy Assessment focused on compliance rather than learning and improvement Limited stakeholder involvement Lack of expertise Involve stakeholders in decision-making and creating vision Increase participation Share information Provide training and professional development Challenge Strategy Fear of negative repercussions Concerns about increased workload Resistance to change Clarify expectations Provide opportunities for discussion and input Identify supporters Negotiate Challenge Strategy Lack of common vision Belief that assessment work is devalued No culture of assessment Communicate and celebrate success through awards, showcase events, and celebrations Connect assessment to institutional culture and symbols Use data for decision–making

Transcript of Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based...

Page 1: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Maureen Andrade Maureen Andrade Associate Vice President, Associate Vice President,

Academic Programs Academic Programs Utah Valley UniversityUtah Valley University

Leading Assessment-Based Change: Strategies for Faculty Buy-In and Development

Gaining involvement and support for assessment efforts can be a major challenge for institutions. Examining this

challenge through a multi-frame perspective results in new insights and strategies.

Challenges Strategy

Duplication of effort Unclear processes

and roles

Lack of infrastructure Not using data for

decision-making

Synthesize reporting requirements and formats

Establish clear reporting structures, timelines, and mechanisms for aggregating, analyzing, and using data

Challenge Strategy

Assessment focused on compliance rather than learning and improvement

Limited stakeholder involvement

Lack of expertise

Involve stakeholders in decision-making and creating vision

Increase participation

Share information Provide training and

professional development

Challenge Strategy Fear of negative

repercussions Concerns about

increased workload

Resistance to change

Clarify expectations Provide opportunities

for discussion and input

Identify supporters

Negotiate

Challenge Strategy

Lack of common vision

Belief that assessment work is devalued

No culture of assessment

Communicate and celebrate success through awards, showcase events, and celebrations

Connect assessment to institutional culture and symbols

Use data for decision–making

Page 2: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Leading Assessment-Based

Change—Strategies for Faculty

Buy-In and Development

2012 Assessment Institution in Indianapolis

October 28-30

Dr. Maureen Andrade, Utah Valley University

1

Page 3: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

What schools need to

more effectively assess

and use student learning

outcomes –

“More faculty

engagement, with 66% of

the schools saying this

would be helpful in

assessing learning

outcomes.”

“About four-fifths of

provosts at doctoral-

research universities

reported greater faculty

engagement as their

number one challenge.”

2

(Kuh & Ikenberry, p. 24)

“Gaining faculty involvement and support remains a major challenge.”

Page 4: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

RESTRICTS ACADEMIC FREEDOM

WASTE OF RESOURCES

FEAR OF CONSEQUENCES

INCREASED WORKLOAD

NOT LINKED TO TENURE/RANK

THREATENS STATUS QUO

Reasons for Resistance

3

Page 5: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Change

o Disrupts patterns

o Creates uncertainty

o Results in confusion,

anxiety, feelings of

incompetence,

withdrawal 4

Implementing

university-wide

student learning

outcomes

Identifying core

themes

Adopting ePortfolios

Using assessment

software

Examples

Compliance

Aiming low

Not using results for

decision-making

No broad involvement

Challenges

Page 6: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

“People

only

support

what

they

create” (Wheatley, 2005, p. 89).

5

Page 7: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Multiframe Thinking

“Multiframe thinking requires moving beyond

narrow, mechanical approaches for

understanding organizations”

(Bolman & Deal, 2008, p. 19).

“The frames can be used as tools for expanding

understanding, balancing alternatives, and finding

new options and strategies”

(Andrade, 2011, p. 219).

6

Page 8: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Structural

Human

Resource

Political

Symbolic

(Bolman & Deal, 2008)

7

Page 9: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Structural Strategies Challenge Strategy

Assessment at various levels

across the institution (e.g.,

program, general education,

institutional) may involve

unnecessary duplication and

effort.

Align assessment efforts by linking assessment

outcomes, considering the multiple purposes

for which data is needed, and allowing for

flexibility in reporting formats; consider

software that allows for tracking of learning

outcomes and use of standardized scoring

rubrics.

No existing infrastructure for

assessment work.

Consider roles and responsibilities to create

layers of accountability and support at the

program, college/school, and institutional levels,

and provide opportunities for greater

involvement.

No common reporting

template, established deadlines,

or system for data collection

and review.

Design appropriate processes and procedures

for planning, collecting and reviewing data,

implementing needed changes, and reporting

(e.g., design a common template, set deadlines,

establish a system for regular review of

information).

Lack of experience of general

assessment principles related to

identifying outcomes and means

of assessment.

Provide guidelines and training to increase

understanding regarding expectations in terms

of number of outcomes, number and types of

measures, use of course objectives, rotation of

outcomes, use of self-report data, etc.

8 (Andrade, 2011)

Page 10: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Assessment Software

9

Page 11: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

10

Page 12: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

11 Adapted from Walvoord, 2011.

Page 13: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

12

Page 14: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Human Resource Strategies Challenge Strategy

Assessment focused on compliance

rather than learning and

improvement (e.g., setting goals

that are easily met or continually

meeting goals without exploring

additional outcomes or means of

assessment).

Involve others in creating vision; inspire

creativity through the good to great

approach; provide support and resources

to accomplish the vision.

One person managing assessment

in a program or department rather

than wide stakeholder

involvement.

Encourage broad involvement through

sharing and discussion of information; use

of committees; inclusion of outcomes on

course syllabi.

Fear that assessment information

will be used in negative ways (e.g.,

to discontinue programs or

eliminate positions).

Hold open meetings for demonstrating

the importance and use of assessment

results, proposing improvements, and

requesting needed funding to support

accomplishment of goals.

Lack of expertise in writing

outcomes, developing tests,

collecting and analyzing data.

Provide professional development

opportunities and rewards for

involvement.

13 (Andrade, 2011)

Page 15: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Create Vision

14

Superior performance

Being efficient and delivering

results related to the

organization’s mission

Distinctive impact

Making a unique contribution; if

the organization disappeared, it

would leave a void

Lasting endurance

Delivering exceptional results

over the long term

(Good to Great and the Social Sectors, Jim Collins)

Page 16: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

(Bonnie Kyburz)

Page 17: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

16

Page 18: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Political Strategies

17

Challenge Strategy

Conflict, protection of

the status quo,

individual agendas.

Encourage diversity of opinion

through a supportive environment

and opportunities to negotiate,

resolve differences, and compromise;

create diverse teams.

Concerns about

increased work load

related to assessment

responsibilities.

Be willing to negotiate in terms of

reassigned time, deadlines; hire

needed personnel; encourage

embedded assessment; provide

models for unfamiliar tasks.

Lack of progress by

committees; lack of

decision-making and

results.

Manage coalitions by forming teams

to accomplish specific tasks; identify

appropriate participants and

reporting deadlines.

(Andrade, 2011)

Page 19: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

18

Page 20: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

19

Page 21: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Learning

Circle

Page 22: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

21

Symbolic Strategies Challenge Strategy

Need to unite around a

common vision and set of

values.

Focus on institutional mission by making

it central to assessment work and

encouraging individual programs to

demonstrate their contributions toward

it.

A focus on assessment

rather than learning and

improvement.

Cultivate a culture of learning by uniting

constituents around key aspects of the

institution’s mission that directly affect

them.

Belief that assessment is not

valued by the institution and

that information from

assessment activities is not

used.

Communicate success through the

inclusion of assessment outcomes and

highlights in documents such as course

syllabi, newsletters, marketing materials,

and websites, and at special events.

Assessment efforts are not

part of institutional culture.

Celebrate success with award

ceremonies, transition rituals, showcase

events; develop related grant programs,

tenure/promotion criteria; support

presentations and publications on

assessment topics.

(Andrade, 2011)

Page 23: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Core Themes - Mission

22

Page 24: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

23

Page 25: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

Copyright © 2012 Maureen Andrade

Page 26: Leading Assessment-Based Change: Strategies for Faculty ...Leading Assessment-Based Change—Strategies for Faculty Buy-In and Development 2012 Assessment Institution in Indianapolis

References

Andrade, M. S. (2011). Managing change—engaging faculty in assessment opportunities. Innovative Higher Education, 36(4), 217-233.

Bolman, L. G., & Deal, T. E. (1999). 4 steps to keeping change efforts heading in the right direction. The Journal for Quality & Participation, 22(3), 6-11.

Collins, J. 2005. From good to great and the social sectors. Why business thinking is not the answer. New York, NY: Harper Collins.

Cummings, R, Maddux, C. D., & Richmond, A. (2008). Curriculum-embedded performance assessment in higher education: Maximum efficiency and minimum disruption. Assessment and Evaluation in Higher Education, 33(6), 599-605.

Kuh, G., & Ikenberry, S. (2009). More than you think, less than we need: Learning outcomes assessment in American higher education. (Champaign, IL: National Institute for Learning Outcomes Assessment)

Wheatley, M. J. (2005). Finding our way: Leadership for an uncertain time. (San Francisco: Berrett-Koehler Publishers, Inc.)

Walvood, B. (2011). Assessment clear and simple: Practical steps for institutions, department, and general education. Paper presented at the 2011 Assessment Institute, Indianapolis, IN.

Zubizaretta, J. (2009). The learning portfolio: Reflective practice for improving student learning. 2nd ed. San Francisco: Jossey-Bass.

25