Professional Learning Communities: Taking the Angst out of General Education

Assessment

Professional Learning Communities: Taking the Angst out of General Education

Assessment

Harriet R. Fayne, Ph.D.Otterbein CollegeWesterville, Ohio

Harriet R. Fayne, Ph.D.Otterbein CollegeWesterville, Ohio

Professional Learning Communities: Taking the Angst out of General Education Assessment

This roundtable will highlight Otterbein’s formation of a professional learning community focused on the assessment of general education. Four years of success with teaching and learning communities prompted Otterbein’s assessment committee to adapt this model to focus on college-wide outcomes assessment.

Our professional learning communities (PLCs) are made up of faculty, administrators, staff, and, in some cases, students. Generally we hope that PLCs will allow individuals to transcend disciplinary and/or status boundaries, reflect on their own practices, and collect evidence to inform decisions. During the roundtable, we will talk a bit about how the assessment learning community is working at Otterbein and encourage others to think about the potential of this type of change structure for their campuses.

What makes a learning community work?

• Challenge

• Mutual support

• Strong facilitation

• Commitment on the part of members

• Cultivation of atmosphere/collegiality

• Clear structures for meetings

• Nature of the “space” for meetings (off campus, if possible)

• Regularity of meetings

• Inquiry orientation

• Projects/outcomes shared in process

Professional Learning Community Project at Otterbein College, 2003-present

• “Professional” learning communities (PLCs) because they include non-faculty members

• Cohort- and topic-based– 6 new faculty learning communities– 7 topical learning communities:

• Service Learning • Diversity• Undergraduate Research• Scholarship of Teaching and Learning-SoTL (3 years)• First Generation College Students• Greater Expectations• General Education Outcomes

General Education Outcomes (GEO) Learning Community

Membership: Niki Fayne, Assessment Fellow and Education Faculty; Leslie Ortquist-Ahrens, Director, Center for Teaching and Learning; Mary Gahbauer,Chair, Assessment Committee and Life Science Faculty; AlisonPrindle, English Faculty; Regina Kengla, Academic Support Center Writing Faculty; Amy Jessen-Marshall, future Chair, Integrative Studies Program and Life Science Faculty; Kate Porubcansky,Asst. Dean/Director of Center for Student Involvement; Terry Contenza, Math Faculty;Susan Thompson, Math Dept. Chair; Doris Ebbert, Librarian; Rick Mosholder, OSU Doctoral Candidate, Preparing Future Faculty Participant

Meetings: Regular 90 minutes meetings scheduled every other week during the three academic quarters; two day-long meetings during winter and spring breaks.

Core Readings: Maki, P.L. (2004) Assessing for Learning. Sterling, VA: Stylus Publishing and the following AAC&UMonographs: The Art and Science of Assessing General Education Outcomes, Advancing Liberal Education: Assessment Practices on Campus; General Education: A Self-Study Guide for Review and Assessment

Conferences Attended: 2006 Assessment Institute at IUPUI, “Writing Across the Curriculum” at Quinnipiac U, and AAC&U Assessment Conference in Miami

Blackboard Site: Announcements, Minutes, Readings, and Discussion Board

General Education Outcomes

• How does Otterbein “add value”? Do we add more value in some areas than in others?

• Are there students for whom we add more value than for others? If so, who are our greatest success stories? Who are our greatest challenges?

Two Key Questions

• Does our core curriculum meet Otterbein’s aspirations (i.e. help to realize the mission of the College)?

• Do students achieve the targets that have been established?

Operating Assumptions

• Assessment is not an end in itself.

• Don’t test what you can’t change.

• The focus of assessment is on improving instruction. Use the data that you collect.

• Faculty buy-in is essential to the success of any assessment effort. Data collected must have face validity and be easy to translate into teaching practices.

Plan 2006-2007Fall Winter Spring

Curriculum Alignment:Standardized Tests and Core Curriculum

Review of standardized test options

Recommendation about standardized testing

Review of Best Practices: Refine or Develop Local Measures of Writing, Quantitative Reasoning, Information Literacy

Data Collection: INST 100 and 300 Level Essays

Data Collection: Information Literacy

Development of Quantitative Reasoning Items

Data Analysis: INST Essays

Data Analysis: Information Literacy

Data Collection: Pilot Quantitative Reasoning Items

Compare Findings with Past Years

Progress to Date

• Value-Added Framework

• Locally Developed Assessment Strategies

• Consideration of Norm-Referenced Assessments

Locally Developed Assessment Strategies: Reading/Writing

Writing prompt developed based on Common Book; administeredin freshman level INST Comp and Lit sections

Rubric, based originally on ACT Writing Rubric, refined after pilot testing by GEO; now addresses key Information Literacy standards and acknowledges the relationship between reading and writing

Over 100 essays will be graded using the revised rubric by 10 INST instructors during spring break, 2007

17 essays written during 2005-2006 will be re-graded using the rubric; the student authors, currently in INST 270, will submit compare/contrast essays. A GEO subgroup will be attempting to determine whether or not the rubric is a sensitive measure of growth from freshman to sophomore year

Locally Developed Assessment Strategies: Quantitative Literacy

GEO members participated in answering and deconstructing QLitems.

GEO members read material about QL Standards

GEO members reviewed QL course syllabi at two other institutions

QL rubric drafted

Goal: Use rubric with embedded items in Integrative Studies sophomore level science courses and again in junior/senior level Integrative Studies science courses

Locally Developed Assessment Strategies: Information Literacy

Review of three years of data: locally prepared skills test

administered to freshmen. What does the data reveal?

Review of research on IL Standards

Selected IL Standards integrated into GEO Reading/Writing Rubric

Proposed consultation model: Library liaisons work with

departments on integrating additional IL standards in major

Courses (upper level courses)

Consideration of Norm-Referenced Assessments

• Web Conference: Introduction to CAE

• ACT CAAP Guide Distributed

• Overarching Question: Would the campus community find the results of an external assessment useful? Would test results have an impact on curriculum or instruction?

The Future

• Course-embedded assessments in Integrative Studies Courses (general education core)

• Exploring how Senior Year Experience courses can contribute to outcomes assessment

• Role of Academic Departments: Consideration of W, Q, IL designated courses

• An Exit e-Portfolio for All Graduates?