Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment
description
Transcript of Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment
![Page 1: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/1.jpg)
Evidence of Student Learning
Fall Faculty SeminarOffice of Institutional Research and Assessment
August 15, 2012
![Page 2: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/2.jpg)
Agenda • Overview of Assessment
• What assessment is• What it isn’t • Why we do it
• Assessment Levels • Classroom Assessment• Course Assessment• Program Assessment• General Education Assessment
• Institutional Commitment to Student Learning• Assessment of General Education• Data Analysis and Results
![Page 3: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/3.jpg)
Assessment of Student Learning is . . .
… the collection of evidence about student learning, used for improvement of teaching and learning.
Owolabi, 2009
![Page 4: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/4.jpg)
Defining Assessment of Student Learning
• Action research• Gathers indicators that will be useful for decision making• Standardized tests or “objective” measures• Assessment means basing decisions about curriculum,
pedagogy, staffing, advising, and student support upon the best possible data about student learning and the factors that affect it Walvoord, 2004, p. 2.
![Page 5: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/5.jpg)
Assessment of Student Learning is not…
Is not program review
… about evaluating individual faculty members
… about using course grades to assess student performance
… an infringement on faculty academic freedom
… an assignment or test used by a single instructor to determine students’ understanding in a specific classroom
![Page 6: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/6.jpg)
![Page 7: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/7.jpg)
Benefits of Assessing Learning
• Focus on student learning• Articulate learning outcomes• Improve courses, programs, curricula, and pedagogy• Promote conversations and dialogue about
teaching and learning• Align curriculum with learning outcomes• Redesign our curriculum
![Page 8: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/8.jpg)
Classroom Assessment
“ The teacher of the senior capstone course evaluates her students’ final projects, assigns grades, and uses the information for her own improvement next semester.”
Walvoord, 2004, p. 2
An instructor asks students to indicate the muddiest point in the concept he/she has just taught. The instructor uses the data to improve instruction
![Page 9: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/9.jpg)
Course Assessment
“Assessment at the course level means not just assigning individual grades but also reflecting on how well students as a whole are achieving the course’s learning goals. This is done by aggregating assessment results…”
Suskie, 2009, p. 6
![Page 10: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/10.jpg)
Course Assessment • What evidence of student
learning do we collect?• Are we systematic about
collecting these evidence?• What actions have we
taken to improve pedagogy and curriculum based on the results of assessment?
![Page 11: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/11.jpg)
Program Assessment
“…helps determine whether students can integrate learning from individual courses into a coherent whole. It is interested in the cumulative effects of the educational process.”
Palomba and Banta (1999) (p.5-6).
“The faculty teaching the senior capstone report annually to the department, outlining the strengths and weaknesses of the students’ work in relation to departmental learning goals. The department uses these and other data, such as student and alumni surveys, to inform decisions about curriculum, pedagogy, and other factors tat affect student learning.” Walvoord, 2004, p. 3
![Page 12: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/12.jpg)
Commitment to Student Learning
• General Education –Maturing Outcomes
• Diversity of Learners and Learning
• Co-curricular Learning and Learning Environments
![Page 13: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/13.jpg)
![Page 14: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/14.jpg)
Accreditations• Higher Learning Commission of North Central
Association of Colleges and Schools
• National Council for Accreditation of Teacher Education (NCATE)
• Council for Accreditation of Counseling and Related Educational Programs (CACREP)
• National Association of Schools of Music
![Page 15: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/15.jpg)
![Page 16: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/16.jpg)
AQIP Pathway1
4
7
Systems Portfolio
*
Action Projects
StrategyForum
Systems Appraisal
Quality Checkup
Reaffirmation of Accreditation
Higher Learning Commission of North Central Association of Colleges and Schools
![Page 17: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/17.jpg)
Current Action Projects
• Mentoring New Faculty and Staff• Assessment Using a Data Driven Decision
Making Model• Resources for Undergraduate and Graduate
Students
Serra, 2011 “Academic Quality Improvement Program AQIP.” PowerPoint presentation . New Faculty Orientation.
![Page 18: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/18.jpg)
General Education Outcomes
• Engage different viewpoints in thoughtful and deliberative ways by making critical judgments and defending them reasonably using appropriate quantitative and qualitative sources of information and methods
• Read texts critically with understanding • Listen actively and communicate ideas effectively through
speaking and writing • Examine the human, natural, and aesthetic worlds and
articulate their place in them
![Page 19: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/19.jpg)
General Education Outcomes
• Conduct research, engage in the ways of knowing and participate in discourse across the arts, sciences, and humanities
• Reflect theologically and philosophically on significant
questions about the value and meaning of life and living • Live and serve as wise, humane, responsible, and ethical
citizens of our diverse nation and world
• Articulate a Christian world view and its implications for living
![Page 20: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/20.jpg)
Assessment of General Education• ETS Proficiency Profile Test• Critical thinking • Reading• Writing• Mathematics• Humanities• Social sciences • Natural sciences
![Page 21: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/21.jpg)
ETS Proficiency Profile Test• Reviewed mean scores and identified
trends
• Total mean score on the ETS Proficiency Profile test has a possible range of 400-500
• Sub scores have a possible range of 100-130
![Page 22: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/22.jpg)
Demographic Variables
• Age• Best Language• Credit Hours• Curriculum
Completed• Enrollment Status• Ethnicity
• Gender• GPA• Hours Working• Major• Program Enrolled• Transfer Status.
![Page 23: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/23.jpg)
ETS Proficiency Profile: Sub Scores
![Page 24: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/24.jpg)
ETS – Reading Scores
![Page 25: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/25.jpg)
ETS – Social Sciences
![Page 26: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/26.jpg)
ETS Proficiency ProfileDemographic Analysis
![Page 27: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/27.jpg)
AgeAge 2010-2011 2009-2010 2008-2009 2007-2008 2006-2007
<20 436.47 436.36 439.53 437.90 439.09
20-29 445.66 443.77 445.70 444.03 449.94
Difference 9.19 7.41 6.17 6.13 10.85
![Page 28: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/28.jpg)
Performance by Cohort and Curriculum Completed
Curriculum Completed
2007/2008 2006/2007
Freshmen (None) 437.60 438.25
Seniors (100%) 450.41 447.46
Value Added 12.81 9.21
![Page 29: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/29.jpg)
Performance by Cohort and Credit Hours
Credit Hours Completed
2007/2008 2006/2007
Freshmen (None) 437.20 438.28
Seniors (More than 90 Semester Hours or more than 145 quarter hours)
448.39 447.69
Value Added 11.19 9.41
![Page 30: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/30.jpg)
Recommendations
• Eliminate one of the testing windows since the data is limited in usage and no item analysis can be done
• Develop additional method of assessing general education outcomes even if the ETS tests are deemed worth repeating as we currently do
• Develop signature assignments and rubrics to assess the newly defined general education outcomes.
![Page 31: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/31.jpg)
Recommendations
• Embed the signature assignments in courses within the general education program
• Maximize the use of Black Board (BB) to manage our assessment data
• Restructure the assessment committee to
include representatives from colleges quality assurance committees
![Page 32: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/32.jpg)
Assessment requires…
• Beginning where it makes sense
• Collecting data and information that is meaningful and useful
• Persevering through the process
![Page 33: Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062410/56816158550346895dd0e387/html5/thumbnails/33.jpg)
Questions or comments