Email: [email protected] Office Hours: By appointment ...€¦ · MS Word document, or a PDF ......
Transcript of Email: [email protected] Office Hours: By appointment ...€¦ · MS Word document, or a PDF ......
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
1
Loyola University – Chicago
School of Education Fall 2020 Course Syllabus
ELPS 431: Evaluation in Higher Education Online Synchronous Session(s): Tuesdays 5:30 (CT)
Instructor Information _______________________________________________________________________________________________ Darren Pierre, Ph.D. (pronouns: he/him/his) Clinical Assistant Professor of Education, Loyola University Chicago Email: [email protected] Office Hours: By appointment Wednesdays 3:00pm Zoom link: https://luc.zoom.us/j/3464201177 Required Text: _______________________________________________________________________________________________ Henning, G. & Roberts, D. (2016). Student affairs assessment: Theory to practice.
Sterling, VA: Stylus
Kuh, G., Ikenberry, S., George, K., Jankowski, N.m Cain, T., Ewell, P., Hutchings, P., & Kinzie, J. (2015). Using evidence of student learning to improve higher education. San Francisco: CA: Jossey-Bass
Additional Resources: _______________________________________________________________________________________________ ACPA Commission for Assessment and Evaluation http://www.myacpa.org/commae NASPA Knowledge Community – Assessment, Evaluation, and Research https://www.naspa.org/constituent-groups/kcs/assessment-evaluation-and-research Online Guide for Student Affairs Professionals www.studentaffairs.com The Chronicle of Higher Education www.chronicle.com Inside Higher Education www.insidehighered.com The National Clearinghouse for Leadership Programs http://nclp.umd.edu International Leadership Association http://www.ila-net.org
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
2
Course Description _____________________________________________________________________________________________
This course is intended to give you a practical understanding of assessment and evaluation within higher education and student affairs. In this course, we will explore various assessment techniques, trouble how to develop a comprehensive assessment plan, and explain how qualitative, quantitative, and mix method approaches of data collection work in concert and separately to examine program effectiveness.
Course Objectives
_____________________________________________________________________________________________
1. Learning fundamental principles of assessment and evaluation
2. Developing the skills to create a comprehensive assessment plan
3. Explain the various data collection methods as it relates to assessment
4. Illuminate the benefits of qualitative, quantitative, and mixed-methods approaches for data collection as it relates to assessment
5. Translate findings from assessment plans into practical actions that inform practice, policy, and institutional effectiveness
6. Learning to apply course content to problem solving, program effectiveness,
and the generating of interventions and services to enhance student affairs within higher education
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
3
Class Schedule _______________________________________________________________________________________________
Date Class Topic Readings Assignment August 25 (week one)
Introduction of the Course
September 1 (week 2)
Assessment in Student Affairs CAS (2009) ACPA & NASPA Competencies Timm, Barham, McKinney & Knerr (2013) Schuh, Biddix, Dean & Kinzie (Ch. 1) Henning (Ch. 1)
September 8 (week three)
Assessment and Student Learning
Maki (Ch. 3) Barber (2015) ACPA Student Learning Imperative (2008) Kuh et al. (Ch. 1 & 8) Schuh, Biddix & Kinzie (Ch. 4)
White Paper #1
September 15 (week four)
Student Affairs Administrators/Educators: Champions for Student Learning
Learning Reconsidered 2 Kuh et al. (Ch. 2)
September 22 (week five)
Assessment Design Schuh, Biddix, Dean, & Kinzie (Ch. 2) Henning & Roberts (Ch. 2, 3 & 4)
September 29 (week six)
Assessing for Learning Quantitative Methods of Assessment
Schuh, Biddix & Kinzie (5) Henninng & Roberts (5-7) University of Wisconsin (Post-then-pre-design)
Assessment Proposal Due (includes names of all members within each group)
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
4
October 6 (week seven)
Questionnaire Design Henning (Ch. 8) BrckaLorenz, Zilvinskis, Haeger (2014) Ducharme (n.d.)
Questionnaire Due
October 13 (week 8)
Qualitative Methods of Assessment
Henning & Roberts (Ch. 9-12) Adams (2010) Krueger & Casey (2010)
Interview Protocol
October 20 (week nine)
Sharing Results/Closing the Loop
Henning & Roberts (13 & 14) Barham & Scott (2006) Kuh et al.(Ch. 3, 4) Engberg, Manderino, Dollard (2014) Schuh, Biddix, Dean and Kinzie (Ch. 13)
October 27 (week 10)
Ethics and Politics of Assessment Assessment and Broader Implications
Henning (15 & 16) Kuh et al. (Ch. 5-7)
White Paper #2
November 3 (week 11)
Next Steps: After Assessment Kuh et al. (Ch. 9-11)
November 10 (week 12)
Culture of Assessment Henning (Ch 17 & 18) Holzweiss, Bustamante & Fuller (2016)
Program Assessment Plan Due
November 17 (week 13)
The Future of Student Affairs Assessment
Henning Ch 19 Schuh, Biddix, Dean & Kinzie (Ch. 15)
November 24 (week 14)
Group Presentations
December 1 (week 15)
No Class Comprehensive Assessment Paper & Peer Evaluation Form(s) due
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
5
Assignments: _____________________________________________________________________________________________ White Paper #1 In this paper, you are asked to speak to the following: How do you see yourself implementing the principles of good practice outlined by Henning & Roberts (2016). What guidance do the 10 Competencies of Student Affairs offer to us as educators. Speaking of educators, using the Student Learning Imperative as a framework, make the argument for why student affairs practitioners are in fact educators. (750-1000 words) White Paper #2 In this paper, you are asked to answer the following: In your view what do you see as the benefits of qualitative and quantitative data collection methods – be sure to use the literature as a reference. Based on the text, what are some of the consideration we should make when determining what to assess? How will these considerations inform your work moving forward? Looking at the work of Barham & Scott (2006), how does assessment help support a culture of accountability. From what we have read, what are some of the ways in which we can foster a culture of assessment. Moving forward, what are some of the ethical considerations you will want to keep in mind as you develop assessment projects (750-1000 words) Questionnaire Using the readings as a guide, develop a questionnaire (10-20 prompts). In 500-750 words describe your rationale for the questionnaire – again, use the literature as a guide. This would include, but not limited to: the purpose of the questionnaire, why you asked the questions you asked, what consideration did you give for the questions asked, how did you consider the ordering of the questions, and a brief summation of how the readings informed your design. Interview Protocol Using the readings as a guide, develop an interview protocol (6-8 prompts). In 500-750 words describe your rationale for the interview protocol – again, use the literature as a guide. This would include, but not limited to: the considerations for developing interview questions, rationale for qualitative methods choosing (i.e. focus group, semi-structured interview, structured interview etc.), speak to the type of sampling you would employ to get participants. What are some of the advantages and limitations of this design. Finally, give a brief summation of how the readings informed your design. Assessment Proposal: In groups (2-4), you will work to develop your proposed assessment plan, this will include: the department/organization, rationale for the study, and timeline for completion. *This proposal should be 2-3 pages
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
6
Assignments Continued: _____________________________________________________________________________________________ Program Assessment Plan: In groups (same as proposal), you will identify a campus program to assess. Based on the outline included in Appendix B, you are asked to develop a comprehensive assessment plan within your group that outlines the assessment design, rationale for the study, and the institutional context/department mission that grounds the inquiry, and the timeline for if this was to move forward. This assessment plan will also include an in-class presentation that will be 10 minutes. Comprehensive Assessment Paper: In this final paper (7-10 pages), you will be asked to address the following:
• The importance of assessment within student affairs • The difference between research and assessment • Articulate the value of quantitative data collection methods and those that
are qualitative in nature • Speak to the broader implications of assessment within student
affairs/higher education, how we further a culture of assessment within student affairs
• Spend a portion of the paper addressing how you define yourself as an educator within student affairs – using learning as a framework for your practice
**all assignments are due on Sakai by 11:30pm of the date they are assigned. Assignments should be uploaded on Sakai as either a MS Word document, or a PDF *All assignments should be APA formatted *Examples of both the assessment proposal and plan are available via Sakai *Syllabus is subject to change
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
7
Grading _______________________________________________________________________________________________
Final grades will be determined by totaling the points received on each of the assignments above (100-94= A, 93.9-90 =A-, 89.9-86=B+, 85.9-83=B, 82.9-80=B-, 79.9-77=C+, 76.9-74=C, 73.9-70=C-, 69-65=D+, 64.9-61=D, 60.9-58=D-, 57.9>=F). *Note, the syllabus is subject to change.
Assessment Proposal 10% Assessment Plan & Presentation 25% *20 points (10 points of which come from your peer evaluation) 5 points for the presentation White Paper #1 & 2 10% *five points each Questionnaire 10% Interview Protocol 10% Comprehensive Assessment Paper 25% Participation and Attendance 10%
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
8
Accessibility Students who have disabilities which they believe entitle them to accommodations under the Americans with Disabilities Act should register with the Services for Students with Disabilities (SSWD) office. To request accommodations, students must schedule an appointment with an SSWD coordinator. Students should contact SSWD at least four weeks before their first semester or term at Loyola. Returning students should schedule an appointment within the first two weeks of the semester or term. The University policy on accommodations and participation in courses is available at the http://luc.edu/sswd/index.shtml Conceptual Framework: Professionalism in service of Social Justice A conceptual framework that emphasizes social action through education guides instructional, extracurricular, and professional activities within LUC’s SoE. Faculty are dedicated to promoting professionalism in service of social justice by developing students’ knowledge, skills, ethics, and service to improve educational opportunities for all members of society. (The entire SoE conceptual framework is accessible at http://www.luc.edu/education/mission/.) The SoE conceptual framework is exemplified within this course in several ways. We discuss the very construction of educational assessment (i.e., its social, historical, and political contexts) and how our work and we are situated relative to this. We discuss throughout the semester challenges in articulating and measuring student and institutional outcomes inclusively. We investigate the intersection of diverse identities with assessment questions and methodologies. Finally, we spend a significant amount of time investigating ways to use educational assessment to understand the extent to which equity, inclusive practices, and other social justice aims are actualized. In doing so, we consider important contextual elements in using assessment for these important purposes. Specifically, this course contributes to the realization of the SOE conceptual framework by including a core assessment for the following Conceptual Framework Standard (CFS): • CFS2: Candidates apply culturally responsive practices that engage diverse
communities Electronic Communication Policies and Guidelines The School of Education faculty, students and staff respect each other’s rights, privacy and access to electronic resources, services, and communications while in the pursuit of academic and professional growth, networking and research. All members of the university community are expected to demonstrate the highest
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
9
standards of integrity, communication, and responsibility while accessing and utilizing technology, information resources, and computing facilities. Here is a link to access the School of Education Policy on Cyberbulling: http://luc.edu/media/lucedu/education/pdfs/SOE_Cyberbullying_Policy.pdf Here is a link to access the School of Education Netiquette Guidelines: http://luc.edu/media/lucedu/education/pdfs/SOE_Netiquette_Guidelines.pdf Here is a link to access Information Techology Services Policies and Guidelines: http://luc.edu/its/itspoliciesguidelines/index.shtml
EthicsLine Reporting Hotline
Loyola University Chicago has implemented EthicsLine Reporting Hotline, through a third party internet & telephone hotline provider, to provide you with an automated and anonymous way to report activities that may involve misconduct or violations of Loyola University policy. You may file an anonymous report on-line or by dialing 855-603-6988. (within the United States, Guam, and Puerto Rico) The University is committed to the highest ethical and professional standards of conduct as an integral part of its mission of expanding knowledge in the service of humanity through learning, justice and faith. To achieve this goal, the University relies on each community member's ethical behavior, honesty, integrity and good judgment. Each community member should demonstrate respect for the rights of others. For More information, visit: https://secure.ethicspoint.com/domain/media/en/gui/34712/index.html Diversity & Inclusion This course’s content and design are intended to celebrate the aims of diversity inclusion. Conversations on difference based on social identity, or viewpoint are illuminated to further ideals rooted in a more socially just society. You are asked to respect the identities and viewpoints you hold, and offer that same level of respect to others while in this class. When these intentions are not met, you are asked to share those, so as a community we can address concerns. Dispositions: All courses in the SOE assess student dispositions. All students in this course will be assessed across the following three dispositional areas: Professionalism, Inquiry, and Social Justice. The evaluation rubric for these dispositions can be found in Appendix A of this syllabus and in LiveText. Instructor assessments will be conducted at the end of the semester through LiveText. Disposition data are reviewed by program faculty on an ongoing basis, allowing them to work with students to develop throughout their program and address any issues as they arise.
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
10
Idea Course Evaluation ______________________________________________________________________________________________
Each course you take in the School of Education is evaluated through the IDEA Campus Labs system. We ask that when you receive an email alerting you that the evaluation is available that you promptly complete it. To learn more about IDEA or to access the website directly to complete your course evaluation go to: http://luc.edu/idea/ and click on STUDENT IDEA LOGIN on the left hand side of the page.
Academic Honesty Academic honesty is an expression of interpersonal justice, responsibility and care, applicable to Loyola University faculty, students, and staff, which demand that the pursuit of knowledge in the university community be carried out with sincerity and integrity. Here is a link to access Loyola University Chicago School of Education statement on Academic Integrity: http://luc.edu/education/resources/academic-policies/academic-integrity/ Accessibility Students who have disabilities which they believe entitle them to accommodations under the Americans with Disabilities Act should register with the Services for Students with Disabilities (SSWD) office. To request accommodations, students must schedule an appointment with an SSWD coordinator. Students should contact SSWD at least four weeks before their first semester or term at Loyola. Returning students should schedule an appointment within the first two weeks of the semester or term. The University policy on accommodations and participation in courses is available at the http://luc.edu/sswd/index.shtml Conceptual Framework: Professionalism in service of Social Justice Our Conceptual Framework —Social Action through education is exemplified within the context of this course. This course pays special attention to the role diversity and social justice play in the context of identity development amongst college students
• You are invited to critically evaluate the theories and concepts introduced in this course
• You are asked to apply culturally responsive practices that engage diverse communities
• With this and every course you are asked to demonstrate knowledge of ethics and social justice
• You are expected to engage with local and/or global communities in ethical and socially just practices.
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
11
Electronic Communication Policies and Guidelines
The School of Education faculty, students and staff respect each other’s rights, privacy and access to electronic resources, services, and communications while in the pursuit of academic and professional growth, networking and research. All members of the university community are expected to demonstrate the highest standards of integrity, communication, and responsibility while accessing and utilizing technology, information resources, and computing facilities. Here is a link to access the School of Education Policy on Cyberbulling: http://luc.edu/media/lucedu/education/pdfs/SOE_Cyberbullying_Policy.pdf Here is a link to access the School of Education Netiquette Guidelines: http://luc.edu/media/lucedu/education/pdfs/SOE_Netiquette_Guidelines.pdf Here is a link to access Information Techology Services Policies and Guidelines: http://luc.edu/its/itspoliciesguidelines/index.shtml
EthicsLine Reporting Hotline Loyola University Chicago has implemented EthicsLine Reporting Hotline, through a third party internet & telephone hotline provider, to provide you with an automated and anonymous way to report activities that may involve misconduct or violations of Loyola University policy. You may file an anonymous report on-line or by dialing 855-603-6988. (within the United States, Guam, and Puerto Rico) The University is committed to the highest ethical and professional standards of conduct as an integral part of its mission of expanding knowledge in the service of humanity through learning, justice and faith. To achieve this goal, the University relies on each community member's ethical behavior, honesty, integrity and good judgment. Each community member should demonstrate respect for the rights of others. For More information, visit: https://secure.ethicspoint.com/domain/media/en/gui/34712/index.html Diversity & Inclusion This course’s content and design are intended to celebrate the aims of diversity inclusion. Conversations on difference based on social identity, or viewpoint are illuminated to further ideals rooted in a more socially just society. You are asked to respect the identities and viewpoints you hold, and offer that same level of respect to others while in this class. When these intentions are not met, you are asked to share those, so as a community we can address concerns LiveText
All students, except those who are non-degree, must have access to LiveText to complete the benchmark assessments aligned to the Conceptual Framework
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
12
Standards and all other accreditation, school-wide and/or program-wide related assessments. You can access more information on LiveText here
Smart Evaluation
Towards the end of the course, students will receive an email from the Office of Institutional Effectiveness as a reminder to provide feedback on the course. Students will receive consistent reminders throughout the period when the evaluation is open, and the reminders will stop once the evaluation is completed.
• The evaluation is completely anonymous. When the results are released, instructors and departments will not be able to tell which student provided the individual feedback.
• Because it is anonymous and the results are not released to faculty or departments until after grades have been submitted, the feedback will not impact a student’s grade.
The feedback is important so that the instructor can gain insight in to how to improve their teaching and the department can learn how best to shape the curriculum.
Syllabus Addendum Link
• www.luc.edu/education/syllabus-addendum/
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
13
Syllabus Statement In this class software will be used to record live class discussions. As a student in this class, your participation in live class discussions will be recorded. These recordings will be made available only to students enrolled in the class, to assist those who cannot attend the live session or to serve as a resource for those who would like to review content that was presented. All recordings will become unavailable to students in the class when the Sakai course is unpublished (i.e. shortly after the course ends, per the Sakai administrative schedule). Students who prefer to participate via audio only will be allowed to disable their video camera so only audio will be captured. Please discuss this option with your instructor.
The use of all video recordings will be in keeping with the University Privacy Statement shown below:
Privacy Statement Assuring privacy among faculty and students engaged in online and face-to-face instructional activities helps promote open and robust conversations and mitigates concerns that comments made within the context of the class will be shared beyond the classroom. As such, recordings of instructional activities occurring in online or face-to-face classes may be used solely for internal class purposes by the faculty member and students registered for the course, and only during the period in which the course is offered. Students will be informed of such recordings by a statement in the syllabus for the course in which they will be recorded. Instructors who wish to make subsequent use of recordings that include student activity may do so only with informed written consent of the students involved or if all student activity is removed from the recording. Recordings including student activity that have been initiated by the instructor may be retained by the instructor only for individual use.
Copyright Copyright law was designed to give rights to the creators of written work, artistic work, computer programs, and other creative materials. The Copyright Act requires that people who use or make reference to the work of others must follow a set of guidelines designed to protect authors’ rights. The complexities of copyright law in no way excuse users from following these rules. The safest practice is to remember (1) to refrain from distributing works used in class (whether distributed by the professor or used for research); they are likely copyright protected and (2) that any research or creative work should be cited according to [please insert standards appropriate to your discipline, e.g., MLA guidelines]. Read more about LUC’s copyright resources online.
Intellectual Property All lectures, notes, PowerPoints and other instructional materials in this course are the intellectual property of the professor. As a result, they may not be distributed or shared in any manner, either on paper or virtually without my written permission. Lectures may not be recorded without my written consent; when consent is given, those recordings may be used for review only and may not be distributed.
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
14
Recognizing that your work, too, is your intellectual property, I will not share or distribute your work in any form without your written permission. Statement of Intent By remaining in this course, students are agreeing to accept this syllabus as a contract and to abide by the guidelines outlined in the document. Students will be consulted should there be a necessary change to the syllabus. *School of Education Commitment - COVID-19: Loyola’s School of Education (SOE) recognizes that this is an unprecedented time. We understand that moving into the 2020-2021 academic year while living in the context of the COVID-19 pandemic may stir feelings of uncertainty, fear, or anxiousness. We want you to know that your safety, health, and well-being, as well as that of our faculty and staff, remain our primary concern. We want to be able to support you in any way that we can. We ask you to embody the Jesuit value of Cura Personalis, or care for the whole person, as we prepare to learn together. We ask that you consider your way of being in this community, to act with care, and treat all with dignity to keep yourself and others safe. The University understands that you may encounter obstacles that make reaching academic goals more difficult. We strongly encourage you to access the Student Resources on Loyola’s COVID-19 Response webpage for information, supports, and resources on basic needs such as housing, food, financial aid, and medical and mental health. This web page also offers information on official University communications, access to technology, and student services. All Loyola University Chicago administrators, faculty, and advisors are also here for you. The SOE is committed to working with all students to address any challenges that may arise during the semester. Please reach out to your professor as early as possible to discuss any accommodations you think may be necessary in order for you to successfully complete your coursework. We know this will be a semester like none other, but through collaboration, communication, and shared responsibility, we will not only get through this difficult time; we will thrive.
*COVID-19 Reporting Protocol: In preparation for our upcoming semester, Loyola University Chicago’s Emergency Response Management team has been working to develop protocols in accordance with Centers for Disease Control and Prevention (CDC) guidelines that help ensure the health and safety of our community. Given the rising number of COVID-19 cases across our country, it is very likely that incidence within our community will occur in the fall. Students, faculty, and staff who have tested positive for COVID-19 must report their case to the University as soon as possible. If you have tested positive for the virus, please contact us at [email protected] or by calling 773-508-7707. All COVID-19-related questions or feedback should continue to be sent to [email protected], not the new case reporting email address.
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
15
*Class Conduct One important aspect of a Jesuit education is learning to respect the rights and opinions of others. Please respect others by (1) allowing all classmates the right to voice their opinions without fear of ridicule, and (2) not using profanity or making objectionable (gendered, racial or ethnic) comments, especially comments directed at a classmate. *Student Support Special Circumstances--Receiving Assistance
Students are urged to contact me should they have questions concerning course materials and procedures. If you have any special circumstance that may have some impact on your course work, please let me know so we can establish a plan for assignment completion. If you require assignment accommodations, please contact me early in the semester so that arrangements can be made with Services for Students with Disabilities (SSWD) (http://www.luc.edu/sswd/).
*Center for Student Access and Assistance (CSAA)
Should you encounter an unexpected crisis during the semester (e.g., securing food or housing, addressing mental health concerns, managing a financial crisis, and/or dealing with a family emergency, etc.), I strongly encourage you to contact the Office of the Dean of Students by submitting a CARE Referral for yourself or a peer in need of support: www.LUC.edu/csaa. If you are uncomfortable doing so on your own, please know that I can submit a referral on your behalf.
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
16
Reading List: _______________________________________________________________________________________________ ACPA: College Student Educators-International and NASPA: Student Affairs
Administrators in Higher Education. (2015). ACPA/NASPA professional competency areas for student affairs practitioners. Retrieved from: myacpa.org
ACPA: College Student Educators-International (2008). The student learning imperative. Retrieved from: myacpa.org
Adams, W. C. (2010). Conducting semi-structured interviews. In J.S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (3rd ed.) (p. 365-377). San Francisco, CA: Jossey Bass.
Barber, J.P. (2015). Tenet two: Commit to student learning as a primary focus. In R.P. Bingham, D.A. Bureau, & A. G. Duncan (Eds.) Leading assessment for student success: Ten tenets that change culture and practice ins student affairs (p. 22-37). Sterling, VA: Stylus
Barham, J. D., & Scott, J. H. (2006). Increasing accountability in student affairs through a New comprehensive assessment model. The College Student Affairs Journal, 25(2), 209-219.
BrckaLorenz, A., Zilvinskis, J., & Haeger, H. (2014). Categorizing identities: Race, gender, disability, and sexual orientation. Paper presented at the AIR Annual Forum, Orlando, FL.
Council for the Advancement of Standards in Higher Education. (2009). CAS learning and development outcomes, L.A. Dean (Ed.), CAS professional standards for higher education (7th ed.). Washington, DC: Author
Ducharme, D. (n.d.). Survey response categories: Guide for using natural or N/A options. Newport, RI: United States Naval War College
Engberg, M. E. Manderino, M., & Dollard, K. (2014). Collecting dust or creating change? A Multicampus utility study of student survey results. Journal of Assessment and Institutional Effectiveness, 4 (1), 27-51
Holzweiss, P., Bustamante, R., Fuller, M. (2016). Institutional Cultures of Assessment: A Quality study of administrator perspectives. Journal of Assessment and Institutional Effectiveness, 6 (1), 1-27
Keeling, R. P. (Ed.) (2006). Learning reconsidered 2: Implementing a campus-wide focus on the student experience. Washington, DC: American College Personnel Association, Association of College and University Housing Officers- International, Association of College Unions-International, National Academic Advising Association, National Association for Campus Activities, National Association of Student Personnel Administrators, and National Intramural- Recreational Sports Association.
Krueger, R.A., & Casey, M. A. (2010). Focus group interviewing. In J.S. Wholey, H.P. Hatry & K.E. Newcomer (Eds), Handbook of practical program evaluation (3rd ed.) (p. 378-403). San Francisco, CA: Jossey-Bass
Maki, P. (2010). Assessing for learning 2nd edition. Sterling, VA: Stylus Schuh, J., Biddix, P. J., Dean, L., & Kinzie, J. (2016). Assessment in student affairs. San
Francisco, CA: Jossey-Bass Timm, D. M., Barham, J. D., McKinney, K., & Knerr, A. R. (Eds.). (2013) Assessment in
practice: A companion guide to the ASK standards. Washington, DC: ACPA. Retrieved from: http://thekeep.eiu.edu/cgi/viewcontent.cgi?article=1032&context=csd_fac
University of Washington (2005). Program development and evaluation. Using the retrospective post-then-pre design. Madison, WI: Author
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
17
Appendix A Three Student Dispositions Evaluated by LUC’s SOE
(Dispositions = Professionalism, Social Justice, and Inquiry)
Professionalism Exceeds Expectations
Meets Expectations Partially Meets Expectations
Does Not Meet Expectations
Student meets all deadlines.
Student demonstrates
exceptional ability to work well with
others, lead educational
initiatives, and show leadership
qualities in professional
settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being open and responsive
to feedback
Student occasionally demonstrates an ability
to work well with others in a professional
setting through exhibiting behaviors such as punctuality,
meeting deadlines, and being open and
responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work setting
Student attends class and is punctual for all
professional obligations.
Student demonstrates
exceptional ability to work well with
others, lead educational
initiatives, and show leadership
qualities in professional
settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being open and responsive
to feedback
Student occasionally demonstrates an ability
to work well with others in a professional
setting through exhibiting behaviors such as punctuality,
meeting deadlines, and being open and
responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work setting
Student communicates
promptly with faculty, supervisors,
employers, and peers (no longer than 2 business days).
Student demonstrates
exceptional ability to work well with
others, lead educational
initiatives, and show leadership
qualities in professional
settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being open and responsive
to feedback
Student occasionally demonstrates an ability
to work well with others in a professional
setting through exhibiting behaviors such as punctuality,
meeting deadlines, and being open and
responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work setting
Student is able to express himself or
herself appropriately (verbally and in
writing) with faculty, supervisors,
employers, and peers.
Student demonstrates
exceptional ability to work well with
others, lead educational
initiatives, and show leadership
qualities in professional
settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being open and responsive
to feedback
Student occasionally demonstrates an ability
to work well with others in a professional
setting through exhibiting behaviors such as punctuality,
meeting deadlines, and being open and
responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work setting
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
18
Professionalism (cont’d)
Exceeds Expectations
Meets Expectations Partially Meets Expectations
Does Not Meet Expectations
Student is able to work effectively
with peers on assignments.
Student demonstrates
exceptional ability to work well with
others, lead educational
initiatives, and show leadership qualities
in professional settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being
open and responsive to feedback
Student occasionally demonstrates an ability
to work well with others in a professional
setting through exhibiting behaviors such as punctuality,
meeting deadlines, and being open and
responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work
setting
Student demonstrates
ethical behavior in all professional and
graduate student work.
Student demonstrates
exceptional ability to work well with
others, lead educational
initiatives, and show leadership qualities
in professional settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being
open and responsive to feedback
Student occasionally demonstrates an ability
to work well with others in a professional
setting through exhibiting behaviors such as punctuality,
meeting deadlines, and being open and
responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work
setting
Student dresses in an appropriate
manner.
Student demonstrates
exceptional ability to work well with
others, lead educational
initiatives, and show leadership qualities
in professional settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being
open and responsive to feedback
Student occasionally demonstrates an ability
to work well with others in a professional
setting through exhibiting behaviors such as punctuality,
meeting deadlines, and being open and
responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work
setting
Student is able to accept supervision.
Student demonstrates
exceptional ability to understand the
situations of others and responds in an
appropriate, proactive manner
Student demonstrates ability to understand
the situations of others and responds in an
appropriate, proactive manner
Student occasionally demonstrates ability to
understand the situations of others and
responds in an appropriate, proactive
manner
Student fails to consider the
situation of others in making
professional decisions and acts
inequitably
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
19
Social Justice Exceeds Expectations
Meets Expectations
Partially Meets Expectations
Does Not Meet Expectations
Student is sensitive to cultural
differences.
Student exhibits exemplary
understanding and practice reflecting the belief that all students,
regardless of contextual influences, are capable of learning
Student believes and demonstrates in
practice that all students, regardless
of contextual influences, are
capable of learning
Student occasionally believes and
demonstrates in practice that all
students, regardless of contextual
influences, are capable of learning
Student fails to understand and/ or
demonstrate in practice that all
students, regardless of contextual
influences, are capable of learning
Student respects the diversity of learning styles.
Student exhibits exemplary
understanding and practice reflecting the belief that all students,
regardless of contextual influences, are capable of learning
Student believes and demonstrates in
practice that all students, regardless
of contextual influences, are
capable of learning
Student occasionally believes and
demonstrates in practice that all
students, regardless of contextual
influences, are capable of learning
Student fails to understand and/ or
demonstrate in practice that all
students, regardless of contextual
influences, are capable of learning
Student is considerate
(verbally and nonverbally) of appropriately
expressed feelings and opinions of
others.
Student demonstrates exceptional ability to
understand the situations of others and responds in an
appropriate, proactive manner
Student demonstrates ability
to understand the situations of others and responds in an
appropriate, proactive manner
Student occasionally demonstrates ability
to understand the situations of others and responds in an
appropriate, proactive manner
Student fails to consider the situation of others in making
professional decisions and acts
inequitably
Student exhibits active listening
skills.
Student demonstrates exceptional ability to
understand the situations of others and responds in an
appropriate, proactive manner
Student demonstrates ability
to understand the situations of others and responds in an
appropriate, proactive manner
Student occasionally demonstrates ability
to understand the situations of others and responds in an
appropriate, proactive manner
Student fails to consider the situation of others in making
professional decisions and acts
inequitably
Student uses the framework of
social justice in decision making.
Student exhibits exemplary
understanding and practice reflecting the belief that all students,
regardless of contextual influences, are capable of learning
Student believes and demonstrates in
practice that all students, regardless
of contextual influences, are
capable of learning
Student occasionally believes and
demonstrates in practice that all
students, regardless of contextual
influences, are capable of learning
Student fails to understand and/ or
demonstrate in practice that all
students, regardless of contextual
influences, are capable of learning
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
20
Inquiry Exceeds Expectations
Meets Expectations Partially Meets Expectations
Does Not Meet Expectations
Student adequately addresses feedback
provided on coursework
(e.g., grammar, APA style, content).
Student demonstrates exceptional ability to
work well with others, lead educational
initiatives, and show leadership qualities
in professional settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being
open and responsive to feedback
Student occasionally demonstrates an ability
to work well with others in a professional setting
through exhibiting behaviors such as
punctuality, meeting deadlines, and being
open and responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work setting
Student accurately cites
material in academic work
ascribing appropriate credit for
information conveyed.
Student demonstrates exceptional ability to
work well with others, lead educational
initiatives, and show leadership qualities
in professional settings
Student demonstrates an ability to work well
with others in a professional setting through exhibiting behaviors such as
punctuality, meeting deadlines, and being
open and responsive to feedback
Student occasionally demonstrates an ability
to work well with others in a professional setting
through exhibiting behaviors such as
punctuality, meeting deadlines, and being
open and responsive to feedback
Student fails to demonstrate professional
behavior in the academic or work setting
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
21
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
22
APPENDIX B ASSESSMENT PLAN PREPARATION
1. Institutional Context -Program Mission
2. Define the purpose of the assessment.
ASSESSMENT ASSESSMENT 3. Determine assessment outcomes. •
As a result of this assessment (end goal)
4. How does current literature inform your assessment project?
Articulate in your proposal how you effectively integrate the literature on assessment within student affairs
5. Determine what kind of assessment methodology is most appropriate for your outcome. Why? • Consider qualitative, quantitative,
and mixed methodology
6. How can you best measure your desired outcome? • Questionnaire • Focus group • Existing data • Other
7. Determine the best sampling strategy. Ensure the population you are assessing is appropriate to answer assessment question. • Random, Purposeful, or
Convenience • Other
8. How will you analyze your data and ensure reliability and validity?
9. Consider ethical issues that may arise during the course of your assessment project. Do you need to seek IRB approval?
10. List special issues/problems you might encounter in conducting your assessment project. How can you address these on the front end?
I think that there may need to be some intentional conversation before starting the assessment process with constituents, secondly, I can see some questions/ concerns around areas of anonymity.
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
23
EVALUATION EVALUATION 11. Describe how you will use the results
from your assessment project to improve practice?
12. How will you report the results? To whom?
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
24
Appendix C Group Members’ Name: Assessment Project Title:
ELPS 431: Final Assessment Group Project Grading Rubric Appropriate organization,
APA formatting,
and grammar (5 Points)
The final product is well organized and free of errors
related to grammar and APA
formatting. 5 points
The final product is well organized
with only minimal grammar or APA formatting errors.
4 points
The final product suffers from
problems associated with organization, grammar, and
APA formatting. 3 points
The final product is poorly
organized and contains numerous
grammar and/or APA formatting
errors. 2 points
Application (5 Points)
Application demonstrates a
thorough, comprehensive
understanding of major
concepts/themes related to the
course. 5 points
Application demonstrates an adequate, basic
understanding of the major
concepts/themes related to the
course. 4 points
Application demonstrates an
incomplete understanding of
the major concepts/themes
related to the course. 3 points
Application is unclear and
demonstrates little understanding of
the major concepts/themes
related to the course. 2 points
Co-Team Member
Evaluation (10) points)
My assessment partner was fully engaged in the
project. Demonstrating the
following: timeliness in
responsiveness, understanding of the material, and
providing significant
contributions meriting 50% of the responsibility of completion of
the project 10 points
My assessment partner was
engaged in the project.
Demonstrating the following: delay
in responsiveness, understanding of
the material, providing
contributions to the project, but limited to less
than 50% of the responsibility of
completion of the project 8 points
My assessment partner was
limited in their engagement with
the project. Demonstrating the following: delay
in responsiveness, limited
understanding of the material,
providing limited contributions to
the project to less than 50% of the responsibility of
completion of the project 6 points
My assessment partner was not
engaged with the project.
Demonstrating the following: Delay in responsiveness,
very little understanding of the material, with
limited to no contributions to
the overall completion of the
project. 4 points
*The design of this course was developed with influences from similar courses taught by the following: Dr. Shannon Dean (Texas State San Marcos)) Lisa Davidson (Loyola University Chicago) Dr. Jan Barham (University of Georgia), and Dr. Laura Dean (University of Georgia) Note, this form can be found on Sakai under “Additional Resources” and Week 12 of the Week-by-Week tab
Fall 2020- Syllabus: ELPS 431 Evaluation in Higher Education Darren Pierre, Ph.D. -Instructor Modified August 17, 2020
25