WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani,...
-
Upload
christopher-lewis -
Category
Documents
-
view
217 -
download
3
Transcript of WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani,...
![Page 1: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/1.jpg)
WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE
UNITED STATES?
Marilee J. Bresciani, Ph.D.Professor of Postsecondary Education Leadership at San
Diego State University
October 4, 2010
![Page 2: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/2.jpg)
WEBINAR OVERVIEWBRESCIANI, M.J., 2010
Context for Accountability of the Quality of General Learning within the United States
Exploring Comparability of Quality of General Learning
Positing Questions for Consideration
![Page 3: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/3.jpg)
FRAMING QUESTIONSBRESCIANI, M.J., 2010
What do you know about the quality of general learning at your institution?
How does the quality of general learning at your institution compare to the quality of learning at other institutions?
![Page 4: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/4.jpg)
Bresciani, M.J.
CONTEXT FOR ACCOUNTABILITY(BRESCIANI, ET AL, 2009)
To improve the underperforming student
Competency Movement in Business and Industry International Trade Agreements
Bologna Declaration of 1999
![Page 5: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/5.jpg)
Bresciani, M.J.
CONTEXT FOR ACCOUNTABILITY, CONT.(BRESCIANI, ET AL, 2009)
Government Conversation, 1985 The Higher Education Re-authorization Act Testimonies in USA, 2002 and 2006 Response to NCLB Legislation Regional Accreditation – flexibility
CRAC – 2003, 2004 Both documents focus on student learning
![Page 6: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/6.jpg)
Bresciani, M.J.
CONTEXT FOR ACCOUNTABILITY, CONT.(BRESCIANI, ET AL, 2009)
National Commission on the Future of Higher Education
•Demand for Public Information about Performance•Transparency of outcomes and results•Comparable measures of quality•Demonstration of value-added of the entire educational experience
![Page 7: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/7.jpg)
Bresciani, M.J.
CONTEXT FOR ACCOUNTABILITY, CONT.(BRESCIANI, ET AL, 2009)
Accountability requirements handed back to statesPerformance indicators Increased desire for transparency, comparability, and value-added
Discipline Standards still expected to be addressed by disciplines
![Page 8: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/8.jpg)
IN OTHER WORDS…(BRESCIANI, ET AL, 2009)
We are being held accountable for general learning expectations by the public.
The disciplines are “taking care” of accountability via professional accreditation/certification.
Bresciani, M.J.
![Page 9: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/9.jpg)
SO, THE QUESTIONS REMAIN…(BRESCIANI, ET AL, 2009)
So, how effective is our design and delivery of general learning?
How well equipped are we to evaluate that learning?
How well can we compare our quality of general learning with another institution?
Bresciani, M.J.
![Page 10: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/10.jpg)
REPORT OUT
Bresciani, M.J.
![Page 11: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/11.jpg)
Bresciani, M.J.
TIPS FROM GOOD PRACTICE INSTITUTIONS(BRESCIANI, 2007)
They clearly communicate the purpose of the programs that deliver their general learning
There is cross institutional buy-in to the purpose
There is cross institutional buy-in to the outcomes and in some cases assessment methods, if appropriate
![Page 12: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/12.jpg)
Bresciani, M.J.
TIPS FROM GOOD PRACTICE INSTITUTIONS(BRESCIANI, 2007)
They clearly define their expected learning through learning outcomes
They align the process for creating the expected learning with the manner in which they evaluate the learning
They “advertise” the variances in their processes
They advertise the “success” of their general learning with evidence; they improve where they are not successful
![Page 13: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/13.jpg)
Bresciani, M.J.
TIPS, CONT.(BRESCIANI, 2007)
They invite peer critiques, internal to their organization and external to their organization
They use testimonials to demonstrate their effectiveness
Some articulate expectations of and investments in to students and faculty
Some are mindful of their ”inputs”
![Page 14: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/14.jpg)
SECOND SET OF QUESTIONS(BRESCIANI, ET AL, 2009)
Who claims ownership for the design, deliver, and evaluation of your general learning?
How well does the assessment data inform improvements?
How well coordinated is the evaluation and decision-making process?
Bresciani, M.J.
![Page 15: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/15.jpg)
REPORT OUT
Bresciani, M.J.
![Page 16: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/16.jpg)
SUMMARY OF PROS AND CONS OF COMPARABLE DATABRESCIANI, 2010
Standardized Tests Commercially designed Ability to update is limited May be able to align with
learning outcomes May be able to align with
delivery of learning Generates validity and
reliability statistics Less subjective
Rubrics Faculty designed Ability to update is dynamic May be able to align with
learning outcomes May be able to align with
delivery of learning Generates inter-rater
reliability statistics Subjective
![Page 17: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/17.jpg)
CONSIDERATIONS FOR USING RUBRICS FOR COMPARABILITYBRESCIANI, 2010
Can you answer the previously posited questions?
Can your faculty collaborate on the design of rubrics or can your faculty adapt those developed by the AAC&U VALUES project?
Can you collaborate with other institutions to share rubric results and run inter-rater reliability data?
![Page 18: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/18.jpg)
SESSION CITATION
Bresciani, M.J. (October 4, 2010). What do We know About the Quality of Higher Learning in the United States? EDUCAUSE Learning Initiative Webinar
![Page 19: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/19.jpg)
REFERENCES
Bresciani, M. J. (Ed.). (2007). Good practice case studies for assessing student learning in general education. San Francisco, CA: Jossey Bass.
Bresciani, M. J., Gardner, M. M., & Hickmott, J. (2009). Demonstrating student success in student affairs. Sterling, VA: Stylus Publishing.
![Page 20: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/20.jpg)
RESOURCES
AAC&U Leap Report - http://www.aacu.org/leap/documents/GlobalCentury_ExecSum_3.pdf
Raising the Bar: Employers' Views on College Learning in the Wake of the Economic Downturn" (January, 2010) - http://www.aacu.org/leap/documents/2009_EmployerSurvey.pdf
"How Should Colleges Assess And Improve Student Learning? Employers' Views on the Accountability Challenge" (January 2008): http://www.aacu.org/leap/documents/2008_Business_Leader_Poll.pdf
![Page 21: WHAT DO WE KNOW ABOUT THE QUALITY OF HIGHER LEARNING IN THE UNITED STATES? Marilee J. Bresciani, Ph.D. Professor of Postsecondary Education Leadership.](https://reader030.fdocuments.in/reader030/viewer/2022032612/56649eaa5503460f94bae8e6/html5/thumbnails/21.jpg)
RESOURCES, CONT.
AAC&U VALUE Rubrics - http://www.aacu.org/value/rubrics/index_p.cfm?CFID=25068677&CFTOKEN=29196266
New Leadership Alliance for Student Learning and Accountability - http://www.newleadershipalliance.org/
Bresciani, M. J., Oakleaf, M., Kolkhorst, F., Nebeker, C., Duncan, K., Barlow, J., & Hickmott, J. (2009). Examining Inter-Rater Reliability for a Research Methodology Rubric. [Electronic version] Practical Assessment, Research, & Evaluation, 14(13A),1-7.