MEASURING STUDENT SUCCESS SYMPOSIUM
Ontario College Key Performance Indicators
Joanne Brown Manager, Colleges Unit, MTCU
Presentation to OISE Research Policy Symposium
November 22, 2013
2
WHAT IS STUDENT SUCCESS? • Gaining employment? • Employment related to field of study? • Satisfied students? • Graduation? • Critical thinking? • Gaining an education? • Satisfied employers? • Desire to gain knowledge? • Becoming a better engaged citizen? • Satisfied graduates? • Gaining opportunities to enroll in other programming? • Contributing to meaningful research?
ANSWER: All of the above…and more.
STUDENT SUCCESS AS DEFINED IN THE COLLEGE SECTOR
• Ontario Colleges of Applied Arts and Technology Act:
– The objects of the colleges are to offer a comprehensive program of career-oriented, post-secondary education and training to assist individuals in finding and keeping employment, to meet the needs of employers and the changing work environment and to support the economic and social development of their local and diverse communities.
3
KPIs and STUDENT SUCCESS
4
Student Success
Student Satisfaction
Graduation Rate
Graduate Satisfaction
Employment Rate
Employer Satisfaction
CONTINUOUS EVOLUTION
5
1996: Provincial Auditor - collect, report and tie KPI to funding
1998: Launch
2005: Data sharing agreement
2012: Launch of Web-based Employment Profile
2013: OPEN GOVERNMENT
OPEN GOVERNMENT
• Involves making data the
government collects available to the
public in a free and accessible way.
• Subject to privacy, security and
confidentiality protections.
OPEN GOVERNMENT: ACCOUNTABILITY AND TRANSPARENCY
6
College System
• Colleges Ontario
• MTCU webpage
Provincial Program
• Employment Profile
Local Program
• Institutional Webpages
Employment rates, graduate and employer satisfaction rates are tied to
performance funding.
VALUE OF KPI
*Approx. 120-page analysis of 2011-12 Fanshawe College KPI results disaggregated by question.
7
• Monitoring the outcomes that
result from this use of public
funds and better
understanding how the
system is used by students
and serves employers.
• Results in better allocation of
public funds and more efficient
achievement of goals.
• Better outcomes for our
students and our
communities.
• Continuous improvement.
RESPONDING TO STUDENTS
8
CURRENT UPGRADES
• Modernization and updating of questionnaire
• Expansion of demographic information collected
• Growth of ability to monitor outcomes of government funded initiatives
Student Satisfaction and
Engagement Survey
• Collection of longitudinal data by introduction of a survey at two years
• Alignment with university practices
• Growth of ability to monitor outcomes of government funded initiatives
Graduate Outcomes Surveys
• Centralization and automation of calculations
• Better capture of student movement based on the Ontario Education Number (OEN)
Graduation Rate Calculation
9
BETTER TRACKING OF STUDENT SUCCESS
• Research indicates engagement is a critical component of student success.
• 20 engagement-related questions added focusing on:
• support offered by colleges to students
• student engagement in college life
• student time commitments.
• Separate monitoring of in-class apprentices, international, first generation and students with disabilities.
Student Satisfaction and
Engagement Survey
• Inclusion of:
• work-integrated learning experience
• survey section for Co-op Diploma Apprenticeship graduates
• Development of a graduate outcomes survey at two years to assess progression of graduate’s career or further education path.
Graduate Outcomes Surveys
• Separate monitoring of preparatory programs, international, Co-op Diploma Apprenticeship, and Second Career students.
Graduation Rate Calculation
10
LONG-TERM OPPORTUNITIES
11
• KPIs for all sectors of Ontario’s Postsecondary
Education System:
• Public Colleges
• Private Career Colleges
• Publicly-assisted Universities
• Other OSAP-eligible institutions
• Harmonized data collection methods
• Uniform KPI calculations
• Timely and comprehensive reporting
• Linkages with other relevant information
• and…
CLOSING THOUGHTS
The Ministry is allocating approximately $1.42 billion in operating support to the college system in 2013-14.
The Ministry will spend approximately $2.1 million (0.15% of overall expenditure) in College KPI to monitor this investment of public funds.
In addition to monitoring, this expenditure provides the following benefits annually:
131,926 students report on their satisfaction.
56,431 graduates report on their satisfaction and outcomes.
8,622 employers report on their satisfaction with college graduates preparation for the workforce.
Approximately 500 fields of data collected.
12
Top Related