LEAGUE TABLES AND NEW KPIsVC’s OPEN MEETING

Anita Wright

Head of Planning

November 2013

League Tables and RankingsWhy are League Tables Important?

• League Tables are here to stay• New Tables e.g. Which?, Unistats

• Increasing evidence that they inform choice• Students and parents• Staff (to a lesser extent)

• Reputational Impact• More significant in a competitive market • Student recruitment• Research grants• Partnership activity

University of LiverpoolHeadlines

• The Good News• University of Liverpool is in the top 1% of International Universities

• The Bad News• Ranking deteriorated in 2013 compared to 2012

League Table Performance How are we doing?

• Performance in many metrics remains generally stable

• Continue to see a drop in rankings• Failing to keep pace with other HEIs

• Context• RAE results are fixed until REF 2014 published• Research assessment highly weighted (1.5 times)• REF performance is critical

• Need to gain in other measures (e.g. SSR, Spend) to improve our rank

Performance - Strengths Where do we do well?

Staff Student RatioTop 10 in the sector but downward trend

Academic Services SpendTop 10 in the sector

Completion RateStable performance, predicted, fluctuation

Entry TariffImproved performance, only maintained rankQuality vs student numbers

Performance - Weaknesses Where do we do less well?

Good HonoursRelatively stable, losing position

Student SatisfactionOverall improvement, primary indicator, maximum weighting

Graduate ProspectsLocal students, less graduate opportunities

Facilities SpendImproving, poor rank

Reputational SurveysDifficult to influence?

University of Liverpool Performance – THE World University Rankings

University of Liverpool What can you do?

• Subject Performance• Performance in individual subject areas critical• Measures in overall league tables are adjusted for subject mix• Overall University score depends on performance in each subject table

• Understand performance in your area and which measures need improving

• Outstanding Areas

• Areas for Improvement

KEY PERFORMANCE INDICATORSWhy do we need them?

• The Right KPIs are critical• Linked to our Strategic Plan• Define and evaluate success against progress with strategic aims• Broader context than what's in the league tables only

• Essential to understanding our current position, where we sit against our competitors and predict future performance to inform our Plans

• Facilitate performance improvement and progress against agreed Strategic Vision and direction

• Make adjustments or take corrective action where necessary through effective monitoring and reporting

New KPIs – FrameworkLink to Strategy and Vision

Vision

•Purpose and Vision

•Core Values

•Brand

Strategy

•Strategy to Achieve our Vision

•Key Priorities

Priorities

•KPIs•Cross

-cutting

New KPIs – Agreed ApproachIncluding Other Supporting Measures

KPIs

•Strategic and in line with Priorities and Vision

•Small Number (i.e. 6-10)

SPIs

•More detailed measures in support of KPIs

•Specific SPIs for Strategic Committees and Planning Units

MI

•Detailed MI in support of activity and performance monitoring by Schools/Institutes

Agreed KPIs and SPIsResearch and KE

KPIs

•Research Quality and Impact

•Citations/Publications

•PGR Students

•Innovation

SPIs

•Applications, Awards, Success Rates

•‘Prestigious’ Projects (e.g. Fellowships)

•Income•Large

Grants

Agreed KPIs and SPIsStudent Experience

KPIs

•Degrees Awarded

•Employability/Destinations

•Satisfaction (L&T and services)

•Diversity

SPIs

•Contact Time and Quality

•League Table metrics (e.g. SSR, Spend)

•Applications and Conversions

•Progression/Retention

Agreed KPIs and SPIsWidening Participation

KPIs •As Student Experience

SPIs

•HEFCE Benchmarks

•Access Agreement

•Value Added

Agreed KPIs and SPIsEnablers

KPIs

•Financial Health and Sustainability

•Staff Satisfaction

SPIs

•Staff (retention, progression, diversity)

•Condition of the Estate and Space Utilisation

•Alumni and Fundraising Activity

KPIs and SPIsReporting Framework – Dashboard Examples

• MI Dashboards and Explorer for KPIs and SPIs to support analysis• Performance against Target• Comparator Performance• Trend over Time• Drill down capability

KPIs and SPIsReporting Framework – R&KE Example

MISPIKPI

Research Quality

% 3* and 4* outputs Eligible Staff

Research Grants

Awarded

Applications

Success Rates

Source of Funds

Prestigious Projects

Fellowships

Large Grants

Next StepsCurrent Development Areas

• Define and Specify KPIs and SPIs• Link between KPIs, SPIs and MI – Three Tier Approach• Report through dashboards and explorer• Defined reporting calendar/timeline• Develop Operational MI• Validate by modelling historical data

• Agree Targets/Milestones• Actual value vs. RG position• Challenging but Realistic• Identify appropriate National and International benchmarks

• Integrate in to PPC and Quarterly Performance Reports

Where Next?Overall Vision and Strategy

• Move from MI to BI….

• MI is used to:• Inform decisions• Define strategy • Change behaviour

• Leading to improved performance…….

• More to follow ……your help in assessing our ‘BI Maturity’

Questions