“Recent Advances and Challenges for Quality
Assurance and Accreditation in the Higher Education
for Modern World” ( December 11th - 23rd 2017)
Academic Productivity
Measurement in Higher Education
Institutes: Experience from Asian
Countries and Lessons for India
APO Asian Country
understanding
7-10 aug, 2107
indonesia
Bangladesh
Cambodia
Fiji
India
Indonesia
Iran
Lao PDR
Malaysia
Nepal
Pakistan
Philippines
Sri Lanka
Thailand
Vietnam
Resources Person
Australia
USA
Japan
Country Paper
Indian Higher Education:
A Kaleidoscope of Development, Progress,
Challenges and Oppournities
Dr. M M Bagali, PhDDirector
School of Management Studies,
Professor of Human Resource Management,
Bengaluru, India
SP GoyalPrincipal Secretary to the Hon'ble Chief Minister
Government of Uttar Pradesh,
Fifth Floor, Lal Bahadur Shastri Bhawan,
Lucknow, India
Recent Advances Challenges Quality Assurance
and Accreditation
Higher Education
for Modern World
Global Ranking
Scopus
UGC ranked /
listed journals
ISSN
ISBN
indexed
peer reviewed
Plagiarism
Scope for
research
Time divide
Am I faculty or I
am researcher
or I am Admin….
Post Doct
International
Connects
rigor/relevance
NAAC
NBA
ISO
NIRF
private
MOOC
Online
Swayam
Tech used
Certification
Global exposure
Global faculty
Global Visits
Benchmark
Blended model
Higher Education Productivity Metrics
University of TokyoOxford University, UK
Carnegie Mellon
University
Swiss Federal Institute of Technology
Top 6 Universities for Engineering &
Technology 2015/16
Massachusetts Institute of Technology (MIT) ...
Stanford University …
University of Cambridge. ...
National University of Singapore (NUS) ...
ETH Zurich (Swiss Federal Institute of
Technology) ...
Nanyang Technological University (NTU)
who certified or
accredited?
who certified or accredited?
they are recognised by the
academic community
they are recognised by the industry/
corporates
they are recognised peer groups
they are recognised by research
bodies
what is needed by all of us !!
NAAC
NBA
ISO
NIRF
if yes, fine….. but, List in
world Class University !!
if NO, what can be done /
what should be done !!
How do Indian Higher Education Institutes figure in World Class List of
University;
If they are figured now, fine…..
If they are not figured, why ……
how do you all feel, why many don't figure !!!!!
How do Indian Higher Education Institutes figure in World Class List of
University;
MIT-USA and Harvard University-USA produced 74 and 46 Noble
Laureates, as of 2017. How can Indian University Higher Education
Institutes march towards this;
Oxford University, has 140 country students on campus, and applies
for Patent every week. How can Indian University Higher Education
Institutes promote on wider scale and bigger canvas;
In USA, Faculty and Alumina together have established several MNC’s
with trillions of $US. This trend is less reflected in Indian community,
and Indian University Higher Education Institutes don’t have
impressive numbers to reflect such figures;
Indonesia / aug / 2017
Experts at the Productivity Measurement
workshop, and Discussions with all the Delegates from 20 countries
Productivity Matrix for Higher Education Institutions
the measurement of outcome should reflect in this
THE’s World University Rankings
The Academic Ranking of World Universities (ARWU)
The QS - Quacquarelli Symonds- World University Rankings
The Times Higher Education Ranking
NIRF
Productivity !! knowing
Productivity !!output, outcome
quality, quantity
……. if you cant measure something, you cant improve something
Productivity areas !!
self
institution
others
community
How Do People Experience You in the Academic Market?
Productivityfocus areas
General
Teaching
Research
Administration
Hours of work
Publications
Indian Context
NAAC
Curricular Aspects
Teaching-Learning and Evaluation
Research, Consultancy and Extension
Infrastructure and Learning Resources
Student Support and Progression
Governance, Leadership
and Management
Innovations and Best Practices
NBA
Physical requirements
Governance
Human Resources
Academic Program
……
NIRF
Teaching, Learning & Resources
Research and Professional Practice
Graduation Outcomes
Outreach and Inclusivity
Perception of Stake hold……
…. few others
Productivityfocus areas
Level 1-6 years 7-12 years 12 -18 years 20+
Teaching……
Research……
Inst Devp……
Consultancy……
Publications……
Asian Context
Productivityfocus areas
Level 1-6 years 7-12 years 12 -18 years 20+
Teaching…… 60%
Research…… 20%
Inst Devp…… -%
Consultancy……05%
Publications……15%
35%
25%
05%
10%
25%
10%
40%
15%
15%
20%
?
?
?
?
?
Asian Context
Productivityfocus areas
Level 1-6 years 7-12 years 12 -18 years 20+
Teaching……
Research……
Inst Devp……
Consultancy……
Publications……
04%
40%
15%
25%
15+1%
10%
40%
15%
15%
20%
35%
25%
05%
10%
25%
Asian Context
Productivityfocus areas
Level 1-6 years 7-12 years 12 -18 years 20+
Teaching…… 60%
Research…… 20%
Inst Devp…… -%
Consultancy……05%
Publications……15%
35%
25%
05%
10%
25%
10%
40%
15%
15%
20%
04%
40%
15%
25%
15+1%
Asian Context
the signs of a teaching
faculty
The performance indicators
Teaching (the learning
environment)
Research (volume, income and
reputation)
Citations (research influence)
International outlook (staff,
students and research)
Industry income (knowledge
transfer)
Others…..
Asian Country Indicators
impact
influence
relevance
rigor
revenue
Paper publications
Books publication
working paper
White / Policy paperTV talk
Editor
Board of Director on MNC
Policy Committee
Invitations
Research
Consultancy
Teaching
Course Development
Workshop / Seminar / Conference
contribution
specified
research
projects
MOOC
rigor
course development
course registration
research area
consultancy
reputation survey
visibility among peers
research influence
policy documents ….at what level
appearing in top journals
referred / invited talk @ Academy
Conference
5 - 3 - 1 framework
5 attract
every faculty
should refer 5
relevant profiles;
referrals
3 retain
3 top performers;
engage them;
prevent attrition
1 develop
coach;
mentor;career
path;competency;
leadership position
impact of your research /
teaching Output Model!!
REI Model
Relevance - Engagement - Impact
PRM Model
Process of Improvement - Revenue - Margins
associate professor +
teaching
research - guide
post doctoral - funding
funding for research councils
workshop
conference
seminar/ symposium
csr-committee
research council team
awards / prizes
associate professor +
workshop /conference
seminar grading
theme
profile of invited speakers
registration
turnover - revenue
outcome
policy decisions
outcome- book,course, mdp
associate professor +
Other Metrics
how many drop=outs / average attendance
in your course
characteristic of students
background- composition
alumina connect to the course
course development/New pedagogies
support peer….demonstrate
created learning environment
professor / rector /
dean +
national research funding
committee
citations
references
international invitations,
awards, honours
business impact
mou’s and collaborations
board members of mnc's
patent - patent - patent
you should secure
Chair Professor
professor / rector /
dean +
citations
Journal Lists for Searchable Databases
Web of Science Core Collection
Arts & Humanities Citation Index
Science Citation Index Expanded
Social Sciences Citation Index
Emerging Sources Citation Index
Subject Indexes on the Web of Science platform
Current Contents Connect
Current Contents / Agriculture, Biology & Environmental Sciences
Current Contents / Arts & Humanities
Current Contents / Clinical Medicine
Current Contents / Engineering, Computing & Technology
Current Contents / Life Sciences
Current Contents / Physical, Chemical & Earth Sciences
Current Contents / Social & Behavioral Sciences
Current Contents Collections / Business Collection
Current Contents Collections / Electronics & Telecommunications Collection
Other Collections
Science Citation Index
professor / rector /
dean +
research
books
papers
creative materials
research guidance- ongoing; complected
placements - level;profile; JD
download of digital material of your stuff
sponsored research funding
collaborative projects with industry
PATENT / INTELLECTUAL PROPERTY
FUND GENERATED = FUND SAVED= NET SAVED
USEABILITY + VALUE + OUTCOME
professor / rector /
dean +
course introduction
relevance
registration
revenue
placements
level
salary
job profile
your book into course
your course into case
your case into revenue
Journals
Journal Citation Reports (Thomson Reuters)
Impact Factor
- [# of citations in a year]/[total # of articles published in 2 previous years]
Eugene Garfield
Article Influence (uses Thomson Reuters citation data; in Journal Citation
Reports)
Scopus (Elsevier)
Journal Analyzer (uses Elsevier citation data; in Scopus)
SNIP (uses Elsevier citation data; in Scopus)
SJR (uses Elsevier citation data; in Scopus)
h index (used in many citation trackers including
Web of Science, Google Scholar, Scopus)
Based on author's years active as well as number of citations of specific
articles
g index (used in Publish or Perish, elsewhere)- Adds weight to heavily-cited
articles in h-index metric
Adds weight to heavily-cited articles in h-index metric
Citation Tracker (Scopus)
h index (researchers' impact) (Scopus, Web of Science, Google Scholar)
h-Graph (depicts impact of a set of articles) (Scopus)
Journal Citation Reports (Journal Citation Reports (WoS)
Citation Map (Web of Science)
My Citations (Google Scholar)
Students expect more than lectures, basic
interactions and a well-known name on
a degree certificate
more than lecturer
evaluating your success
sr professor / dean /
director +
research - impact
World 20 best jl
relevance - value creation
editor - peer jl
membership
consultancy
revenue level- 30c
mnc’s level
indi X team
report/high visibility
assignment
teaching
corporate university
mdp
visiting
develop-teach course
research ; education program; mdp’s; consultancy;
writing; case; books; …… gross and net MARGINS
sr professor / dean /
director +
academic journals indexed by Elsevier’s Scopus database per scholar,
research journal publications that have at least one international co-author
https://www.timeshighereducation.com/world-university-rankings
World 20 best jl
tech used
app used
flipped classroom
gamification strategies
blended learning
ebooks, journals
social media
mood
online
webinar
have separate websites
post doctoral assignment
rewards / honors/ recoginations
phd review committee member
chair professor
chair conditions
Top 10 Journals
On Editorial Board
Advisory Council
Board Member of Corporate
Award / Prize Committee Member
Book / Report / Edited volumes
/ Chapters
Visibility in Prof. Association
Best Seller Book Series
Invited Publications, Editorials,
and Write-ups of Research
Consultancy
contributions
Public Testimony
Research Services
Conference/ seminars
everyone at the
schools
GLOBAL TEACHING
EXCELLENCE AWARD 2018:
Celebrating institution-wide
teaching excellence
leading to Global Teaching
Excellence Award 2018. The
accolade will be awarded to an
institution in recognition of
outstanding approaches to
teaching
Promoted by Higher Education
Academy
data collection
academic audit
students satisfaction survey
external agencies
corporate perception
enrolments / registrations
…….
input / output + cross = net MARGIN
grading
Excellent Teacher
Good teacher
Average
below average
90-100
75-89
65-74
less 64
promoted
discuss and promoted
panel decide
ask to leave
“Productivity” has many facets, e.g..
Amount of output
Output relative to input
Financial return
Popular measures include:
Degrees and other awards
Student-faculty ratios
Time to degree
Cost per credit or degree
Net revenue from a program
These remind us of the blind men and
the elephant: each man sees a piece,
but no one can visualize the whole.
Productivity !!
“In higher education,
productivity improvement is
seen as the most
promising strategy for
containing costs in the
continuing effort to expand
access and affordability
while keeping the quality of
higher education … at
world-class levels.”
Mackie (2016), p. 1.
“Productivity” has many facets, e.g..
Quantity produced
Quality produced
Efficiency
Effective
Earned Revenue
Value….. intrinsic X extrinsic
Productivity !!
Increasing Students Expectations X Productivity Indicators
1996 era
Get Admissions
Get Good College/ University
Get Degree
Get Good Grades
2017 days
Global Placements / Exposure
Connected Class rooms
ICT/ MOOC’s
Industry Oriented
Flipped Classrooms
360 degree personality development
………..
Facilitators and blockers???What are the main facilitators to spurring work in your institutions and country/system? How can these be secured?
Facilitators and blockers???What are the main facilitators to spurring work in your institutions and country/system? How can these be secured?
Management - goals
Colleges
Social Support system
Personality of Institutes
Eco-system - resources
Process efficiency
Facilitators and blockers???What are the blockers hindering uptake of productivity-related work? How can these be recognised and mitigated?
Mismatched curriculum Gap Between one and other unversities in term of facilitiesQuality of Students Quality of Lecturers
what is the definition of Quality !!!
factors influencing
Productivity !!
Productivity of academics/staff
Incentivising people
Workload balance
Faculty quality/qualifications
Formal training of academician
Institutional governance
Transparent linking of leadership with productivity
Mission clarity/differentiation
Allocating resources
Collaboration at Institutional level
How do Indian Higher Education Institutes figure in World Class List of
University;
MIT-USA and Harvard University-USA produced 74 and 46 Noble
Laureates, as of 2017. How can Indian University Higher Education
Institutes march towards this;
Oxford University, has 140 country students on campus, and applies
for Patent every week. How can Indian University Higher Education
Institutes promote on wider scale and bigger canvas;
In USA, Faculty and Alumina together have established several MNC’s
with trillions of $US. This trend is less reflected in Indian community,
and Indian University Higher Education Institutes don’t have
impressive numbers to reflect such figures;
International profile in terms of teaching program, Professors, faculty, dual
degree with World class University, collaborations, MOU’s, multi-cultural-
multidisciplinary academic milieu is absent;
Overseas students registering for Indian Education in different Universities
is not impressive, compared to some Developed and Developing counties;
A Report says that, 4,50,000 Indian students spend over $US 13 Billion each
year in acquiring higher education overseas. How do Indian University
retain and get enchased by having this segment stay back;
Multiple statutory bodies have suffocated and paralyzed the
system, with several regulatory approvals and requirements,
which are hindrance to growth and development of Indian
University Higher Education Institutes;
High Competency faculty team with Global and International
exposure, bagged with Global Research aptitude and Global
Recognition and Reputation is missing in most Indian University
Higher Education Institutes teaching community;
Many Indian University Higher Education Institutes Professors
and Faculty are not part of Corporate Boards, Editors, Editorial
Boards of International Research Journal; Chair of International
conference and World Meets;
While 100% FDI in Higher Education exists in India, along with
Foreign University establishment, how do we cope with the World
Class University;
Update teaching curriculum; using of MOOC; technology enabled
methodology; Global Philanthropists support of University; and
the like are few other areas of concern;
Lastly, How can we get away with this culture and practice of
favouritism, casteism, nepotism, and bring an atmosphere of total
merit oriented/performance driven practices and culture…..
Recent Advances Challenges Quality Assurance
and Accreditation
Higher Education
for Modern World
Global Ranking
Scopus
UGC ranked /
listed journals
ISSN
ISBN
indexed
Scope for
research
Time divide
Am I faculty or I
am researcher
MOOC
Online
Tech used
Certification
Global exposure
Global faculty
Global Visits
Benchmark
Higher Education Productivity Metrics
NAAC
NBA
ISO
NIRF
Broadly used for understanding the “Quality
Status” of an institution. The accreditation status
indicates that the particular Higher Educational
Institutions (HEI) meets the standards of quality
set. NAAC has identified the following seven
criteria to serve as the basis of its assessment
procedures:
1. Curricular Aspects; 2. Teaching-Learning and
Evaluation; 3. Research, Consultancy and
Extension; 4. Infrastructure and Learning
Resources; 5. Student Support and Progression;
6. Governance, Leadership and Management; 7.
Innovations and Best Practices
5 Star
4 Star
3 Star
A++
A=
A
B++
B+
B
C
D…. NO
NAACNational Assessment and
Accreditation council
NBA…Initially established by AICTE for
periodic evaluations of technical institutions &
programmes. It has the full authority to
recognise or derecognize institutions and
programmes under them. It is the only
authorized body in India entrusted with the
task of undertaking accreditation of technical
education programmes, and NBA is part of this
council, which checks the Quality standards in
Engineering Higher Education Institutes.
NBA
The National Board of Accreditation
NIRFNational Institutional Ranking Framework
Indian Government established, 2015, The
National Institutional Ranking Framework,
evaluating the Quality and Output of all the
University in Indian on 5 parameters:
1. Teaching, Learning & Resources;
2.Research and Professional Practice; 3.
Graduation Outcomes; 4. Outreach and
Inclusivity; 5. Perception of Stake hold
limitations/
challenges
metrics measurement variety
some have 5 point; some 10;
some ??
Is it teaching / Research…..which
is prime
year of commencement
et al ……
| 90
Mapping Research Metrics To Productivity Dimensions Key: means “strongly associated”; means “weakly associated”.
| 91
Mapping Educational Metrics To Productivity Dimensions (3)Key: means “strongly associated”; means “weakly associated”.
Colored items were discussed in the first presentation.
| 92
Mapping Educational Metrics To Productivity Dimensions (2)Key: means “strongly associated”; means “weakly associated”.
| 93
Mapping Educational Metrics To Productivity Dimensions (1)Key: means “strongly associated”; means “weakly associated”.
Mapping of Educational Metrics to the Productivity Dimensions
| 94
Attributes of a Good Metric
1. Adequacy. The metric should correspond to the object or concept
being evaluated.
2. Sensitivity. The metric should vary in a manner consistent with the
“inertia” of the object being measured.
3. Homogeneity. The metric should be homogeneous in its
composition, so that it will not send ambiguous signals about which
objects are changing.
Based on Yves Gingras, Bibliometrics and Research Evaluation: Uses and Abuses (Cambridge, MA: The MIT Press, 2016.
• Global demand rising rapidly since turn of century
• Economies mature, requiring more educated workers
• Competition for higher levels of credential/ competency
• People have longer careers, requiring retraining
• Asia has a special role to play in global workforce
Unprecedented demand
• Legacy higher education designed for elite provision
• Many collegial approaches do not scale well
• Scaling higher education creates discontinuities
• Complexities with cross-subsidisations, conventional academic work, new forms of governance
Choking supply
• Universities have large infrastructure costs, large labour costs and rely on expensive face-to-face provision
• High fixed and variable costs, and limited economies of scale
• Increasing pressure to explore revised cost structures
• New ‘academic production functions required’
The ‘cost disease’
• Typically limited revenue options regarding price or numbers
• Regulation and subsidy carries double-edge sword
• The international circuit breaker
• Need mew financing options into the future
The revenue squeeze
• Waning emphasis on quality process/inputs
• Accountability for standards
• Shift to focus on outcomes
• Shift to focus on students
Increased regulatory pressure
• Economic pressures are enveloping core education business
• New streams of private finance flowing into higher education
• Problems for universities around ownership, disclosure and autonomy
New commercial constraints
• New transnational influences eroding national protective barriers
• Emerging international ecosystem structured by market power and finance
• System actors strive to respond in pre-/post-system world
• New governance trends – unclear what strategies/policies are at play
Stratification pressures
• Governments value reach and returns of scarce public funds
• Institutions seek uncontested market space through differentiation
• Isomorphic paradoxes driven by market and regulatory forces
Desires for diversity
• Knowledge being flat-packed
• Promulgation of online, open-access, proprietary products
• Providers repackage information, though bottlenecking with assessment
• Technology a facilitator not disruptor
Changing education fundamentals
• More standardised provision compresses quality
• More challenges to achieving excellence
• Need new perspectives on quality given changes in core business
New views on quality
• Need new ‘academic production functions’
• Redesign/re-engineer core research and education processes
• Innovate corporate/financial systems to support renewed processes
• Unique opportunities for fast-developing Asian systems to create novel ‘smart-HE’
Shift policy and management to create new ways of doing core academic business
We need new approaches
ACKNOWLEDGMENTS
place my thanks to APO, NPC, Experts at the Productivity Measurement
workshop, and Discussions with all the Delegates from 20 countries
Director, Professor, CoachM M Bagali, PhD, PhDGrace Residency enclave,
3rd Block, 2nd Cross, 1st Phase,
HBR layout, Kalyanagar post, Bangalore - North 560 043
98809 86979 I [email protected]
Reference for the scholarly work
https://www.linkedin.com/in/mmbagali/
https://scholar.google.com/citations?
https://www.researchgate.net/profile/Mettu_Bagali/publications
http://jainuniversity.academia.edu/MMBagali
https://www.researchgate.net/profile/Mettu_Bagali/reputation
https://www.slideshare.net/sanbag
( creating tomorrow india, today )
Centre for Human Resources and Higher Education