Uwe Brandenburg | CHE Consult GmbH Rome, September 2012 · Uwe Brandenburg | CHE Consult GmbH Rome,...

Input, output, and outcome:two approaches to measureinternationalisationUwe Brandenburg | CHE Consult GmbHRome, September 2012

2

Core assumptions and statements

IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012

Internationalisation

No goal in itself but effective instrument to achieve other goals

can enhance education, research, civic engagement etc.

Measuring Internationalisation

So far too many assumptions made, to few things proved: we claim but we do not know!

Satisfaction surveys dominate next to input measurement

Outcome (impact) is not measured yet

3

Three projects…


Complexityof interna-

tionalisation

IMPI

IMS2020MEMO©

Input & OutputInput & OutputOutcomesOutcomes

4

Step 1: acknowledging diversity through a toolbox


IMPI (Indicators for mapping and profilinginternationalisation)The IMPI toolbox

No ranking tool

No ultimate set of key indicators

Tool for tailored-made profiling and self-assessment, inter-institutional comparison

Inclusion of very broad set of relevant indicators

Changes due to interactivity with user (rating relevance, no. of users)

Globally relevant as based on different global projects & used globally!

5IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012


A toolbox is not building the house!


First strategic goals, embeddedness in overall strategy; then indicators

Easy indicators have little meaning

only meaningful when combined with other resources

No definitive answers with regard to “success” or “failure”

provides framework for collecting data

effective use of the toolbox requires reflection, dialogue, and analysis


• Using the number of users, rate of relevance and standard deviation• Calculated per goal dimension and aggregated over all• Example: aggregated indicators:

with: v = average rating value, n = number of users, s = standard deviationwith: v = average rating value, n = number of users, s = standard deviation

with: v = average rating value, n = number of users, s = standard deviation


03-009 Does the unit have a specific organisational structure to support internationalisation?

07-002 Does the unit monitor its international visibility?

01-027Out of all students in the unit, what proportion is in international joint/double/multiple degree programmes in a given year?

05-023Out of all degree programmes offered by the unit in a given year, what proportion are international joint/double/multiple degree programmes?

05-022In a given year, what proportion of international joint/double/multiple degree programmes does the unit offer at the Doctoral-level?

07-013Does the unit participate in national, regional or local networks supporting internationalisation?

02-041In a given year, out of all of the unit's academic staff members, what proportion is involved in international joint doctoral supervision / co-tutelle?

05-022In a given year, what proportion of international joint/double/multiple degree programmes does the unit offer at the Doctoral-level?

05-021In a given year, what proportion of international joint/double/multiple degree programmes does the unit offer at the Master's-level?

01-004 Out of all students in the unit, what proportion studies abroad in a given year?


Number of choices of indicators under the

respective goal dimensionGoal 1 „to enhance the quality of education” 1330Goal 2 „to enhance the quality of research” 1048Goal 3 „to well-prepare students for life and work in an intercultural and globalising world” 864

Goal 4 „to enhance the international reputation and visibility of the unit” 998

Goal 5 „to provide service to society and community social engagement” 130

15

Distribution of IMPI users by country of origin (Autumn 2012)


502 users428 non-project300+ non-EU52 countries

16

Users by types of institutions


0

50

100

150

200

250

300

Two-yeardegree

Bachelor Master Doctoral degree

17

Users by size of institutions


0

50

100

150

200

250

under 1,000 between 1,000and 5,000

between 1,000and under

5,000

between 5,000and under

10,000

more than10,000

MEMO©Monitoring Exchange Mobility OutcomesUwe Brandenburg | CHE Consult GmbHCGU Annual conference, Oulu / Finland, September 2012

19

The structure of MEMO

Measuring Exchange mobility outcome

Combined sociometric, satisfaction and psychometric tool

SociometricsDiversity of

outgoing cohort

SociometricsDiversity of

outgoing cohort

PerceptionsQuality of services,

international orientation

PerceptionsQuality of services,

international orientation

Psycho-metrics

Change of attitudes

Psycho-metrics

Change of attitudes


20

Do you want to know…

whom you send abroad?

what effect these stays have on the people?

where your students develop more, where less?

how you perform against your peers worldwide or in a group (anonymously of course)?

memo© has the answers …


21

Who participates …

30+ HEIs from around the world

15 countries

All continents: Europe, (North) America, Asia, Africa, Australia

All types: from large comprehensive over small private universities to universities of applied sciences


24

What it produces…

24

Sociometricresults

Who goesabroad,

biases, over-representation

s groups

Sociometricresults

Who goesabroad,

biases, over-representation

s groups

Perceptionresults

How are theservices

provided, whatis evaluatedwell/badly?

Perceptionresults

How are theservices

provided, whatis evaluatedwell/badly?

Pre-departure

psychome-tric resultsWhat are the

attitudes?

Pre-departure

psychome-tric resultsWhat are the

attitudes?

Post-returnpsychome-tric resultsWhat are the

new attitudes?

Post-returnpsychome-tric resultsWhat are the

new attitudes?

CHANGECHANGE

What remains unchanged?

Influence

Influence


25

Male students show development, but they…

0

2

4

6

8

10Factor 1: Confidence

Factor 2: Tolerance ofAmbiguity

Factor 3: Self‐Efficacy

Factor 4: Sociality

Factor 5: Vigor

Factor 6: Curiosity

Factor 7: Serenity

Factor 8: Decisiveness

Factor 9: Disputability

Factor 10: Resilience

MEMO

Male students: change

Pre Post statistically significant change


26

Slightly differ from female students…

0

2

4

6

8

10Factor 1: Confidence

Factor 2: Tolerance ofAmbiguity

Factor 3: Self‐Efficacy

Factor 4: Sociality

Factor 5: Vigor

Factor 6: Curiosity

Factor 7: Serenity

Factor 8: Decisiveness

Factor 9: Disputability

Factor 10: Resilience

MEMO

Change for female students

Pre Post statistically significant change


27

You could also analysis your entire network…


28

The memo© conference

First time 2013

25-26 June only for MEMO© partners

27 June for public audience

The internal conference will contain

Presentation of prelimiray results of the year (academic year not finished)

Presentation of some universities on good practices

Networking with other MEMO© partners


29

Where do I find more information?

www.impi-project.eu

www.memo-tool.net


Uwe Brandenburg | CHE Consult GmbH Rome, September 2012 · Uwe Brandenburg | CHE Consult GmbH Rome,...

Documents

Transcript of Uwe Brandenburg | CHE Consult GmbH Rome, September 2012 · Uwe Brandenburg | CHE Consult GmbH Rome,...