Multi Source Feedback. An Essential Tool for Enhancing ...

42
Multi Source Feedback. An Essential Tool for Enhancing Student Learning and Enriching Future Education Presentation to Bluenote EMEA Conference 2018 6-7 November 2018 Esam Agamy Dean, QA, IE and Accreditation Hiba Jadallah Data Analyst

Transcript of Multi Source Feedback. An Essential Tool for Enhancing ...

Page 1: Multi Source Feedback. An Essential Tool for Enhancing ...

Multi Source Feedback. An Essential Tool for Enhancing Student Learning and Enriching Future

Education

Presentation to Bluenote EMEA Conference 2018

6-7 November 2018

Esam Agamy

Dean, QA, IE and Accreditation

Hiba Jadallah

Data Analyst

Page 2: Multi Source Feedback. An Essential Tool for Enhancing ...

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

Page 3: Multi Source Feedback. An Essential Tool for Enhancing ...

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

Page 4: Multi Source Feedback. An Essential Tool for Enhancing ...
Page 5: Multi Source Feedback. An Essential Tool for Enhancing ...

0

2

4

6

8

10

12

14

16

97-98 98-99 99-00 00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09 09-10

1. Shari’a & Law

2. Arts & Sciences

3. Business Admin.

4. Engineering

6. Fine Arts

12. Community

13. Graduate Studies &

Scientific Research

Launching

Khorfakkan

Campus

9. Medicine

10. Dentistry

11. Pharmacy 14. Sciences

Development of University Campuses and Colleges

5. Health Sciences

Launching

Kalba Campus7. Communication

8. Law

Page 6: Multi Source Feedback. An Essential Tool for Enhancing ...

University of Sharjah Campuses

Main campusFine Arts & Design

CampusMedical Campus

Community College

Community College

Community College

Community College

Univ. Branch

Community College

Kalba

Diba

Khor Fakkan

Al Malaiha

Sharjah

160 km

Al Dhaid

Page 7: Multi Source Feedback. An Essential Tool for Enhancing ...

Academic Programs Offered at the University

Program Level Number

Bachelor 52Undergraduate Diploma 14

Graduate Diploma 01

Masters 21Doctorate 11

Total 99

Page 8: Multi Source Feedback. An Essential Tool for Enhancing ...

8

86979199

9694

1083311513

1244813300

1381114325

1507315301

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

08-09 09-10 10-11 11-12 12-13 13-14 14-15 15-16 16-17 17-18 18-19

Total Enrolled Students

Page 9: Multi Source Feedback. An Essential Tool for Enhancing ...

255

448542

693807

1349

11201281

13991464

1837

2050

1753

2041

2285

27082700

0

500

1000

1500

2000

2500

3000

00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09 09-10 10-11 11-12 12-13 13-14 14-15 15-16 16-17

Graduated Students

The University graduated 26,900 students by the end of 2017/2018

Page 10: Multi Source Feedback. An Essential Tool for Enhancing ...

64.4%

39.4%

41.1%

8.3%

10.8%

10.7%

20.3%

40.1%

38.8%

6.9%

9.6%

9.4%

Graduate

Undergraduate

University Total

Enrolled Students by Nationality

UAE GCC Other Arabs Others

University students come from 98

different nationalities10

Page 11: Multi Source Feedback. An Essential Tool for Enhancing ...

Medical & Health

Sciences Sector

Fine Arts &

Design Sector

Community College

Sector

Subject Based

Programs Sector

UoS Education Systems according to Curriculum

Structure and Main Delivery Methods

Integrated curricula

PBL/TBL

Clinical rotation

Modules

Creative work

Hands on

experience

Vocational training

Subject based

lectures and

practicals

Almost one

instructor per

subject

Semester wise

Multi instructor

modules

May lat for more

than a year

3 phases program

PBL/TBL weekly

sessions

10 week rotations

Workshops and

practical sessions

Field work

11

Page 12: Multi Source Feedback. An Essential Tool for Enhancing ...

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

Page 13: Multi Source Feedback. An Essential Tool for Enhancing ...

13

(1) formative decisions and feedback

about teaching improvement;

(2) summative decisions and feedback

for merit pay and contract renewal;

and

(3) formative decisions and feedback

about professional behaviors in the

academic setting.

MSF models allow:

Page 14: Multi Source Feedback. An Essential Tool for Enhancing ...

14

can be configured for faculty to obtain feedback for

formative and summative decisions on teaching

performance

can be adapted to provide feedback on

professional behaviors of faculty in the academic

as well as clinical setting.

can provide more accurate, reliable, fair, and

equitable decisions than the one based on just a

single source.

Page 15: Multi Source Feedback. An Essential Tool for Enhancing ...

15

Multisource ratings Quality feedback

Action plan to Improve Improved

performance

Timely standardized

administration, processing,

interpretation, and feedback the.

Most significant practical concerns

Page 16: Multi Source Feedback. An Essential Tool for Enhancing ...
Page 17: Multi Source Feedback. An Essential Tool for Enhancing ...

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

Page 18: Multi Source Feedback. An Essential Tool for Enhancing ...

18

Student senior exit survey

Student satisfaction survey

Alumni survey

Employer survey

Faculty feedback

Accreditation bodies feedback

Advisory boards

External evaluators

Feedback tools

Page 19: Multi Source Feedback. An Essential Tool for Enhancing ...

Portfolios used at UoS

Course e-portfolio

Program e-portfolio

Faculty e-portfolio

Field Placement/Practical training/Internship e-portfolio

Page 20: Multi Source Feedback. An Essential Tool for Enhancing ...

20

Program e-portfolio

Page 21: Multi Source Feedback. An Essential Tool for Enhancing ...

21

Page 22: Multi Source Feedback. An Essential Tool for Enhancing ...

22

Page 23: Multi Source Feedback. An Essential Tool for Enhancing ...

23

Page 24: Multi Source Feedback. An Essential Tool for Enhancing ...

24

Course e-portfolio

Page 25: Multi Source Feedback. An Essential Tool for Enhancing ...

25

Page 26: Multi Source Feedback. An Essential Tool for Enhancing ...

26

Page 27: Multi Source Feedback. An Essential Tool for Enhancing ...

27

Page 28: Multi Source Feedback. An Essential Tool for Enhancing ...

28

Page 29: Multi Source Feedback. An Essential Tool for Enhancing ...

29

Page 30: Multi Source Feedback. An Essential Tool for Enhancing ...
Page 31: Multi Source Feedback. An Essential Tool for Enhancing ...

SIS

(Banner)

Course delivery

platform

(Blackboard)

HR

System

(Logsis)

Survey

system

(Blue)

Assessment

Management

System

Administration

(Chancellor, VCs,

Deans, etc.)

Faculty

Staff

StudentsIR tools

(crystal report,

templates,

forms, etc.)

Inte

gra

tion

, re

port

ing,

etc

.

Institutional Effectiveness System

Public

Using IT to stimulate:

• Engagement

• Transparency

• E-portfolios

• Communication

• Effectiveness

• Quality culture

31

Page 32: Multi Source Feedback. An Essential Tool for Enhancing ...

Semester 1

Sem. 2

Sem. 3

Sem. 4

Sem. 5

Sem. 6

Sem. 7

Sem. 8

Program Advisory Board

Alumni

Employers

An

aly

sis of o

utco

me a

chiev

emen

t (Institu

tion

al

Resea

rch)

Dev

elo

pm

ent

of

ob

ject

ives

, cu

rric

ulu

m,

tea

chin

g &

learn

ing

to

ols

& m

eth

od

s

Survey

Survey

Consultation

Summative Test

Formative Test

Element

Graduation Project

External Evaluation Reports

Student Exit Survey

Chart for Program Outcomes Assessment

(8 Semester Model)

Internship

Student Portfolio

Course Evaluation by faculty

Course Evaluation by Students

Midterm exam

Quizzes

Project

Report and Essay

Presentation

Tools of Assess/Evaluation

Page 33: Multi Source Feedback. An Essential Tool for Enhancing ...

• Artificial

Intelligence

• Computing

• Advanced skills

• Innovation

• Entrepreneurship

• Health care

• Space

UAE National Agenda

Page 34: Multi Source Feedback. An Essential Tool for Enhancing ...
Page 35: Multi Source Feedback. An Essential Tool for Enhancing ...

CHOICE

INTEG-

RATION

APPLICATION

SYNTHESIS

ANALYSIS

COMMUNICATION

INFORMATION DATA KNOWLEDGE

OUTCOMES

• creativity

• research

• problem solving

• problem identification

• teaching / training

• self learning

• team work

• leadership

INPUTS

• community needs

• user expectations

• experience

• culture

• value

• ethics

• autonomous learning

• team work

• critical approach

ELEMENTS OF HIGHER EDUCATION

ENABLING SKILLS• logic / analysis

• interpersonal

• technical / physical

Page 36: Multi Source Feedback. An Essential Tool for Enhancing ...

Integration of:

- Research into curricula

- Teaching/learning/assessment

into curricula

- Information Technology into

curricula and services

- Entrepreneurship and

Innovation into education

Current and Future Education

Page 37: Multi Source Feedback. An Essential Tool for Enhancing ...

Interdisciplinary

- Research

- Programs

- Activities

Alumni relations

Supporting Policies and

Procedures

Logistic support services

Current and Future Education

Page 38: Multi Source Feedback. An Essential Tool for Enhancing ...

Integration

Page 39: Multi Source Feedback. An Essential Tool for Enhancing ...

THANK YOU

39

Page 40: Multi Source Feedback. An Essential Tool for Enhancing ...

Characteristics of a good Assessment System

• Linked to student learning outcomes

• Ongoing (Continuous)

• Formative vs. summative balance

• Assessment drives learning/Assessment for learning

• Transparent to all parties concerned

• Engage faculty

• Engage students

• Immediate feedback

• Lead to closing the loop

40

Page 41: Multi Source Feedback. An Essential Tool for Enhancing ...

41

Declared

Curriculum

Delivered

Curriculum

Learned

Curriculum

Gap in curriculum design/delivery/learning

What we assume/claim student learn What is actually presented

What student actually learn

Page 42: Multi Source Feedback. An Essential Tool for Enhancing ...

42

Declared

Curriculum

Delivered

Curriculum

Learned

Curriculum

More overlap is needed

What we assume/claim student learn What is actually presented

What student actually learn