Evaluation framework linkedup_amsterdam

Mo#va#on Data on the Web

Some eyecatching opener illustra#ng growth and or diversity of web data

25/05/12 1 Stefan Dietze

Design of an Evalua#on Framework for Open Web Data Applica#ons

Hendrik Drachsler, Slavi Stoyanov (The Open University of the Netherlands, NL): WP2 Lead

25 February 2013

LinkedUp Vision

2

Adopting open Web data, educational and cross-domain resources to provide educational services up to university degree-level in open and

distance education.

1) A domain-specific (educational) set of criteria

2) A generic set of criteria for the evaluation of open Web data applications.

“There is a substantial risk that the evaluation criteria are not adequately specified."

At what point are the criteria adequately specified?

When the stakeholders agree with the criteria.

25 February 2013 Hendrik Drachsler

Development of the Evalua#on Framework

3

P1: Initialisation P2: Establishment and Evaluation

P3: Exit and Sustainability

M0-M6: Preparation M7-M18: Competition cycle M18-M24: Finalising

Literature review Cognitive Mapping

Group Concept Mapping

Documentation Dissemination

EF proposal Expert validation

Final release

of EF

Competition

Review of EF

Refinement of EF

New versio

n

Draft 3x

Practical experiences and refinement


Development of the Evalua#on Framework

4 25 February 2013 Hendrik Drachsler

LinkedUp



6

•  Group Concept Mapping resembles the Post-it notes problem solving technique and Delphi method

•  GCM involves participants in a few simple activities (generating, sorting and rating of ideas) that most people are used to.

GCM is different in two substantial ways: 1. Robust analysis (MDS and HCA) GCM takes up the original participants contribution and then quantitatively aggregate it to show their collective view (as thematic clusters) 2. Visualisation GCM presents the results from the analysis as conceptual maps and other graphical representations (pattern matching and go-zones).



25 February 2013 7

•  innovations in way network is delivered •  (investigate) corporate/structural alignment •  assist in the development of non-traditional partnerships (Rehab with the

Medicine Community) •  expand investigation and knowledge of PSN'S/PSO's •  continue STHCS sponsored forums on public health issues (medicine

managed care forum) •  inventory assets of all participating agencies (providers, Venn Diagrams) •  access additional funds for telemedicine expansion •  better utilization of current technological bridge •  continued support by STHCS to member facilities •  expand and encourage utilization of interface programs to strengthen the

viability and to improve the health care delivery system (ie teleconference) •  discussion with CCHN

...organize the issues...

brainstorm

Work quickly and effectively under pressure

49

Organize the work when directions are

not specific. 39

Decide how to manage multiple

tasks. 20 Manage resources effectively.

4

sort

1 2

3 4

5

1 2

3 4

5

3 Scan a multitu

de of information and

decide what is important.

1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 Manage tim

e effectively

2 Manage resources effectively.

3 Scan a multitu

de of information

and decide what is important.

4 Decide how to manage multiple tasks.

5 Organize the work when directions are not specific.

1 Manage tim

e effectively

Rating Sheet

rate

Hendrik Drachsler


11





Work quickly and effectively under

pressure 49

Organize the work when directions are not

specific. 39



4

sort

1 2

3 4

5

1 2

3 4

5

3 Scan a multitu



1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 Manage tim

e effectively


3 Scan a multitu





1 Manage tim

e effectively

Rating Sheet

rate

organize

Management Financing

Regionalization

STHCS as model

Community & Consumer Views

Information Services Technology

…”map” the issues...



12


Regionalization

Mission & Ideology







Work quickly and effectively under

pressure 49

Organize the work when directions are not

specific. 39



4

sort

1 2

3 4

5

1 2

3 4

5

3 Scan a multitu



1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 2

3 4

5

1 Manage tim

e effectively


3 Scan a multitu





1 Manage tim

e effectively

Rating Sheet

rate

organize


Regionalization

STHCS as model



map

...prioritize the issues...



13

WP2 Progress

•  Invited 122 external experts •  56 experts contributed 212 indicators for the

evaluation framework •  After cleaning -> 108 indicators remained •  26 experts sorted on similarity in meaning •  26 experts rated on priority and

applicability



14

A point map



15

A cluster map 15



16

A cluster map 6



17

Clusters’ labels



18

Rating Map Priority



19

Rating Map Applicability



This silde is available at:http://www.slideshare.com/Drachsler

Email: [email protected]: celstec-hendrik.drachslerBlogging at: http://www.drachsler.deTwittering at: http://twitter.com/HDrachsler

Many thanks for your attention!

Evaluation framework linkedup_amsterdam

Business

Transcript of Evaluation framework linkedup_amsterdam