Information Systems Success Awareness for Professional Long Tail Communities of Practice
-
Upload
dominik-renzel -
Category
Science
-
view
61 -
download
0
Transcript of Information Systems Success Awareness for Professional Long Tail Communities of Practice
![Page 1: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/1.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-1 This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International Public License.
Information Systems Success Awareness for Professional
Long Tail Communities of PracticeDipl.-Inform. Dominik Renzel
Doctoral Thesis DefenseChair of Computer Science 5 – Information Systems & Databases
RWTH Aachen University
Aachen, GermanyJuly 12, 2016
![Page 2: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/2.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-2
Agenda
IntroductionMobSOS CIS Success Awareness Framework
– Methodology– Formalization– Technical Infrastructure
Longitudinal Studies & FindingsConclusion & Outlook
![Page 3: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/3.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-3
IntroductionIntroduction
Motivating Examples Terminology Research Problem & Questions
![Page 4: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/4.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-4
Small-Scale Example – Aphasics Group Chat Tool (DESRIST 2015)
Success?Quality? Impact?
Simple?Responsive?Reliable?Deployable?
Helps regain skills?Avoids isolation?Augments therapy?Unforeseen effects?
Success
Success Success
Introduction
![Page 5: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/5.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-5
How to measure & stay aware of success in/across highly distributed
& heterogeneous communities using mobile Web technologies on
a massive scale over time?
Large-Scale Heterogeneity & Dynamicity – ROLE Sandbox (EC-TEL 2015)
Introduction
Success? Success?Success?
![Page 6: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/6.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-6
Community of Practice, Long Tail & Community Information Systems
Community of Practice (CoP) [Weng98]
Technology
People
Rules
“A group of people who share a concern or a passion for
something they do and learn how to do it better as they
interact regularly.”
[Ande06]
Introduction
Learning requires reflection & awareness of CIS Success!
![Page 7: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/7.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-7
Related Work
Web Science
IS Success
IS Design
Research Framework [HMPR04]
Methodology [PTRC07,SHP*11]
Models [DeMc92,GSCh08,CKAb14]
Formalization [JMPo03,SBGe04]
Web Engineering [GJHV95,Fiel00] Web Analytics [Kaus10,CCSt12,Evan12]Introduction
![Page 8: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/8.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-8
Related Work
Web Science
IS Success
IS Design
Research Framework [HMPR04]
Methodology [PTRC07,SHP*11]
But: implicit success notion Models [DeMc92,GSCh08,CKAb14]
Formalization [JMPo03,SBGe04]
But: positivist paradigm,myopic financial focus
Web Engineering [GJHV95,Fiel00] Web Analytics [Kaus10,CCSt12,Evan12]
But: analytics infrastructure & strategy corporate secret
Introduction
![Page 9: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/9.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-9
General Idea
For us, success is…
Introduction
From main-stream, centralized & secret corporate business analytics to long-tail, scalable, distributed, open negotiation of CIS success
![Page 10: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/10.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-10
Research Questions & Contributions
RQ1: How can professional long tail communities of practice achieve a shared sense of CIS success awareness with the help of a media-supported and negotiation-based methodology?
RQ2: What formalization should communities use to model CIS success? How can communities formalize the assessment, negotiation, and validation of different notions of CIS success?
RQ3: How should technical infrastructure for community information systems be designed to achieve integrated support for CIS success awareness?
MobSOS CIS Success Awareness Framework
Introduction
![Page 11: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/11.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-11
MobSOS MethodologyMobSOS
Methodology
Community-Oriented Design Research Media-Supported CIS Success Negotiation
RQ1: How can professional long tail communities of practice achieve a shared sense of CIS success awareness with the help of a media-supported and negotiation-based methodology?
![Page 12: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/12.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-12
Design Science Research in Information Systems [HMPR04]
MobSOSMethodology
![Page 13: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/13.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-13
Community-Oriented Design Science Research (DESRIST 2015)
MobSOSMethodology
![Page 14: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/14.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-14
CIS Success Modeling & Negotiation as Media Transcription [JJKS08,Klam10]
MobSOSMethodology
![Page 15: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/15.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-15
MobSOS Formalization Framework CIS Success Model Formalization CIS Success Model Validation
RQ2: What formalization should communities use to model CIS success? How can communities formalize the assessment, negotiation, and validation of different notions of CIS success?
MobSOSFormalization
Framework
![Page 16: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/16.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-16
Formal CIS Success Models – Structural Model (DESRIST 2015)
MobSOSFormalization
FrameworkExplo
re
Validate
Adapt
IS-Impact Model, Formative Index [GSCh08,JMPo02]
![Page 17: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/17.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-17
Formal CIS Success Models – Measurement Model
Model:
Metrics:
MobSOSFormalization
Framework
![Page 18: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/18.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-18
CIS Success Model Validation – Ordinal Logistic Regression
Literature: multiple (linear) regression [DiWi01,PSRa07]
But: metrics violate assumptions (linearity, homoskedacity, normality, scales) Better: ordinal logistic regression [Agre01]
Interpretation: odds & probabilities Statistics:
– Model: fit– Effect Strengths– Significances
MobSOSFormalization
Framework
![Page 19: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/19.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-19
MobSOS Technical Infrastructure CIS Success-Aware Community Platform MobSOS Service Tool Kit
RQ3: How should technical infrastructure for community information systems be designed to achieve integrated support for CIS success awareness?
MobSOSTechnical
Infrastructure
![Page 20: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/20.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-20
Success-Aware CIS Platform (WISMA 2008, ICSC 2009)
MobSOSTechnical
Infrastructure
![Page 21: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/21.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-21
Usage Data Collection & Enrichment – MobSOS Pipeline (LAK 2013)
MobSOSTechnical
Infrastructure
Reverse Proxy & Pipeline Pattern: [Somm02,GHJV95]
![Page 22: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/22.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-22
Exploration by Visual Analytics – MobSOS QV (I-Know 2012)
Visualization Authoring Visual AnalyticsWidgets & Dashboards
MobSOSTechnical
Infrastructure
![Page 23: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/23.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-23
Evaluation Products for Awareness – MobSOS Success Model Service
MobSOSTechnical
Infrastructure
![Page 24: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/24.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-24
Longitudinal Studies & FindingsCase Studies
&Findings
2004 – 2015: SOCRATES – Aphasia Therapy (DFG SFB 427) 2008 – 2016: ROLE SDK – Self-Regulated Learning (ROLE) (6 more studies in thesis)
![Page 25: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/25.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-25
SOCRATESX – Aphasia Therapy(DESRIST 2015)
Case Studies&
Findings
![Page 26: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/26.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-26
SOCRATESX – Aphasia Therapy(DESRIST 2015)
Group chat tool incl. word completion
German aphasia patients (N>200) + therapists, linguists, computer scientists
Chat protocol logs & survey responses(1 yr.)
Compact success model? Mineable from protocol logs? Benefits?
Case Studies&
Findings
![Page 27: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/27.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-27
SOCRATESX – Optimizing Designwith System Quality Metrics
Case Studies&
Findings
High hit rate (HR) & low keystrokes until prediction (KUP)
5 candidates good size for word completion list
![Page 28: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/28.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-28
SOCRATESX – Measuring Individual & Community Impacts
Patients improve individual performance Community as whole improves performance Positive impacts traceably measurable
Case Studies&
Findings
![Page 29: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/29.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-29
SOCRATESX CIS Success Model (DESRIST 2015)
Case Studies&
Findings
![Page 30: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/30.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-30
CIS Success Models – General Target Characteristics
Sharply focused scope
Handful of most relevant factors
Balance universal vs. community-specific factors
Majority of quality & impact dimensions reflected
Actionable support for agency
Case Studies&
Findings
![Page 31: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/31.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-31
ROLE Sandbox – Analyzing Self-Regulated Learning (LAK 2013, ICWL 2015)
Background: planning, building & reflection of personal learning environments (PLE) essential activities for self-regulated learning (SRL) [Zimm02,NKR*14a].
Case Studies&
Findings
![Page 32: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/32.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-32
ROLE Sandbox – Analyzing Self-Regulated Learning (LAK 2013, ICWL 2015)
PLE management platform, learning spaces & learning widgets
Widget developers, learners, teachers, researchers (N>10.000)
Context-enriched PLE management logs (>3 yrs.)
Self-regulated learning activity traceable in PLE? Learner classification? Recommendations?
Case Studies&
Findings
![Page 33: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/33.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-33
Category-Based Recommendations for Self-Regulated Learners (ICWL 2015)
In SRL-Spaces: Intense use of recommendations Interesting evaluation contexts Improve recommendations by complete categorization
Case Studies&
Findings
![Page 34: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/34.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-34
Measuring Networking Impact of ROLE SDK with SNA Metrics
Case Studies&
Findings
![Page 35: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/35.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-35
Conclusion & Outlook
Conclusion&
Outlook
![Page 36: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/36.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-36
Major Contributions
Anti-positivist methodology for media-based CIS success negotiation as guidance for CIS design
Digital media representation & validation of fluid CIS success models capturing qualitative & quantitative aspects from multiple heterogeneous data sourcesRobust, scalable & extensible Open Source Software framework based on established patterns & cutting-edge mobile Web technologies
MobSOS CIS Success Awareness Framework
![Page 37: Information Systems Success Awareness for Professional Long Tail Communities of Practice](https://reader035.fdocuments.in/reader035/viewer/2022070521/58efaf461a28ab1f1f8b46ab/html5/thumbnails/37.jpg)
Lehrstuhl Informatik 5(Information Systems)
Prof. Dr. M. JarkeI5-Renzel-0716-37
Possible Avenues for Future Work
Conclusion&
Outlook
Standard ACIS thesis evaluation framework
Social software for CIS success negotiation
Integrated early-phase RE & CIS success modeling
CIS success-driven recommender systems
Automated metric exploration by machine learning
Cross-community CIS success analytics