Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik...
Transcript of Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik...
![Page 1: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/1.jpg)
Comparing Cohorts of Event Sequences
presented by Sana Malik
with Fan Du, Catherine Plaisant, and Ben Shneiderman
May 26, 2016 — HCIL 33rd Annual Symposium, College Park
A VISUAL ANALYTICS APPROACH
![Page 2: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/2.jpg)
often, analysts compare cohorts within datasets
![Page 3: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/3.jpg)
any groups
of users,
patients,
or records
often, analysts compare cohorts within datasets
![Page 4: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/4.jpg)
![Page 5: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/5.jpg)
![Page 6: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/6.jpg)
?
![Page 7: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/7.jpg)
FREQUENT PATTERNS
![Page 8: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/8.jpg)
ABSENCE OF EVENTS
![Page 9: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/9.jpg)
DURATION
![Page 10: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/10.jpg)
StatisticsCohort SelectionData Collection
![Page 11: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/11.jpg)
StatisticsVisual AnalyticsCohort SelectionData Collection
![Page 12: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/12.jpg)
Cohort Selection StatisticsData Collection Visual Analytics
![Page 13: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/13.jpg)
Monroe et al. Temporal event sequence simplification. IEEE Transactions on Visualization and Computer Graphics (TVCG 2013).
EVENTFLOW
![Page 14: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/14.jpg)
Monroe et al. Temporal event sequence simplification. IEEE Transactions on Visualization and Computer Graphics (TVCG 2013).
EVENTFLOW
![Page 15: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/15.jpg)
Monroe et al. Temporal event sequence simplification. IEEE Transactions on Visualization and Computer Graphics (TVCG 2013).
EVENTFLOW
?
![Page 16: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/16.jpg)
Cohort Selection StatisticsData Collection Visual Analytics
![Page 17: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/17.jpg)
Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Exit 38.37, 0.0, 4.11e-123 Emergency -> ICU -> Exit 24.61, 0.0, 2.11e-73 Emergency -> Normal Floor Bed -> Exit -> ICU 5.26, 0.0, 4.12e-15 Emergency -> Normal Floor Bed -> ICU -> Exit 5.26, 0.0, 4.12e-15 Aspirin -> Emergency -> ICU -> Normal Floor Bed -> Exit 7.89, 3.22, 1.20e-06 Aspirin -> Emergency -> ICU -> Intermediate Care -> Exit 4.15, 0.0, 4.22e-12 Emergency -> Normal Floor Bed -> ICU -> Intermediate Care -> Exit 2.97, 0.0, 7.02e-09 Aspirin -> Emergency -> ICU -> Exit 2.80, 0.0, 2.02e-08 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 1.44, 0.0, 9.83e-05 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 1.01, 0.0, 0.00 Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Intermediate Care -> Exit 0.76, 0.0, 0.00 Aspirin -> Emergency -> Normal Floor Bed -> Exit 0.0, 1.61, 3.37e-05 Aspirin -> Emergency -> ICU -> Normal Floor Bed -> ICU -> Exit 0.0, 2.37, 2.84e-07 Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 3.82, 6.45, 0.00 Emergency -> ICU -> Normal Floor Bed -> ICU -> Exit 0.0, 4.07, 7.17e-12 Emergency -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 0.0, 4.24, 2.48e-12 Emergency -> Exit 0.0, 11.88, 9.00e-34 Emergency -> ICU -> Normal Floor Bed -> Exit 0.0, 16.12, 2.18e-46 Aspirin -> Emergency -> Exit 0.0, 47.79, 2.49e-162 Aspirin -> Emergency -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 0.0, 0.59, 0.02 Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit Aspirin -> Emergency -> ICU -> Exit 2.80, 0.0, 2.02e-08 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 1.44, 0.0, 9.83e-05 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU ->
![Page 18: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/18.jpg)
5.26, 0.0, 4.12e-15 Emergency -> Normal Floor Bed -> ICU -> Exit 5.26, 0.0, 4.12e-15 Aspirin -> Emergency -> ICU -> Normal Floor Bed -> Exit 7.89, 3.22, 1.20e-06 Aspirin -> Emergency -> ICU -> Intermediate Care -> Exit 4.15, 0.0, 4.22e-12 Emergency -> Normal Floor Bed -> ICU -> Intermediate Care -> Exit 2.97, 0.0, 7.02e-09 Aspirin -> Emergency -> ICU -> Exit 2.80, 0.0, 2.02e-08 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 1.44, 0.0, 9.83e-05 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 1.01, 0.0, 0.00 Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Intermediate Care -> Exit 0.76, 0.0, 0.00 Aspirin -> Emergency -> Normal Floor Bed -> Exit 0.0, 1.61, 3.37e-05 Aspirin -> Emergency -> ICU -> Normal Floor Bed -> ICU -> Exit 0.0, 2.37, 2.84e-07 Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 3.82, 6.45, 0.00 Emergency -> ICU -> Normal Floor Bed -> ICU -> Exit 0.0, 4.07, 7.17e-12 Emergency -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 0.0, 4.24, 2.48e-12 Emergency -> Exit 0.0, 11.88, 9.00e-34 Emergency -> ICU -> Normal Floor Bed -> Exit 0.0, 16.12, 2.18e-46 Aspirin -> Emergency -> Exit 0.0, 47.79, 2.49e-162 Aspirin -> Emergency -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 0.0, 0.59, 0.02 Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit Aspirin -> Emergency -> ICU -> Exit 2.80, 0.0, 2.02e-08 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 1.44, 0.0, 9.83e-05 Emergency -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> ICU -> Normal Floor Bed -> Exit 1.01, 0.0, 0.00 Aspirin -> Emergency -> Normal Floor Bed -> ICU -> Intermediate Care -> Exit 0.76, 0.0, 0.00 Aspirin -> Emergency -> Normal Floor Bed -> Exit 0.0, 1.61, 3.37e-05
![Page 19: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/19.jpg)
SAS Business Analytics Software. Vers. 9.4. SAS Institute, 2014. Computer software.
StataCorp. 2015. Stata Statistical Software: Release 14. College Station, TX: StataCorp LP.
SAS STATA
![Page 20: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/20.jpg)
StatisticsVisual AnalyticsCohort SelectionData Collection
![Page 21: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/21.jpg)
Cohort SelectionData Collection
Statistics
Visual Analytics
![Page 22: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/22.jpg)
![Page 23: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/23.jpg)
HIGH-VOLUMEHypothesis Testing
![Page 24: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/24.jpg)
HIGH-VOLUMEHypothesis Testing
OF RESULTSSystematic Exploration
![Page 25: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/25.jpg)
HIGH-VOLUMEHypothesis Testing
OF RESULTSSystematic Exploration
REAL-WORLDCase Study
![Page 26: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/26.jpg)
HIGH-VOLUMEHypothesis Testing
![Page 27: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/27.jpg)
![Page 28: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/28.jpg)
Emergency Room
![Page 29: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/29.jpg)
Normal Floor Bed
![Page 30: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/30.jpg)
ICU
![Page 31: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/31.jpg)
Discharged
![Page 32: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/32.jpg)
![Page 33: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/33.jpg)
start and end of record
![Page 34: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/34.jpg)
![Page 35: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/35.jpg)
![Page 36: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/36.jpg)
![Page 37: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/37.jpg)
![Page 38: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/38.jpg)
![Page 39: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/39.jpg)
non-consecutive (contains other events between)
![Page 40: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/40.jpg)
non-consecutive (contains other events between)
1 SHORT SEQUENCE
14 UNIQUE PATTERNS
![Page 41: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/41.jpg)
FREQUENCYOn average, does this sequence occur more frequently per record in one cohort than the other?
DURATIONOn average, does this sequence take longer in one cohort than the other?
RECORD COVERAGEDoes this sequence occur in more records in one cohort than the other?
![Page 42: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/42.jpg)
FREQUENCYOn average, does this sequence occur more frequently per user in one cohort than the other?
DURATIONOn average, does this sequence take longer in one cohort than the other?
RECORD COVERAGEDoes this sequence occur in more records in one cohort than the other? 14 UNIQUE PATTERNS
X 3 METRICS
42 HYPOTHESES
![Page 43: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/43.jpg)
HIGH-VOLUMEHypothesis Testing
OF RESULTSSystematic Exploration
REAL-WORLDCase Study
![Page 44: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/44.jpg)
OF RESULTSSystematic Exploration
![Page 45: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/45.jpg)
![Page 46: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/46.jpg)
Demo
![Page 47: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/47.jpg)
HIGH-VOLUMEHypothesis Testing
OF RESULTSSystematic Exploration
REAL-WORLDCase Study
![Page 48: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/48.jpg)
REAL-WORLDCase Study
![Page 49: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/49.jpg)
MULTI-DIMENSIONAL IN-DEPTH LONG-TERM CASE STUDIES (MILCS)
Entry Interview & Training (1 session)
Exit Interview (1 session)
Partners Use Tool
Partners Provide Feedback
Researchers Refine Tool
(3 months)
Papers, insights, discoveriesDemonstrate utility, refine tool
For Researchers For Partners
B. Shneiderman and C. Plaisant. Strategies for evaluating information visualization tools: Multi- dimensional in-depth long-term case studies. In BELIV ’06: Proceedings of the 2006 AVI workshop on BEyond time and errors, pages 1–7. ACM, 2006.
![Page 50: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/50.jpg)
CASE STUDY PARTNERS
![Page 51: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/51.jpg)
CASE STUDY PARTNERS
![Page 52: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/52.jpg)
Users’ events on a product website • viewing the display ads • signing up for promotions or free trials • purchasing products
PARTICIPANTS & DATASET
Three analysts at Adobe • One experienced user • Two novice users
Dataset Size • 6,999 users • 124 events types / 81,563 events
![Page 53: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/53.jpg)
Compare users who purchased a product with using trials versus without using trials
to understand ad-related behaviors
GOAL
![Page 54: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/54.jpg)
SYSTEM USE
![Page 55: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/55.jpg)
SYSTEM USE
![Page 56: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/56.jpg)
“Event filtering was the most helpful to focus the analysis”
SYSTEM USE
![Page 57: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/57.jpg)
“Reduced metric calculation time provided a much better user experience for data analysis”
SYSTEM USE
![Page 58: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/58.jpg)
Users who had a trial viewed display ads more than the other group & contained more retargeting events. Analysts hypothesized trial users were “explorers” and non-trial users were “experienced users” based on event pattern differences
RESULTS: FOR PARTNERS
![Page 59: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/59.jpg)
HIGH-VOLUMEHypothesis Testing
OF RESULTSSystematic Exploration
REAL-WORLDCase Study
Future Work
• Extensions to other data types (e.g., networks)
• Interval events
• Cohort selection
![Page 60: Comparing Cohorts of Event SequencesComparing Cohorts of Event Sequences presented by Sana Malik with Fan Du, Catherine Plaisant, and Ben Shneiderman May 26, 2016 — HCIL 33rd Annual](https://reader033.fdocuments.in/reader033/viewer/2022060412/5f11359697d10d685c2b71b6/html5/thumbnails/60.jpg)
presented by Sana Malik
email [email protected]
www http://hcil.umd.edu/coco
Support from Adobe, Oracle, and the University of Maryland’s Center for Health-related Informatics & Bioimaging (CHIB).
Comparing Cohorts of Event Sequences
A VISUAL ANALYTICS APPROACH
TRY COCO!