TagFlip: Active Mobile Music Discovery with Social Tags

45
Active Mobile Music Discovery with Social Tags Torsten Möller IUI 2016 March 2016, Sonoma, CA Mohsen Kamalzadeh Christoph Kralj Michael Sedlmair TagFlip

Transcript of TagFlip: Active Mobile Music Discovery with Social Tags

Page 1: TagFlip: Active Mobile Music Discovery with Social Tags

Active Mobile Music Discovery with Social Tags

Torsten Möller

IUI 2016 March 2016, Sonoma, CA

Mohsen Kamalzadeh

Christoph Kralj Michael Sedlmair

TagFlip

Page 2: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

• online streaming services

• over 30 millions songs

• need 200 years to listen to everything!

• how to narrow down?

2

Page 3: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

play something nice for a while

exploration and discovery

3

how to narrow down?

Page 4: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

play something nice for a while

exploration and discovery

4

• radio stations • curated playlists • recommendation

how to narrow down?

Page 5: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

play something nice for a while

exploration and discovery

5

• radio stations • curated playlists • recommendation

• library visualization

• critiquing, weighting, etc.

how to narrow down?

Page 6: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

?6

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

Page 7: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

?7

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

Page 8: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

?8

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

• elaborate interfaces

• large screens • for long sessions

Page 9: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

• elaborate interfaces

• large screens • for long sessions

?9

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

Pu and Chen, 2006

Page 10: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

• elaborate interfaces

• large screens • for long sessions

?10

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

Pampalk and Goto, 2007

Page 11: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

• elaborate interfaces

• large screens • for long sessions

?11

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

O’Donovan et al., 2008

Page 12: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

• elaborate interfaces

• large screens • for long sessions

?12

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

Bostandjiev et al., 2012

Page 13: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

?13

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

• elaborate interfaces

• large screens • for long sessions

Page 14: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

14

play something nice for a while

• radio stations • curated playlists • recommendation

exploration and discovery

• library visualization

• critiquing, weighting, etc.

• not much control • black box

problem • pigeon-holing

TagFlip

?

• elaborate interfaces

• large screens • for long sessions

Page 15: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

15

TagFlip

high user control +

low interaction effort +

small screen

Page 16: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

TagFlip

Contributions:

• Design and evaluation of a tag-based interactive recommendation interface

• Design choices, lessons, and future directions

• Strengths of tag-based discovery

16

Page 17: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

17

Design

Page 18: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

• High level abstraction over music library • Understandable to ordinary users • Navigate based on social tags

• genre • mood • location • year • instruments • etc.

• 100,000 songs • 350 tags (processed from 500,000) • Android

18

TagFlip

Page 19: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

19

Page 20: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

20

• High impact interaction • Fine tuning/precise control • Low interaction effort and mental load • Transparency • Small screen

key design factors

Page 21: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

21

• left to right flow

design choices

Iterative user-centred design

Page 22: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

22

• left to right flow

design choices

Iterative user-centred design

Page 23: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

23

• left to right flow • tag strength

design choices

Iterative user-centred design

Page 24: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

24

• left to right flow • tag strength

design choices

Iterative user-centred design

Page 25: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

25

• left to right flow • tag strength • communicating target set sizes

design choices

Iterative user-centred design

Page 26: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

26

• left to right flow • tag strength • communicating target set sizes • “excluding” tags

design choices

Iterative user-centred design

Page 27: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

27

Evaluation

Page 28: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

• Is there room for this type of interface? • compared with Spotify’s mobile app • within subjects • 16 users (8 female), median age = 26

28

Evaluation

Page 29: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

29

• with each app: - alternating order of apps - 5 minutes familiarization - 10 minutes test

- find new songs that you like - use any feature of apps

- usability and recommendation questionnaires

• post-hoc interview

Protocol

Page 30: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

30

questionnaires video captureinterview

evaluation data

Page 31: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

31

questionnaires video captureinterview

evaluation data

• Usability - SUS questionnaire

• Recommendation • Based on ResQue

framework (Pu and Chen, RecSys 2010)

Page 32: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

32

video captureinterview

evaluation data

• Usability - SUS questionnaire

• Recommendation • Based on ResQue

framework (Pu and Chen, RecSys 2010)

questionnaires

• Pros and cons of each app

Page 33: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

33

video capture

evaluation data

• Objective performance

interview

• Pros and cons of each app

• Usability - SUS questionnaire

• Recommendation • Based on ResQue

framework (Pu and Chen, RecSys 2010)

questionnaires

Page 34: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

34

Hypotheses

• H1: Higher overall score for TagFlip in rec. questionnaire

• H2: Smaller number of interactions per liked song in TagFlip

• H3: More liked songs with TagFlip

questionnaires video captureinterview

evaluation data

Page 35: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

1.Quality of recommendations

35

questionnaires

• Usability

• Recommendation

video captureinterview

2.Interface and interaction adequacy

3.Control and transparency

4.Attitudes and behavioural intentions (trust)

Page 36: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

0 1 2 3 4

2.67

2.26

2.33

2.29

2.51

3.03

2.83

2.72

2.48

3.03

TagFlip Spotify

36

questionnaires

2. Interface and interaction adequacy

1.Quality of recommendations

3.Control and transparency

4.Attitudes and behavioural intentions (trust)

scores from 0 to 4

video captureinterview

p values form paired sample t-test

questionnaires

• Usability

• Recommendationp<0.05

statistically significant*

All questions

p<0.05

p<0.05

p<0.05

Page 37: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

0 1 2 3 4

2.67

2.26

2.33

2.29

2.51

3.03

2.83

2.72

2.48

3.03

TagFlip Spotify

37

questionnaires

2. Interface and interaction adequacy

1.Quality of recommendations

3.Control and transparency

4.Attitudes and behavioural intentions (trust)

scores from 0 to 4

video captureinterview

• TagFlip sig. higher in • overall subjective recommendation capability

(Hypothesis 1 confirmed)

p values form paired sample t-test

questionnaires

• Usability

• Recommendationp<0.05

statistically significant*

All questions

p<0.05

p<0.05

p<0.05

Page 38: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

38

video capture

interview

• Objective performance

10 20 30 40

34.58

25.61interactions per liked

song

2 4 6 8 10

7.06

7number of liked songs

questionnaires

p<0.05

Page 39: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

39

video capture

interview

• Objective performance

10 20 30 40

34.58

25.61interactions per liked

song

2 4 6 8 10

7.06

7number of liked songs

questionnaires

p<0.05

• TagFlip needed sig. less interaction (H2 confirmed)

• Equal number of liked songs (H3 not confirmed

Page 40: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

video capture

interview

40

• pros: • precise control (all 16

participants) • fine-tuning (11)

• cons: • Spotify better for passive

listening (8)

• 7 participants very enthusiastic • 7 other participants open to using

questionnaires

Page 41: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

video capturequestionnaires interview

• Higher overall satisfaction with TagFlip

• High user control with TagFlip

• Lower interaction effort with TagFlip

• Fine-tuning ability is key in user enthusiasm

41

Page 42: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

42

Conclusion

Page 43: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

43

• stagnant mobile recommendation scene

• encouraging results with TagFlip

• great potential for tag-based interaction

Conclusion

Page 44: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

44

• design solutions to remaining problems

• excluding tags, tag strength, etc.

• longitudinal studies

• more advanced processing

• excluding music types?

• topic modelling

Future work

Page 45: TagFlip: Active Mobile Music Discovery with Social Tags

motivation design evaluation conclusion

45

Thank you!