Anticipating Information Needs Based on Check-in...

24
Anticipating Information Needs Based on Check-in Activity Author: Jan R. Benetka , Krisztian Balog , Salvatore Giorgi, Kjetil Nørvåg Source: WSDM’17 Speaker: 游雅雯 Date: 2017/6/9

Transcript of Anticipating Information Needs Based on Check-in...

Page 1: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Anticipating Information Needs Based on Check-in

Activity

Author: Jan R. Benetka , Krisztian Balog , Salvatore Giorgi, Kjetil Nørvåg Source: WSDM’17 Speaker: 游雅雯 Date: 2017/6/9

Page 2: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Outline• Introduction

• (RQ1)Information Needs Related to Activities

• (RQ2)Analysis of Temporal Dynamics of Information Needs

• (RQ3)Anticipating Information Needs

• Conclusion

Page 3: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Introduction Zero-query Search

• using the person’s check-in activity as context

• anticipate information needs

• respond with a set of information cards

Page 4: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Introduction

Category is a very strong indicator of human activity

An activity, in the scope of this paper, is defined as a category of a point-of-interest (POI) that the user visited.

Page 5: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Introduction Research questions

RQ1) What are common information needs and their relevance in the context of different activities?

RQ2) Are information needs static or dynamic in time?

RQ3) How to rank future information needs given the last

activity of the user?

Page 6: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Introduction Flow Chart

R1

R2

R3

Page 7: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Outline• Introduction

• (RQ1)Information Needs Related to Activities

• (RQ2)Analysis of Temporal Dynamics of Information Needs

• (RQ3)Anticipating Information Needs

• Conclusion

Page 8: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Information Needs Related to Activities(RQ1)

Check-in data

• Foursquare Category Hierarchy

• Foursquare API

Collecting Query Suggestions

• Google Query Suggestion API

Page 9: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Information Needs Related to Activities(RQ1)

Normalization

• graph-based approach

• DPClus graph clustering algorithm

Determining relevance

Page 10: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Information Needs Related to Activities(RQ1)

Evaluation

• compare the extracted information needs against crowdsourced human judgments

Page 11: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Information Needs Related to Activities(RQ1)

Evaluation

Page 12: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Outline• Introduction

• (RQ1)Information Needs Related to Activities

• (RQ2)Analysis of Temporal Dynamics of Information Needs

• (RQ3)Anticipating Information Needs

• Conclusion

Page 13: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Analysis of Temporal Dynamics of Information Needs(R2)

Temporal scope

pre peri post

Page 14: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Analysis of Temporal Dynamics of Information Needs(R2)

Page 15: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Analysis of Temporal Dynamics of Information Needs(R2)

Evaluation

Page 16: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Analysis of Temporal Dynamics of Information Needs(R2)

Evaluation

temporal sensitivity (TS)

Page 17: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Outline• Introduction

• (RQ1)Information Needs Related to Activities

• (RQ2)Analysis of Temporal Dynamics of Information Needs

• (RQ3)Anticipating Information Needs

• Conclusion

Page 18: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Anticipating Information Needs(R3)

Anticipation of user's future information needs given her last activity

Page 19: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Anticipating Information Needs(R3)

transition probabilities

defined as activity session, where any two consecutive activities are separated by a maximum of 6 hours

Page 20: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Anticipating Information Needs(R3)

Proposed Models

• M1 Consider all possible upcoming activity

• M2 Consider influence of the last activity

Page 21: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Anticipating Information Needs(R3)

Proposed Models

• M3 Consider the temporal dynamics of each information need individually

Page 22: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Anticipating Information Needs(R3)

Evaluation

I.the check-in data are split into training and testing set

II.activity-to-activity transition probabilities

III.Crowd judges are tasked with evaluating the usefulness of individual information needs

Page 23: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

Anticipating Information Needs(R3)

Evaluation

context-agnostic model M0, which always returns the most frequent information needs

Page 24: Anticipating Information Needs Based on Check-in Activity184pc128.csie.ntnu.edu.tw/presentation/17-06-06... · Anticipating Information Needs Based on Check-in Activity Author: Jan

ConclusionA method for obtaining information needs and determining their relevance for various activities without relying directly on a large-scale search log

A detailed analysis of how the relevance of information needs changes over the course of an activity for different categories of activities

In a simulation experiment on historical check-ins combined with human judgments, we have shown that our models have good predictive performance