Yelp Refiner Lightning Talk

Post on 13-Apr-2017

34 views 0 download

Transcript of Yelp Refiner Lightning Talk

YELP REVIEWSMAKING HEADS OR TAILS OF

THE [FOOD] GET[S] A 5 STAR FROM ME, BUT, SADLY, THE SERVICE BRINGS IT DOWN TO A 3.

Yelp Review

THE PROBLEM

GOAL

MAKE YELP MORE USEFUL

GOAL

MAKE YELP MORE USEFUL

▸ More clarity

GOAL

MAKE YELP MORE USEFUL

▸ More clarity

▸ Easier to make decisions

GOAL

MAKE YELP MORE USEFUL

▸ More clarity

▸ Easier to make decisions

▸ Less scrolling

GOAL

MAKE YELP MORE USEFUL

▸ More clarity

▸ Easier to make decisions

▸ Less scrolling

DATASET

YELP DATASET CHALLENGE

▸2.7M Reviews

▸649K Tips

▸687K Users

▸86K Businesses

PREDICT CATEGORIES + SENTIMENTS

MODEL GOAL:

LATENT DIRICHLET ALLOCATION

OUTPUTS

OUTPUTS

▸ “Topics”

OUTPUTS

▸ “Topics”

▸ Top words in each topic

Car, vehicle, tires, drive, …

OUTPUTS

▸ “Topics”

▸ Top words in each topic

Car, vehicle, tires, drive, …

▸ Topic proportions for each “document”

40% Topic 1, 30% Topic 2, 15% Topic 3, …

MODIFICATIONS

MODIFICATIONS▸ “Codewords”

Positive and negative adjectives (nltk)

(Jack Linshi, 2014 Yelp Dataset Challenge winner)

MODIFICATIONS▸ “Codewords”

Positive and negative adjectives (nltk)

(Jack Linshi, 2014 Yelp Dataset Challenge winner)

▸ “Foodwords” Food-related nouns

TEST RESTAURANTS

FOUR RESTAURANTS

Restaurant 1 Restaurant 2 Restaurant 3 Restaurant 4

Mexican Italian Mexican Pizza

4.2 Stars 3.0 Stars 3.0 Stars 3.0 Stars

49 reviews 19 reviews 20 reviews 20 reviews

MANUAL CODING

“GOOD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

78%

58%

65%

50%

57%

47%

55%

40%

MANUAL CODING

“GOOD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

20%

26%

35%

35%

20%

32%

25%

35%

MANUAL CODING

“BAD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD FOOD” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

39% 43%

26%16%

40% 20%

10% 15%

MANUAL CODING

“GOOD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“GOOD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

4% 4%

21%16%

10% 15%

15% 25%

MANUAL CODING

“BAD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD SERVICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD PRICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

0% 18%

11%11%

5% 15%

5% 15%

MANUAL CODING

“BAD PRICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD PRICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD PRICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD PRICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4

MANUAL CODING

“BAD PRICE” REVIEWSLDA CODING

Rest 1

Rest 2

Rest 3

Rest 4