Yelp Refiner Lightning Talk
49
YELP REVIEWS MAKING HEADS OR TAILS OF
-
Upload
christopher-pleasants -
Category
Data & Analytics
-
view
34 -
download
0
Transcript of Yelp Refiner Lightning Talk
YELP REVIEWSMAKING HEADS OR TAILS OF
THE [FOOD] GET[S] A 5 STAR FROM ME, BUT, SADLY, THE SERVICE BRINGS IT DOWN TO A 3.
Yelp Review
THE PROBLEM
GOAL
MAKE YELP MORE USEFUL
GOAL
MAKE YELP MORE USEFUL
▸ More clarity
GOAL
MAKE YELP MORE USEFUL
▸ More clarity
▸ Easier to make decisions
GOAL
MAKE YELP MORE USEFUL
▸ More clarity
▸ Easier to make decisions
▸ Less scrolling
GOAL
MAKE YELP MORE USEFUL
▸ More clarity
▸ Easier to make decisions
▸ Less scrolling
DATASET
YELP DATASET CHALLENGE
▸2.7M Reviews
▸649K Tips
▸687K Users
▸86K Businesses
PREDICT CATEGORIES + SENTIMENTS
MODEL GOAL:
LATENT DIRICHLET ALLOCATION
OUTPUTS
OUTPUTS
▸ “Topics”
OUTPUTS
▸ “Topics”
▸ Top words in each topic
Car, vehicle, tires, drive, …
OUTPUTS
▸ “Topics”
▸ Top words in each topic
Car, vehicle, tires, drive, …
▸ Topic proportions for each “document”
40% Topic 1, 30% Topic 2, 15% Topic 3, …
MODIFICATIONS
MODIFICATIONS▸ “Codewords”
Positive and negative adjectives (nltk)
(Jack Linshi, 2014 Yelp Dataset Challenge winner)
MODIFICATIONS▸ “Codewords”
Positive and negative adjectives (nltk)
(Jack Linshi, 2014 Yelp Dataset Challenge winner)
▸ “Foodwords” Food-related nouns
TEST RESTAURANTS
FOUR RESTAURANTS
Restaurant 1 Restaurant 2 Restaurant 3 Restaurant 4
Mexican Italian Mexican Pizza
4.2 Stars 3.0 Stars 3.0 Stars 3.0 Stars
49 reviews 19 reviews 20 reviews 20 reviews
MANUAL CODING
“GOOD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
78%
58%
65%
50%
57%
47%
55%
40%
MANUAL CODING
“GOOD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
20%
26%
35%
35%
20%
32%
25%
35%
MANUAL CODING
“BAD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD FOOD” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
39% 43%
26%16%
40% 20%
10% 15%
MANUAL CODING
“GOOD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“GOOD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
4% 4%
21%16%
10% 15%
15% 25%
MANUAL CODING
“BAD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD SERVICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD PRICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
0% 18%
11%11%
5% 15%
5% 15%
MANUAL CODING
“BAD PRICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD PRICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD PRICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD PRICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
MANUAL CODING
“BAD PRICE” REVIEWSLDA CODING
Rest 1
Rest 2
Rest 3
Rest 4
