Measurecamp 6 session: Effective Customer Feedback & Measurement Frameworks
Open Analytics: Building Effective Frameworks for Social Media Analysis
-
Upload
ikanow -
Category
Technology
-
view
720 -
download
1
Transcript of Open Analytics: Building Effective Frameworks for Social Media Analysis
![Page 1: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/1.jpg)
Building Effective Frameworks for Social Media Analysis
Open Analytics NYC – 11/08/2012
![Page 2: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/2.jpg)
Agenda
• Social Media: An Intelligence perspective• Common Analytic Pitfalls• An Analytic Framework• Case Study: Brand Management– Problem Definition– Source Selection– Data Capture– Data Reporting– Data Analysis
• Ways Forward, Future Analysis• Questions?
![Page 3: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/3.jpg)
Intelligence
• Intelligence is information that has been transformed to meet an operational need
Data Intelligence
Operational Lens
![Page 4: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/4.jpg)
Intelligence Cycle
• No matter what methodology you use…
intelligence analysis is an iterative process.
Collect
Store
Analyze
Distribute
![Page 5: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/5.jpg)
Social Media: Intelligence Perspective
HUMINT
SIGINTOSINT
• Social Media Intelligence is a combination of the best and worst features of:– HUMINT– OSINT– SIGINT
![Page 6: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/6.jpg)
Social Media Analysis Goals
• Provide value to the organization – turn data into intelligence using an “operational lens”
• Ensure cyclical feedback occurs during collection, processing, analysis, and consumption
• Validate that a particular network is the right source of data for the questions you need answered
![Page 7: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/7.jpg)
Common Misconceptions
• Social media is not a panacea– Not everyone uses social media– Users of social media use it unevenly– User behavior changes based on situations
• Just because people can talk about anything does not mean they talk about everything all the time.
![Page 8: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/8.jpg)
Common Pitfalls
• Analyzing What Instead of Why:The important thing is often not what people are saying… but why they are saying it.
• Using the Wrong Analysis Tools:Reporting tools rarely help dig into the why. Many common tools, reports, and metrics are actually misleading:– Word clouds atomize message context– Sentiment metrics are often highly inaccurate– Information in aggregate hides more than it reveals
![Page 9: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/9.jpg)
Pitfalls: An Example of the Challenge
![Page 10: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/10.jpg)
Pitfalls: An Example of the Challenge
![Page 11: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/11.jpg)
Dangers of Disintegration
Source: Matthew Auer, Policy Studies Journal, Volume 39, Issue 4, pages 709–736, Nov 2011
![Page 12: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/12.jpg)
Analytic Framework
• Data Capture (DC)• Data Reporting (DR)• Data Analysis (DA)– What to measure– What the data is saying– What should be done based on the data
Source: Avinash Kaushik, Occam’s Razor Blog http://www.kaushik.net/avinash/web-analytics-consulting-framework-smarter-decisions/
Capture
ReportAnalyze
![Page 13: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/13.jpg)
Choosing a Platform
• Social media, and the ways that it is used, is relatively new and evolving rapidly:– Static approaches to social media are flawed from
the outset– No one metric or set of metrics will always let you
know what is happening• Platforms need to be open and highly
adaptable to facilitate data capture, reporting, and analysis
![Page 14: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/14.jpg)
Case Study: Brand Management
• Industry: Gaming– Experiencing 10% growth annually– Overall revenue expected to exceed $80 billion by
2014• In May, Zenimax Online Studios announced
Elder Scrolls Online– Elder Scrolls V: Skyrim 2nd largest game of 2011
![Page 15: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/15.jpg)
Problem Definition
• Question: How can brand managers use social media to track and understand public attitudes toward a product?
• Challenge: Capture relevant information for social media sources.– Query too large = false positives– Query too small = miss potential information
![Page 16: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/16.jpg)
• Twitter has excellent analytical potential:– Enormous volume, 400 million+ tweets per day– Large user base, 140 million+ accounts– Open API
• But its not without its limitations:– 140 characters– Limited historical (lookback) capacity without
using a 3rd party provider like DataSift or GNIP
![Page 17: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/17.jpg)
Data Capture: Initial Query
• Twitter search for “Elder Scrolls Online”– Simplest possible way to access information– RSS feed for 10 days (Jun 27 – July 6 2012)
![Page 18: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/18.jpg)
Data Capture: Entities & Associations
Hashtag TwitterHandle URL
Unstructured Keywords
Time / Date Stamp
WhoTwitterHandle
WhatHashtags, Keywords, URLs
WhenTime, Date
WhereGeo (if Available)
![Page 19: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/19.jpg)
Data Reporting
![Page 20: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/20.jpg)
Data Reporting
![Page 21: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/21.jpg)
Data Analysis
• Analysis needs to be rooted in the operational need:
“How can I use social media to track and understand public attitudes toward my product”
• Emphasis on hypothesis generation, testing, and experimentation
![Page 22: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/22.jpg)
Data Analysis: Hashtags
• Top hashtags were almost all generic or abstract– Undermines tracking and understanding– Top hashtags tied to franchise, not to the game
Hashtags#ElderScrolls #concept#games #nerd#online #geek#MMO #gamer#skyrim #ScreenShot
![Page 23: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/23.jpg)
Data Analysis: Expanding the Query
• Hash tags from an initial subset of Tweets fed back into the initial query
Twitter Stream
Initial Query Results
Expanded Query Results
![Page 24: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/24.jpg)
Data Analysis: Sentiment
• Sentiment analysis on small snippets of text like Tweets is generally poor
• Follow and convert linked URLs into derivative sources
• Larger text sources offer potential value with sentiment analysis that tweets alone cannot offer
![Page 25: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/25.jpg)
Data Analysis: Sentiment
• Top negative and positive sentiment scores can provide a glimpse into aggregate attitudes
• Provide starting points for additional analysis
![Page 26: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/26.jpg)
Next Steps: Shape the Conversation
• Create and promote hashtags that help shape the conversation and make it easier to collect and analyze the Twitter stream
![Page 27: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/27.jpg)
Next Steps: Segment the Data
• Segment, or cluster, your data by:– User name or handle– Hashtags– Keywords– Geographic region
to explore patterns and trends at the micro level versus the entire dataset
![Page 28: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/28.jpg)
Next Steps: Segment the Data
![Page 29: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/29.jpg)
Next Steps: Graph Analysis
![Page 30: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/30.jpg)
Lessons Learned
• Don’t:– Try drinking from a fire hose, sometimes less
really is more;– Use metrics you can’t tie to actions;– Use visualizations or reports that strip the data
from its context.
![Page 31: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/31.jpg)
Lessons Learned
• Do:– Segment data rather than attempting to work in
the aggregate;– Look for the why behind the message;– Always return to the source material;– Explore alternative explanations;– Always consider the ultimate goal.
![Page 32: Open Analytics: Building Effective Frameworks for Social Media Analysis](https://reader031.fdocuments.in/reader031/viewer/2022013101/55528130b4c905b4598b4efa/html5/thumbnails/32.jpg)
Thank You!
Craig Vitter
github.com/ikanow/Infinit.e