Definition of criteria_for_impact_analysis
-
Upload
sti-innsbruck -
Category
Technology
-
view
681 -
download
0
Transcript of Definition of criteria_for_impact_analysis
![Page 1: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/1.jpg)
Definition of Criteria for Impact Analysis
A work in progress
Christoph Fuchs
![Page 2: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/2.jpg)
Overview
1. What I won't talk about
2. Twofold
3. Classical social network analysis
4. Criteria in the online world
5. Specific definition of criteria
6. Open questions
![Page 3: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/3.jpg)
What kind of impact?
I will not talk about impact in the "real world"!
Such as...
• Total revenue
• Offline bookings
• Offline sales
• ...
![Page 4: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/4.jpg)
What I will talk about
Impact of actors and shared items on online social platforms.
Looking for impact criteria which are
• accessible(via automatic retrieval)
• independent of platform specifics
![Page 5: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/5.jpg)
Two kindsImpact analysis is twofold
![Page 6: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/6.jpg)
Two kinds of impact analysis
• actor level (potential impact)"Who is the most important guy?"
![Page 7: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/7.jpg)
Two kinds of impact analysis
• item level (impact after publication)"What is 'hot' right now?"
![Page 8: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/8.jpg)
In other terms
= page post
• Impressions"...measure the number of times a post from your Page is displayed, whether the post is clicked on or not."
• Reach"...measures the number of people who received impressions of a Page post."
![Page 9: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/9.jpg)
"Classical" vs. "Online"
• Classical social network analysiso actor centric
• Online impact analysiso item centric
![Page 10: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/10.jpg)
Classical Social Network Analysis
aka Graph Theory
![Page 11: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/11.jpg)
Measures from "classical"Social Network Analysis
All* classical approaches are on the actor level.
• Centrality
• Prestige
• described by Wasserman and Faustin 'Social Network Analysis'
* at least all I have found so far.
![Page 12: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/12.jpg)
Who is the "most important guy"?
![Page 13: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/13.jpg)
Centrality
Centrality measure
C(actor) = [0 .. 1]
Normalized on the graph size.
Online: Where does your graph end?
![Page 14: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/14.jpg)
Centrality
• Degree Centrality"Who has the most ties to other actors?"
• Closeness Centrality"How close is an actor to all the others?"
• Betweenness Centrality"Interactions between two nonadjacent actors might depend on the other actors in the set of actors, especially the actors who lie on the paths between the two."
![Page 15: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/15.jpg)
Degree Centrality
"Who has the most ties to other actors?"
Cdinbound(orange) = 4 [normalized: 4 / 5 = 0.8]
Cdoutbound(orange) = 3 [normalized: 3 / 5 = 0.6]
Cdoutbound(green_women)
= 0.2
![Page 16: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/16.jpg)
Closeness Centrality"How close is an actor to all the others?"
Online problem: Where does your graph end?Relevant for the online world?
![Page 17: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/17.jpg)
Betweenness Centrality"Are you between any important actors?"
Online problems- Mostly direct communication (to immediates)- Distance can be easily reduced to 1
![Page 18: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/18.jpg)
Prestige
• Degree PrestigeIndegree of each actor.
• Proximity PrestigeBased on average distance of actors in an influence domain.
• Status or Rank Prestige"If one’s influence domain
is full of prestigious actors, one’s prestige should also be high. If, however, an actor’s domain contains only peripheral, or marginally important, actors, then the rank of this actor should be low."
![Page 19: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/19.jpg)
Criteriain the online world
![Page 20: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/20.jpg)
Criteria?
• Connections between actors
• May be directed connectionso Indegree of connectionso Outdegree of connections
![Page 21: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/21.jpg)
Criteria?
• Connections translated in terms of social platformso Facebook: x is a friend of yo Twitter: x is following yo YouTube: x subscribed to yo ...
![Page 22: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/22.jpg)
Criteria?
• There may be different types of connections
• A platform may supporto Some kind of friendship relationo Some kind of subscriptionso ...
![Page 23: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/23.jpg)
Platform specific criteria
• Some platforms have a form of reputation measurements
![Page 24: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/24.jpg)
![Page 25: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/25.jpg)
Item level
• "How many people have seen it?"
• "How many people have clicked on it?"
![Page 26: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/26.jpg)
Item level
• "How many people have reacted on it? And how did they react?"o Like (+1, thumbs up, ...)o Favouriteo Reply or comment
• "How many people have re-shared it?"
![Page 27: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/27.jpg)
Criteria?
• All kinds of criteria...o Views and clickso Unary feedbacko Binary feedbacko Ratingso Re-publication
![Page 28: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/28.jpg)
Criteria?
• ... and moreo Replies (may not be text)o Commentso Sentiment of comments
![Page 29: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/29.jpg)
Criteria?
• Platform specific exampleso MoodsDeviantARTo Bumpingvarious Forumso Pull Requests, Forks, Watches
githubo ...
![Page 30: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/30.jpg)
What to make of it?So many things to measure!
![Page 31: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/31.jpg)
We need
impact criteria which are
• accessible
• independent of platform specifics
![Page 32: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/32.jpg)
Actor level criteria
• Connections between actorsMay be directed connections
o in- and outdegree of connections
![Page 33: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/33.jpg)
Actor level criteria
Criterion (#) Value
Actors who are friends with you Integer
Actors whom you are friends with Integer
Actors who want to be friends with you [*] Integer
Actors you want to be friends with [*] Integer
Actors subscribed to your stream ("following" you) Integer
Actors to whom you are subscribed Integer
Reputation score [?] Integer
[*] Are those important?[?] Not sure about available reputation scores - platform dependency.
![Page 34: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/34.jpg)
Item level criteria
Criterion (#) Value
Views Integer
Clicks Integer
Positive unary feedback Integer
Special unary feedback Integer
Negative unary feedback Integer
Re-publications Integer
Replies Integer
Comments Integer / Text
Sentiment Hash with Integer
![Page 35: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/35.jpg)
Open Questions...or "Problems"
![Page 36: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/36.jpg)
• What about re-publications?o broadens the 'impact area'o you don't have access to data outside your
immediate peerso It may be important who re-published it.
Almost impossible to measure how many times an item has been viewed if it goes viral.
Open questions
![Page 37: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/37.jpg)
Is normalization important?
• Normalizationo Usually dependent on graph sizeo Online social network graphs are huge!
Open questions
![Page 38: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/38.jpg)
Is the actor's reputation important?
• What about...o the success of previously published items?o the sentiment of previously published items?o Is any publicity good publicity?
Open questions
![Page 39: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/39.jpg)
• Weighingo What criteria are the most important?
Re-publication >? Like
• Combination across platformso One platform may only have 'Like'o Online social network graphs are huge!
Open questions
![Page 40: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/40.jpg)
• Algorithm?o Can existing classical approaches be used?o Existing open-source algorithms?o Is performance important?
To be investigated...
Open questions
![Page 41: Definition of criteria_for_impact_analysis](https://reader038.fdocuments.in/reader038/viewer/2022110121/558a0f9cd8b42a89078b465d/html5/thumbnails/41.jpg)
Thank you.Questions?
Discussion!