The Promises and Perils of Mining Github: MSR'2014
Transcript of The Promises and Perils of Mining Github: MSR'2014
![Page 1: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/1.jpg)
![Page 2: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/2.jpg)
A short (me ago, in an office, far far away...
![Page 3: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/3.jpg)
![Page 4: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/4.jpg)
a postdoc states:
![Page 5: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/5.jpg)
![Page 6: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/6.jpg)
![Page 7: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/7.jpg)
![Page 8: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/8.jpg)
![Page 9: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/9.jpg)
[...]
![Page 10: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/10.jpg)
A pull request that is not marked as merged is not necessarily rejected!!
markedAsMerged != merged
!merged != rejected
![Page 11: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/11.jpg)
![Page 12: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/12.jpg)
But others will not know about this...
![Page 13: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/13.jpg)
From proceedings in a close, close loca(on...
![Page 14: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/14.jpg)
Except from a paper at ...
![Page 15: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/15.jpg)
Except from a paper ...
![Page 16: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/16.jpg)
A pull request that is not marked as merged is not necessarily rejected!!
markedAsMerged != merged
!merged != rejected
Re-‐emphasizing
![Page 17: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/17.jpg)
Many are already using this data to reach conclusions!
![Page 18: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/18.jpg)
Open source report card
![Page 19: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/19.jpg)
![Page 20: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/20.jpg)
![Page 21: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/21.jpg)
![Page 22: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/22.jpg)
![Page 23: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/23.jpg)
![Page 24: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/24.jpg)
Mixed methods approach
![Page 25: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/25.jpg)
Surveys
![Page 26: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/26.jpg)
Interviews
![Page 27: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/27.jpg)
Random Sta>s>cal Sampling
![Page 28: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/28.jpg)
![Page 29: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/29.jpg)
![Page 30: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/30.jpg)
![Page 31: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/31.jpg)
![Page 32: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/32.jpg)
"I store my presenta>ons in github. I don't need USB s>ck anymore!"
github interviewee
![Page 33: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/33.jpg)
![Page 34: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/34.jpg)
![Page 35: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/35.jpg)
![Page 36: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/36.jpg)
![Page 37: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/37.jpg)
![Page 38: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/38.jpg)
• “Any serious project would have to have some separate infrastructure -‐ mailing lists, forums, irc channels and their archives, build farms, etc. [...] Thus while GitHub and all other project hosts are used for collaboraDon, they are not and can not be a complete solu5on.”
![Page 39: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/39.jpg)
![Page 40: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/40.jpg)
•
• In sample projects: – 44% of pull-‐requests marked as merged
– Depending on sample • Extra 19 to 42% of pull-‐requests have been merged, but are not marked as merged in github
![Page 41: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/41.jpg)
A New Hope
![Page 42: The Promises and Perils of Mining Github: MSR'2014](https://reader034.fdocuments.in/reader034/viewer/2022042817/55a681bb1a28ab6a2a8b46d4/html5/thumbnails/42.jpg)