Accountability Hack Redux
-
Upload
giuseppe-sollazzo -
Category
Government & Nonprofit
-
view
206 -
download
0
Transcript of Accountability Hack Redux
![Page 1: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/1.jpg)
Parli-N-Grams
Giuseppe Sollazzo@puntofisso
Accountability Hack 2014 ReduxPortcullis House, 15 January 2015
![Page 2: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/2.jpg)
The language used in politicspoints to the
political, cultural, social backgroundof MPs, parties, and their time
![Page 3: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/3.jpg)
A great search lets you
discover knowledgeby just searching
![Page 4: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/4.jpg)
Parli-N-Grams
A search and analysis tool for Hansard
![Page 5: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/5.jpg)
An N-Gram is a sequence of N words extracted from a longer sentence
N-Grams?
![Page 6: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/6.jpg)
You can split any word sequence in n-grams lists
e.g. “The quick brown fox”
N-Grams?
![Page 7: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/7.jpg)
“The quick brown fox” | 1-grams
● the● quick● brown● fox
N-Grams?
![Page 8: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/8.jpg)
“The quick brown fox” | 2-grams
● the quick● quick brown● brown fox
N-Grams?
![Page 9: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/9.jpg)
“The quick brown fox” | 3-grams
● the quick brown● quick brown fox
N-Grams?
![Page 10: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/10.jpg)
“The quick brown fox” | 4-grams
● the quick brown fox
N-Grams?
![Page 11: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/11.jpg)
30” demo
![Page 12: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/12.jpg)
![Page 13: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/13.jpg)
![Page 14: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/14.jpg)
![Page 15: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/15.jpg)
What can we find out?
![Page 16: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/16.jpg)
![Page 17: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/17.jpg)
![Page 18: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/18.jpg)
![Page 19: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/19.jpg)
![Page 20: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/20.jpg)
![Page 21: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/21.jpg)
![Page 22: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/22.jpg)
Related Ideas
![Page 23: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/23.jpg)
1. Create a Markov Chain by analysing text2. Generate text by using the Markov Chain
Markov Text Generation
![Page 24: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/24.jpg)
photo CC BY-NC by UK Parliament: https://www.flickr.com/photos/uk_parliament/8719647747
![Page 25: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/25.jpg)
What happens if we apply Markov analysis and generation to the
Queen’s Speeches?
![Page 26: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/26.jpg)
My Government will be devolved.
![Page 27: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/27.jpg)
My Government will be devolved.
FALSE
![Page 28: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/28.jpg)
My Government will work with the Afghan government.
![Page 29: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/29.jpg)
My Government will work with the Afghan government.
TRUE
![Page 30: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/30.jpg)
My Government looks forward to an enhanced partnership with India.
![Page 31: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/31.jpg)
My Government looks forward to an enhanced partnership with India.
FALSE
![Page 32: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/32.jpg)
And more...
![Page 33: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/33.jpg)
My Government will be reduced.
![Page 34: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/34.jpg)
My Government will be strengthened in July.
![Page 35: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/35.jpg)
My Government will be strengthened in Afghanistan.
![Page 36: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/36.jpg)
People will be reviewed.
![Page 37: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/37.jpg)
My Government will introduce fixed term Parliaments of unnecessary laws.
![Page 38: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/38.jpg)
My Government will introduce fixed term Parliaments of children.
![Page 39: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/39.jpg)
Legislation will be introduced for a viable Palestinian state existing in Northern Ireland.
![Page 40: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/40.jpg)
My Government will support the abolition of Wales.
![Page 41: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/41.jpg)
My Government looks forward to the blessing of Identity Cards and political parties.
![Page 42: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/42.jpg)
The Almighty God may rest upon the management of the Commons.
![Page 43: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/43.jpg)
Perception: real but implausibleCan we analyse empathy in language?Can we analyse emotional reactions to speeches?Do speeches by MPs elicit the same reaction?
A language uncanny valley?
![Page 44: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/44.jpg)
Hubris Syndrome?
P Garrard, D Owen, et al., “Linguistic Biomarkers of Hubris Syndrome, Cortex, Elsevier, 2013
COPYRIGHT BY THE ARTICLE’S AUTHORS
SEE FOOTNOTE FOR DETAILS
![Page 45: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/45.jpg)
Stylistic similarity in literature
J Hughes et al., “Quantitative patterns of stylistic influence in the evolution of literature”, PNAS, 2012
COPYRIGHT BY THE ARTICLE’S AUTHORS
SEE FOOTNOTE FOR DETAILS
![Page 46: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/46.jpg)
Vocabulary Size
M Daniels, “The largest vocabulary in Hip-Hop”, http://rappers.mdaniels.com.s3-website-us-east-1.amazonaws.com/
COPYRIGHT BY THE ARTICLE’S AUTHORS
SEE FOOTNOTE FOR DETAILS
![Page 47: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/47.jpg)
Reading level
Fox et al., “Who was America’s most well-spoken President?” http://www.vocativ.com/interactive/usa/us-politics/presidential-readability/
COPYRIGHT BY THE ARTICLE’S AUTHORS
SEE FOOTNOTE FOR DETAILS
![Page 48: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/48.jpg)
Reading level
Fox et al., “Who was America’s most well-spoken President?” http://www.vocativ.com/interactive/usa/us-politics/presidential-readability/
COPYRIGHT BY THE ARTICLE’S AUTHORS
SEE FOOTNOTE FOR DETAILS
![Page 49: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/49.jpg)
What lies ahead
![Page 50: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/50.jpg)
Vocabulary Size
![Page 51: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/51.jpg)
Ongoing Work
Run away from PHP Python + NLTKMake it stable; auto-harvestSearch on N-Grams, N>1Search by MP and political party
-> build each MP’s political historyBuild a base of analysesUI for the public + researchers
![Page 52: Accountability Hack Redux](https://reader030.fdocuments.in/reader030/viewer/2022032619/55bde120bb61eba6368b456e/html5/thumbnails/52.jpg)
Questions?Parli-N-Gram
http://parli-n-grams.puntofisso.net
http://github.com/puntofisso/AccHack14
http://www.slideshare.net/puntofisso
Giuseppe Sollazzo@puntofisso
Accountability Hack 2014 ReduxPortcullis House, 15 January 2015