Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other...
Transcript of Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other...
![Page 1: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/1.jpg)
Hack Like the Movie Stars:A Big-Screen Multi-Touch Network
Monitor
George Louthan & Cody Pollet & John Hale
![Page 2: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/2.jpg)
Computer Science / www.isec.utulsa.edu
Overview
• Multi-touch interfaces– What is multi-touch?
• This rhetorical question will not be dignified with a response.
– Optical multi-touch methods
• Our big board– History, building process– Other uses
• The tool: DVNE– Architecture– Future plans
![Page 3: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/3.jpg)
Computer Science / www.isec.utulsa.edu
Multi-touch Methods
• Electronic– Capacitive (iPhone)– Hard to build at home
• Optical– Main idea: capture infrared blobs with a camera
![Page 4: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/4.jpg)
Computer Science / www.isec.utulsa.edu
Optical Multi-touch
• The question: how to illuminate the touches?• Rear Diffused Illumination
– Example: Microsoft Surface– IR shines out of the screen, illuminating objects
![Page 5: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/5.jpg)
Computer Science / www.isec.utulsa.edu
Optical Multi-touch
• Frustrated Total Internal Reflection– Shine light into the edges of plexiglass– Touching the glass causes it to flex and emit light– This is what we use
![Page 6: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/6.jpg)
Computer Science / www.isec.utulsa.edu
Our big screen
• AKA That Thing I Keep Tripping Over– FTIR method– 56” diagonal, 16:9 aspect ratio (roughly 48”x30”)– 1280 x 800– Plexiglass construction– Laminated vellum
projection screen– 168 IR LEDs– PlayStation Eye camera
![Page 7: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/7.jpg)
Computer Science / www.isec.utulsa.edu
Our big screen
![Page 8: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/8.jpg)
Computer Science / www.isec.utulsa.edu
Architecture
• Touch signals over UDP– TUIO Protocol
![Page 9: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/9.jpg)
Computer Science / www.isec.utulsa.edu
What do we DO with it?
• Some ongoing projects– Immersive collaboration (multi-touch caves)– Educational software (we're building tables for schools)
• But we're a security lab– We also like campy movies. (“It's a UNIX system!”)
![Page 10: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/10.jpg)
Computer Science / www.isec.utulsa.edu
We also play games ...
![Page 11: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/11.jpg)
Computer Science / www.isec.utulsa.edu
DVNE
• Dynamic Visualization for Network Environments– Primary goal: to build a flashy Hollywood-style
computer interface – Secondary goal: build something useful for looking at
networks
• Network monitor– Track TCP streams, identify protocol using signatures
• Interface– Python with pymt multitouch extensions– TUIO
![Page 12: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/12.jpg)
Computer Science / www.isec.utulsa.edu
Resources
• Natural User Interface Group– http://www.nuigroup.com
• PyMT– http://pymt.txzone.net
• Pyglet– http://www.pyglet.org
![Page 13: Hack Like the Movie Stars - DEF CON · • Our big board – History, building process – Other uses • The tool: DVNE – Architecture – Future plans. Computer Science / Multi-touch](https://reader033.fdocuments.in/reader033/viewer/2022050303/5f6c1060d006037bcd04efdf/html5/thumbnails/13.jpg)
Computer Science / www.isec.utulsa.edu
Acknowledgements
Support for this research through the National Science Foundation Cyber Trust Program (Award Number 0524740) is gratefully acknowledged.