TETRIS: Smartphone-to-Smartphone Screen-Based … a form of Visible Light Communication, a color...

1
RESEARCH POSTER PRESENTATION DESIGN © 2011 www.PosterPresentations.com EXPERIMENTAL SET-UP SYSTEM OVERVIEW FUTURE WORK CONCLUSIONS RESULTS REFERENCES ACKNOWLEDGEMENT TETRIS: Smartphone-to-Smartphone Screen-Based Visible Light Communication REU fellows: Matthew C. Stafford 1 , Adriana E. Rogers 2 , Charles J. Carver 3 , Shela Y. Wu 4 Faculty Mentors: Drs. N. Sertac Artan 5 and Ziqian Dong 5 Affiliation: 1. University of Buffalo, 2. Lewis & Clark College, 3. Fordham University, 4. New York University, 5. School of Engineering and Computing Science, NYIT Emails: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected] ABSTRACT DISCUSSIONS With the extensive use of smartphones, technology improving secure communication between smartphones is a growing field of research. As a form of Visible Light Communication, a color video barcode system creates a smartphone-to-smartphone communication channel. This color video barcode system, essentially an evolved form of QR codes, provides a secure alternative to WiFi, Bluetooth, and Near-field communication. Recent improvements in smartphone screen resolution and camera capabilities allow for data transmission with larger amounts of information. We investigate if these hardware changes will allow for improvements to be made in data transmission over a screen-to-camera color barcode link. Our system, TEtra-TRansmISsion (TETRIS), achieves a communication throughput of 311.22 kbps with 90% accuracy with a 4-color scheme. BACKGROUND Visible Light Communication line of sight security [1] minimal interference unregulated Near-Field Communication (NFC) 10 cm range [2] Wifi & Bluetooth long range security drawbacks Barcodes & Quick Response (QR) Codes [1] C. Rohner, S. Raza, D. Puccinelli and T. Voigt. “Security in visible communication: Novel challenges and opportunities,” in Sensors & Transducers 192. 2015. [2] “NFC or EMV, Which is More Secure?” Best of Category Reviews. Accessed July 28, 2017. https://bestofcategoryreviews.com/nfc-or-emv-which-is-more-secure. [3] T. Hao, R. Zhou, and G. Xing, “COBRA: Color barcode streaming for smartphone systems,” in Proc. 10th Int. Conf. MobiSys, New York, NY, USA, June 2012, pp. 85–98. [4] Q. Wang, M. Zhou, K. Ren, T. Lei, J. Li, and Z. Wang. "Rain bar: Robust application-driven visual communication using color barcodes," in 2015 IEEE 35th Int. Conf. Distributed Computing Systems (ICDCS) , June 2015, pp. 537-546. [5] W. Du, J.C. Liando, and M. Li. "Softlight: Adaptive visible light communication over screen-camera links," in 35th Annu. IEEE Int. Conf. Computer Communications (INFOCOM), April 2016, pp. 1-9. [2] Transmitter: Samsung Galaxy S7 2560 x 1440 resolution screen Receiver: Samsung Galaxy S8 12-megapixel camera On tripod 15 cm above transmitter Decoding color barcode using: Color barcode: Fig. 1: Graphical user interface to drag corners Fig. 3: Example of 4 frames being sent Pink signals beginning and end, white and yellow alternate Fig. 2: Close-up of our top left and right corners and timing strips This research was supported by the National Science Foundation (NSF) Research Experiences for Undergraduates (REU) program. We would like to thank all of the mentors and research fellows at the New York Institute of Technology who have provided their helpful insight and expertise that greatly assisted with our research. We want to extend our thanks to the helpful graduate students, Mahmoud Saleh and Gopi Prasad, for their constant help over the program’s duration. This project is funded by National Science Foundation Grant No. CNS-1559652 and New York Institute of Technology. TETRIS’s preliminary result: 24 x 24 pixel block size 4 Hz (frames per second) 2 bits (4 colors: red, green, blue, white) 36.096 (kilobits per second) Error rate: 2% of transmission TETRIS’s best result: 14 x 14 pixel block size 10 Hz (frames per second 2 bits (4 colors: red, green, blue, white) 311.22 kbps (kilobits per second) Error rate: 10% of transmission Fig. 6: Error heat map of smartphone screen Camera is located above (45, 85) at a height of 15 cm. Reasons for bit error: Receiver takes images before transmitter screen has refreshed, creating what we see in the heat map Ambient light may have impacted testing Focus on finding computational sweetspot between: Number of colors used Frame rate of video Implement a feedback channel between transmitter and receiver to retake inaccurate image Improve usability in various levels of ambient light Test usability over various distances between transmitter and receiver Attempt an 8-color scheme using mid-point RGB values Implement usability without a tripod using continuous corner detection With improvements in smartphone screen and camera resolution, we improve our ability to transmit more code blocks in a densely packed grid, and ultimately improve the potential for secure smartphone-to-smartphone color barcode communication. In testing our hypothesis, we focused on how we could optimize results by altering the frame rate, size of color blocks, and number of colors, while maintaining an acceptable level of accuracy. We successfully implemented a screen-to-camera link using a high resolution smartphone and camera with a connection throughput of 311.22 kbps. We allow for future work to improve the accuracy and throughput of our smartphone-to-smartphone communication system. Color block size Maintaining accuracy *Found using Android Studio on Galaxy S7 Transmission Method Block size (pixels) Resolution Throughput (kbps) Supported with adaptive blur-awareness Supported with feedback channel TETRIS 14 x 14 2560 x 1440 311.22 COBRA [3] 6 x 6 800 x 480 225 RainBar [4] 11 x 11 1920 x 1080 956 SoftLight [5] variable 1920 x 1080 317 Table II: Comparison between TETRIS and related works Table I: Outline of TETRIS’s preliminary and best results Fig. 4: Distribution of incorrect colors detections over 50 frames Fig. 5: Computational time of each processing component

Transcript of TETRIS: Smartphone-to-Smartphone Screen-Based … a form of Visible Light Communication, a color...

Page 1: TETRIS: Smartphone-to-Smartphone Screen-Based … a form of Visible Light Communication, a color video barcode system creates a smartphone-to-smartphone communication channel.

RESEARCH POSTER PRESENTATION DESIGN © 2011

www.PosterPresentations.com

QUICK TIPS(--THIS SECTION DOES NOT PRINT--)

This PowerPoint template requires basic PowerPoint (version 2007 or newer) skills. Below is a list of commonly asked questions specific to this template. If you are using an older version of PowerPoint some template features may not work properly.

Using the template

Verifying the quality of your graphicsGo to the VIEW menu and click on ZOOM to set your preferred magnification. This template is at 100% the size of the final poster. All text and graphics will be printed at 100% their size. To see what your poster will look like when printed, set the zoom to 100% and evaluate the quality of all your graphics before you submit your poster for printing.

Using the placeholdersTo add text to this template click inside a placeholder and type in or paste your text. To move a placeholder, click on it once (to select it), place your cursor on its frame and your cursor will change to this symbol: Then, click once and drag it to its new location where you can resize it as needed. Additional placeholders can be found on the left side of this template.

Modifying the layoutThis template has fourdifferent column layouts. Right-click your mouseon the background and click on “Layout” to see the layout options.The columns in the provided layouts are fixed and cannot be moved but advanced users can modify any layout by going to VIEW and then SLIDE MASTER.

Importing text and graphics from external sourcesTEXT: Paste or type your text into a pre-existing placeholder or drag in a new placeholder from the left side of the template. Move it anywhere as needed.PHOTOS: Drag in a picture placeholder, size it first, click in it and insert a photo from the menu.TABLES: You can copy and paste a table from an external document onto this poster template. To adjust the way the text fits within the cells of a table that has been pasted, right-click on the table, click FORMAT SHAPE then click on TEXT BOX and change the INTERNAL MARGIN values to 0.25

Modifying the color schemeTo change the color scheme of this template go to the “Design” menu and click on “Colors”. You can choose from the provide color combinations or you can create your own.

QUICK DESIGN GUIDE(--THIS SECTION DOES NOT PRINT--)

This PowerPoint 2007 template produces a 36”x48” professional poster. It will save you valuable time placing titles, subtitles, text, and graphics.

Use it to create your presentation. Then send it to PosterPresentations.com for premium quality, same day affordable printing.

We provide a series of online tutorials that will guide you through the poster design process and answer your poster production questions.

View our online tutorials at: http://bit.ly/Poster_creation_help (copy and paste the link into your web browser).

For assistance and to order your printed poster call PosterPresentations.com at 1.866.649.3004

Object Placeholders

Use the placeholders provided below to add new elements to your poster: Drag a placeholder onto the poster area, size it, and click it to edit.

Section Header placeholderMove this preformatted section header placeholder to the poster area to add another section header. Use section headers to separate topics or concepts within your presentation.

Text placeholderMove this preformatted text placeholder to the poster to add a new body of text.

Picture placeholderMove this graphic placeholder onto your poster, size it first, and then click it to add a picture to the poster.

© 2011 PosterPresentations.com 2117 Fourth Street , Unit C Berkeley CA 94710 [email protected]

Student discounts are available on our Facebook page.Go to PosterPresentations.com and click on the FB icon.

EXPERIMENTAL SET-UP

SYSTEM OVERVIEW

FUTURE WORK

CONCLUSIONS

RESULTS

REFERENCES

ACKNOWLEDGEMENT

TETRIS: Smartphone-to-Smartphone Screen-Based Visible Light Communication

REU fellows: Matthew C. Stafford1, Adriana E. Rogers2, Charles J. Carver3, Shela Y. Wu4

Faculty Mentors: Drs. N. Sertac Artan5 and Ziqian Dong5

Affiliation: 1. University of Buffalo, 2. Lewis & Clark College, 3. Fordham University, 4. New York University, 5. School of Engineering and Computing Science, NYIT

Emails: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]

ABSTRACT DISCUSSIONSWith the extensive use of smartphones, technology improving secure communication between smartphones is a growing field of research. As a form of Visible Light Communication, a color video barcode system creates a smartphone-to-smartphone communication channel. This color video barcode system, essentially an evolved form of QR codes, provides a secure alternative to WiFi, Bluetooth, and Near-field communication. Recent improvements in smartphone screen resolution and camera capabilities allow for data transmission with larger amounts of information. We investigate if these hardware changes will allow for improvements to be made in data transmission over a screen-to-camera color barcode link. Our system, TEtra-TRansmISsion (TETRIS), achieves a communication throughput of 311.22 kbps with 90% accuracy with a 4-color scheme.

BACKGROUND

Visible Light Communication● line of sight security [1]● minimal interference● unregulated

Near-Field Communication (NFC)● 10 cm range [2]

Wifi & Bluetooth● long range● security drawbacks

Barcodes & Quick Response (QR) Codes

[1] C. Rohner, S. Raza, D. Puccinelli and T. Voigt. “Security in visible communication: Novel challenges and opportunities,” in Sensors & Transducers 192. 2015. [2] “NFC or EMV, Which is More Secure?” Best of Category Reviews. Accessed July 28, 2017. https://bestofcategoryreviews.com/nfc-or-emv-which-is-more-secure.[3] T. Hao, R. Zhou, and G. Xing, “COBRA: Color barcode streaming for smartphone systems,” in Proc. 10th Int. Conf. MobiSys, New York, NY, USA, June 2012, pp. 85–98.[4] Q. Wang, M. Zhou, K. Ren, T. Lei, J. Li, and Z. Wang. "Rain bar: Robust application-driven visual communication using color barcodes," in 2015 IEEE 35th Int. Conf. Distributed Computing Systems (ICDCS), June 2015, pp. 537-546.[5] W. Du, J.C. Liando, and M. Li. "Softlight: Adaptive visible light communication over screen-camera links," in 35th Annu. IEEE Int. Conf. Computer Communications (INFOCOM), April 2016, pp. 1-9.

[2]

Transmitter:● Samsung Galaxy S7● 2560 x 1440 resolution

screen

Receiver:● Samsung Galaxy S8● 12-megapixel camera● On tripod 15 cm above

transmitter

Decoding color barcode using:

Color barcode:

Fig. 1: Graphical user interface to drag corners

Fig. 3: Example of 4 frames being sentPink signals beginning and end, white and yellow alternate

Fig. 2: Close-up of our top left and right corners and

timing strips

This research was supported by the National Science Foundation (NSF) Research Experiences for Undergraduates (REU) program. We would like to thank all of the mentors and research fellows at the New York Institute of Technology who have provided their helpful insight and expertise that greatly assisted with our research. We want to extend our thanks to the helpful graduate students, Mahmoud Saleh and Gopi Prasad, for their constant help over the program’s duration.

This project is funded by National Science Foundation Grant No. CNS-1559652 and New York Institute of Technology.

TETRIS’s preliminary result:

24 x 24 pixel block size

4 Hz (frames per second)

2 bits (4 colors: red, green, blue, white)

36.096 (kilobits per second)

Error rate: 2% of transmission

TETRIS’s best result:

14 x 14 pixel block size

10 Hz (frames per second

2 bits (4 colors: red, green, blue, white)

311.22 kbps (kilobits per second)

Error rate: 10% of transmission

Fig. 6: Error heat map of smartphone screenCamera is located above (45, 85) at a height of 15 cm.

Reasons for bit error:● Receiver takes images before transmitter screen

has refreshed, creating what we see in the heat map● Ambient light may have impacted testingFocus on finding computational sweetspot between:● Number of colors used● Frame rate of video

● Implement a feedback channel between transmitter and receiver to retake inaccurate image

● Improve usability in various levels of ambient light● Test usability over various distances between transmitter

and receiver● Attempt an 8-color scheme using mid-point RGB values● Implement usability without a tripod using continuous

corner detection

With improvements in smartphone screen and camera resolution, we improve our ability to transmit more code blocks in a densely packed grid, and ultimately improve the potential for secure smartphone-to-smartphone color barcode communication. In testing our hypothesis, we focused on how we could optimize results by altering the frame rate, size of color blocks, and number of colors, while maintaining an acceptable level of accuracy. We successfully implemented a screen-to-camera link using a high resolution smartphone and camera with a connection throughput of 311.22 kbps. We allow for future work to improve the accuracy and throughput of our smartphone-to-smartphone communication system.

● Color block size● Maintaining accuracy

*Found using Android Studio on Galaxy S7

Transmission Method

Block size (pixels)

Resolution Throughput (kbps)

Supported with adaptive blur-awareness

Supported with feedback channel

TETRIS 14 x 14 2560 x 1440 311.22 ✗ ✗

COBRA [3] 6 x 6 800 x 480 225 ✓ ✗

RainBar [4] 11 x 11 1920 x 1080 956 ✓ ✓

SoftLight [5] variable 1920 x 1080 317 ✓ ✓

Table II: Comparison between TETRIS and related works

Table I: Outline of TETRIS’s preliminary and best results

Fig. 4: Distribution of incorrect colors detections over 50 frames

Fig. 5: Computational time of each processing component