Engineers @ NudgeNudge - July master lecture slides
-
Upload
swengineers -
Category
Technology
-
view
1.228 -
download
0
Transcript of Engineers @ NudgeNudge - July master lecture slides
![Page 1: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/1.jpg)
ByIvan Trajkovic
andDamir Burazerovic
AUGMENTED REALITY AND 3D
![Page 2: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/2.jpg)
INDEX
• What is Augmented Reality ?
• Problems in Augmented Reality
• Augmented Reality on Android platform
• Development platform and system requirements
• LG Optimus 3D additional requirements
• ARToolKit
![Page 3: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/3.jpg)
WHAT IS AUGMENTED REALITY (AR) ?
• It is a variation of Virtual Environments (VE)• It is a system that supplements the real world with
computer-generated virtual objects which seem to coexist in the same space and present the following properties:– It combines real and virtual objects in real environment– It executes interactively in real time– It lines up real and virtual objects– It is applied to all senses of the user
![Page 4: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/4.jpg)
PROBLEMS IN AUGMENTED REALITY
There are three major challenges associated with AR:
CAMERA TRACKING
HANDLING OCCLUSIONS
ILLUMINATION CONSISTENCY
![Page 5: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/5.jpg)
CAMERA TRACKING
Fig 1: the Simple Program Running a virtual block aligned
with a real mark
Fig 2: Threshold Video Image with Identified Pattern
![Page 6: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/6.jpg)
HANDLING OCCLUSIONS
Problem: real objects are in front of the virtual objects in the scene
![Page 7: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/7.jpg)
ILLUMINATION CONSISTENCY
Three frames from a 3 hour long sequence showing virtual sculpture rendered into scene with consistent illumination.
![Page 8: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/8.jpg)
AUGMENTED REALITY ON ANDROID PLATFORM
• AndAR - Android Augmented Reality.– ARToolKit for Android.
( http://code.google.com/p/andar/ )
• NyARToolkit.- Java/C#/Android.
( http://sourceforge.jp/projects/nyartoolkit/ )
![Page 9: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/9.jpg)
DEVELOPMENT PLATFORM AND SYSTEM REQUIREMENTS
• Multiplatform (Linux, MacOS and Windows)– Windows XP (32-bit), Vista (32- or 64-bit), or Windows 7 (32- or 64-
bit)– Mac OS X 10.5.8 or later (x86 only)– Linux (tested on Ubuntu Linux, Lucid Lynx)
• Android SDK– (http://developer.android.com/sdk/index.html)
• Eclipse IDE
• ADT Plugin for Eclipse
![Page 10: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/10.jpg)
LG OPTIMUS 3D ADDITIONAL REQUIREMENTS
• Real3D SDK – ( http://developer.lgmobile.com/sdk/android/repository.xml )
• What LG Real3D provides– Real3D API that helps you to control the display hardware block
interliving– Real3D API demos– The emulator that enables you to test your 3D applications with red-
cyan glasses
![Page 11: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/11.jpg)
WHAT IS Real3D?
![Page 12: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/12.jpg)
HOW Real3D WORKS?
Source: LG Real3D SDK
![Page 13: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/13.jpg)
ARToolKit
• Software library for building AR applications.
• Originally developed by Dr. Hirokazu Kato.– Human Interface Technology Laboratory (HIT Lab) at the University of
Washington,– HIT Lab NZ at the University of Canterbury, New Zealand,– ARToolworks, Inc, Seattle.
![Page 14: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/14.jpg)
ARToolKit
• Uses computer vision algorithms to solve AR tracking problem.
• Calculate the real camera position and orientation relative to physical markers in real time.
![Page 15: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/15.jpg)
ARToolKit FEATURES
• Multiplatform (Linux, MacOS and Windows)
• Single camera tracking using any black square.
• Distributed with complete source code.
• Fast rendering based on OpenGL.
• Simple and modular API (in C and C++).
• A complete set of samples and utilities.
![Page 16: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/16.jpg)
ARToolKit FEATURES
• OpenSource with GPL license for non- commercial usage.
• Commercial licenses are administered by ARToolworks, Inc., Seattle, WA, USA.
![Page 17: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/17.jpg)
ARToolKit ARCHITECTURE
ARToolKit has three basic modules:
1. Scene Capturer
2. Augmented Reality (AR)
3. Augmented Image Generator
![Page 18: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/18.jpg)
HOW DOES ARToolKit WORK?
Source: http://www.hitl.washington.edu/artoolkit/documentation/userarwork.htm
![Page 19: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/19.jpg)
LIMITATIONS
• Virtual objects appear only when complete markers are visible.
• Size of virtual objects
• Movement of virtual objects
• If users cover up part of the pattern with their hands or other objects the virtual object will disappear
![Page 20: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/20.jpg)
LIMITATIONS
• Range issues
• Pattern complexity
• Marker orientation relative to the camera
• Lighting conditions
![Page 21: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/21.jpg)
ARToolKit – DEVELOPMENT PRINCIPLES
There are two stages when developing an ARToolKit application:
1. Writing the application.
2. Training image-processing routines on markers that will be used in the application.
![Page 22: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/22.jpg)
ARToolKit – Development Principles
Initialization 1. Initialize the video capture and read in the marker pattern files and camera parameters.init()
Main Loop 2. Grab a video input frame. arVideoGetImage()
3. Detect the markers and recognized patterns in the video input frame.arDetectMarker()
4. Calculate the camera transformation relative to the detected patterns.arGetTransMat()
5. Draw the virtual objects on the detected patterns.draw()
Shutdown 6. Close the video capture down.cleanup()
![Page 23: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/23.jpg)
LITERATURE
• Augment Reality (Edited by SohaMaad), 2010 Intech
• ARToolKithttp://www.tinmith.net/lca2004/ARToolkit/ARToolKit2.33doc.pdf
• Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach
Authors: Yuan Tian, Tao Guan* and Cheng Wang http://www.mdpi.com/1424-8220/10/4/2885/pdf
![Page 24: Engineers @ NudgeNudge - July master lecture slides](https://reader035.fdocuments.in/reader035/viewer/2022062702/554c1d6cb4c905ec518b53b2/html5/thumbnails/24.jpg)
LINKS
• ARToolKithttp://www.hitl.washington.edu/artoolkit/
• ARToolkitPro for Androidhttp://www.artoolworks.com/support/library/
ARToolKit_Professional• ARToolkitPlus 2.1.1
http://handheldar.icg.tugraz.at/artoolkitplus.php• NyARToolkit for Android
http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=7605