EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality
-
Upload
klen-copic-pucihar -
Category
Technology
-
view
139 -
download
0
description
Transcript of EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality
![Page 1: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/1.jpg)
Estimating Scale using Depth From Focus for Mobile Augmented Reality
Klen Čopič PuciharDr. Paul Coulton
![Page 2: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/2.jpg)
Overview
• Introduction to vision based Augmented Reality;
• Problem identification;• Solving scale ambiguity;• Results of empirical study;• Implications;• Conclusions with future work
suggestions;
![Page 3: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/3.jpg)
Introduction to vision based Augmented Reality
Where is the problem?
Marker based AR (AR Toolkit) Markerless AR (PTAM on iPhone)
Informed Un-informed
![Page 4: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/4.jpg)
Problem of monocular vision
“It is impossible to determine the scale of the scene from a sequence of images alone.”
Hartley, R.I. and Zisserman, A.
![Page 5: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/5.jpg)
Let’s have another look.
Marker based AR (AR Toolkit) Markerless AR (PTAM on iPhone)
Informed Un-informed
“It is impossible to determine the scale of the scene from a sequence of images alone.”
Scale known
Scale might be known Scale unknown
![Page 6: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/6.jpg)
Solving scale ambiguity
• Till now, the only alternative for scale initialization was based on asking the user to subjectively introduce additional information to the system.
What solution do we propose?
![Page 7: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/7.jpg)
Introducing scale using Depth From Focus (DFF)
Where is the novelty?
Image formation in a convex lens
![Page 8: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/8.jpg)
Novelty
• The Depth From Focus method has been previously limited to high end cameras and was never before implemented and tested on a mobile phone camera.
• Innovative use of Depth From Focus in context of mobile augmented reality.
![Page 9: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/9.jpg)
Quick view at results• 4 Nokia N900 Phones.• Data was captured in the range of 7-50 cm with
20 measurements at each given distance.• Data was aggregated based on each phone and
auto-focusing method.• Three different modes of operation were tested.
What are the implications?Experiment photo
• The identified useful range is between 7 and 30 cm.
• Maximal relative depth error was between 6.6 and 12.2 %.
![Page 10: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/10.jpg)
Implications
• Measuring applications;• Simplified initialization of Public ‘You are Here’
maps for navigation system on mobile devices;• Introducing scale to markerless mobile augmented reality;
Screenshot of Meter application.
Why is scale so important in AR?
![Page 11: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/11.jpg)
Why is scale so important?
Picture of a miniature garden scene.
![Page 12: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/12.jpg)
Conclusion with future work suggestions
• Future work:– Solution needs to be tested on a fully functional marker-
less AR system.– Detailed feasibility study on other AR platforms should
be performed. – Accuracy of the system needs testing on horizontal
surfaces, as well as in cases where camera image plan and the scene plane are not parallel.
• Uninformed markerless AR is the most appropriate vision based AR system for wide scale deployment.
• The limitation of unknown scale has been solved by the proposed DFF scale initialization.
• The solution is applicable to other platforms that have auto-focusing camera with access to the camera driver.
![Page 13: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/13.jpg)
Time for questions.
![Page 14: EICS '11: Estimating Scale Using Depth From Focus for Mobile Augmented Reality](https://reader038.fdocuments.in/reader038/viewer/2022103114/554e8d97b4c90573338b4bdc/html5/thumbnails/14.jpg)
Thank you very much for your attention.