ASE 2014 Augmented Reality Teaching
-
Upload
francisco-perez -
Category
Education
-
view
409 -
download
4
description
Transcript of ASE 2014 Augmented Reality Teaching
U N IV E R S ITAT D E B A R C E L O N AU
B1
Unitat de Farmacologia i Farmacognòsia - Facultat de Farmàcia
AugmentedRealityTeachingDr. Francisco Pérez GarcíaHead of Technology Dept. , Pompeu Fabra High School, MartorellHead of i-Campus Project, University of Barcelona, Barcelona
ASE Conference University of Birmingham, 9th January 2014
U N IV E R S ITAT D E B A R C E L O N AU
B2
Dr. Francisco Pérez García - Institut Pompeu Fabra
The author respects article 32 of the Spanish Law of Intellectual Property to use images and other materials contained in this presentation.The Berne Convention provides for a specific exception to allow uses of copyrighted works for the purpose of teaching:“ Art.10.2.-It shall be a matter for legislation in the countries of the Union, and for special agreements existing or to be concluded between them, to permit the utilization, to the extent justified by the purpose, of literary or artistic works by way of illustration in publications, broadcasts or sound or visual recording for teaching, provided such utilization is compatible with fair practice”
U N IV E R S ITAT D E B A R C E L O N AU
B3
Dr. Francisco Pérez García - Institut Pompeu Fabra
Contents of this presentation
1. Augmented reality (AR) as a disruptive technology?2. Level 0: AR with no programming knowledge
a) App: Google Googles (QR and GeoWeb)b) Online: www.learnar.orgc) Free software: BuildAR
3. Level 1: AR with minor programming skillsa) Open Source software: processing 2b) libraries NyAR4psg, OBJLoader, etcc) Online: Create 3D objects
http://www.123dapp.com/catch4. Level 2: AR with programming skills: Google Glasses
U N IV E R S ITAT D E B A R C E L O N AU
B4
Augmented reality
A disruptive technology?Lavandula angustifolia Something that generates a very
important change
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B5
Augmented reality
A disruptive technology?Lavandula angustifolia Something that generates a very
important change
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B6
Level 0
Level 1
Level 2
LEVEL OF PROGRAMMING SKILLS REQUIRED TO CREATE AUGMENTED REALITY APPLICATIONS
Programming skills
Higher
Lower
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B7
Types of Augmented Reality
Trigger by
Hiperlinks in the real world
QR
Marker based augmented reality
Markers
Markerless augmented reality
Objects or pictures
Geoweb-Internet of places Objects and GPS positionInternet of things Sensors, objects and GPS
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B8
Level 0 AUGMENTED REALITY: QR CODE
http://www.goqr.me (among many other ways to generate QR)Zint Barcode Generator
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B9
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B10
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B11
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B12
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B13
Internet of places - GeowebDr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B14
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B15
Dr. Francisco Pérez García - Institut Pompeu Fabra
http://www.learnar.org AUGMENTED REALITY WITH A BROWSER AND MARKERS
U N IV E R S ITAT D E B A R C E L O N AU
B16
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B17
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B18
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B19
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B20
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B21
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B22
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B23
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B24
Dr. Francisco Pérez García - Institut Pompeu Fabra
http://6007.stem.org.uk Gravity, Bugs, Sounds and Materials
U N IV E R S ITAT D E B A R C E L O N AU
B25
Creating book with Augmented Reality with www.zooburst.com
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B26
Download Build AR free version at http://www.buildar.co.nz/home/download/?did=6
Two examples in the next slides
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B27
http://www.arined.org/ARfiles/Final_lecture_AR_Text.pdfMovement to understand eclipse
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B28
http://www.buildar.co.nz/buildar-showcase-2/Movement to understand Stirling engine
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B29
Students using technology or students creating technology?Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B30
Dr. Francisco Pérez García - Institut Pompeu Fabra
TO CREATE AUGMENTED REALITY APPS WE NEED CREATIVE STUDENTS…
U N IV E R S ITAT D E B A R C E L O N AU
B31
Dr. Francisco Pérez García - Institut Pompeu Fabra
WITH COMMON HARDWARE, AND…
U N IV E R S ITAT D E B A R C E L O N AU
B32
Dr. Francisco Pérez García - Institut Pompeu Fabra
SOME SOFTWARE, AND PROGRAMING SKILLS?
U N IV E R S ITAT D E B A R C E L O N AU
B33
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B34
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B35
Dr. Francisco Pérez García - Institut Pompeu Fabra
Processing
Open Source softwareDerived from JavaMany available examplesMany contributed libraries: for Arduino, 3DObject, QRCode, Box2D for games, Open Computer Vision, for Augmented Reality like NyAR4psg or NyAR2, etc.
U N IV E R S ITAT D E B A R C E L O N AU
B36
Marker augmented reality(NyAR4psg, NyAR2 libraries)
Markerless augmented reality(OpenCV library)
Loading 3D objects(Saito OBJLoader library)
QR code library
Data communication(libraries for SMS,SQL databases,…)
Machine learning(Gnet library)
Arduino library(http://tecnologies.net/?page_id=206)
Dr. Francisco Pérez García - Institut Pompeu Fabra
Games (pBox2D library)
Lego robots(NTXcomm library)
U N IV E R S ITAT D E B A R C E L O N AU
B37
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B38
AUGMENTED REALITY MARKERS
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B39
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B40
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B41
We need extra libraries and programs to start executing augmented reality code with Processing:
• Libraries
GSVideo
http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0 OBJLoader
https://code.google.com/p/saitoobjloader
/ Nyar4psg-1.3.1
http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=8920
• Programs
QuickTime
http://www.apple.com/es/quicktime/download
/
WinVDIG
http://www.eden.net.nz/7/20071008/
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B42
Quicktime 7:http://www.apple.com/ca/quicktime/download/
http://www.eden.net.nz/7/20071008/
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B43
http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0/
GSVIDEO LIBRARY (ONLY FOR PROCESSING 1.5.1)
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B44
http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=8920
MAIN AR LIBRARY FOR PROCESSING: NyAR4psg
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B45
http://cpbotha.net/files/nyar4psg_multimarker/
MULTIMARKER LIBRARY FOR AUGMENTED REALITYUSING PROCESSING
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B46
http://code.google.com/p/saitoobjloader/downloads/list
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B47
WHERE WE HAVE TO PUT THE EXTRA LIBRARIES
Libraries: Inside processing (modes>java>libraries)
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B48
Programs: At the same folder than processing
WHERE WE HAVE TO PUT THE EXTRA PROGRAMS
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B49
SIMPLELITE.PDESIMPLEST CODE FOR AUGMENTED REALITY
USING PROCESSING
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B50
CODE CHANGES IF GSVIDEO LIBRARY IS USED
import processing.video.*; //core libraryimport codeanticode.gsvideo.*; //gsvideo contributed library
Capture cam;GSCapture cam;
cam=new Capture(this,width,height);cam=new GSCapture(this,width,height);
cam.start();
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B51
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B52
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B53
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B54
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B55
Dr. Francisco Pérez García - Institut Pompeu Fabra
CREATING 3D OBJECTS FROM PHOTOGRAPHS
U N IV E R S ITAT D E B A R C E L O N AU
B56
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B57
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B58
Dr. Francisco Pérez García - Institut Pompeu Fabra
Creating 3D objects withwww.blender.org
www.sketchup.org
U N IV E R S ITAT D E B A R C E L O N AU
B59
http://flash.tarotaro.org/ar/MarkerGeneratorOnline.swf
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B60
http://www.brosvision.com/ar-marker-generator/
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B61
Online quiz about processing:http://blocs.xtec.cat/pile/2013/05/quiz1.swf
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B62
Computer vision OpenCV library + Processing 2.1
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B63
Level 2. AR WITH GOOGLE GLASSES
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B64
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B65
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B66
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B67
Dr. Francisco Pérez García - Institut Pompeu Fabra
Woodpecker images from @tecnotic
U N IV E R S ITAT D E B A R C E L O N AU
B68
THE INTERNET OF THINGS
I detected a weigth of 60.4kg
My sensor measured 70.2kg
John and Anne are getting fat. I
must send a message now
Dr. Francisco Pérez García - Institut Pompeu Fabra
John’s seat
Anne’s seat
U N IV E R S ITAT D E B A R C E L O N AU
B69
References
http://www.tecnologies.net http://www.processing.orghttp://www.learningprocessing.com/http://www.openprocessing.orghttp://www.creativeapplications.net/category/processing/https://www.coursera.org/course/digitalmedia
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B70
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B71
MOOC from University of London about www.processing.org
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B72
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B73
http://www.wiley.com/WileyCDA/WileyTitle/productCd-1118036638,miniSiteCd-SYBEX,descCd-DOWNLOAD.html
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B74
ACKNOWLEDGEMENTS
-To the Government of Catalonia, Department of Educationfor the school innovation project “Technological Creativity” atPompeu Fabra High School-To the University of Barcelona for the innovation project “i-Campus”
Dr. Francisco Pérez García - Institut Pompeu Fabra
U N IV E R S ITAT D E B A R C E L O N AU
B75
THANK YOU VERY MUCH FOR YOUR ATTENTION
QUESTIONS?
Dr. Francisco Pérez García - Institut Pompeu Fabra