NIMO Nordic Interaction and Mobility Research Platform

WP3: 3D InternetProfessor Timo OjalaUniversity of OuluDepartment of Computer Science and EngineeringMediaTeam Oulu research groupFinland

Feb 13, 2013

NIMO (Nordic Interaction and Mobility Research Platform) http://www.nimoproject.orgTimespan: 6/2011 5/2014 (36 months)ConsortiumLule University of Technology, Sweden (LTU) (coordinator)University of Oulu, Finland (UO)University of Lapland, Finland (UL)Total budget: 1.45 MEURMain public financier: Interreg IV A Nord programUO budget: 285 kEURCo-funders: BusinessOulu, OBP Research Ltd.

UO objectives Open 3D virtual model of Oulu city centre (Oulu3D) Pervasive city game for youthOpen 3D Internet City Laboratory projectUO gave Prof. Ojala 598500 EUR strategic research infrastructure grant Open 3D Internet City LaboratoryWith 25% co-funding total budget is 798000 EURSmall part of the co-funding is contributed the NIMO projectGrant is facilitated by the groundbreaking work done in the NIMO projectThree objectives to be implemented in 2013-2014Expansion of the Oulu3D modelAdd 40 blocks to the high fidelity city modelCreate low fidelity regional modelCreate indoor models of selected buildingsDesign and implement functionalities and interfaces supporting research use of the modelPurchase equipment supporting research use of the modelInternal and external calls for use cases (scenarios) for the model in Jan-Feb 2013

Open UBI Oulu FIRI 2013 funding application Academy of Finlands call for updating the Finnish research infrastructure roadmap 2013Infrastructures selected to the FIRI roadmap get substantial funding in 2014-2019 (25% matching funding)

Two stage callStage 1: Plan of intent (6 pages, Feb 2012)Reviewed by the national FIRI committeeStage 2: Full application (20 pages, May 2012)Reviewed by international panel

Oulu3D virtual model is one of the infrastructures included in the Open UBI Oulu applicationNIMO: UO project teamLeader: Professor Timo Ojala

Project team on NIMOs payrollResearch assistant Daniele ZanniResearch assistant Toni Alatalo (75%)Graphical designer Teijo Rty (part-time)Trainee Lasse Annola (5-8/2012, partly supported by government traineeship grant)

Program manager Marika Leskel

Project secretary Elvi HiltunenNIMO: Advisory groupKari Autio, UO/CIEJanne Heikkil, UO/CSESeamus Hickey, UO/CIETommi Hollstrm, AdminotechJonna Hkkil, UO/CIEJussi Kangasoja, OUASJarmo Laitinen, City of Oulu / Center of Youth AffairsUki Lahtinen, City of Oulu / Technical CentreTony Manninen, LudocraftVille Mickelsson, CyberlightningJuhani Miettunen, Oulu3DPekka Nisula, OUASIlpo Okkonen, Oulu3DJyrki Okkonen, Oulu3DJohannes Peltola, VTTHarri Pesola, CubiCasaJani Pirkola, Cyberlightning / realXtend FoundationJukka Riekki, UO/CSEMika Sorvisto, CENTRIAChristian Sundell, Business OuluEero Tervo, EvoconsNIMO: UO WP3 objective #3-1: Oulu3DJoint initiative to build open interactive 3D virtual model of downtown Oulu atop the realXtend platformOutdoor modeling of selected blocksIndoor modeling of selected key buildingsHosting of the model in public Internet

Division of activitiesData (photographs, blueprints, laser scanning)ModelingHostingIPRServices

Phasing of the modelPhase #1: 9 (available in 2012)Phase #2: 50 (resourcing by Open 3D Internet City Laboratory project)Phase #3: CityrealXtend - Open source platform for the 3D Internethttp://www.realxtend.orgClient-server architectureTundra SDK, Naali viewerExtensible scene architectureAlatalo T (2011) An entity-component model for extensible virtual worlds. IEEE Internet Computing 15(5):30-37.Example shared presentation

Oulu3D: Phase #1 area (9 blocks)

Oulu3D: Phase #2 area (50 blocks) (tentative)Oulu3D: Modeling processDATA3D MODELINGTEXTURINGMOVE MODELTO REALXTENDHOSTING OFREX MODELEVOCONS & CUBICASAADMINOTECHNIMOCENTRIA

Oulu3D: Photographing of building facadesPakkahuoneenkatu 14 facade south

Oulu3D: Photographing of blueprintsPakkahuoneenkatu 14 facade south

Oulu3D: Photographing of blueprints (2)Pakkahuoneenkatu 14 floorplan

Oulu3D: Laser scanning3D visualization of Puistola block from laser dataVideo

(30 seconds, disk)Laser scanning equipment

Oulu3D: Laser scanning example (1)Oulu market: Scan #1

Oulu3D: Laser scanning example (2)Oulu market: Scan #2

Oulu3D: Laser scanning example (3)Oulu market: Scan #3

Oulu3D: Laser scanning example (4)Oulu market: Scans #1-#3 merged

Oulu3D: Laser scanning phase #1 (fall 2011)50 scanning points

Oulu3D: realXtend modeling exampleWhich part is realXtend model and which part is photo? Differences between realXtend model (low polygon) andCAD models (high polygon) have to be understood

Oulu3D: Current 9 block realXtend model

Optimized low-fidelity version of the phase #1 model has also been created in collaboration with the CIE researchers, targeted for lightweight web/mobile clients

Oulu3D: realXtend indoor modeling of buildingsBystrms houseselected as pilot forindoor modeling

Oulu3D: HostingNIMO purchases hosting from Adminotech (uses Amazon cloud)

Oulu3D: Recent progressCreation of best practice recommendations for modelers

Design of Oulu3D licensing model

Design of Oulu3D O&M modelOulu3D Ltd. selected as administrative operator by 3DIA

Utilization of Oulu3D model in various R&D activities

Oulu3D: Best practice recommendations for modelersPrepared in collaboration with the CIE researchersBased on the lessons learned in the modeling of phase #1 model and in the subsequent optimization of the modelPeer reviewed by modeler community in Jan-Feb 2013When accepted, sets technical requirements for all future Oulu3D modeling activitiesOulu3D: Licensing modelSource materials: CC Attribution-ShareAlike 3.0Any modifications have to be shared

realXtend materials: CC Attribution 3.0Facilitates free use by attributing the licensor

Maximize utilization of the Oulu3D model by the community

REX ContributionsServer Instance(s) (hosting operator)CorpX Scenewww.corp_x.fi/3DCorpXServer Instance(s) (hosting operator)CorpX Scenewww.corp_x.fi/3DCorpXServer Instance(s) (hosting operator)CorpX Scenewww.corp_x.fi/3DCorpXOulu3D: O&M modelOulu3Dlive.net (Univ. of Oulu)NIMOCity of OuluMCTOrganisation ACompany BCompany C...realXtend Server (hosting operator)Administration (administrative operator, Oulu3D Ltd.)Root Model (Creative Commons)Server Instance (hosting operator)City of Oulu Scene(s)www.ouka.fi/3DServer Instance(s) (hosting operator)NIMO Scene(s)streetartgangs.netServer Instance(s) (hosting operator)MCT Scene(s)MCT3D.netCommercial services Nonprofit services Server Instance(s) (hosting operator)CompX Scene(s)www.compX.com/3DCompXRoot Scene3D Internet OrganizationsModel ElementsCases Oulu3D: Example of utilization in research (UO/CIE)Service Fusion: Real-world online services are fused into Oulu3D

Hickey S, Arhippainen L, Kuusela E, Pakanen M, Pouke M & Karhu A (2012) Service Fusion: Interactive 3D user interface. Proc. MUM 2012, Ulm, Germany, article no. 58.Oulu3D: Example of utilization in research (UO/CIE)Reality vs virtual reality in mobile AR UIComparison of camera-basedaugmented reality UI and3D virtual model based UI

Wizard-of-Oz testing atdowntown Oulu withsimulated location-basedmobile services

Oulu3D: Example of utilization in public serviceCity of Oulu: Urban planning (1)

Oulu3D: Example of utilization in public serviceCity of Oulu: Urban planning (2)

Oulu3D: Example of utilization in businessCyberlightning Ltd.: CyberSlide Oulu3D model as a virtual 3D presentation environment

Oulu3D: Demonstrations on multi-touch surfacesPorting of Service Fusion onto UBI-wall and UBI-table demonstrated at the establishment dinner of the University of Oulus Donors Club, in collaboration with the CIE researchers

Alatalo T, Zanni D, Goncalves J & Ojala T (2013) Porting a 3D tablet interface onto a wall-sized display. CHI 2013 workshop POWERWALL - International Workshop on Interactive, Ultra-High-Resolution Displays, Paris, France, to appear.

Oulu3D: Other R&D utilizationsAs test content in technology developmentPorting of realXtend Tundra SDK to Android (CIE/Chiru project & Ludocraft Ltd.)Development of lightweight web browser client for realXtend targeted for tablets and mobile phones (CIE/Chiru project & Playsign Ltd.)

Creation of 3D marketing video of downtown Oulu (BusinessOulu/Contum)

Environment for virtual sports in 3D Live project (FP7 STREP)

Oulu3D: Ongoing and upcoming activitiesDefine O&M practices with Oulu3D Ltd.

Commence theOpen 3D Internet City Laboratory projectEstablish management groupCollect use cases from the stakeholder communityUpdate requirements for the Oulu3D modelComplete Bystrm houses modelCommence indoor modeling of other buildingsCommence expansion of high-fidelity city modelCommence modeling of low-fidelity regional modelCommence design and implementation of functionalities and interfaces

NIMO: UO WP3 objective #3-2: Pervasive city gamePervasive gaming ~ seamless integration and interaction of real world and game worldDesign and implementation of incremental prototypes of pervasive games for youth utilizing the 3D virtual modelEvaluation via game play by significant number of real players in authentic urban settingClose collaboration with the upcoming MESSI project of City of Oulus Centre of Youth AffairsFirst pervasive city game Street Art GangsTeams of players try to create virtual graffitis around downtown Oulu, at the same time stopping other teams from creating graffitis38

Street Art Gangs: Conceptual architecture

Street Art Gangs: Recent progressGame serverFirst functional prototype co