c-Space Project - Fraunhofer IGD · c-Space Project AIM S&T OBJECTIVES The aim of c-Space is to...

1
c-Space Project AIM S&T OBJECTIVES The aim of c-Space is to create new technologies aiming at supporting creativity processes. The 3D reconstruction framework of c-Space leverages on videos recorded with mobile devices for the creation, in nearly real-time, of a continuously evolving 4D model (3D plus time) of the corresponding real scene. The adaptive and affective content access module helps the creative process by reducing the time needed to find the appropriate and at the same time increasing its quality. It relies on affective computing to detect emotions, which in turn help creators to iterate and improve the quality of their designs. Lastly, c- Space introduces also new visual paradigms based on interaction with pico-projected content. In contrast to traditional augmented reality strategies that require the user to wear head-mounted displays, mobile content projections are not limited to users wearing the AR devices and path new way in the augmentation of the c-Space addresses the strategic Objective ICT-2013.8.1 “Technologies and scientific foundations in the field of creativity” targeting the topic “a) Creative experience tools”. The precise list of S&T objectives is: Objective 1: To allow interactive near real-time 4D reconstruction of real scenes from pictures and live video streams coming from multiple users. Objective 2: To deliver a mechanism based on crowdsourcing that promotes reconstruction of 3D scenes for different creative purposes. Objective 3: To ensure the very high-quality visualization of content within an Augmented Reality application for portable devices (smartphones, tablets) that accounts for real geometry of surrounding space. Objective 4: To deliver a more immersive experience and create new visual computing paradigms based on interaction with content projected in the real environment that surrounds the user. Objective 5: To facilitate intuitiveness and user friendliness through a dialogue-based interaction founded on affective computing paradigms. Objective 6: To develop a system that can be run on consumer mobile technology, either already available today or that is set to reach the market shortly (e.g. pico-projectors). Objective 7: To define a business model that can ensure low-cost 3D modelling software as a service, thus allowing cost-effective, IT-asset-free operations, facilitating adaptation to varying market demand. Objective 8: To develop low-level technology that is then further specialized to respond to requirements of individual creators as well as specialized SMEs in 3 domains: architecture, advertisement, cultural tourism. Objective 9: To demonstrate c-Space in the following real life scenarios with involvement of the following SME partners of the project. ARCHITECTURE AND URBAN PLANNING The objective of this demonstrator is to deliver a software framework to professionals in urban planning and architecture that facilitates the access to sets of historical and morphological data through a number of interoperable web-services. The access and use of these web-services is fundamental to a proper “augmentation” of the real scene. For example, these web-services allow urban planners to easily integrate 3D digital reconstructions into their presentations, which are automatically created from images and videos, and that are functional to tasks that involve visual inspection, design iteration and discussion of real landscape. In addition, this demonstrator explores new forms of collaboration throughout “augmented” scenes to enable people with different backgrounds to join participative and cooperative process. MOBILE ADVERTISEMENT This demonstrator that targets mobile advertisement take advantage of augmented reality to offer brands a unique new opportunity to interact with consumers. The objective of this demonstrator is to rely upon on projected AR paradigms to deliver a richer experience and to create more innovative forms of advertisement through projection - around the users - of interactive content on the real world, perfectly “blended” within the real scene. INDIVIDUAL CONTENT CREATION & CULTURAL TOURISM The cultural tourism demonstrator is a software experiment that can be used by SMEs operating in the cultural tourism industry to create highly personalized cultural routes throughout a real space. By using the c-Space, content creators are able to access digital content, reference it to the real space, and cross-link it to create a network of geographical and logical hyperlinks. DEMONSTRATORS c-Space Grant agreement no: 611040 fostering new creative paradigms based on recording and sharing “casual” videos through the internet. Dutch Design Week, Eindhoven, Netherlands, 2015 scan to discover Dr. Raffaele De Amicis Project Coordinator Office: +39 0461 283395 Fax: +39 0461 283398 Mobile: +39 3316 104569 [email protected] CONSORTIUM PARTNERS TIMELINE KICK-OFF November 2013 4D RECONSTRUCTION January 2015 AFFECTIVE CONTENT April 2015 AR APPLICATIONS October 2015 WEB API July 2015 END OF PROJECT May 2016 1 st PUBLIC RELEASE January 2015 The FP7 European Union Funding for Research & Innovation surrounding environment with new scenarios for collaborative experience.

Transcript of c-Space Project - Fraunhofer IGD · c-Space Project AIM S&T OBJECTIVES The aim of c-Space is to...

Page 1: c-Space Project - Fraunhofer IGD · c-Space Project AIM S&T OBJECTIVES The aim of c-Space is to create new technologies aiming at supporting creativity processes. The 3D reconstruction

c-Space Project

AIM

S&T OBJECTIVES

The aim of c-Space is to create new technologies aiming atsupporting creativity processes. The 3D reconstructionframework of c-Space leverages on videos recorded withmobile devices for the creation, in nearly real-time, of acontinuously evolving 4D model (3D plus time) of thecorresponding real scene. The adaptive and affectivecontent access module helps the creative process byreducing the time needed to find the appropriate and atthe same time increasing its quality. It relies on affectivecomputing to detect emotions, which in turn help creatorsto iterate and improve the quality of their designs. Lastly, c-Space introduces also new visual paradigms based oninteraction with pico-projected content. In contrast totraditional augmented reality strategies that require theuser to wear head-mounted displays, mobile contentprojections are not limited to users wearing the AR devicesand path new way in the augmentation of the

c-Space addresses the strategic Objective ICT-2013.8.1 “Technologies andscientific foundations in the field of creativity” targeting the topic “a)Creative experience tools”. The precise list of S&T objectives is:

• Objective 1: To allow interactive near real-time 4D reconstruction of realscenes from pictures and live video streams coming from multiple users.

• Objective 2: To deliver a mechanism based on crowdsourcing that promotesreconstruction of 3D scenes for different creative purposes.

• Objective 3: To ensure the very high-quality visualization of content within anAugmented Reality application for portable devices (smartphones, tablets)that accounts for real geometry of surrounding space.

• Objective 4: To deliver a more immersive experience and create new visualcomputing paradigms based on interaction with content projected in the realenvironment that surrounds the user.

• Objective 5: To facilitate intuitiveness and user friendliness through adialogue-based interaction founded on affective computing paradigms.

• Objective 6: To develop a system that can be run on consumer mobiletechnology, either already available today or that is set to reach the marketshortly (e.g. pico-projectors).

• Objective 7: To define a business model that can ensure low-cost 3Dmodelling software as a service, thus allowing cost-effective, IT-asset-freeoperations, facilitating adaptation to varying market demand.

• Objective 8: To develop low-level technology that is then further specializedto respond to requirements of individual creators as well as specialized SMEsin 3 domains: architecture, advertisement, cultural tourism.

• Objective 9: To demonstrate c-Space in the following real life scenarios withinvolvement of the following SME partners of the project.

ARCHITECTURE AND URBAN PLANNING

The objective of this demonstrator is to provideprofessionals in urban planning and architecture withthe possibility to access sets of historical andmorphological data through a number of standardweb-services, which are then used to “augment” thereal scene. This demonstrator will allow studyingcollaborative solutions throughout “augmented”scenes that make it possible for the various people tojoin a participative/cooperative process. This processmakes it possible to assess possible projects withinthe real landscape as automatically reconstructed byc-Space.

MOBILE ADVERTISEMENT

Combining the digital and physical worlds, augmentedreality offers brands a unique new opportunity tointeract with consumers. With this demonstrator, c-Space relys upon on projected AR paradigms todeliver a richer experience and create moreinnovative forms of advertisement through projection- around the users - of interactive content on the realworld, perfectly “blended” within the real scene.

INDIVIDUAL CONTENT CREATION &CULTURAL TOURISM

This demonstrator is deployed as a softwarecomponent that can be used by SMEs operating in thecultural tourism industry to create highly personalisedcultural routes throughout a real space. By using thec-Space, content creators will be able to access digitalcontent, reference it to the real space, and cross-link itto create a network of geographical and logicalhyperlinks.

ARCHITECTURE AND URBAN PLANNING

The objective of this demonstrator is to deliver asoftware framework to professionals in urbanplanning and architecture that facilitates the access tosets of historical and morphological data through anumber of interoperable web-services. The accessand use of these web-services is fundamental to aproper “augmentation” of the real scene. Forexample, these web-services allow urban planners toeasily integrate 3D digital reconstructions into theirpresentations, which are automatically created fromimages and videos, and that are functional to tasksthat involve visual inspection, design iteration anddiscussion of real landscape.

In addition, this demonstrator explores new forms ofcollaboration throughout “augmented” scenes toenable people with different backgrounds to joinparticipative and cooperative process.

MOBILE ADVERTISEMENT

This demonstrator that targets mobile advertisementtake advantage of augmented reality to offer brands aunique new opportunity to interact with consumers.The objective of this demonstrator is to rely upon onprojected AR paradigms to deliver a richer experienceand to create more innovative forms of advertisementthrough projection - around the users - of interactivecontent on the real world, perfectly “blended” withinthe real scene.

INDIVIDUAL CONTENT CREATION &CULTURAL TOURISM

The cultural tourism demonstrator is a softwareexperiment that can be used by SMEs operating in thecultural tourism industry to create highly personalizedcultural routes throughout a real space. By using thec-Space, content creators are able to access digitalcontent, reference it to the real space, and cross-link itto create a network of geographical and logicalhyperlinks.

DEMONSTRATORS

c-SpaceGrant agreement no: 611040

fostering new creative paradigms based on recording and sharing “casual” videos through the internet.Dutch Design Week, Eindhoven, Netherlands, 2015

scan to discover

Dr. Raffaele De AmicisProject Coordinator

Office: +39 0461 283395Fax: +39 0461 283398

Mobile: +39 3316 [email protected]

CONSORTIUM

PARTNERS

TIMELINE

KICK-OFFNovember 2013

4D RECONSTRUCTIONJanuary 2015

AFFECTIVE CONTENTApril 2015

AR APPLICATIONSOctober 2015

WEB APIJuly 2015

END OF PROJECTMay 2016

1st PUBLIC RELEASEJanuary 2015

The FP7 European Union Funding for Research &

Innovation

surrounding environment with newscenarios for collaborative experience.