A complete interior design solution with diminished reality
2
[email protected] [email protected], [email protected] [DEMO] A Complete Interior Design Solution with Diminished Reality Sanni Siltanen* Henrikki Saraspää* Jari Karvonen* VTT Technical Research Centre of Finland Vivid Works Ltd Vivid Works Ltd ABSTRACT We demonstrate an interior design solution with advanced features, most importantly, a diminished reality feature. The diminished reality functionality takes 3D indoor structures into account and adapts to the lighting of the environment. We present two demonstrations on tablet and laptop. The iPad version utilizes touch screen for selecting removed objects from the image. It allows users to build modular furniture and it casts shadows of the virtual furniture for realistic visualization result. On laptop PC we demonstrate real time diminished reality for indoor AR with several options. Our demonstrations are optimized for interior design and indoor AR. Keywords: Augmented reality, AR, diminished reality, indoor AR, interior design, object removal, illumination adaptation, real- time, user interaction, tablet PC, iPad, touch screen. Index Terms: H.5 [Information Interfaces and Presentation]— Artificial, augmented, and virtual realities; 1 INTRODUCTION Diminished reality is area of augmented and mixed reality where something real is removed virtually from the images. Diminished reality is needed for example in augmented reality interior design, when people want to virtually test new furniture, and the existing furniture is still in place. Diminished reality can also be used for occlusion handling; if a foreground object is unimportant, and something needs to be augmented behind it, it can be removed virtually (Figure 4). Researchers have presented several solutions for diminished reality [1, 2, 3, 4]. Some of them need background information [1] or assume the object to be planar or nearly planar [2]. Some utilize 3D structure information [3] and some adapt to lighting changes [4]. Most methods work great when the inpainted area is small, but have problems when it grows. In interior design, the system does not have any information of the background texture, but may utilize 3D information of walls and floor. The environment may have large variations and changes in illumination and the diminished object may be large. We demonstrate a diminished reality solution that can handle large 3D objects such as furniture; it works in real time, adapts to lighting. All in all it is a complete solution for handling indoor diminished reality needed in interior design applications. Our demonstration utilizes method developed at VTT in cooperation with Vivid Works Ltd [5]. 2 TABLET PC (I PAD) The iPad version utilizes touch screen interface for selecting objects to be removed from the picture. The pictures can be taken either with or without the marker while maintaining the correct perspective for augmenting the furniture in the picture. The iPad version also allows user to build modular furniture and try out the available color and fabric options. Also pricing related information and product measurements are dynamically calculated while the user makes changes to the configuration. To increase realism in visualization the application uses multiple effects (such as shadows, antialiasing and color correction) to achieve best possible augmentation result. . Figure 1: With the iPad application the user can take a set of still images and the plan the augmentation with time. 371 IEEE International Symposium on Mixed and Augmented Reality 2014 Science and Technology Proceedings 10 - 12 September 2014, Munich, Germany 978-1-4799-6184-9/13/$31.00 ©2014 IEEE
-
Upload
vtt-technical-research-centre-of-finland -
Category
Design
-
view
103 -
download
0
description
We demonstrate a diminished reality solution that can handle large 3D objects such as furniture; it works in real time, adapts to lighting. All in all it is a complete solution for handling indoor diminished reality needed in interior design applications.
Transcript of A complete interior design solution with diminished reality
[email protected] [email protected],[email protected]
[DEMO] A Complete Interior Design Solution with Diminished Reality
Sanni Siltanen* Henrikki Saraspää* Jari Karvonen*
VTT Technical Research Centre of Finland Vivid Works Ltd Vivid Works Ltd
ABSTRACTWe demonstrate an interior design solution with advancedfeatures, most importantly, a diminished reality feature. Thediminished reality functionality takes 3D indoor structures intoaccount and adapts to the lighting of the environment. We presenttwo demonstrations on tablet and laptop. The iPad version utilizestouch screen for selecting removed objects from the image. Itallows users to build modular furniture and it casts shadows of thevirtual furniture for realistic visualization result. On laptop PC wedemonstrate real time diminished reality for indoor AR withseveral options. Our demonstrations are optimized for interiordesign and indoor AR.
Keywords: Augmented reality, AR, diminished reality, indoorAR, interior design, object removal, illumination adaptation, real-time, user interaction, tablet PC, iPad, touch screen.Index Terms: H.5 [Information Interfaces and Presentation]—Artificial, augmented, and virtual realities;
1 INTRODUCTIONDiminished reality is area of augmented and mixed reality wheresomething real is removed virtually from the images. Diminishedreality is needed for example in augmented reality interior design,when people want to virtually test new furniture, and the existingfurniture is still in place. Diminished reality can also be used forocclusion handling; if a foreground object is unimportant, andsomething needs to be augmented behind it, it can be removedvirtually (Figure 4).
Researchers have presented several solutions for diminishedreality [1, 2, 3, 4]. Some of them need background information [1]or assume the object to be planar or nearly planar [2]. Someutilize 3D structure information [3] and some adapt to lightingchanges [4]. Most methods work great when the inpainted area issmall, but have problems when it grows.
In interior design, the system does not have any information of thebackground texture, but may utilize 3D information of walls andfloor. The environment may have large variations and changes inillumination and the diminished object may be large.
We demonstrate a diminished reality solution that can handlelarge 3D objects such as furniture; it works in real time, adapts tolighting. All in all it is a complete solution for handling indoordiminished reality needed in interior design applications. Ourdemonstration utilizes method developed at VTT in cooperationwith Vivid Works Ltd [5].
2 TABLET PC (IPAD)The iPad version utilizes touch screen interface for selectingobjects to be removed from the picture. The pictures can be takeneither with or without the marker while maintaining the correctperspective for augmenting the furniture in the picture. The iPadversion also allows user to build modular furniture and try out theavailable color and fabric options. Also pricing relatedinformation and product measurements are dynamically calculatedwhile the user makes changes to the configuration. To increaserealism in visualization the application uses multiple effects (suchas shadows, antialiasing and color correction) to achieve bestpossible augmentation result.
.
Figure 1: With the iPad application the user can take a set of stillimages and the plan the augmentation with time.
371
IEEE International Symposium on Mixed and Augmented Reality 2014Science and Technology Proceedings10 - 12 September 2014, Munich, Germany978-1-4799-6184-9/13/$31.00 ©2014 IEEE
The tablet version is built on top of VividPlatform Cloud service.The 3D content, product related rules and configuration arelocated on the server side which makes the application easilymaintainable and gives a flexibility to connect the application toany backend service, ERP or web-shop. Moreover, the diminishedcalculations are executed on the server
3 REAL-TIME DEMONSTRATION ON LAPTOP PCWe present a real-time method for AR interior design. In theinitialization phase, user selects the area to be diminished (Figure2, a). Then the area is diminished on real time (Figure 2, b), andaugmentation is made (Figure 2, c). Even large areas can bediminished seamlessly thanks to lighting adaptation (Figures 2band 4).
a)
b)
Figure 2: a) In the initialization phase, user can select diminishedarea (blue polygon) and indicate edge between floor-wall(green-line). b) Thereafter, the area is diminished in real time,and c) virtual furniture can be augmented.
We also demonstrate diminishing using a volume. In realapplication the diminished volume can be defined e.g. with depthcameras. Our demonstration is independent of the way it isproduced. For simplicity we use a rectangular volume (Figure 3).
Figure 3: Diminished area defined by a volume.
We will bring a dollhouse room with furniture for the ISMARdemonstration session, so the visitors can play with it (see Figures2 and 3).
Figure 4: Diminished reality can also be used to remove unwantedobjects from foreground. Irregular wall decoration texture isnicely imitated in inpainting texture.
4 SUMMARYWe present a complete augmented reality interior design solutionon iPad and real time demonstration of diminished reality onlaptop.
REFERENCES[1] Zhuwen Li, Yuxi Wang, Jiaming Guo, Loong-Fah Cheong, Steven
Zhiying Zhou, Diminished reality using appearance and 3Dgeometry of internet photo collections, ISMAR 2013, pp. 11-19
[2] Norihiko Kawai, Masayoshi Yamasaki, Tomokazu Sato, andNaokazu Yokoya. AR marker hiding based on image inpaintingand reflection of illumination changes. ISMAR 2012. pp. 293-294.
[3] Kawai, N.; Sato, T.; Yokoya, N., Diminished reality consideringbackground structures, ISMAR 2013, pp.259,260
[4] Herling, J.; Broll, W., PixMix: real-time approach to high-qualityDiminished Reality, ISMAR 2012, pp.141-150
[5] Siltanen, Sanni “Diminished and Mediated Reality for AugmentedReality Interior Design”, Title subject to changes, to be published.
372
