More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service...
Transcript of More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service...
![Page 1: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/1.jpg)
Round Table Session – Georg Fiechtner
More Efficient and Intuitive PLM by
Integrated AR/VR
![Page 2: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/2.jpg)
Service Portfolio
2
PLM Consulting
PLM Software
Development
Human-System
InteractionAMS
• Processes• Systems• Technologies
• Design• Customization• Implementation• Rollout
• Clients:Rich/Web/Mobile
• VR/AR/MR/VUI• AI
• Global Support Models
• Levels 2-4
![Page 3: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/3.jpg)
3
![Page 4: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/4.jpg)
4
Which Industries are here today?What is your expectation on xR from a today‘s perspective?
![Page 5: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/5.jpg)
Source: https://www.gartner.com/smarterwithgartner/top-trends-in-the-gartner-hype-cycle-for-emerging-technologies-2017/
5
![Page 6: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/6.jpg)
With Expectations Set Straight...
6
VR/AR is gaining momentum
In the Consumer Market
![Page 7: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/7.jpg)
With Expectations Set Straight...
7
Shorter innovation cycle of consumer electronics (< 2 years)
especially due to strong competition
VR/AR is gaining momentum
![Page 8: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/8.jpg)
8
![Page 9: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/9.jpg)
With Expectations Set Straight...
9
Most user friendly/intuitive systems win – Standards emerge
VR/AR is gaining momentum
So
urc
e:
htt
ps:/
/re
ad
wri
te.c
om
/2
01
7/0
7/1
0/vr-
ar-
he
ad
se
t-sa
les-2
02
1-d
l4/
![Page 10: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/10.jpg)
10
What do you expect from the Consumer Market?In your opinion, how does it influence the industry?
![Page 11: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/11.jpg)
11
How can this be applied to PLM?Examples? Why?
![Page 12: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/12.jpg)
VR Product Configurator
12
Mercedes Me Store in Hamburg
Product-
planning
Design &
Engineering
Production-
planningProduction Sales Service Recycling
► „85 percent of new car buyers still make use of the classic dealership
touchpoints, three-quarters of these customers are dissatisfied with the
quality of their experience there“
► real-time gaming technology to create a photorealistic interactive scenario
► real-time rendering on the basis of CAD data and information from PDM
► time required for project: „a few weeks“
Source: http://www.mackevision.com/references/mercedes-benz-w213-real-time-application/
![Page 13: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/13.jpg)
Product Design & Engineering
13
Collaboration in VR
Product-
planning
Design &
Engineering
Production-
planningProduction Sales Service Recycling
So
urc
e: h
ttp
://w
ww
.ma
cke
vis
ion.c
om
/port
folio
/sh
are
d-s
tudio
-vr/
► Rapid presentation and testing of models in different (prepared) scenarios
► Photo-realistic presentation
► A collaborative VR space with multiple users (multi-user approach)
► Worldwide interaction with users in different locations
► Interaction with the VR model such as adding comments or voice notes
![Page 14: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/14.jpg)
Product Design & Engineering
14
BMW Mixed Reality Lab
Product-
planning
Design &
Engineering
Production-
planningProduction Sales Service Recycling
Sources:
(*) https://pro.merckgroup.com/archive/en/welcome-to-the-holodeck/
https://uploadvr.com/bmw-is-using-vr-mixed-reality-build-your-next-car/
https://www.unrealengine.com/en-US/blog/bmw-opts-to-incorporate-htc-vive-vr-headsets-and-mixed-reality-into-the-development-of-new-vehicle-models
► Room-scale VR with an area of 5 x 5 metres
► Based on HTC Vive
► Merge between physical model and photorealistic virtual world
► More than 20 developer stations of this type(*)
► Can cheaply and quickly be updated with better and
additional hardware, e.g.
o New version of base stations (10 x 10 metres VR area)
o Wireless HMD-Kit (TPCast, ...)
o Finger/Hand-capturing (Leap Motion, ...)
► Based on Unreal(R) Game Development Platform / Engine
![Page 15: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/15.jpg)
15
Training for Assembly & Service
Product-
planning
Design &
Engineering
Production-
planningProduction Sales Service Recycling
VR Repair Training
VR Assembly Training ► Room-scale VR with an area of 5 x 5 metres
► Based on HTC Vive
► Based on Unity Game Development Platform / Engine
► For Mobile and VR devices
► Training context and content defined in dynamically loaded PLMXML
► Supports parts, tools, operational information,
assembly/disassembly animations (from NX)
► Uses pre-defined scenes
► Semi-automatic CAD-data preparation (tesselation / cleanup)
PITERION Customer Studies
![Page 16: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/16.jpg)
How is it Done?
16
Semi-automatic step from PLM to VR / Rise of content creation plattforms
Product-
planning
Design &
Engineering
Production-
planningProduction Sales Service Recycling
Source: http://www.mackevision.com/portfolio/visualization-data-management/
Authoring Plattform/Pipeline
![Page 17: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/17.jpg)
17
![Page 18: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/18.jpg)
Design Validation
19
Dealing with large and multi-format CAD-data sets
PDM
CA
D
Pro
cess
Dat
a
Insp
ecti
on
Sce
ne
Automated CAD Conversion+ Reference Mapping
UpdateChanges
UpdateChanges
Reference Mapping+ Transfer Changes
Minutes Seconds
VR
Insp
ecti
on
VR
Sce
ne
& M
od
el
![Page 19: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/19.jpg)
Process Simulate to VR
20
Manufacturing – Programming Robots in VR
![Page 20: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/20.jpg)
21
(*) exluding application of materials
![Page 21: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/21.jpg)
Usability Improvements
22
► Mitigate Motion Sickness
► Dynamic calibration of HMDs
► Natural User Interfaces (Gesture, Voice, Gaze)
► Adapt to User (experience, needs, limitations)
► Use of Cognitive Capabilities...
(Machine Learning)
VR/AR must be as immersive and intuitive as the real world
![Page 22: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/22.jpg)
Cognitive AR
23
Machine Learning Methods + Augmented Reality Techniques
Sourc
e: http://w
ww
.ioxp.d
e/e
n/ioxpcognitiv
e-a
r/
Step 1: Record actions of expert
![Page 23: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/23.jpg)
Cognitive AR
24
Machine Learning Methods + Augmented Reality Techniques
Step 2: Understand workflow &
automatically create service manual
Sourc
e: http://w
ww
.ioxp.d
e/e
n/ioxpcognitiv
e-a
r/
![Page 24: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/24.jpg)
Cognitive AR
25
Machine Learning Methods + Augmented Reality Techniques
Step 3: Guide user from any step &
understand progress
Sourc
e: http://w
ww
.ioxp.d
e/e
n/ioxpcognitiv
e-a
r/
![Page 25: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/25.jpg)
Cognitive AR
26
Machine Learning Methods + Augmented Reality Techniques
Step 3: Guide user from any step &
understand progress
Sourc
e: http://w
ww
.ioxp.d
e/e
n/ioxpcognitiv
e-a
r/
![Page 26: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/26.jpg)
Cognitive VR
27
Machine Learning Methods + Virtual Reality Techniques
Sourc
e: https://c
ognitiv
e3d.c
om
/► Measure action and engagement in immersive vehicle experiences
► Develop insights around showroom configurations
► Identify issues or compliance with training scenarios
► Test manufacturing and assembly line configurations
► Determine health and safety issues in manufacturing process
![Page 27: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/27.jpg)
A Quick Glance into the Future
![Page 28: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/28.jpg)
The Future of Industrial xR
29
► xR will be the medium to reduce complexity, transport information, create content
(in combination with other technologies, like Machine Learning)
► xR Authoring Plattforms and Pipelines will emerge
► That either interface or merge with current PLM systems (only way to scale)
► xR is all about software – it will become device agnostic
► People will become more and more xR savy (like with smartphones today)
► There will be standards and best practices on how to interact with xR
(heavily influenced by the consumer market)
~ 5+ years
![Page 29: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/29.jpg)
PLM
Co
gn
itiv
e
Me
tho
ds
30
Plattform for PLM-VR/AR/MR Applications
Device Abstraction
xR-Plattform
Process
Data
xR-Authoring
xR-PLM Plattform
ScenesCAx
FunctionsMaterials
xR-BOM/BOP
Autom. CAD Import/Preparation Virtual Collaboration
![Page 30: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/30.jpg)
31
Start now and make xR a vital part of your Digitalization Strategy!
![Page 31: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/31.jpg)
32
Where is your standing with xR?In Consideration/PoC/Large Scale Use?
![Page 32: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/32.jpg)
Thank You for Your Attention!
![Page 33: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/33.jpg)
Tel.:
Fax:
Mob:
Email:
Web: www.piterion.com
Georg FiechtnerInnovation Management
+49 89-2000 395-62
+49 89-2000 395-80
+49 173 6041751
PITERION GmbH
Reichenbachstraße 2
85737 Ismaning
3424.10.2017
![Page 34: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/34.jpg)
„... A membership funded alliance, helping to accelerate the
adotion of Enterprise Augmented Reality by creating a
comprehensive ecosystem.“
http://thearea.org/
![Page 35: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/35.jpg)
The cross-platform VR standard
eliminates industry fragmentation
by enabling applications to be
written once to run on any VR
system, and to access VR devices
integrated into those VR systems to
be used by applications.
https://www.khronos.org/openxr
![Page 36: More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service Product-planning Design & Engineering Production-planning Production Sales Service](https://reader030.fdocuments.in/reader030/viewer/2022041100/5ed80ad7cba89e334c6722af/html5/thumbnails/36.jpg)
37
Source: https://uploadvr.com/oculus-nate-mitchell-oc4/
More than a Hype?