Displays, HUD and Augmented Reality -...
Transcript of Displays, HUD and Augmented Reality -...
![Page 1: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/1.jpg)
Displays, HUD and Augmented RealityWardsAuto UX, Oct. 4, 2016
![Page 2: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/2.jpg)
Our Vision:
A global leader in automotive cockpit electronics delivering a rich, connected cockpit experience for all cars from luxury to entry segment.
Our Mission:
To be the foremost leader in driver information and connected infotainment solutions that enables a rich driving experience in a safe
and convenient manner. We will achieve this through relentless pursuit of excellence in electronics and software technology
as well as global execution.
2
![Page 3: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/3.jpg)
Broadest cockpit electronics portfolio in the industry
Complete cockpit electronics portfolio positions Visteon well for continued growth
Instrument
clusters
Head-up
displays
Telematics Cockpit domain
controllers
Information
displays
AudioInfotainment
3
![Page 4: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/4.jpg)
Topics for Today
• Displays proliferation and user interaction
• Driver information display trends
• HUDs and augmented reality
4
![Page 5: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/5.jpg)
Trends in display integration in instrument panel: wider displays
Extra-wide information display, shared between driver and passenger5
BMW Concept Interactive Vision (CES 2016)
PSA Citroen CXperience (Paris 2016)
Mercedes F015(IAA 2015)
![Page 6: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/6.jpg)
Avoiding driver distraction
• Wider information display, or dedicated passenger display, allows for additional content (entertainment, services) for passenger
• To avoid driver distraction, a privacy mode feature is then required (static or switchable)
Multiplication of displays requires increased focus on driver distraction avoidance6
Normal mode Privacy mode
![Page 7: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/7.jpg)
Trends in display integration in instrument panel: seamless
• Designers wish to seamlessly integrate displays in instrument panel
• Freeform shapes, no visible display active areas
• Will touch still be the most adapted solution for user interaction?
Seamless display integration and emerging occupant interface technologies7
![Page 8: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/8.jpg)
Future spatial gesture recognition solutions
From simple gesture recognition to more elaborate body language 7
• Visteon InfraRed technology unit
• Hand approach and tracking
• Swipe left / right
• CW / CCW rotation
• Low-cost CMOS camera
• Static gesture
• increased spatial recognition envelop
• Multiple axis detection
• Time of Flight camera technology
• High-quality proximity detection
• 3-D hand gesture detection
• Virtual touch panel
• Driver / passenger identification
![Page 9: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/9.jpg)
Driver information display trends
![Page 10: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/10.jpg)
• Reconfigurable clusters becoming standard; designers looking for ways to enhance driver experience
• Growing interest in technologies increasing depth of the image –enabling 3-D effects – for a more immersive experience
10
![Page 11: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/11.jpg)
Increased depth for driver information
11
Multi-layer display
• Delivers depth with use of transparent display over traditional display
Prism display
• Delivers depth with use of two displays and a semi-reflective “blade” in between
Auto-stereoscopic display
• Uses switchable parallax barriers to generate 3-D effect
• Requires eye-tracking information for smoother experience
![Page 12: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/12.jpg)
Prism display
Scalable multi-layer display
- 1X reflective
blade
- 2x 12.3” TFT
display• Scalable concept using standard
LCD-TFTs display sizes
• Importance of GUI definition to maximize benefits of 3-D effects and transitions
• Prototype sample (mass production in 2019)
13
![Page 13: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/13.jpg)
HUD and augmented reality
![Page 14: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/14.jpg)
HUD – Visteon’s history
After being first to market with combiner HUD, Visteon HUDs proliferate across regions and customers
2009
2010
2012
14
Acura C-SUV
China
SGM GL8
China
Late 2016
Japan OEM X
2017
Japan OEM Y
2018
N. America OEM
2019
Japan OEM Z
Europe OEM
PSA Expert / Jumpy /
Traveler / Space Tourer
Europe
The head up display creates an unleashed selling
point on the 3008 and 5008 Peugeot vehicles.
Head of purchasing, PSA
“Visteon wins PSA Innovations Award
![Page 15: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/15.jpg)
15
2010
2015
2017
~2020
HUD roadmap – from standard HUDs to augmented reality
4.5° x 1.5°
7° x 3°
10° x 3°
> 10° x 4° AR
Field of View
![Page 16: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/16.jpg)
What is augmented reality HUD?
16
Conventional HUD
Visual assistance system to increase driving safety and
user experience
Transition from
- below line of sight -
into
- drivers direct vision -
overlaying
- reality and information -
Augmented Reality HUD
Further enhances driver’s experience and generates faster reliable decisions out of ADAS-
system data in real time
![Page 17: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/17.jpg)
Augmented reality HUD – basic features
Lane departure warning Adaptive cruise control Intuitive navigation
SENSE
Data acquisitionINFORM
HMI generation
CamerasExternal and internal
Car sensorsSpeed/acceleration,
steering angle
NavigationGPS/positioning
Data fusion
• Data processing
• Data fusion
• AR decision making
• Dynamic coordinates
positioning
• Prediction function
AR HUD Image generation
• Real-time drawing
• Dynamic object
creation
• Warping pre-correction HUD
domain
ADAS
domain
ANALYZE
Data fusion
18
![Page 18: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/18.jpg)
Single image AR HUD – fixed virtual image distance• Vertical virtual image (10°x4.5° at 15m)
• Not parallax-free, eye tracking system required
• Lower optical design complexity
Dual image AR HUD – variable virtual image distance• Parallax-free, no eye-tracking system required
• Dual optical system to add conventional HUD information (10°x5° lying on the road at 10 to 20m / 5°x1° classic HUD @ 2m)
• More complex optical design and increased packaging challenge
Augmented reality HUD – optical concepts
19
![Page 19: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/19.jpg)
• Increased image size and projection distance generates packaging challenges
• Ergonomic studies allow confirmation of minimum image size by feature
Augmented reality HUD – ergonomic studies
Blind spot detection Adaptive cruise control
20
![Page 20: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/20.jpg)
Augmented reality – audio HMI
• Human ear is always active
• Ear is permanently listening in all directions
• Acoustic channel is hardly used for automotive HMI
Bikes
Blind spot
detectionForward collision
warning
Pedestrians
Multimodal HMI vehicle
• Integrates driver into environment through
acoustic cues to increase safety
• Immersive audio must be relevant – should be
contextual
21
![Page 21: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/21.jpg)
HUD and augmented reality – conclusions
• While packaging remains a challenge, existing HUD technologies (TFT, DLP, laser) are available to introduce basic augmented reality features in near future
• Enhancing driving experience by providing relevant and intuitive information about driving and ADAS
• Augmented reality experience will support the transition towards autonomous driving by reassuring driver in semi-autonomous mode
• New technologies (e.g., holographic optical elements) may allow for package size reduction in the future and enable wider adoption
Augmented reality HUD will support transition to autonomous driving22
![Page 22: Displays, HUD and Augmented Reality - WardsAutowardsauto.com/site-files/wardsauto.com/files/uploads/2016/10/05... · Complete cockpit electronics portfolio positions Visteon well](https://reader031.fdocuments.in/reader031/viewer/2022022513/5aeb2c4b7f8b9ae5318d6856/html5/thumbnails/22.jpg)