Advanced IP solutions enabling the autonomous … multi-core Computer Vision Control Cortex-A55 +...

© 2017 Arm Limited

Shanghai, Beijing, Shenzhen

Arm Tech Symposia 2017

Advanced IP solutions enabling the autonomous

driving revolution

Chris Turner | Director, Emerging Technology

& Strategy, Embedded & Automotive | Arm

© 2017 Arm Limited 2

Agenda

Autonomous vehicles

Heterogeneous processing

Arm IP in driving systems

Safety and security


Connected autonomous vehicles

Communication

5G cellularV2X

Processing

System on ChipSoftware

Cloud

Machine IntelligenceBig data

Sensing & Actuation

Computer VisionRadar, Lidar


Autonomous driving

Level 0

No Automation

Full-time human driver for all aspects driving, even with warning systems

Level 1

Driver Assistance

Mode-specific driver assistance of either steering or acceleration/deceleration with human driver for remaining task

Level 2

Partial Automation

Mode-specific driver assistance of both steering and acceleration/deceleration with human driver for remaining task

Level 3

Conditional Automation

Mode-specific Automated Driving of all dynamic driving task with human driver responding to a request to intervene

Level 4

High Automation

Mode-specific Automated Driving of all driving task, even if a human driver does not respond

Level 5

Full Automation

Full-time Automated Driving under all roadway and environmental conditions

Human Monitoring Machine Monitoring


Where are the challenges?

Complex and demanding compute requirements

High-integrity functional safety requirements

Multiple security issues and data privacy


Total automotive computing from Arm

Computer Vision

• Sensing and perceiving the driving scene

• Sensor fusion with radar, lidar etc.

Machine Learning

• Cognition

• Mission objective

Mapping

• 360 degree mapping

• Precision navigation

Decision & Actuation

• Course of action

• Real-time control

Arm Compute Library for fast deployment of CV & ML


Navigation & Infotainment

Energy-aware schedulingRich OSSecurity

Cortex-A75 + Cortex-A55 + Mali G51Vision ADAS

Heterogeneous multi-coreComputer Vision

Control

Cortex-A55 + Cortex-R52

Powertrain

Real timeHomogeneous multi-core

Cortex-R52Cortex-R52

Autonomous driving

High performance multi-clusterMachine LearningFunctional safety

Cortex-A75 + Mali G72 + Mali-C71 + Cortex-R52

Other modules

Radar

V2X

Chassis

Sensor

Audio

Security

Networks

Arm processors for automotive

Central body control

Low power Efficient performance

Scalable

Cortex-M7, Cortex-M0+


Safety and security

Safety and security are intimately related and some languages don’t differentiate:

安全, sécurité, Sicherheit, säkerhet, turvallisuus, …

Environment

System

Security Safety

SecurityProtects things and defends from malicious attack

SafetyLimits uncontrolled system behaviour to prevent harm

Data

Both guard against undesirable situations and together form a barrier that protects us and our things


▪ Cache parity / ECC▪ Exception handling▪ MMU▪ RAS features

Cortex-A55& future Cortex-A

Functional Safety throughout Arm CPUs

† availability dependent on processor

Cortex-M3/M4Cortex-M0+

▪ Exception handling▪ MPU▪ SW test library

▪ Cache parity / ECC†

▪ Exception handling▪ MMU

Cortex-AArmv8-A

▪ Dual core lockstep†

▪ ECC interface†

▪ Exception handling▪ MPU▪ Stack limit check▪ SW test library

Cortex-M33Cortex-M23

▪ TCM ECC interface▪ MBIST interface▪ Dual core lockstep▪ Cache ECC▪ Exception handling▪ MPU

Cortex-M7

▪ Virtualization▪ Bus protection▪ SW test library▪ System error▪ Bus ECC▪ Error management▪ TCM ECC▪ MBIST interface▪ Dual core lockstep▪ Cache ECC▪ Exception handling▪ Two-stage MPU

Cortex-R52

▪ Bus ECC▪ Error management▪ TCM ECC▪ MBIST interface▪ Dual core lockstep▪ Cache ECC▪ Exception handling▪ MPU

Cortex-R5

SIL3/ASIL D systematic capabilitySIL2/ASIL B systematic capability


Complete Arm solution for automotive SoC development

Solutions built from Arm IP

• Computing capability meets requirements• Within power and thermal constraints

• Accelerators• Task-specific processing complements mainstream computing

• System IP• Interconnect system IP delivering coherency and quality of

service required for optimum memory bandwidth

• Software programming environment• Managing complexity, ease of use, task separation

• Sub-systems• Efficient integration and communication, vehicle-wide


Mali-GPUs: Enabling tomorrow’s technology todayMali-G72 is Arm’s latest high-performance GPU, Mali-G51 provides mid-range efficiency

Optimised machine learning and computer vision

• Performance and efficiency for autonomous drive

• Face tracking and speech recognition for IVI

Advanced capabilities

• High fidelity graphics for latest displays

• Augmented reality for applications such as mirror replacement

Strong ecosystem

• Arm Compute Library for CV & ML

• QNX OS, graphics libraries and Linux drivers for IVI

Arm Mali is #1 for GPUs shipped


Image Signal Processing from Arm

Autonomous drive

• Ultra-wide dynamic range for lighting extremes

• Simultaneous support for human display and computer vision

• Every pixel reliable with real-time diagnostic capability

• Quad camera capability for cost efficiency

Cockpit

• Mirror replacement

• 360 surround view

• Road sign recognition

• Driver alertness

Mali-C71 designed for automotive vision


Arm compiler support for functional safety

Compiler safety package for software development in safety markets

• Industrial control, automotive, medical, transportation, military and others

Access to the safety package provided with DS-5 Ultimate and Keil MDK Pro

• Valid DS-5 or MDK support and maintenance entitlement enables extended maintenance

• Compiler installation is an add-on to the standard product installation

Functional Safety Certified

• TÜV SÜ D certification• ISO 26262 (ASIL D)• IEC 61508 (SIL 3)

Qualification Kit

• Development process docs• Safety manual• Defect report• Test report

Extended Maintenance

• Five year commitment• Technical support• Critical defect fixes


Arm TrustZone and Platform Security Architecture (PSA)Arm security throughout the SoC

Shifting the economics of security

• Easy and affordable

• Throughout the life-cycle

Endpoint-to-ecosystems security

• Sensors to cloud

Making security deployable at scale

• Throughout the vehicle

• Across the market


Arm solutions for automotive

Architecture and performance leadership for the car of the future

Best performance in tight thermal and space constraints

Safe and secure with ISO 26262, PSA and Arm TrustZone

Diverse and competitive supply chain to the automotiveindustry supported by a rich ecosystem

Comprehensive economic solutions throughout the vehicle

1717 © 2017 Arm Limited

The Arm trademarks featured in this presentation are registered trademarks or trademarks of Arm Limited (or its subsidiaries) in the US and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners.

www.arm.com/company/policies/trademarks

Advanced IP solutions enabling the autonomous … multi-core Computer Vision Control Cortex-A55 +...

Documents

Transcript of Advanced IP solutions enabling the autonomous … multi-core Computer Vision Control Cortex-A55 +...