Networks for Cyber Physical Automotive Systems - … for Cyber Physical Automotive Systems ... •...
85
Networks for Cyber Physical Automotive Systems Forward radar Computing platform Event data recorder (EDR) Positioning system Rear radar Communication facility Display 1 Rajeev Shorey (Ph.D, FNAE) ITRA, Dept of IT, Govt of India Founding President, NIIT University, India Formerly GM Research & IBM Research IGSTC Workshop, New Delhi 23-24 January 2014
Transcript of Networks for Cyber Physical Automotive Systems - … for Cyber Physical Automotive Systems ... •...
Networks for Cyber Physical Automotive Systems
Forward radar
Computing platform
Event data recorder (EDR)
Positioning system
Rear radar
Communication facility
Display
1
Rajeev Shorey (Ph.D, FNAE) ITRA, Dept of IT, Govt of India
Founding President, NIIT University, IndiaFormerly GM Research & IBM Research
IGSTC Workshop, New Delhi23-24 January 2014
Structure of the Talk• Introduction
– Smart Cars– OnStar Service
• Programmable Vehicles• Connected Vehicles• Connected Vehicles• Networked Traffic Systems• In-Vehicle Systems
– Remote Diagnostics, Testing and Reprogramming
• Conclusion 2
Next Generation of Real Time Control, Communication and Computation for
Wireless Systems
Computation Communication
Internet
Control
Internet
Sensors and Actuators
Added Dimension
RFID Technology
Networked Cyber-Physical Systems
4
Automotive CPS
5
Smart Vehicles
6
Smart Vehicles
• Vehicles are becoming more and more sophisticated• Increasing role of Electronics, Controls, Software (ECS)
• Powerful on-board computing capabilities– On-board of storage– On-board of storage– Significant communication capabilities– No power limitations
• Computations capabilities supported by hosts of sensors and actuators– On-board radars– GPS
• Several OEMs need to collaborative to succeed in the highly competitive market 7
Smart Cars
8
Vehicular Sensors
LongRange
SensorsShort-Range
Blind-Spot Sensors
Forward Vision System• Lane tracking• Object detection• Far IR capability
Sensor Strategy
9
Short Range
Sensors
Rear Vision System• Object detection• Far IR capability
EnhancedDigital Map
System
Short-RangeSensors
Long-RangeScanning
Sensor
In-Vehicular System Complexity
10
Recent Developments
• Laser Headlights from BMW• Dear-Spotting Diodes• …
11
Driverless Car by Google
12
The Role of ECS inthe Automotive Sectorthe Automotive Sector
13
Example: Electronics, Controls & Software in Automotive Sector
• Increasing role of Electronics and Software in the automotive sector– From 15% in 1990s to 37% in the current decade, an
exponential increase of 146%
• Automotive electronics and control systems– Key properties
14
– Key properties• High-integrity• Real-time• Distributed• Hybrid systems
– Requiring development processes with robust verification and validation
– The activities in this thrust area are centered on formal methods based design and verification of control software
Electronics, Controls & Software
15
Automotive Software
16
A Modern Vehicle: Computer on Wheels
Forward radar
Event data recorder (EDR)
Positioning system
Rear radar
Communication facility
(GPS)
17
Computing platform
Rear radar
Display
• Processing power: comparable with a Personal Computer + a few dozens ofspecialized processors
• Communication: typically over a dedicated channel:Dedicated Short Range Communications (DSRC)
• In the US, 75 MHz at 5.9 GHz• In Europe, 20 MHz requested but not yet allocated
• Envisioned protocol: IEEE 802.11p• Penetration will be progressive (over 2 decades or so)
- Human-Machine Interface- Navigation system
A Peek at OnStar
www.onstar.com
18
Vehicle to Infrastructure Communications
The OnStar SystemEnterpriseEnterpriseEnterpriseEnterprise
BackendBackendBackendBackend
Cellular ChannelCellular ChannelCellular ChannelCellular Channel
TelematicsTelematicsTelematicsTelematics
PlatformPlatformPlatformPlatform
19
Cellular Communication
OnStar Services• Automatic Crash Response• Automatic Air Bag Deployment
Response• Emergency Services• OnStar Vehicle Diagnostics• Turn-by-Turn Navigation
20
• Turn-by-Turn Navigation• Stolen Vehicle Assistance• Remote Door Unlock• Roadside Assistance
Programmable Vehicles
21
Programmable Vehicles
• Challenges Today– Long design cycles– Static electronic architecture
• Vehicle of the future will be programmable• Vehicle of the future will be programmable– With services for long-term health &
performance of both humans and vehicles
22
Vehicle Evolution
Mechanical
Electronic
Software
23
Software Controlled
Service Based Mobile CPS Platforms
New Automotive Electronic Architectures
• New Automotive Electronic Architectures enable– Remote Diagnostics & Reprogrammability
throughout the life of the vehicle
• Drivers will be able to choose from a software component marketplace to enhance– Safety– Performance– Comfort 24
New Classes of Services
• Ensuring the safe and correct programming of the new service features is paramount !
• New classes of services and customization– Online vehicle diagnostics– Online vehicle diagnostics– Warranty management– Networked infotainment– Integration of applications
• Personalized insurance services
25
A Device that keeps Track of our Driving !Usage-based Insurance Program
26http://www.progressive.com/auto/snapshot-how-it-works/
Connected Vehicles
27
Statistics
• Each year, ~ 6.4 M car accidents occur in the USA– 19.2 M Americans are injured in car accidents
each yeareach year
• Over 90% of vehicle crashes are due to driver negligence and thus avoidable
• Reference: Duric and Miladinov-Mokov 200828
Connected Vehicles
• Connected vehicle architectures for safety-critical automotive systems require much work– To ensure security and privacy– To ensure security and privacy– Timely delivery of traffic alerts, warnings, and
information updates
29
Vehicular Sensors
LongRange
SensorsShort-Range
Blind-Spot Sensors
Forward Vision System• Lane tracking• Object detection• Far IR capability
Sensor Strategy
30
Short Range
Sensors
Rear Vision System• Object detection• Far IR capability
EnhancedDigital Map
System
Short-RangeSensors
Long-RangeScanning
Sensor
Vehicular CommunicationsApproaches
• Vehicle to Infrastructure• Roadside Units
•Vehicle to Vehicle• DSRC standard
• In Vehicle• ZigBee
31
V2X Active Safety Applications• Event reporting applications (Early Apps)
– Generate messages only for the duration of the event
– Report events based only on information present at sending vehicle
– Examples: EEBL (Emergency Electronic Brake Lights), RCHA (Road Condition Hazard Ahead)
• Persistent applications (Later Apps)
`̀
32
• Persistent applications (Later Apps)– Require repeated exchange of vehicle
kinematics in a local neighborhood– Predict and report events by processing
exchanged information– Examples: CCW (Cooperative Collision
Warning), BSW (Blind Spot Warning)
`̀
Driver Interaction: Applications raise advisories or warnings
to help the driver avoid accidents
Vehicle Safety Scenarios
Avoiding rear-end collision
Avoiding lane change collision
Vehicle brakes hard
Collision mitigation
33
Traffic signal
Avoiding intersection
collision
Vehicle Safety Scenarios
Avoiding rear-end collision
Vehicle brakes hard
Collision mitigation
V2V Messages
34
Traffic signal
Avoiding intersection
collision
Solution : Vehicle to vehicle/ Infrastructure / Roadside communication of information
� Very Adhoc ( > 40 MPH speeds)
� Low latency � High reliability (low PER) � Authenticated & Secure� Multihop
In-Vehicle Systems: Remote Diagnostics, Testing
& Reprogramming& Reprogramming
35
Automotive – Software Recalls
36
Astounding Statistics !• 100 Million+ lines of code • 60+ ECUs (Electronic Controller Units) in a
vehicle• There are only about 8 standard diagnostic
trouble codes (DTCs) for software trouble codes (DTCs) for software • The DTCs are extremely general• None target the ECU software !
37
Remote Diagnostics of Automotive Control Systems
Software Architecture
Cruise Control
38
Antilock Braking
Stability
Existing Efforts
39
AutoPlug: Remote ECU DiagnosticsUniversity of Pennsylvania, USA
40
DARPA Urban Challenge
41Towards Autonomous Driving !
Driverless Car by Google
42
Concluding Remarks
• Future of the automobile lies in design and development of new vehicles that are:– Programmable– Connected vehicles– Connected vehicles– Networked traffic centers
• End Goal– Towards a safer, more efficient, and more
comfortable commuting with automobiles
43
Concluding Remarks
• OEMs will need “flexibility”– Ever changing technologies– Newly emerging solutions
• Future vehicles will be “plug and play”– At least as far as ECS is concerned
44
– At least as far as ECS is concerned• The field offers rich challenges to both Industry
& Academia
Concluding Remarks
• OnStar is to be seen as a Game Changer !
• We are likely to see a good number of emerging ‘services’ in the Automotive sector
45
sector
A Device that keeps Track of our Driving !Usage-based Insurance Program
46http://www.progressive.com/auto/snapshot-how-it-works/
Convergence in the Automotive Sector
Emerging Services
• Emergency call• Breakdown call• Vehicle diagnostics• Stolen vehicle tracking• Remote immobilization• Remote lock/unlock• Online services
Automotive
48
Applications
NewBusinessModels
&Demands
Heterogeneous Technologies
(Hardware, Software,Middleware)
• Safety• Infotainment
• 3G • WLANs• ZigBee• RFID • Sensors • GPS• XM Radio, …
AutomotiveManufacturers
Current Automotive Software Design & Maintenance
49
Framework Proposed
50
A Taxonomy of Faults
51
52
53
Vehicular Networks: Vehicle Safety Scenarios
Avoiding rear-end collision
Avoiding lane change collision
Vehicle brakes hard
Collision mitigation
54
Traffic signal
Avoiding intersection
collision
Conclusion• Major challenges for Universities &
Corporates in the ever changing Pervasive World !
• Trend towards all Pervasive & Wireless Systems Systems – Privacy and Security will be major challenges
• Cyber-Physical Systems will play a major role in all aspects of our life
• Managing complex systems will be a huge challenge– Nuclear & Power plants, Grid, …
55
A Typical Multi-Hop Network
11 Mbps
2 Mbps
5.5 Mbps
A
BC
D
� Power Limited� BW Limited
Link Parameters• Power• Rate• Channel
FTPTCP
Routing ProtocolCSMA/CA MAC
PHY
5.5 Mbps11 Mbps
2 Mbps
2 Mbps
A
Protocol Stack at Each Node
Cyber-Physical Systems• Energy harvesting• Wake-up radio technology• Energy efficiency in WSNs• Clinical and medical applications of WSNs• Environmental monitoring• Environmental monitoring• Data privacy and anonymity• Economic case studies for large scale WSN
deployments• Novel applications and analytical frameworks for
sensor-assisted cyber physical systems57
Emerging Trends in Wireless/Mobile Systems
58
Wireless/Mobile Systems
Forward radar
Computing platform
Event data recorder (EDR)
Positioning system
Rear radar
Communication facility
Display
Emerging Paradigms
• Telematics & Smart Vehicles– Vehicular Communications– OnStar System
• Internet of Things (IoT) or M2M • Internet of Things (IoT) or M2M Communications
• Pervasive Healthcare
59
IoT or M2M Communications
60
A Peek at OnStar
61
Vehicle to Infrastructure Communications
Vehicular SystemsEnterpriseEnterpriseEnterpriseEnterprise
BackendBackendBackendBackend
OnStar ChannelOnStar ChannelOnStar ChannelOnStar Channel
TelematicsTelematicsTelematicsTelematics
PlatformPlatformPlatformPlatform
62
V2V SecurityV2V SecurityV2V SecurityV2V Security
DSRC Communication(IEEE 802.11p Standard)
Cellular Communication
What is OnStar (by GM)?
• Provides multiple “Telematics” related services
• Leverages Cellular Channel• Supports
63
• Supports– Data– Audio
• Customers subscribe to a set of services• Cost depends upon the number of
subscribed services
Automatic Air Bag Deployment Response
• With Automatic Air Bag Deployment Response, OnStar will be there for you when your air bags deploy
• If you get involved in a crash and your air bags deploy, your vehicle's built-in sensors can
64
vehicle's built-in sensors can automatically alert OnStar
• An OnStar Emergency Advisor is immediately connected into your vehicle to see if you are okay
• Using GPS technology, emergency help is sent to your exact location even if you're hurt and unable to respond
Emergency Services• If you need emergency help, one
push of the red emergency button connects you to a live Emergency Advisor, 24 x 7
• Red emergency button calls take priority status to a live Emergency Advisor
65
• Using GPS technology, the Advisor can pinpoint your exact location and will immediately send for police, fire or medical support
• The Advisor stays on the line with you for as long as you need until help arrives on the scene
OnStar Vehicle Diagnostics
• Diagnostic Information provides alerts for your key operating systems– Engine and Transmission System– Stabilitrak® Stability Control System
66
– Stabilitrak® Stability Control System– Air Bag System– Emissions System– Antilock Braking System– OnStar System
Other Services
• Hands Free Calling• Turn-by-Turn Navigation• Stolen Vehicle Assistance• Remote Door Unlock
67
• Remote Door Unlock• Roadside Assistance
Take Away
• Onstar is a proprietary system– Vehicle to Infrastructure Communications
• Multiple Onstar services are available • User needs to subscribe to the services• User needs to subscribe to the services• Cost per service per month• System is scalable, robust and secure
68
Vehicular Communications
V2V or C2C or VANETs
69
A Modern Vehicle is a Computer on Wheels
Forward radar
Event data recorder (EDR)
Positioning system
Rear radar
Communication facility
(GPS)
70
Computing platform
Rear radar
Display
• Processing power: comparable with a Personal Computer + a few dozens ofspecialized processors
• Communication: typically over a dedicated channel:Dedicated Short Range Communications (DSRC)
• In the US, 75 MHz at 5.9 GHz; • In Europe, 20 MHz requested but not yet allocated)
• Envisioned protocol: IEEE 802.11p• Penetration will be progressive (over 2 decades or so)
- Human-Machine Interface- Navigation system
Vehicular Positioning
• Accurate autonomous geo-spatial positioning finds itself at the core of most VANET applications– All Safety applications
• GPS: 10 – 15 m accuracy• GPS: 10 – 15 m accuracy• DGPS: approx 1 m positional accuracy
71
Sensor Networks for Automotive Applications
72
Automotive Applications
Traditional Sensors in a Vehicle• Radar• Ultrasonic systems• Vision and LIDAR systems
73
Traditional sensors have their natural limits• They only sense the immediate vehicle environment (short-haul)• Mostly passive (radar has limited data capabilities)• Relatively expensive and typically not versatile
Efforts in Standardization
74
WAVEWireless Access in a Vehicle Environment
WAVE Communications Architecture & Standards
MAC (IEEE 1609.4)
LLC (IEEE 802.2)
WSMP(IEEE 1609.3)
IP
UDP
General AppsSafety Apps
Other Apps
MLME
IPLME
Data Plane
WME
LLCME
WSMLME
Management Plane
1609.2
75
IEEE P1609 committee for DSRC standardization� P1609.1 -- Resource Manager � P1609.2 -- Security Services for Applications and Ma nagement Messages � P1609.3 -- Network Services - Intermediate Layers � P1609.4 -- Medium Access Control (MAC) Extension Serv ices � 802.11p -- WAVE physical and lower MAC layers
PHY (IEEE 802.11p)PLME
76
DARPA Urban Challenge
77
Towards Autonomous Driving
Motivation - Auto Industry Challenges
Challenges Stretch Goals
� Energy Low cost renewable energy
� Emissions No tailpipe environmental impact
78
� Safety Vehicles that never crash
� Congestion Congestion-free routing
� Affordability All of above with price constrained
Goal – Vehicles That Drive Themselves
Where am I – GPS + Digital Maps
What’s around me – 360˚ sensing
(sensors + “V2V”)
LongRange
Sensors
Short Range
Sensors
Short-RangeBlind-Spot Sensors
Rear Vision System• Object detection• Far IR capability
EnhancedDigital Map
System
Short-RangeSensors
Long-RangeScanning
Sensor
Forward Vision System• Lane tracking• Object detection• Far IR capability
Sensor Strategy
79
(sensors + “V2V”)
Take me where I want to go – Navigation +
Software algorithms + electronic controls and
actuators
GPS
Communications
Maps
Comms
Cooperative Systems
DARPA Urban Challenge
80
What does the Future Look Like?Look Like?
81
Scary !
82
Why?• Inter galactic communications• Internet in space
– Earth – Moon– Earth – Mars
• All pervasive seamless world !– Need to be careful– Privacy and Security would be key challenges
• Nothing would be hidden from the Big Brother !
83
84
