Smartphone-based Connectivity on AGLevents17.linuxfoundation.org/sites/events/files/slides... ·...

Smartphone-based

Connectivity on AGLAgustin Almansi

Technology Consultant

01 June 2017

Copyright © 2002-2017 RealVNC Limited. All rights reserved. RealVNC®, VNC® and RFB® are trademarks of RealVNC Limited. Other trademarks and logos are the property of their respective owners. VNC Automotive is a division of RealVNC.

Agenda

• About RealVNC & VNC Automotive

• Why connect the smartphone to the car?

• Smartphone-based connectivity review

• Connected Car with MirrorLink

• Integration on AGL


About&


VNC Automotive, 2017

15 Auto OEMs50+ Vehicle Models10+ Million Cars100+ Million Phones

VNC Automotive is a pioneerin delivering connected car solutions…


1994

VNC & RFB invented in Olivetti / AT&T LabsResearch Project

2002

RealVNCfounded by inventors

2007

RFB3.8published as an open internet standard, RFC 6143

2009

VNC Automotive launched

2010

VNC MirrorLinkreleased

2011

RFB4.1released

Available to License

2012

RealVNCachieves Core Member Status of CCC

2013

RealVNCdelivers world’s first MirrorLink1.1 server certification

2014

First MirrorLink1.1 in production

2015

VNC available for Raspberry Pi

2016

VNC Connect launched

Corporate Rebranding

Telematics solution

Contract withMajor Chinese OEM

First MirrorLink in cars(customer option)

Handsets OEM

Sony phone contractFirst contract direct with Auto OEM

VNC release support for iPod Out

Major contract for head units

First contract with major Tier 1

First Automotive partners signed First volume line-fit

MirrorLink

First contract with

Volume line-fit production

Major head unit contract for VW GroupTelematics solution

First MirrorLink 1.1in production

Partnerships

Member

Partnerships

VNC Automotive supports

2017

membershipmembership

http://www.google.co.uk/url?sa=i&source=images&cd=&cad=rja&docid=zL2pnnGCCLAdEM&tbnid=uBt_TRueWUOEiM:&ved=0CAgQjRwwAA&url=http://www.mobileindustryreview.com/2012/02/fujitsus-robert-pryke-my-top-5-trends-for-mwc.html&ei=-IBOUtPrC7Db4QS0o4DwDg&psig=AFQjCNHOg6x-UeB0uG1KXnuq4d-7Iql7Og&ust=1380962936248078http://www.google.co.uk/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=_p96WqsLJgsIxM&tbnid=JfwVU3A5XgMflM:&ved=0CAUQjRw&url=http://blackskullperformance.net46.net/index.php?cPath=22&ei=7H5OUuHWGYnDswblgYGADA&bvm=bv.53537100,d.bGE&psig=AFQjCNEOWhUxz5Vb5C4CW-Bllj847IJ4UQ&ust=1380962384957548http://www.google.co.uk/url?sa=i&source=images&cd=&cad=rja&docid=FOPxiiH1BFfByM&tbnid=DFBABvCZf6rCZM:&ved=0CAgQjRwwAA&url=http://blog.toyota.co.uk/toyota-and-bmw-to-make-ever-better-cars/toyota-logo-2&ei=mYBOUuSQIY_T4QSc7oCYCw&psig=AFQjCNGAE7sJIeOC6sNfIFCO6skssMufBg&ust=1380962841600975http://www.google.co.uk/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=_p96WqsLJgsIxM&tbnid=JfwVU3A5XgMflM:&ved=0CAUQjRw&url=http://blackskullperformance.net46.net/index.php?cPath=22&ei=7H5OUuHWGYnDswblgYGADA&bvm=bv.53537100,d.bGE&psig=AFQjCNEOWhUxz5Vb5C4CW-Bllj847IJ4UQ&ust=1380962384957548https://www.google.co.uk/imgres?imgurl&imgrefurl=https://pt.m.wikipedia.org/wiki/Ficheiro:Volkswagen_Logo.png&h=0&w=0&sz=1&tbnid=iBmdoSzj2yDjeM&tbnh=224&tbnw=225&zoom=1&docid=RsZl8f24WlqF1M&ei=jX9OUqKIMobdtAbb2YDwDg&ved=0CAIQsCUhttp://www.google.co.uk/url?sa=i&source=images&cd=&cad=rja&docid=F9RM5rEsStahyM&tbnid=t3IXao1S0N_8lM:&ved=0CAgQjRwwAA&url=http://phandroid.com/2013/04/08/htcs-new-direction/htc-logo-12/&ei=y4BOUqi-EoW14ATA1IDADg&psig=AFQjCNEZkVS5UpLjaQ1WPytuvQdTmN99ug&ust=1380962891364105http://www.google.co.uk/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&docid=JltkiXmTjWK3IM&tbnid=jE16Yt84zmLmdM:&ved=0CAUQjRw&url=http://logos.wikia.com/wiki/File:Huawei.png&ei=Z0_JU6XLPMSc0AXdr4H4CQ&bvm=bv.71198958,d.ZGU&psig=AFQjCNEC8JJYzlKU-_6dZqHRMMct6HyY6g&ust=1405788379317216http://www.google.co.uk/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&docid=Npmzt9myMKBtPM&tbnid=LdKyfXJb3w8z-M:&ved=0CAUQjRw&url=http://www.sensethecar.com/19568/car-and-automobile-industry-news/business/suzuki-goes-to-icc-international-court-of-arbitration-against-volkswagen-ag/attachment/suzuki-logo-2/&ei=NwJ6U9aMCa-e7AaTvoH4Bw&bvm=bv.66917471,d.ZWU&psig=AFQjCNG-V5RiN_UtK2iI-vL4mtsjijOpKA&ust=1400591265441372http://www.google.co.uk/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&docid=LtCfY6d6TkNZiM&tbnid=ENZGvgarmR7I3M:&ved=0CAUQjRw&url=http://logos.wikia.com/wiki/File:Skoda.png&ei=DFDJU9XGCsen0QXV1oGQCw&bvm=bv.71198958,d.ZGU&psig=AFQjCNFI5Qerz02p1y5RgT4KuuJ-QGfTDw&ust=1405788539761726http://www.google.co.uk/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&docid=TA-Gk41ALN9qAM&tbnid=5jb7StYll8tdkM:&ved=0CAUQjRw&url=http://logos.wikia.com/wiki/File:SEAT_logo.png&ei=hlDJU8XfBeaW0QWrhYDADw&bvm=bv.71198958,d.ZGU&psig=AFQjCNFIR5ImY2q51ieIYBLbUHAlqJYLTw&ust=1405788584731702

Collaborating with Volkswagen to deliver a market-defining user experience to MirrorLink connected cars


RealVNC work very closely with Volkswagen and all major mobile phone OEMs providing a mature, high-performance MirrorLink implementation. This close cooperation has brought many new major mobile phone vendors to the ecosystem. Using our VNC Automotive™ MirrorLink Certified™ solution in their handsets provides fast time-to-market and guaranteed MirrorLink Certification.As part of our continuous improvement process, we are pleased to declare our commitment to Volkswagen to refine and perfect the overall end-to-end user experience for MirrorLink enabled devices.

Using our unique position in the industry as a vendor of full MirrorLink software stack technology, for both ends of the connection (in the car and mobile devices), RealVNC are able to realise a highly optimised MirrorLink solution where both ends are designed and guaranteed to work well together. Thus ensuring fast response times and a smooth driver experience. As the industry strives to ensure a high level of interoperability and consistent user experience, knowing the mobile devices have the same underlying software stack is a significant assurance to Volkswagen.

Why connecting the smartphone to the car makes sense


Advantages of having Smartphone connectivity


For driver

Familiar / Consistent user-experience

Continue using favourite Apps

Large app ecosystem

No need to sync content

For IVI Developer (Car OEM, Tier 1/2)

Simplify development

Easy to extend and update

Increased security, sandboxing

Reduced hardware / software cost

Smartphone-based connectivity review


Smartphone-based connectivity solutions are emerging


Mobile Centric

• Mobile ecosystem

• Mobile brand

OEM Centric

• Preserve the traditional OEM ecosystem

• OEM brand

Open Standard

• Community driven

• Brand neutral

Multiple connectivity standards but no clear winner

− Closed standard

− Limited Apps controlled by Apple

− Siri voice mandated

− OEM liability concerns*

− Pre-installed on iOS devices

− Closed standard

− Not available globally (e.g. China)


− Most modernAndroid devices supported

− Closed standard

− Limited to Baidu Services


− Works well in China

− Supports iOS and Android

− Open standard

− Driven by Auto OEMs & Handset Vendors

− Open to any App developer

− Auto OEMs in fullcontrol

− Open standard

− Open to any App developer

− Capabilities limited by templates

− Auto OEMs in full control

− Open or closed standard

− Extendable providing greater flexibility

− Supports rear- seats, multiple handsets etc.

− Car OEM need to create Mobile App

− Closed standard

− Auto OEM in full control

− Supports iOS and Android

* Auto OEMs have expressed serious liability concerns as both Apple and Google accept no liability, e.g. Driver distraction, yet provide no way for the OEMs to influence what is displayed


Mobile Centric OEM CentricOpen Standard

It is very likely that the trend to support multiple standards in one HU will grow.

Apple CarPlay


• Apple-centric Ecosystem, iPhone 5+

• Proprietary Protocol

• 3rd party Apps as services (media, text)

• OEM Apps supported

• Driver Distraction Policy: Templates

• Siri for voice control

• Projected Virtual Display

Application Library

• Media and Messaging Only• No Maps, No Parking

Google Android Auto


• Google-centric Ecosystem, Lollipop+


• 3rd party Apps as services (media, text)

• OEM Apps supported

• Driver Distraction Policy: Templates

• Google Now

• Projected Virtual Display

Application Library

• Media and Messaging Only• No Maps, No Parking

Baidu CarLife


• Baidu-centric Ecosystem


• 3rd party Apps as services, China focus.

• Baidu Services in the Car

• Projected Baidu Application Display

• Supports both iOS and Android devices

Application Library

SmartDeviceLink


• OEM-centric Ecosystem

• Open Protocol

• Open-source Application Developer SDK

• Driver Distraction Policy: Whitelist

• Template based remote rendering

SCOUT Life360 AccuWeather

Application Library

Connected Car with


MirrorLink


• Open Ecosystem, controlled by consortium of car OEMs and smartphone OEMS

• Open Protocol

• Driver Distraction Policy: Certification program

• Projected Application Display

Car Connectivity Consortium


• Global consortium to develop connected-car solutions, including smartphone based connectivity

− Membership open to any interested company

− Solutions are not owned or governed by a single corporation

− OS agnostic - No platform limitations

− Assure device and application interoperability

− Future proof – not reliant on a single vendor

• Bringing car, mobile and head-unit industries together

− Established in February, 2011. Now 100 member companies

− Automotive, Smartphone, Tier 1 and Ecosystem-enablers

Some of CCC Members are:

MirrorLink is the only cross-industry collaborationin developing an open standard for car-smartphone connectivity


Extensive support in cars, smartphones and Apps


30+ Million cars MirrorLink enabled, 250+ Million phones


History of MirrorLink

• v1.0

• Initial release

• a.k.a. Terminal Mode

• v1.1

• In production since 2014

• Provided foundation for 3rd party Apps

• v1.2

• expanded technology portfolio with wireless MirrorLink (WFD)

• In production since 2016

• v1.3• being published to members

• Adds H.264 encoding for the RFB protocol, supporting HD resolutions

• More features for App developers

• Will be published as an ETSI (European TelecommunicationsStandards Institute) standard


Wireless MirrorLink is already available


Volkswagen + Samsung Showcase at CES 2016 Skoda + Samsung PR in 2016

MIRRORLINK USER EXPERIENCELeveraging vehicle’s accessible Display and Controls

Sto

red

No holdingNo touchingNo lookingNo glancing

No obstruction from dash or window mounted device

Car optimized Audio Input & Output

Car optimized Display & Input Control


Source: Car Connectivity Consortium

MIRRORLINK® EXPERIENCEMake it easy to develop for MirrorLink


Connectivity

MirrorLink API

No SDK


Certification program

• Certification program built to help offset risk

• Device certification

• Conformance with specification

• Interoperability with reference devices

• Application certification

• Driver Distraction testing

• Region-based following local regulations

• Conducted by approved Test Labs


Devic

e &

App

Dis

covery

and C

ontr

ol

Shell

MirrorLink Common API (Platform Specific)

Connectivity

Scre

en

Replic

ation

Phone/M

edia

Audio

&

Voic

e C

ontr

ol

Applic

ation

Cert

ific

ate

s

Access t

o

Car

Data

Secure

Devic

e

Att

esta

tion

VC MusicNav

HSML

RTP

CDC/NCM

Call

X.509 OCSP

DHCPTCP/UDPIP

Messaging Productivity Search

MirrorLink Architecture


MirrorLink™ uses VNC (RFB 3.8) for remote control


Integration on AGL


AGL Architecture:

VNC Viewer Services

AudioI/O

h.264 Decoding

CustomViewer

usingVNC API

Touch / PixelData

VNC Viewer Services

VN

C

Enh

ance

d

Mir

rorL

ink

Car

Pla

y

An

dro

id A

uto

Bai

du

Car

Life


Source: AGL / Linux Foundation

Application/ HMI

AutomotiveServices

PlatformServices+OS Layer

ApplicationUX

WindowManagement

Input eventsManagement

UART CANBUSUSBAudio

I/OVideo

I/OBT Wi-Fi

CarPlayAndroid

AutoVNC

EnhancedMirrorLink

Baidu CarLife

AAP AOAPCDC NCM Apple Auth iAP2BT profilesCODECS

(H.264, …)WFD GPS

VNC AUTOMOTIVE on AGL

IVI System

RealVNC component

AGL component

VNC Viewer Services

AudioServices

SpeechServices

…

Custom Viewer using VNC API

HomeScreen

WiFi …


AGL ‘Smartphone Link’ Service


Source: AGL / Linux Foundation

VNC Mobile: supports MirrorLink,Apple CarPlay, Android Auto and Baidu CarLife on any combination of OS and CPU platform

VNC Mobile Components

VNC Enhanced


Please visit our website for more information


https://automotive.realvnc.com/

https://www.realvnc.com/

Smartphone-based Connectivity on AGLevents17.linuxfoundation.org/sites/events/files/slides... ·...

Documents

Transcript of Smartphone-based Connectivity on AGLevents17.linuxfoundation.org/sites/events/files/slides... ·...