Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via...

36
Resilient and Accurate Autonomous Vehicle Navigation via Signals of Opportunity Zak M. Kassas Autonomous Systems Perception, Intelligence, and Navigation (ASPIN) Laboratory University of California, Riverside Stanford University | Stanford, CA | November 8, 2017 1

Transcript of Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via...

Page 1: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Resilient  and  Accurate  Autonomous  Vehicle  Navigation  

via  Signals  of  Opportunity

Zak  M.  Kassas

Autonomous  Systems  Perception,  Intelligence,  and  Navigation  (ASPIN)  LaboratoryUniversity  of  California,  Riverside

Stanford  University    |    Stanford,  CA    |      November  8,  20171

Page 2: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity
Page 3: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Future  Autonomous  Vehicles3

Page 4: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Future  Autonomous  Vehicles4

Page 5: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Navigation  with  Signals  of  Opportunity  (SOPs):  COpNav5

Kassas  (2013).  Collaborative  opportunistic  navigation.  IEEE  Aerospace  and  Electronic  Systems  Magazine,  (28)6,  38–41.

Page 6: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

SOPs:  Opportunities  and  Challenges6

Opportunities

¤ Abundant

¤ Available  at  varying    geometries  &  frequencies

¤ Free  to  use

¤ Are  significantly  more  powerful  than  GPS

Challenges

¤ States  may  be  unknown  a  priori

¤ Observables  need  to  be  extracted

¤ Clocks  are  not  as  stable  and  not  synchronized

¤ Signal  models  and  error  budgets  are  unavailable

Page 7: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity
Page 8: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

8

The  SOP  signal  landscape  state  space  is  NOT  stationary

SOP  Signal  Landscape

Page 9: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Software-­‐Defined  Radio  for  SOP-­‐Based  Navigation  (MATRIX)

9

Page 10: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Cellular  CDMA  Navigation  SDR  (LabVIEW)10

Page 11: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Experimental  Setup  – Ground  Vehicle11

MATRIX

Khalife,  Shamaei,  &  Kassas  (2016).  A  software-­‐defined  receiver  architecture  for  cellular  CDMA-­‐based  navigation.  IEEE/ION  Position,  Location,  &  Navigation  Symposium  (PLANS), 816–826,  (Best  student  paper).

Page 12: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

12

SOP  Mapping

Page 13: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

SOP  Mapping13

Page 14: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

SOP  =  Fake  Tree!14

Page 15: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Experimental  Demo:  UAV  Navigation  with  Cellular  CDMA

https://www.youtube.com/watch?v=GkfUxie2wnA

15

Page 16: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Cellular  LTE  Navigation  SDR  (LabVIEW)16

Shamaei, Khalife, & Kassas (2016). Performance characterization of positioning in LTE systems. in Proceedingsof ION GNSS Conference (IONGNSS+), 2262-­‐2270, (Best paper presentation).

Page 17: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Cellular  LTE  Navigation  SDR  (LabVIEW)17

Shamaei,  Khalife,  &  Kassas  (2016).  Exploiting  LTE  signals  for  navigation:  Theory  to  implementation,  IEEE  Trans.  on  Wireless  Communications,  submitted.

Page 18: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

LTE  Receiver  Structure18

ESPRIT:  estimation  of  signal  parameters  by  rotational  invariance  techniques

Shamaei, Khalife, Bhattacharya, & Kassas (2017). Computationally efficient receiver design for mitigatingmultipath for positioning with LTE signals. in Proceedings of IONGNSS Conference (IONGNSS+), 3751-­‐3760, (Bestpaper presentation).

Page 19: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Experimental  Demo:  Ground  Vehicle  Navigation  with  LTE

https://www.youtube.com/watch?v=fIDgNgrJuZQ

19

Page 20: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

SOP-­‐Aided  Inertial  Navigation20

Page 21: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

¤ Traditional  tightly-­‐coupled  GNSS-­‐aided  INS

¤ Objectives:1. Estimate  SOPs’  states  when  GNSS  pseudoranges are  

available  (mapping)2. When  GNSS  psuedoranges become  unavailable,  continue  to  

estimate  SOPs’  states  and  use                    to  correct  INS  errors  (SLAM)

SOP-­‐Aided  INS  Framework21

Inertial  Navigation  System

EKF  Prediction

EKF  Update

DetectorIMU PPS

data

GNSSReceiver

SOPReceiver

flag

Tightly-­coupled

Page 22: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Simulator  Overview

¤ Mission  Planning  &  Scripting¤ Accelerate/  Decelerate,  Climb/  Descend,  

Turn,  Loops,  Rolls,  Aerobatics…

¤ Kinematic  Models¤ 6DOF  Aircraft¤ 3DOF  &  6DOF  Automobile

¤ Sensor  Models¤ GPS  L1/L2  (constellation  &  sub-­‐frames)¤ IMU¤ Magnetometer¤ Air  Data:  Pitot  &  Static¤ (and  several  others…)

22

Page 23: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

23

SOP-­‐Aided  INS:  Simulated  Environment

SOP

SOP

SOP

SOP

Page 24: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

SOP-­‐Aided  INS:  Simulated  Environment24

Page 25: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

SOP-­‐Aided  INS:  Simulated  Environment25

Page 26: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Error

EKF  Results:  Vehicle  Position  and  Velocity26

0 50 100 150 200 0 50 100 150 200

Error

SOP-­aided  INS*

Traditional  GPS-­aided  INS

GPS  Cut-­off

*With  consumer          grade  IMU

Morales,  Roysdon,  &  Kassas  (2016).  Signals  of  opportunity  aided  inertial  navigation.  ION  Global  Navigation  Satellite  System  (ION  GNSS+)  Conference, 1492-­‐1501,  (Best paper  presentation).

Page 27: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Navigating  with  Cellular  CDMA  &  LTE27

Kassas,  Morales,  Shamaei,  &  Khalife (2017). LTE  Steers  UAV.  GPS  World  Magazine,  (28)4,  18-­‐25  (Cover  Article).

Page 28: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Experimental  Results28

Kassas,  Morales,  Shamaei,  &  Khalife (2017). LTE  Steers  UAV.  GPS  World  Magazine,  (28)4,  18-­‐25  (Cover  Article).

Page 29: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Collaborative  Navigation29

Page 30: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Centralized  Collaborative  Framework30

¤ Modes  of  operation:1. Collaborative  Mapping2. Collaborative  SLAM  (C-­‐SLAM)

Central   fusion  center

o Single  point  of  failure

o Large  communication  bandwidth

Morales  &  Kassas  (2016).  Collaborative  autonomous  vehicles  with  signals  of  opportunity  aided  inertial  navigation  systems.  ION  International  Technical  Meeting  (ION  ITM),  805-­‐818.

Page 31: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Distributed  Collaborative  Framework31

AV  2

AV  3

AV  4

AV  1 AV  N

Morales  &  Kassas  (2017).  A  Low  communication  rate  distributed  inertial  navigation  architecture  with  cellular  signal  aiding.  IEEE  Vehicular  Technology  Conference  (VTC),  submitted.

) 289 elements

This  is  only  32  elements!

Replace:

Page 32: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

32

Monte  Carlo  Analysis

Morales  &  Kassas  (2017).  Distributed  signals  of  opportunity  aided  inertial  navigation  with  intermittent  communication.  ION  Global  Navigation  Satellite  System  (ION  GNSS+)  Conference,2519-­‐2530.  (Best  paper  presentation).

Approximation  robustnessPerformance  robustness

Page 33: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Experimental  Demo:  Distributed  UAV  Navigation  with  SOP-­‐Aided  Inertial

https://www.youtube.com/watch?v=gljRk2OgspM

33

Page 34: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Precise  Carrier  Phase  Navigation34

Page 35: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Experimental  Demo:  UAV  Navigation  with  Carrier  Phase  Cellular  Signals

https://www.youtube.com/watch?v=WSqDUoLkTWo

35

Page 36: Resilient(and(Accurate( Autonomous(Vehicle(Navigation( via ...web.stanford.edu/group/scpnt/pnt/PNT17/presentation_files/I08-Zak_Kassas.pdf · Resilient(and(Accurate(Autonomous(Vehicle(Navigation(via(Signals(of(Opportunity

Acknowledgment36