Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in...
Transcript of Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in...
![Page 1: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/1.jpg)
![Page 2: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/2.jpg)
Active sensing and its application to neuromorphic space imagingGregory Cohen – ICNS, WSU
![Page 3: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/3.jpg)
PAGE 3
Important Points
• The importance of active sensing
• The importance of prediction in neuromorphic systems
• Temporal resolution makes up for spatial resolution
• The importance of synchronization
• Biologically inspired – not biologically plausible
• Low-power, low-bandwidth sensing and computation
![Page 4: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/4.jpg)
PAGE 4
What is space situational awareness?
![Page 5: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/5.jpg)
Space Situational Awareness
![Page 6: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/6.jpg)
Low-Earth OrbitSource: stuffin.spaceSource: stuffin.space
![Page 7: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/7.jpg)
Medium Earth OrbitSource: stuffin.space
![Page 8: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/8.jpg)
Source: stuffin.spaceGeosynchronous Orbits
![Page 9: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/9.jpg)
Event-based sensor
Low Data Rates(logarithmic axis)
Conventional sensor
Daytime LEO DetectionHigh Dynamic Range
Unparalleled Orbital Applications
New Imaging Paradigm for Terrestrial Imaging
Novel imaging paradigm
• Independent and asynchronous pixels
• Logarithmic change detection gives very high dynamic range
• Frame-free imaging with no fixed integration times
• High-speed imaging (events have 1 µs resolution)
• Greatly reduces motion blur and saturation effects
High-speed, low-power, low-bandwidth imaging
Neuromorphic Event-based Sensors
Requires a new approach to processing and computer vision
International Centre Neuromorphic Systems 2018
![Page 10: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/10.jpg)
Telescope Manufacturer and Model Focal Length f / ratio SensorPrimary telescope Officina Stellare RH200 600 mm f / 3 CCD SensorSecondary telescope 8” Meade LX200 2000mm f / 10 ATIS Sensor
Experimental Setup
![Page 11: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/11.jpg)
![Page 12: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/12.jpg)
Imaging the Stars and Planets
PAGE 12
![Page 13: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/13.jpg)
Imaging the Stars and Planets
PAGE 13
![Page 14: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/14.jpg)
Low Earth Orbit Satellites (LEOs)
PAGE 14
Siderally tracking the stars.
![Page 15: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/15.jpg)
Tracking LEOs – Tracking SL8RB 21938
PAGE 15
![Page 16: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/16.jpg)
Siderally tracking the stars.
Event Frames Visualization Surface
Low Earth Orbit Satellites (LEOs)
PAGE 16
![Page 17: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/17.jpg)
PAGE 17
ABS-6 GEO Synchronous Orbit Ground Truth
![Page 18: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/18.jpg)
Object: ABS-6 (25924) on 04/06/207
Real-time Frames Visualization Surface
Sidereal tracking is used to visualize the GEO
Geosynchronous Objects
PAGE 18
![Page 19: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/19.jpg)
Real-time Detection of Daytime LEOs
PAGE 19
![Page 20: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/20.jpg)
PAGE 20
Atmospheric Effects? Jupiter from the DAVIS Camera
![Page 21: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/21.jpg)
PAGE 21
Atmospheric Effects?
![Page 22: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/22.jpg)
PAGE 22
Scintillation Effects?
![Page 23: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/23.jpg)
PAGE 24
Star Tracking with CCD Imaging
![Page 24: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/24.jpg)
Star Mapping with an Event-based Sensor
PAGE 25
![Page 25: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/25.jpg)
Star Mapping with an Event-based SensorComparison of the inferred star map and the ground truth from the CCD sensor
PAGE 26
![Page 26: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/26.jpg)
Seeing Through Gaps in Clouds
PAGE 27
![Page 27: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/27.jpg)
PAGE 28
Seeing Through Gaps in Clouds
PAGE 28
![Page 28: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/28.jpg)
Active Sensing and Occlusion-invariant Sensing
![Page 29: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/29.jpg)
PAGE 30
Seeing through the bushes
![Page 30: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/30.jpg)
SEEING THROUGH THE CLOUDSSeeing through the bushes
PAGE 31
Seeing through the bushes
![Page 31: Active sensing and its - Beyond Conventional Computing Systems · The importance of prediction in neuromorphic systems ... Neuromorphic Event-based Sensors. Requires a new approach](https://reader034.fdocuments.in/reader034/viewer/2022050414/5f8affd6f5e9532dd24b8a8b/html5/thumbnails/31.jpg)