A Multipurpose Software Sensor Toolkit Architecture for ... · Dr. Armando Guevara Chief Executive...
Transcript of A Multipurpose Software Sensor Toolkit Architecture for ... · Dr. Armando Guevara Chief Executive...
Dr. Armando Guevara Chief Executive Officer
Wed 9.23.15
A Multipurpose Software Sensor Toolkit Architecture for UAS Modular and Scalable Applications
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION2
Introduction to Visual Intelligence (“VI”) and the iOne STKA®Overview of iOne® Technology Capabilities User perspectives and UAS 3D Solution: Micro Camera ArrayA proven technology: iOne Airborne Sensor System Solutions ARCA® Technology Software Foundation Conclusions
AGENDA
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION3
About Visual IntelligenceFounded in 2003 as a mapping services company
Restructured in 2007 to become a technology R&D company focused on developing a unique software and hardware sensor array architecture (branded iOne STKA®)
Based in Houston, Texas
Privately Owned and Funded
11 Employees– includes 7 engineers (software, hardware, electronics, optics) all with
PhD and/or MSc
Owns numerous array hardware and software patents that support its technology
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION4
he iOne Software Sensor Tool Kit Architecture (“the iOne STKA”)
The iOne STKA® is a patented software and hardware array architecture from which metric 2D/3D imaging sensors can be built
The platform integrates COTS components in an economical and efficient way (“iOne Sensors”)
iOne Sensors are designed to produce an output that is readily ingested by leading 3rd party software suites
The company has now embarked on using the iOne STKA to build micro array devices that can be used in smarter phones, PCs, tablets and UAS/drones for consumer and enterprise applications
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION5
iOne STKA Sensor Attributes
Software driven architectureAll electronic (no moving parts)Lego®‐like, scalable platform Array system integration with off‐the‐shelf components Economies of scale achieved thru the reusability of designs, arrays and components
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION6
iOne STKA® TechnologyPatents, Awards and Recognitions
Numerous Patents Awarded Worldwide USGS Sensor Type Certification in 2009 to validate first sensor prototypeFirst US Corp to receive the Geospatial World International Technology Innovation Award in Sensors 2013 2014 MAPPS Technology Innovation Award and Grand AwardVisual Intelligence named one of the ‐ 20 Most Promising GIS Solution Providers 2015 ‐ by CIO Review ‐ Maximizing Returns with Flexible Digital Sensor Solutions (Pages 15 and 50)
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION7
Overview of iOne Technology Capabilities
Visual Intelligence (“VI”) is a technology company that, has developed unique geospatial sensors for use in aircraft‐ the iOne Sensor System Solutions
VI’s sensors are based on a software architecture that allows for the co‐mounting and co‐registration (CoCo™) of multiple passive and/or active sensors into a single highly accurate system (e.g. EO, RGB, thermal, LiDAR, radar, etc.)
Supports stereo and 3D geospatial applications
VI looks to apply its technology in micro sensors that support UAS and 3D collection and analytics/modeling apps
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION8
Trends in Imaging Sensor/Camera Technology
Mobile devices exponentially growing and moving into 3D
Hexagon Smart Phones Microsoft iOne Sensors
2002‐ongoing 2002‐ongoing 2012‐ongoing
Cameras
000s 2003‐ongoing
DeviceWare2014 – emerging 3D
ADS Ultracam
DMC
More smarter imaging – 3D ‐ Smaller – Lower cost
MONOLITHIC SINGLE PURPOSE ‐ DSLRs
EXPENSIVE‐BIG‐HEAVY EXPENSIVE‐BIG‐HEAVY Collect More. Do More. For less.
9
www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300
Paradigm Shift from Monolithic Single Purpose SensorsTo one sensor architecture for many platforms
telligence Company Confidential
iOne STKA
UAS/UAV
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION10
Overview of VI Product LinesiOne Aerial Sensors and Software (Current Product Line)– Stereo, Oblique, and 3D Collection Capabilities– Seven systems built to date– About half cost of competitors for similar or better performance
3D Micro Camera Arrays (New Product Line)– Leverage aerial technologies to produce wide field, high resolution
real‐time 3D products
UAS/Drones Sensors (Proposed Product Line)– Miniaturized aerial sensors focused on niche 3D and spectral
applications with weight/cost sized for small to large drones
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION11
Current iOne Aerial Product Applications
iOne IMS
Interface to 3rd Party Production Applications have been Tested
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION12
ARCA® Technology FoundationARCA Array Software and hardware that combines sensors of multiple types into a compact array. Largest field of view thru smallest aperture.Array Retinal Camera Architecture US Patent # 8,334,903 B2 and 0ther patents.
Virtual Frame (Camera Image Fusion)Photogrammetric and image processing methods to fuse images into a single frame with high measurement accuracy. Resulting image behaves as if taken by a single camera/sensor.
Array Calibration for High Positional AccuracyMethod to achieve subpixel measurement accuracy from a virtual frame.
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION13
Micro Camera Array (“MCA”)
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION14
Micro Camera Array FeaturesMore accurate 3D models due to multiple cameras and photogrammetric based calibration methods
Ultrahigh resolution camera (50‐100 MP) due to virtual frame technology
Ultrahigh resolution extended thru super‐resolution methods (100‐200MP)
Capable of scanning large areas quickly due to wide field of view (100 degrees) and long distances (30‐50ft) with millimeter to centimeter level absolute position accuracy
Produces true digital zoom over a very wide zoom range Video mode for H.264 and H.265 compliance
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION15
Micro Camera CapabilitiesHigh‐measurement accuracy over long distance 3D depth maps for post‐exposure image correction and measurementHigh‐speed data captureSignificantly exceeds next generation cell/tablet camera resolution (50MP to 200MP+) Less cost than laser or structured sensorsResolution scalingPreempts increased accuracy & resolution needs for future hand‐held devicesPost‐exposure consumer image editing
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION16
Business Applications for the Micro Camera
Asset Management. Compliments aerial sensors for more complete point cloud models. Supports scanning of full facilities for asset management helping generate detailed Building Information Models (interior + exterior)
Large‐Scale Building Models. Fill business niche for 3D building interior collection for commercial real estate, insurance and emergency response applications
As‐Built CAD. Fills commercial large scale measurement requirements for producing as‐built CAD models
Augmented Reality. Ideal for producing content for Augmented Reality applications
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION17
Functional MCA Architecture
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION18
MCA Primary Image Modes
tual FrameMakes many cameras operate as a single camera to subpixel accuracy using Depth Map
epth MapInterior or Exterior10 cm accuracy at50 feet
Super Resolution• 1.5‐2 x
increase in physical resolution
Video• Full
roving & zoom at video rates
100+ DegreeFOV
H.265
H.264
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION19
Robotics / UAS / Drone navigationOil and GasHomeland SecurityReal EstateBIM, Interior Mapping, Close Range Photogrammetry.Infrastructure Monitoring/ManagementForestry, Agro, EnvironmentalAs‐built SurveysInsurance Claims (change detection)
3D Enterprise/Consumer Applications
• Laptop/PC “Visual Intelligence”• Social Media and Newscasts• AEC ‐ Infrastructure Construction• Emergency Response / Medical delivery• Law enforcement / Surveillance• Situational Awareness / Search• Gaming – Extended Reality• Hunting• Search and Rescue• Virtual Reality• Augmented Reality
nterprise examples: Consumer examples:
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION20
Potential Miniaturized ApplicationsDrones, UAV, Smarter Phone, Interior Maps
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION21
Broad Spot’s use of the iOne STKA is an example of putting aminiaturized sensor array to use in solutions that will do emarkable things in the field of eye care–all within our vision of gher collection, quality and accuracy for less cost. Broad Spot
maging Corporation will be the exclusive licensee of the ARCA atents for ophthalmology applications, and we are excited to be orking with them on this medical solution for the benefit of uman‐kind.”
Case Example: Broad Spot Imaging Corp
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION22
Case Example: Mini Oblique for UAS/Drones
Based on the iOne n‐Oblique airborne sensor, this micro sensor is being specifically designed for UAS/Drone payloads using the iOne STKA methods and architecture.Unique capability to gather 360o imaging covering nadir (ortho) and 4 cardinal directions (oblique).Target applications include insurance, real estate, infrastructure monitoring (e.g. Oil & Gas), change detection, 3D modeling (point clouds, CAD, as‐built, BIM), virtual, augmented and extended reality.
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION23
iOne UAS n‐Oblique
Pixel 7555 x 55455.4 mm lens = 114° x 85° FOVGSD @200ft AGL = 1.5cm @ nadirFrame size @ 200ft = 185m x 110 m
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION24
iOne UAS n‐Oblique
Ortho area
Pixel 4000 x 30005.4 mm lens = 60° x 45° FOVGSD @200ft AGL = 1.5cm @ nadirFrame size @ 200ft = 70m x 50 m
een represents stereo/ortho area° x 60°ue outside of green represents Oblique area
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION25
Existing Product Overview and Output Examples
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION26
Visual Intelligence IP/Product Evolution
Business operated as rvice provider utilizing
technology
1998‐2006
Technology Evolution enabled by iOne STKA
NEXT Future Possibilities
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION27
Traditional Large Area collection of High Resolution Nadir images.
Oblique Camera for 4 sided oblique and nadir images to model in 3 dimensions.
One Commercial Mapping Systems
iOne n‐Oblique
iOne Stereo
Oblique Infrastructure Mapping System – Used for Corridor Mapping for Power lines and Pipelines.
iOne IMS co‐registered with laser mapper to give multiple layers of accurate data.
iOne M+
Medium Format Sensor for smaller missions at a more economical
UAV Mountable
UAV Mountable
UAV Mountable
One Software Technology….Multiple Sensor Configurations
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION28
VI Products Address Wide Value Chain
p Imageryique Imageryctral Imageryed Imagery
p Imageryique Imageryctral Imageryed Imagery
• Elevation Models • Precision Images (Orthos)• Transport/Nav Maps• Vegetation Maps
• Elevation Models • Precision Images (Orthos)• Transport/Nav Maps• Vegetation Maps
Integrated Data
Management
PARTNERS• Oil & Gas• Insurance/ Real
Estate• Utilities inventories• Telecom• Energy• Architecture • Engineering• Construction (BIM)• Asset Mgt• Assessors• Social media• Entertainment• …and more.
PARTNERS• Oil & Gas• Insurance/ Real
Estate• Utilities inventories• Telecom• Energy• Architecture • Engineering• Construction (BIM)• Asset Mgt• Assessors• Social media• Entertainment• …and more.
M$ Product Value & Market Size B$$$$$
llect ImageryTraditionalProducts
Advanced 2D/3D Products
CloudData Mgt.
3D VerticalApplications
2 3 4 5
• 3D Point clouds• Oblique’s• With partners 3D models
• 3D Point clouds• Oblique’s• With partners 3D models
• 3D Database• 3D Applications• Integrated Information Data Models
• Web Viewers/ Distribution
• 3D Database• 3D Applications• Integrated Information Data Models
• Web Viewers/ Distributionpping Companies
vigation Companiesuranceal Government
pping Companiesvigation Companiesuranceal Government
• Local Government• Fed Gov (BLM, ACE)• On‐line Mapping• E911/First Responder
• Local Government• Fed Gov (BLM, ACE)• On‐line Mapping• E911/First Responder
• Insurance• Commercial Real Estate• Fed Government• Local Government
• Insurance• Commercial Real Estate• Fed Government• Local Government
VI VI VI
Partners
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION29
Automated color ortho generation
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION30
DSM Generation / “Depth Map”
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION31
Oblique Automated Generation
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION32
NIR MS 4 Band Automated Generation
1:1 Co registration of color and NIRAutomated MS‐Ortho Generation
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION33
Co‐Registered Forward and Backward Oblique
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION34
Advanced Radiometric AlgorithmsTest flown during an overcast day. Before & after radiometric corrections.
Extend sensor operation during “extreme” light or weather conditions
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION35
Selective Feature Extraction
Automatically locate feature and extract
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION36
Point Cloud Generation for 3D Modeling
Click
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION37
iOne STKA UAS Array Architecture
rray Retinal Camera Architecture
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION39
Optimal maximal coverage and FOV thru the smallest aperture
Patented ARCA Provides Widest FOV CollectionArray behaves like a single sensor – a virtual image
Array Retinal Camera Architecture US Patent # 8,334,903 B2
Other Patents Apply
http://www.visualintelligenceinc.com/products/patents/
Collection and Functional Scalability – Highest metric performance
40
www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300
ARCA® is about GeometryThe ARCA geometry can be embodied in different form factors –arched or flat are two examples
Plate with angle adaptersPlate with angle adapters
=
Array Retinal Camera Architecture
41
www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300
Array Collection Scalability
Dual ARCA Array Largest swath / FOVUnique ability to build “pixel vacuum cleaners”
Array Retinal Camera Architecture US Patent # 8,334,903 B2
Other Patents Apply
http://www.visualintelligenceinc.com/products/patents/
42
www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300
Array Functional Scalability
Dual ARCA Array Co-Mounted and Co-Registered Sensor Fusion
Array Retinal Camera Architecture US Patent # 8,334,903 B2
Other Patents Apply
http://www.visualintelligenceinc.com/products/patents/
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION43
iOne UAS Sensor Solution Positioning
http://www.marketsandmarkets.com/Market‐Reports/unmanned‐aerial‐vehicles‐uav‐market‐662.html?gclid=CP6‐mPeNuLsCFe5j7Aod628AKA
Visual IntelligencePositioning
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION44
iOne UAV Sensor scalable for many apps
‐45‐40‐35‐30‐25‐20‐15‐10‐50
Weigh
t Pou
nds
Levels Based on Sensor Solution Compounded Size/Weight‐Level III‐ ‐Level II‐ ‐Level I‐
45
www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300
UAS Array Architecture
46
www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300
UAS Array Architecture
47
www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300
Array Modular Encapsulation for UAS Multipurpose Missions
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION48
Made possible by…
Planning, command and control, and navigation systems, simple sensor solution integration, with any UAS platform.
iOne “Small to large” UAV/UAS
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION49
Sensor Fusion ‐ CoCoTM
CoCo - Co mounting and Co registering of sensorsUS Patent # 7,725,258
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION50
ne STKA: Many 3D Sensor Applications Hosted in one Device‐Content eCosystem
iOne STKA and iOne Sense 3D
www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION51
Conclusions and Next Steps
Visual Intelligence has developed the iOne STKA®, a patented software and hardware array architecture that can be applied to design and develop sensor platforms of all sizes.As the use of UAS/3D products continues to evolve, VI has embarked on developing a micro camera array based on its proven technology. Applications for the patented array include use on laptops, cell phones, UAS/Drones and other handheld devices.