Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf ·...

16
FROM EVENT -BASED VISIONS T O REAL SYSTEMS Christian Brändli, PhD [email protected] 0041 077 430 32 59 First International Workshop on Event-based Vision ICRA 2017, June 2 nd, Singapore

Transcript of Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf ·...

Page 1: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

FROM EVENT-BASED VISIONS TO REAL SYSTEMS

Christian Brändli, [email protected]

0041 077 430 32 59

First International Workshop on Event-based Vision

ICRA 2017, June 2nd, Singapore

Page 2: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

WHO IS INSIGHTNESS

Page 3: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

TEAM

3

MarcOsswald, PhD

ChristianBrändli, PhDManagment ProductPhD thesis in fieldWorked at startup GetYourGuideVenture Leader award

PhD thesis in fieldTraining as El. & Mech. EngineerIntership ESA

ADVISORSProf. Tobi Delbruck Co-Founder, expert for event-based vision sensors

RaphaelBerner, PhDChip DesignPhD thesis in fieldWorked in industryQuit job to join company

NathanBaumliAlgorithmsMSc thesis in fieldEmployee Nr. 1Internship ABB

+ 2 Computer Vision Engineers

+ 1 Drone Engineer

+ 1 Chip Designer

BOARD MEMBERS

Ed Schneider Managing Director, Quan Technology FundJim Lewis Serial Entrepreneur (Ex-CEO Mesa, Avalon, ...), Consultant

Albert Bergemont Ex-VP Maxim Integrated, expert for semiconductors

Page 4: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

THE HISTORY OF INSIGHTNESS I

Tobi: First working event-based vision sensor (DVS)

2007 20112009 20102008

Christian: First event-based «autonomous driving»

2006

Rapha: First event -USB 2.0 interface

2012

Christian: First event-based structured lighting

Rapha: First color-sensitive DVS

2005

Page 5: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

Rapha: First DAVIS

THE HISTORY OF INSIGHTNESS II2013 20172015 20162014

Nathan: First event lifetime estimation

Insightness: First system EVK

Marc: First robustevent-based stereo

Marc: First event-basedkeypoint tracking

Chris & Tobi: First BSI event sensor

Insightness is founded& excl. license

Page 6: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

FROM EVENT-BASED VISIONS…

“event-based sensors open frontiers which are unthinkable with standard cameras”

“visual sensing and processing in autonomous vehicles, connected devices, security and surveillance systems”

Page 7: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

Event-based SensorsMarkets

Systems

Page 8: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

WHY SYSTEMS?• There are vision sensors that …

… are faster … burn less power… have more dynamic range… produce less data… have more temporal resolution…

• The only USP of event-based: EFFICIENCY

Page 9: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

EFFICIENCY, A SYSTEM SPEC

• Efficiency is not measured on a sensor-level but as a system spec

• System: Sensor, processing hardware, algorithms & software

• Making “better” chips or “better” software do not matter if the system they are integrated does not beat state of the art.

Page 10: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

…TO REAL SYSTEMS

Page 11: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

RINO 2 EVALUATION KIT

Page 12: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

SEES SENSOR MODULE

Page 13: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

EVK OUTPUT

• Raw DAVIS events (a)• Raw DAVIS frames• 9 DoF IMU data• Raw BlueFox• Frames• 6 DoF SVO Pose• Visual Flow Map (b)• Depth Map (c)• Motion Map (d)

Page 14: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

RINO 2 EVALUATION KIT

Page 15: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

INSIGHTNESS AND YOU

• Apply as Computer Vision Engineer – we are hiring!

• Buy our evaluation kit• Watch and share our youtube video:

“Insightness Collision Avoidance”• Build algorithms and license to us• Introduce us to companies and investors• Check out our demo

Page 16: Christian Brändli, PhD - Davide Scaramuzzarpg.ifi.uzh.ch/docs/ICRA17workshop/Insightness.pdf · Christian Brändli, PhD. Managment. Product. PhD thesis in field. Worked at startup

Confidential

FROM EVENT-BASED VISIONS TO REAL SYSTEMS

Christian Brändli, [email protected]

0041 077 430 32 59

First International Workshop on Event-based Vision

ICRA 2017, June 2nd, Singapore