Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential...

16
| Autonomous Mobile Robots Roland Siegwart, Margarita Chli, Nick Lawrance ASL Autonomous Systems Lab Roland Siegwart, Margarita Chli, Nick Lawrance Summary 1 Mobile Robots | Summary Autonomous Mobile Robots Spring 2020

Transcript of Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential...

Page 1: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Roland Siegwart, Margarita Chli, Nick Lawrance

Summary 1

Mobile Robots | SummaryAutonomous Mobile Robots

Spring 2020

Page 2: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 2

Introduction | probabilistic map-based localization

see-think-actraw data

“position“global map

Sensing Acting

InformationExtraction

PathExecution

CognitionPath Planning

knowledge,data base

missioncommands

LocalizationMap Building

Mot

ion

Con

trol

Perc

eptio

n

actuatorcommands

environment modellocal map path

Real WorldEnvironment

Page 3: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 3

Legged Robots and Kinematics Types and application of legged systems Number of legs

Analogy to nature

Static and dynamic stability Locomotion control

Basics of rigid body kinematics Translation, rotations, and homogeneous transformation Translational and angular velocities Rigid body kinematics formulation Vector differentiation in moving coordinate systems

Page 4: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Wheeled types and arrangements

Kinematics Constraints imposed by wheels Forward or inverse differential kinematics

Analysis of the differential kinematics equations the degree of maneuverability

= degree of mobility + degree of steerability

Summary 4

Wheeled Locomotion

𝑋

𝑋𝑌

𝑌

𝛼

𝛽

𝑙

Page 5: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

11 w

w

w

ZYX

TRKvu

Perspective projection Intrinsic and extrinsic parameters

Stereo vision Correspondence search Rectification Disparity map

Structure from motion Epipolar geometry Epipolar constraint Essential matrix 8-point algorithm

5

Commputer Vision | Projective Geometry

Perspective Projection Matrix

epipolar plane

epipolar lineepipolar line

CrCl𝑝

Disparity

rlP uu

bfZ

𝑅,𝑇 ?

𝑃 ?

𝐶𝐶

Summary

Page 6: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 6

Image Saliency | image filtering & place recognition

Image Filtering:

Correlation vs. Convolution Use in template matching,

smoothing & taking the derivate of an image

Image filtering for Edge Detection

Point Features: Harris, SIFT, FAST, BRIEF, BRISK & their characteristicse.g. scale/rotation invariance, computational time

Building and using thevisual vocabulary forPlace Recognition

2N+1

2N+1

Examples of Visual Words

Page 7: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 7

Line Fitting | algorithms & error propagation

The Error Propagation Law

How uncertainties propagate through a function.

Line Fitting algorithms for image/laser point clouds

Split-and-merge, RANSAC, Hough Transform,..

How they work & their relative characteristics and applications

Courtesy of ETH - ASL

Page 8: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

SEE: The robot queries its sensors→ finds itself next to a pillar

ACT: Robot moves one meter forward motion estimated by wheel encoders accumulation of uncertainty

SEE: The robot queries its sensors again → finds itself next to a pillar

Belief update (information fusion)Summary 8

Localization | where am I? 𝑝 𝑥

𝑥

𝑝 𝑥

𝑥

𝑝 𝑥

𝑥

𝑝 𝑥

𝑥

𝑝 𝑥

𝑝 𝑥

𝑥

Page 9: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 9

SLAM | approaches & current challenges

What is SLAM and how does it work? The graphical representation SLAM & the approaches to solve it: Full graph optimization Filtering Keyframe-based

Popular techniques & how they work: EKF SLAM via MonoSLAM [Davison et al. 2007]

A

B C

SLAM today & Challenges

Page 10: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 10

Motion Planning | the planning problem

Goal

Page 11: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

1. Local collision avoidance Dynamic Window Approach (Reciprocal) Velocitiy Obstaces Local potential fields

2. Global planning Harmonic potential fields Graph search (BF, Dijkstra, A*) Randomized tree search (RRT)

Summary 11

Motion Planning| hierarchical decomposition & approaches

v

A

B C

D

E

1

3

3

2

2

Page 12: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Type Written session examination

Language of examination English

Course attendance confirmation required No

Repetition The performance assessment is only offered in the session after the course unit. Repetition only

possible after re-enrolling. Mode of examination written 120 minutes

Aids 4 A4-pages summary (2 sheets written on both sides or 4 sheets written on one side); Calculator

Summary 13

Exam

Page 13: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Content of the exam: MOOC (video segment, exercises, quizzes) Book “Autonomous Mobile Robots” and add on slides

Mode (to be confirmed): The exam will be a combination of Multiple Choice (comprehensive) 20-30% Comprehension questions Calculations, similar to exercises, but simpler and solvable without computer

Two preparation sessions: First: around 2 weeks before the exam Second: 2-3 day before the exam

Date and mode still open due to Corona – typically in the middle of August More information about the exam mode, preparation session and an example

exam will be sent to you as soon as the ETH’s Rectors office has decided.Summary 14

Exam |

Page 14: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 15

Exam (example exercise exam)

Page 15: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 16

Exam (example exercise exam)

Page 16: Autonomous Mobile Robots · Constraints imposed by wheels Forward or inverse differential kinematics Analysis of the differential kinematics equations the degree of maneuverability

|Autonomous Mobile RobotsRoland Siegwart, Margarita Chli, Nick Lawrance

ASLAutonomous Systems Lab

Summary 17

Exam (example exercise exam)