Download - Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Transcript
Page 1: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robosoccer Team MI20 presents …

Supervisors• Albert Schoute• Mannes Poel

Current team members• Paul de Groot• Roelof Hiddema

Mobile Intelligence Twente

Page 2: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robot soccer as a scientific “playing field”

Interdisciplinary• Hardware & Software• Sensing & Control• Image processing • Motion planning• Multi-agent collaboration• Communication• Artificial intelligence

International• Championships

(FIRA, Robocup)• Congresses

Page 3: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Mission Impossible ?

Page 4: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

International leagues

Robocup• Humanoid• Small size• Middle size• Four-Legged• Rescue• Junior• Simulation• @Home

FIRA• HuroSot• KheperaSot• MiroSot UT team• NaroSot• QuadroSot• RoboSot• SimuroSot

Page 5: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robocup Humanoid 2 vs. 2 (Osaka 2005)

Page 6: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

FIRA Humanoid (Vienna 2003)

Page 7: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robocup Middle League

Page 8: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robocup Small League

Page 9: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

FIRA Mirosot (11 vs. 11)

Page 10: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

• Games between teams of 5, 7 or 11 robots• Camera’s above the field observe the playing• Computers control the robots wirelessly

FIRA Mirosot competitie

Page 11: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

MiroSot robots

• Maximal dimensions:7.5 x 7.5 x 7.5 cm

• Two-wheeled differential drive robots

• Board-computer controls wheel velocities

Page 12: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Impression of EC 2005 @ UT

Page 13: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Twente’s robosoccer team

• Started in 2002:

Missing Impossible

Mission Impossible

Mobile Intelligence

Page 14: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Generations of students

1st teamLjubljana 2003

4th teamVienna 2006

Page 15: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Generations of robots

Page 16: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Home base

Page 17: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Computer control

Page 18: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Localization

• Robots have color patches on top

• Design is free, except for obligatory team color

• Design choice:identical or different patterns per robot?

• Identical makes recognition simpler, but robots must be tracked

Page 19: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Vision

Page 20: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Camera image

Page 21: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Color segmentation

Page 22: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Color separation

Page 23: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Region clustering

Page 24: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Camera calibration

• Lens distortion

Page 25: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Image correction

• Remap feature points only

Page 26: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Correction of projective mapping

• Automatic field calibration by 4 known markers

Page 27: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Correct for parallax

Page 28: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Tracking

Page 29: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

State estimation

y

x

v

v

y

x

y

x

y

x

State

) θx

y

(x,y)

Page 30: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Result on the screen

Page 31: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Motion Control

• Robots have local PID velocity controllers• Motion commands wheel speeds (vr, vl) cq. lin.

& ang. velocities (v, )• Kinematic robot model

• Higher speeds: account for dynamics!

10

0sin

0cos

y

x

Page 32: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Motion Planning

Driving fast to play the ballwhile avoiding obstacles …

Page 33: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Strategy ?

The team’s magic

Page 34: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

System design ?

PlayerAgentPlayerAgentPlayerAgentPlayerAgent

prediction &derivation

Camera

Coachagent

UserInterface

PlayerAgent

Robot

TimageTsettings

Tvision_settings & Tcalibration

Tgame_status & Tscore_board

Tscore_board & Tgame_status

Tworld_data

Tworld_data

Tworld_data

Tcoach_data

Tsensor

Tsensor & Todometrics

Twheel

Motors

State

Tvoltage

Tsensor & Todometrics

Todometrics

User

RFcommunication

Twheel

Tsensor & Todometrics

Vision Measurement

Tsnap_shot

Simulator DLL

Tsnap_shot

Twheel

Tsensor & Todometrics &

Timage

Tgame_status & Tscore_board

Tplayer_data

Tscore_board & Tgame_status

The team’s pain

Page 35: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

(Re)designing for the winning team

Initial MI20 multi-agent system architecture:

Page 36: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

1st team motion controller

Solve the parking problem:

move to “pose”(x, y, )

Page 37: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

… while avoiding obstacles

Vector Field Histogram Corresponding Histogram

Local method:

Page 38: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Trying out in de simulator

Page 39: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Shoot and score!

Page 40: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Shoot and miss!

Page 41: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Improvements

Real Prediction

1

2 2

1

1

2

2

1

Avoid tracking errors by collision analysis

Page 42: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision prediction

last1

pred1

pred2

γ

last2

Page 43: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision state correction

corr1

corr2last2

pred2

last1

pred1

Page 44: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision response model

B

VB

P

n

A

VA

Page 45: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision response (cont.)

B

VBωBA

VAωA

P

Page 46: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Improving strategy

Choosing optimal offensive / defensive positions

Page 47: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Improved system structure

• Complete software revision

• Reduced thread concurrency

• Simplified interprocess communication

• Current O.S.Linux Fedora Core 4

Page 48: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Coming soon …

Page 49: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

TU Vienna Parade

Page 50: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Questions?