Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul...

50
Robosoccer Team MI20 presents Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intellige nce Twente

Transcript of Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul...

Page 1: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robosoccer Team MI20 presents …

Supervisors• Albert Schoute• Mannes Poel

Current team members• Paul de Groot• Roelof Hiddema

Mobile Intelligence Twente

Page 2: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robot soccer as a scientific “playing field”

Interdisciplinary• Hardware & Software• Sensing & Control• Image processing • Motion planning• Multi-agent collaboration• Communication• Artificial intelligence

International• Championships

(FIRA, Robocup)• Congresses

Page 3: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Mission Impossible ?

Page 4: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

International leagues

Robocup• Humanoid• Small size• Middle size• Four-Legged• Rescue• Junior• Simulation• @Home

FIRA• HuroSot• KheperaSot• MiroSot UT team• NaroSot• QuadroSot• RoboSot• SimuroSot

Page 5: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robocup Humanoid 2 vs. 2 (Osaka 2005)

Page 6: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

FIRA Humanoid (Vienna 2003)

Page 7: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robocup Middle League

Page 8: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Robocup Small League

Page 9: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

FIRA Mirosot (11 vs. 11)

Page 10: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

• Games between teams of 5, 7 or 11 robots• Camera’s above the field observe the playing• Computers control the robots wirelessly

FIRA Mirosot competitie

Page 11: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

MiroSot robots

• Maximal dimensions:7.5 x 7.5 x 7.5 cm

• Two-wheeled differential drive robots

• Board-computer controls wheel velocities

Page 12: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Impression of EC 2005 @ UT

Page 13: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Twente’s robosoccer team

• Started in 2002:

Missing Impossible

Mission Impossible

Mobile Intelligence

Page 14: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Generations of students

1st teamLjubljana 2003

4th teamVienna 2006

Page 15: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Generations of robots

Page 16: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Home base

Page 17: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Computer control

Page 18: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Localization

• Robots have color patches on top

• Design is free, except for obligatory team color

• Design choice:identical or different patterns per robot?

• Identical makes recognition simpler, but robots must be tracked

Page 19: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Vision

Page 20: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Camera image

Page 21: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Color segmentation

Page 22: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Color separation

Page 23: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Region clustering

Page 24: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Camera calibration

• Lens distortion

Page 25: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Image correction

• Remap feature points only

Page 26: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Correction of projective mapping

• Automatic field calibration by 4 known markers

Page 27: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Correct for parallax

Page 28: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Tracking

Page 29: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

State estimation

y

x

v

v

y

x

y

x

y

x

State

) θx

y

(x,y)

Page 30: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Result on the screen

Page 31: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Motion Control

• Robots have local PID velocity controllers• Motion commands wheel speeds (vr, vl) cq. lin.

& ang. velocities (v, )• Kinematic robot model

• Higher speeds: account for dynamics!

10

0sin

0cos

y

x

Page 32: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Motion Planning

Driving fast to play the ballwhile avoiding obstacles …

Page 33: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Strategy ?

The team’s magic

Page 34: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

System design ?

PlayerAgentPlayerAgentPlayerAgentPlayerAgent

prediction &derivation

Camera

Coachagent

UserInterface

PlayerAgent

Robot

TimageTsettings

Tvision_settings & Tcalibration

Tgame_status & Tscore_board

Tscore_board & Tgame_status

Tworld_data

Tworld_data

Tworld_data

Tcoach_data

Tsensor

Tsensor & Todometrics

Twheel

Motors

State

Tvoltage

Tsensor & Todometrics

Todometrics

User

RFcommunication

Twheel

Tsensor & Todometrics

Vision Measurement

Tsnap_shot

Simulator DLL

Tsnap_shot

Twheel

Tsensor & Todometrics &

Timage

Tgame_status & Tscore_board

Tplayer_data

Tscore_board & Tgame_status

The team’s pain

Page 35: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

(Re)designing for the winning team

Initial MI20 multi-agent system architecture:

Page 36: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

1st team motion controller

Solve the parking problem:

move to “pose”(x, y, )

Page 37: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

… while avoiding obstacles

Vector Field Histogram Corresponding Histogram

Local method:

Page 38: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Trying out in de simulator

Page 39: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Shoot and score!

Page 40: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Shoot and miss!

Page 41: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Improvements

Real Prediction

1

2 2

1

1

2

2

1

Avoid tracking errors by collision analysis

Page 42: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision prediction

last1

pred1

pred2

γ

last2

Page 43: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision state correction

corr1

corr2last2

pred2

last1

pred1

Page 44: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision response model

B

VB

P

n

A

VA

Page 45: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Collision response (cont.)

B

VBωBA

VAωA

P

Page 46: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Improving strategy

Choosing optimal offensive / defensive positions

Page 47: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Improved system structure

• Complete software revision

• Reduced thread concurrency

• Simplified interprocess communication

• Current O.S.Linux Fedora Core 4

Page 48: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Coming soon …

Page 49: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

TU Vienna Parade

Page 50: Robosoccer Team MI20 presents … Supervisors Albert Schoute Mannes Poel Current team members Paul de Groot Roelof Hiddema Mobile Intelligence Twente.

Questions?