12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal...

50
12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Transcript of 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal...

Page 1: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

12 November 2009, UT Austin, CS Department

Control of Humanoid Robots

Luis Sentis, Ph.D.

Personal robotics Guidance of gait

Page 2: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Assessment of Disruptive Technologies by 2025 (Global Trends)

Page 3: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Human on the loop:

Personal / Assitive robotics (health) Unmanned surveillance systems (defense / IT) Modeling and guidance of human movement (health)

Human-Centered Robotics

Page 4: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Current Projects: Compliant Control of Humanoid Robots

Page 5: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Recent Project:Guidance of Gait Using Functional Electrical Stimulation

Page 6: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

CONTROL OF HUMANOID ROBOTS

Page 7: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

General Control Challenges

Dexterity: How can we create and execute advanced skills that coordinate motion, force, and compliant multi-contact behaviors

Interaction: How can we model and respond to the constrained physical interactions associated with human environments?

Autonomy: How can we create action primitives that encapsulate advance skills and interface them with high level planners

PARKOUR

Page 8: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

The Problem (Interactions)

Operate efficiently under arbitrary multi-contact constraints

Respond compliantly to dynamic changes of the environment

Plan multi-contact maneuvers

Coordination of complex skills using compliant multi-contact interactions

Page 9: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Key Challenges (Interactions)

Find representations of the robot internal contact state

Express contact dependencies with respect to frictional properties of contact surfaces

Develop controllers that can generate compliant whole-body skills

Plan feasible multi-contact behaviors

Page 10: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Approach (8 years of development)

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 11: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Humanoids as Underactuated Systems in Contact

Non-holonomic Constraints(Underactuated DOFs)

External forces

Model-based approach: Euler-Lagrange

Torque commands

Whole-bodyAccelerations

External Forces

Page 12: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Model of multi-contact constraints

Accelerations are spanned by the contact null-space multiplied by the underactuated model:

Assigning stiff model:

Page 13: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Model of Task Kinematics Under Multi-Contact Constraints

x

q legs

Reduced contact-consistent Jacobian

x base

q arms Differential kinematics

Operational point (task to joints)

Page 14: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Modeling of Internal Forces and Moments

Page 15: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Variables representing the contact state

Page 16: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Aid using the virtual linkage model (predict what robot can do)

CC

C

C

Grasp / Contact Matrix

Center of pressure pointsInternal tensions

Center of Mass

Normal moments

Page 17: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Properties Grasp/Contact Matrix

1. Models simultaneously the internal contact state and Center of Mass inter-dependencies

2. Provides a medium to analyze feasible Center of Mass behavior

3. Emerges as an operator to plan dynamic maneuvers in 3d surfaces

Page 18: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Example on human motion analysis(is the runner doing his best?)

Page 19: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

More Details of the Grasp / Contact Matrix

Balance of forces and moments:

Underdetermined relationship between reaction forces and CoM behavior:

Optimal solution wrt friction forces

Page 20: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Example on analysis of stability regions (planning locomotion / climbing)

Page 21: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Approach

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 22: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Linear Control

Stanford robotics / AI lab

Torque control: unified force and motion control(compliant control)

Control of the task forces (pple virtual work)

Control of the task motion

Potential Fields

Page 23: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Inverse kinematics vs. torque control

duality

Pros:

Trajectory based

Cons:

Ignores dynamicsForces don’t appear

Pros:

Forces appearCompliant because of dynamics

Cons:

Requires torque control

Inverse kinematics: Torque control:

Page 24: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Highly Redundant Systems Under Constraints

Page 25: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Prioritized Whole-Body Torque Control

Prioritization (Constraints first):

Gradient descent is in the manifold of the constraint

Page 26: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Constrained-consistent gradient descent

x task

Optimal gradient descent:

Constrained kinematics:

x un-constrained

Page 27: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Constrained Multi-Objective Torque Control

Lightweight optimization

Decends optimally in constrained-consistent space

Resolves conflicts between competing tasks

Page 28: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Torque control of humanoids under contact

Page 29: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Control of Advanced Skills

Page 30: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Example: Interactive Manipulation

Page 31: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Manifold of closed loops

Control of internal forces

Unified motion / force / contact control

Page 32: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Compliant Control of Internal Forces

Using previous torque control structure, estimation of contact forces, and the virtual linkage model:

Page 33: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Simulation results

Page 34: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.
Page 35: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Approach

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 36: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Contact Requisites: Avoid Rotations and Friction Slides

C Rotational Contact Constraints: Need to maintain CoP in support area

Frictional Contact Constraints: Need to control tensions and CoM behavior to remain in friction cones

Page 37: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Automatic control of CoP’s and internal forces

Motion control

Page 38: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

CoM control

Page 39: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Example: CoM Oscillations

Page 40: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Specifications

Page 41: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Multiple steps: forward trajectories

Page 42: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Results: lateral steps

Page 43: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Approach

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 44: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.
Page 45: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.
Page 46: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.
Page 47: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Demos Asimo

Upper body compliant behaviors

Honda’s balance controller

Torque to position transformer

Page 48: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

Summary

Grasp Matrix

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 49: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.

PRESENTATION’S END

Page 50: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait.