Reaching and Grasping -...

19
Reaching and Grasping John Loy CSE 888.14X WI 08

Transcript of Reaching and Grasping -...

Page 1: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Reaching and Grasping

John LoyCSE 888.14X

WI 08

Page 2: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Problem Outline

• Plan a path for a jointed arm– Obstacles– Human-like motion

• Find a joint configuration able to grasp anobject

• High Degree of Freedom– 7 DoFs for human arm– ~27 DoFs for human hand

Page 3: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Kinematics

• Forward Kinematics– Explicitly specify joint parameters

• Inverse Kinematics– Specify end effector position– Solve for joint parameters

• Provide animator with precise control

Page 4: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Basic Inverse KinematicsApproach

• Construct the Jacobian to relate change injoint parameters to change in end effectorposition

• Solve using pseudo-inverse• Sensitive to near-singularity• Does not produce human-like motion

Page 5: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Null Space Solutions

• Used to– Avoid obstacles– Prevent singularities– Minimize joint torques– Soft constraints on joint angles

Page 6: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Cyclic Coordinate Descent

Welman, C. Inverse Kinematics and Geometric Constraints for Articulated Figure Manipulation. Thesis.Simon Fraser Univ. 1993. http://fas.sfu.ca/pub/cs/theses/1993/ChrisWelmanMSc.ps.gz

Page 7: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Early Robotics

• Stanford Arm• Victor

Scheinman,StanfordArtificialIntelligenceLaboratory,1969

• Closed-formsolution for IK http://infolab.stanford.edu/pub/voy/museum/pictures/display/1-Robot.htm

Page 8: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Robotics

• Barraquand and Latombe (1991) develop apotential field-based method for obstacleavoidance using Monte Carlo method (RPP)

Page 9: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Jack

• Virtual human modeling system• Developed at Center for Human Modeling

and Simulation at U. Penn. beginning in the70’s.

http://cg.cis.upenn.edu/hms/technology.htmlNorman Badler, Cary Phillips, Bonnie Webber.Simulating Humans. Oxford University Press. 1999.

Page 10: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Multi-arm Planning

• Koga and Latombe(1994) extend RPP tohandle two cooperatingmanipulators

• Plans transfer subtasksthat are guaranteed tohave connecting transitpaths

Page 11: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Human-like Motion

• Koga et. Al (Siggraph1994) combine multi-armRPP, and a null space IKsolution based on aneurophysiologicalmodel by Soechting andFlanders to producenatural motion

Page 12: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Genetic Algorithms

• Miller (1993) uses RPP to generate aninitial population of solutions and iterativelyrefines the solution

• Path fitness is a combination of factorsincluding collisions, joint accelerations,torque, and jerk

Page 13: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Synthesized Motion

• Motion may be synthesized from motioncapture data

• Pollard and Hodgins (2002) propose togeneralize demonstrated manipulation

• New manipulation tasks can be synthesizedbased on similarity in contact points andapplied forces

Page 14: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Handrix: Animating the HumanHand

• ElKoura andSingh (SCA 2003)

• Used motioncapture data togenerate aprocedural modelfor guitar playing

Page 15: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Grasping from Example

• Pollard and Zordan (2005) develop aphysically based motion controller forgrasping than draws from example motioncapture data

Page 16: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Grasping from Example

Page 17: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Dynamics

• Tsang et al give a muscle-tendon system foranatomically reasonable forward dynamicssimulation and finding inverse dynamicssolutions

Page 18: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Future Work

• Real-time solutions• Natural grasping of arbitrary objects• Animator control

Page 19: Reaching and Grasping - web.cse.ohio-state.eduweb.cse.ohio-state.edu/.../888/Character/ReachingAndGrasping.pdf · Reaching and Grasping John Loy CSE 888.14X WI 08. ... (RPP) Jack

Questions?