Model Independent Visual Servoing
description
Transcript of Model Independent Visual Servoing
![Page 1: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/1.jpg)
Model Independent Visual Servoing
CMPUT 610 Literature Reading Presentation
Zhen Deng
![Page 2: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/2.jpg)
Introduction
Summaries and Comparisons of Traditional Visual Servoing and Model independent Visual Servoing emphasizing on the latter.
Works are mostly from Jenelle A. Piepmeier’s thesis and Alexandra Hauck’s thesis
![Page 3: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/3.jpg)
Visual Servo
Visual servo control has the potential to provide a low-cost, low-maintenance automation solution for unstructured industries and environments.
Robotics has thrived in ordered domains, it has found challenges in environments that are not well defined.
![Page 4: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/4.jpg)
Traditional Visual Servoing
Precise knowledge of the robot kinematics, the camera model, or the geometric relationship between the camera and the robot systems is assumed.
Need to know the exact position of the end-effector and the target in the Cartesian Space.
Require lots of calculation.
![Page 5: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/5.jpg)
Rigid Body Links
![Page 6: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/6.jpg)
Forward Kinematics
The Denavit-Hartenberg Notation:
i-1 T i = Rotz(ransz(d) Rotx(Trans(a)
Transformation 0 T e=
0 T 1 1 T 2
2 T 3 … n-1 T n n T e
![Page 7: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/7.jpg)
Jacobian by Differential
Velocity variables can transformed between joint space and Euclidean space using Jacobian matrices
x = J * J \ x Jij = ixj
![Page 8: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/8.jpg)
Calibrated Camera Model
![Page 9: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/9.jpg)
Model Independent Visual Servoing
An image-based Visual Servoing method. Could be further classified as dynamic look-
and-move according to the classification scheme developed by Sanderson and Weiss.
Estimate the Jacobian on-line and does not require calibrated models of either of the camera configuration or the robot kinematics.
![Page 10: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/10.jpg)
History
Martin Jagersand formulates the visual Servoing problem as a nonlinear least squares problem solved by a quasi-Newton method using Broyden Jacobian estimation.
Base on Martin’s work, Jenelle P adds a frame to solve the problem of grasping a moving target.
me ? …
![Page 11: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/11.jpg)
Reaching a Stationary Target
Residual error f() = y(y*. Goal: minimize f() f = fk - fk-1
Jk = Jk-1 + (f-Jk-1 T/ T k+1kJ-1
kfk
![Page 12: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/12.jpg)
Reaching a Fixed Object
![Page 13: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/13.jpg)
Tracking the moving object
Interaction with a moving object, e.g. catching or hitting it, is perhaps the most difficult task for a hand-eye system.
Most successful systems presented in paper uses precisely calibrated, stationary stereo camera systems and image-processing hardware together with a simplified visual environment.
![Page 14: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/14.jpg)
Peter K. Allen’s Work
Allen et al. Developed a system that could grasp a toy train moving in a plain. The train’s position is estimated from(hardware-supported) measurements of optic flow with a stationary,calibrated stereo system.
Using a non-linear filtering and prediction, the robot tracks the train and finally grasps it.
![Page 15: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/15.jpg)
“Ball player”
Andersson’s ping-pong player is one of the earliest “ball playing” robot.
Nakai et al developed a robotic volleyball player.
![Page 16: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/16.jpg)
Jenelle’s modification to Broyden
Residual error f(,t) = y(y*(t). Goal: minimize f(,t) f = fk - fk-1
Jk = Jk-1 + (f - Jk-1 y*(t)ttT/ T
k+1kJkTJk)-1 Jk
T
(fky*(t)tt
![Page 17: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/17.jpg)
Convergence
The residual error converges as the iterations increasing.
While the static method does not. The mathematics proof of this result could
be found in Jenelle’s paper.
![Page 18: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/18.jpg)
Experiments with 1 DOF system
![Page 19: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/19.jpg)
Results
![Page 20: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/20.jpg)
6 DOF experiments
![Page 21: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/21.jpg)
Future work ?
Analysis between the two distinct ways of computing the Jacobian Matrix.
Solving the tracking problem without the knowledge of target motion.
More robust … ?
![Page 22: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/22.jpg)
Literature Links
http://mime1.gtri.gatech.edu/imb/projects/mivs/vsweb2.html
A Dynamic Quasi-Newton Method for Uncalibrated Visual Servoing by Jenelle al
Automated Tracking and Grasping of a Moving Object with a Robotic Hand-Eye System. By Peter K. Allen
![Page 23: Model Independent Visual Servoing](https://reader035.fdocuments.in/reader035/viewer/2022062221/568143a0550346895db01ea3/html5/thumbnails/23.jpg)
Summary
Model Independent approach is proved to be more robust and more efficient.