Lecture 05: camera basics -...

12
Lecture 05: camera basics Katie DC Sept. 10, 2019

Transcript of Lecture 05: camera basics -...

Page 1: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Lecture 05:camera basics

Katie DC

Sept. 10, 2019

Page 2: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Admin

• HW3 is live as of Monday

• Quiz1 is next week – make sure you schedule time at the CBTF

• Policy Updates

• Participation:• “Shout out form” will be posted on Piazza and website

• Optional self-assessment due mid- and end of semester

• Quiz retakes will be at the CBTF ~a week later

Page 3: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Who is this human?

Page 4: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Motivating Example: Block Picking

1. Detect specified block

2. Convert point in image to world coordinates

3. Robot end effector goes to point

4. Picks up block

5. Moves and replaces block in new position

Page 5: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Camera modelsPhoto credit: fdxlabs

Page 6: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Camera Point to World Point

Page 7: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Perspective Phenomenon

Page 8: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Parallel Lines Converge

Page 9: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Perspective Projection

Page 10: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Perspective Matrix Equation

Page 11: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

World to Camera Transformation

Page 12: Lecture 05: camera basics - publish.illinois.edupublish.illinois.edu/ece470-intro-robotics/files/2019/09/05-lecture.pdf · Motivating Example: Block Picking 1. Detect specified block

Finite Projective Camera