Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf ·...
-
Upload
vuonghuong -
Category
Documents
-
view
219 -
download
1
Transcript of Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf ·...
![Page 1: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/1.jpg)
1
Sensors
CSCI545Introduction to Robotics
Hadi Moradi
Previous LectureDC motorsDC motors
InefficientOperating voltageOperating currentStall currentStall torqueStall torqueGearing up and downGear ratiosPWMServo motors vs. stepper motors
![Page 2: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/2.jpg)
2
SensorsPerception through sensorsPerception through sensors
Contact: bump, switch
Distance: Ultrasound, radar, infra red
Light level: photo cells, cameras
Sound level: microphone
SensorsPerception through sensorsPerception through sensors
Strain: strain gauge
Rotation: encoders
Magnetism: compasses
Smell: chemical
![Page 3: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/3.jpg)
3
SensorsPerception through sensorsPerception through sensors
Temperature: thermal, infra red
Inclination: inclinometers, gyroscopes
Pressure: pressure gaugesPressure: pressure gauges
Altitude: altimeters…
SensorsSimple complexSimple complex
Contact switch human retina
![Page 4: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/4.jpg)
4
The General QuestionGiven the sensory reading what was theGiven the sensory reading what was the world like?
Example: SkinExample: Skin
Levels of ProcessingA switch:
open = 0 voltsClosed = 5 volts
A digital scale:
Microphone:Microphone:
Camera:
![Page 5: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/5.jpg)
5
ProprioceptionSensing informationSensing information
Proprioception:
Exteroception:Examples of proprioception
Sensor FusionCombining multiple sensorsCombining multiple sensors Difficulties:
E l H b iExample: Human brain
![Page 6: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/6.jpg)
6
Magnetic Field Sensor of Baby Loggerhead Sea Turtles
Field Inclination AngleField IntensityNeuron sensors in the brain?
http://news.nationalgeographic.com/news/2001/10/1012_TVanimalnavigation.html
http://faculty.washington.edu/chudler/magtur.html
Magnetic Field Sensor of Baby Loggerhead Sea Turtles
http://www.unc.edu/depts/oceanweb/turtles/
Research by Dr. Kenneth Lohmann
![Page 7: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/7.jpg)
7
Ohm’s Law
V= IRV= IRV =voltage (volts)I =current (Amps)R = resistance (Ohms)
Switch SensorsOpen vs closedOpen vs. closed
![Page 8: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/8.jpg)
8
Light SensorsA variable resistorA variable resistor that changes based on the light.Brighter light =>
low resistancelow resistancedarker light =>
Higher resistance
The Importance of shielding
Note: Shielding, position, and directionality of the photocells are important.
![Page 9: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/9.jpg)
9
Resistive Position SensorsOriginallyOriginally developed for video game control.
Bend Sensor
![Page 10: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/10.jpg)
10
PotentiometersVolume control in your stereoVolume control in your stereoTypically called pots
Example
![Page 11: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/11.jpg)
11
Example
Reflective Opto-sensorsEmitter and detectorEmitter and detector Emitter:
LED
Detector:PhotodiodePhotodiodePhototransistor
![Page 12: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/12.jpg)
12
Photodiode vs. PhotoresistorPhotoresistor:Photoresistor:Photodiode/phototransistor:
Phototransistor vs. Photodiode:
Applicationsobject presence detectionobject presence detection object distance detection surface feature detection (finding/following markers/tape) wall/boundary trackingwall/boundary tracking rotational shaft encoding
![Page 13: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/13.jpg)
13
Sensor limitationsLight reflectivity:g y
Surface color
TextureAmbient light: How to overcome the ambient light?
Sensor calibration
=> Partially observable
Break Beam Sensors
Any pair of compatible emitter-detector devices can be used to make a break-beam sensorExamples:
Where have you seen these?
![Page 14: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/14.jpg)
14
Shaft EncodingMeasure angular rotationMeasure angular rotation
Example:Speedometer: speed of rotationp pOdometer: number of rotations
Q: What happens if there is only one notch in the disk?
An Example
![Page 15: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/15.jpg)
15
Quadrature Shaft Encoder
Clockwise rotation signal
Output Signal
ccwcw
![Page 16: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/16.jpg)
16
Modulation and Demodulation of Light
Problem: Ambient lightProblem: Ambient lightSolution:
Example: Home remote controlUsage:g
Modulation and Demodulation of Light
![Page 17: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/17.jpg)
17
Proximity SensingThe distance to a nearby objectThe distance to a nearby object
Just the return of signal
Distance Sensing
![Page 18: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/18.jpg)
18
Infra Red (IR) SensorsInfra red part of the spectrumInfra red part of the spectrumUsed like break beam and reflectance sensorsAdvantage
Time of FlightEmitter: send aEmitter: send a chirpCollector: Receives the bounce backElapsed time
1.12 feet/ms
Called echolocation
![Page 19: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/19.jpg)
19
Bats
Man Made ExampleUsed to mapUsed to map undersea surface
![Page 20: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/20.jpg)
20
Undersea Mapping
Picture from Bluefin Robotics
![Page 21: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/21.jpg)
21
Problem 1: Multiple ReflectionsWhich reflectionWhich reflection gets back earlier?Which reflection should be used for calculation?
Object 2
Object 1
Sonar
Problem 2: Specular ReflectionGraze the surfaceGraze the surface and bounce off
Object 2
Object 1
Sonar
![Page 22: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/22.jpg)
22
Problems
Other Usages: NavBelt
http://www.engin.umich.edu/research/mrl/00MoRob_19.html
![Page 23: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/23.jpg)
23
Navchair
http://www.engin.umich.edu/research/mrl/00MoRob_19.html
GuideCane
![Page 24: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/24.jpg)
24
GuideCane
Machine VisionMachine VisionProblem: determine the objects in theProblem: determine the objects in the environment (Understand the environment).Example: RoboCup
![Page 25: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/25.jpg)
25
The Physics of VisionThe Physics of Vision
Light goes through the irisImpinges retina
Camera Light ProcessingCamera Light Processing
A very simple processing: convert the image to a normal image
![Page 26: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/26.jpg)
26
Image ReconstructionImage Reconstruction
Reconstruction: what was the world likeReconstruction: what was the world like that produced this image?
Pixelizing the Image PlanePixelizing the Image Plane
pixels: picture cellspixels: picture cellsEach picture divided into small cells
Typical camera: 512 X 512 pixels Human eye:
120 x 10^6 rods120 x 10^6 rods 6 x 10^6 cones
![Page 27: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/27.jpg)
27
Image BrightnessImage Brightness
B i h i l h fBrightness: proportional to the amount of light directed toward the cameraBrightness depends on:
Patch BrightnessPatch Brightness
Th b i h d dThe brightness depends on:specular (bounce off the surface)diffuse (re-emitted)
![Page 28: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/28.jpg)
28
First Steps of Early VisionFirst Steps of Early VisionExample:Example:
b&w camera 512 x 512 pixel image plane. intensity level between white and black
Question:Do we know if there is an object?Do we know if there is an object? How do we find an object in the image?
An ExampleAn Example
![Page 29: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/29.jpg)
29
Edge DetectionEdge DetectionEdges: curves in the image plane with significant change in the brightness levelA simple approach: to look for sharp brightness changes:
Problem:
Example: Human Body ProjectExample: Human Body Project
![Page 30: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/30.jpg)
30
Smoothing of NoiseSmoothing of NoiseNoise: Small picks in differentiated imageNoise: Small picks in differentiated image.Eliminating noise:
Finding ObjectsFinding Objects
Step 2: Find objects among all those edgesStep 2: Find objects among all those edges. Segmentation:
Q tiQuestions:How do we know which lines correspond to which objects, What makes an object?
![Page 31: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/31.jpg)
31
Finding ObjectsFinding ObjectsUse clues to detectUse clues to detect objects. The math is hard...
Clues for Segmentation (1)Clues for Segmentation (1)
Use stored models (model-based vision)Use stored models (model based vision)
![Page 32: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/32.jpg)
32
Clues for Segmentation (1)Clues for Segmentation (1)
MAKRO 1.1 drives to a T-shaped junction, measures its width, drives back, performs a turn, stops, drives back and performs a turn back into the main pipe. Second run, different point of view
Clues for Segmentation(2)Clues for Segmentation(2)
Use motion (motion vision)Use motion (motion vision)
![Page 33: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/33.jpg)
33
Clues for Segmentation(3)Clues for Segmentation(3)
Use binocular stereopsisUse binocular stereopsis(stereo vision)
Clues for Segmentation(4)Clues for Segmentation(4)
Left image Right image
Image after disparity
![Page 34: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/34.jpg)
34
Clues for Segmentation(5)Clues for Segmentation(5)
Use textureUse texture
Use shadingshading, contours,Use shadingshading, contours, …recover shape in a similar way as from texture
Complexity of Vision SensingComplexity of Vision Sensing
Reconstruction:Reconstruction:
If no need for reconstruction:Si lif i i iSimplify vision processing
Q: What are some ways of doing that?
![Page 35: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/35.jpg)
35
Simplifying VisionSimplifying VisionUse color
Use a smaller image plane (e.g., a line)
Use other sensors to complement visionUse other sensors to complement vision
Use task-specific information
Question: Determine the object in this image
![Page 36: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/36.jpg)
36
Structured Light VisionStructured Light VisionProject a light on aProject a light on a mirror and scan the area.You may avoid rotating motor and scan with a fullscan with a full surface.
Images courtesy of http://www.caligari.com/
Structured Light VisionStructured Light VisionAny object in theAny object in the environment cuts the light.
Images courtesy of http://www.caligari.com/
![Page 37: Lecture3 Sensors short.ppt - University of Southern …csci545/slides/Lecture3_Sensors_short.pdf · Previous Lecture DCmotorsDC motors ... Strain: strain gauge ... Microsoft PowerPoint](https://reader031.fdocuments.in/reader031/viewer/2022021819/5ac225c17f8b9a5a4e8df102/html5/thumbnails/37.jpg)
37
Structured Light VisionStructured Light Vision
A) The whole scene, B) The object w/o laser light, C) the difference
Images courtesy of http://www.caligari.com/
Structured Light VisionStructured Light VisionY= projection of theY= projection of the laser on the image planeH= height of the cameraQuestion: How do you calculate r?
Images courtesy of http://www.caligari.com/