Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

55
Sensor Data Collection September 11, 2008 Sung-Bae Cho 1

Transcript of Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Page 1: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Sensor Data Collection

September 11, 2008

Sung-Bae Cho

1

Page 2: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

Page 3: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

What is Sensor?

• Sensor

– A device that measures a physical quantity and converts it into a signal which can be read by an observer or by an instrument

• Sensor sensitivity

– How much the sensor's output changes when the measured quantity changes

3/54

Page 4: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Sensor Types

• Thermal:

– Temperature/heat sensors

• Electromagnetic:

– Electrical resistance/voltage/power sensors, magnetism sensors, metal detectors, RADAR

• Mechanical:

– Acceleration, position, pressure, switch, liquid sensors

• Chemical:

– Odor (smell) sensor, oxygen sensors

• Optical radiation:

– Light sensors, infra-red sensor, proximity sensor

• Acoustic: Sound sensors

• Motion sensors:

– Radar gun, speedometer, tachometer, odometer

• Orientation sensors: Gyroscope

4/54

Page 5: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Features of Sensor (1)

• Light Sensors

– Detecting light intensity, density, reflection, color temperature, type of light

– Rich information, very low cost

• C-MOS Camera

– Visual information about the environment

– Processing power and storage needs are often large

– Users feel uncomfortable

• Location sensor

– GPS(Global Positioning System) is mostly used

– Coarse location information

• Cellular network infrastructures: Global System for Mobile Communications (GSM)

5/54

Page 6: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Features of Sensor (2)

• Audio, Microphones

– Interesting information: Noise level, type of input, base frequency

– Using minimal processing: Less than 200 bytes of RAM

– Multiple microphones: Richer information

– Very cheap

– Can be extended up to speech recognition by using more processing power

– Ultrasonic sensors: Augment human sensory capabilities

• Accelerometers

– Information on the inclination, motion, acceleration of the device

– Typical: Mercury switches, angular sensors, accelerometers

– Especially interesting in examination of usage patterns

• Touch sensor

– Can reduce energy consumption: operative in the user's hand

6/54

Page 7: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Features of Sensor (3)

• Air pressure

– Some hints: Closing door

• Temperature sensor

– Most sensors are cheap and easy to use

– Detect body heat, arctic or desert environments

• Passive IR sensors (Motion detector)

– Movement of the device itself is detected as well

• Proximity sensors

– Determine a proximate distance between a physical object in the range and the device

• Gas sensor

– Problem: delay in measurement, enormous energy consumption

7/54

Page 8: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Features of Sensor (4)

• Biosensors

– User awareness

– Skin resistance, blood pressure: sports and medical applications

– Emotional state of the user may be obtained

• Magnetic field

– Similar to a compass

– Direction of a device or movement can be determined

– This sensor can give false information

• Tilt sensors

– Determine the tilt angles of the device

• No-power sensors

– Metal ball switches, mercury switches, solar panels

– Extremely low power consumption

8/54

Page 9: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

Page 10: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Sensing Environments

• Information processing has been thoroughly integrated into everyday objects and activities Ubiquitous environments

• Paradigm change

– Ordinary: a single user consciously engages a single device for a specialized purpose

– New: engages many computational devices and systems simultaneously, in the course of ordinary activities, and may not necessarily even be aware that they are doing so

• Related technologies

– Ubiquitous computing, pervasive computing, ambient intelligence

– Haptic computing, things that think

10/54

Page 11: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Sensors in Ubiquitous Environments

• Body Sensor

– Physiological sensor

– Biosensor: Identity, emotion, facial expression, behavior, gait

– Location sensor (GPS)

• Environment Sensor

– Video camera

– Light

– Noise & sound

– Temperature & humidity

– Pressure

– Movement

– Acceleration

• Object Sensor

– Position & status of object

11/54

Page 12: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Service & Applications

• Application model

• Services

12/54

Page 13: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Sensor Data & Processing(ETRI’06)

Input Data Sensor Data Processing Techniques

VideoCCD

CMOS

•Compression: MPEGX, H.26X, JPEG•Facial detection techniques•Data streamining techniques

• Data mining techniques

• Data searching techniques

• Feature extraction techniques

Audio Microphone•Compression: MPEGX, G.7XX, AAC•Audio data processing techniques•Voice recognition

PositionGPS

RF (Radio Frequency) system

•Position detection•Map data mapping (addressing)•Time detection

Bio

ECG, EEG, EMG, PPG, GSR

Skin temperatureRespiration

Blood Pressure (BP)

•Heart Rate Extraction•Stress Level•Emotion Estimation•Alpha Wave Detection•Electrohystereogram, body temperature extraction•Health Monitoring•Noninvasive BP estimation

EnvironmentLight, Humidity,

Temperature, Ultraviolet sensor

•Noise reduction•Awareness Environment

Movement

•Falling detection•Gesture recognition (walking, running, ...)•Human interface

13/54

Page 14: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Development of Sensor Kit

14/54

Page 15: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Object Sensors

LoveGety

Smart Bag - MIT bYOB Project

Intelligent object of Swiss ETH

15/54

Page 16: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Body Sensors (1)

Microsoft’s SenseCam Microsoft’s Spot Watch

Body Media’s ArmBand

Adias’ Intelligent Shoes

16/54

Page 17: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Body Sensors (2)

Olympus Optical Co., Ltd. is pleased to announce its new wearable user interface technologies.

Employing gestures and other hand movements for input, the system is an ideal match for new wearable PCs.

17/54

Page 18: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Body Sensors (3)

http://www.redwoodhouse.com/wearable/index.htmlhttp://wearables.cs.bris.ac.uk/public/wearables/esleeve.htm

http://www.ices.cmu.edu/design/streetware/

eSleeve of Univ. of Bristol, UK

18/54

Page 19: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Environment Sensors

Smart Dust of UC Berkeley

19/54

Page 20: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Integrated Sensors (1)

20/54

Page 21: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Integrated Sensors (2)

21/54

Page 22: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Integrated Sensors (3)

22/54

Page 23: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Smart Car (GM/CMU)

23/54

Page 24: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Sensor Model for Smart Car

24/54

Page 25: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Sensor Data from Mobile Phone

GPS log

Battery log

MP3 Player log

PicView LogSMS log

Photo log Call log25/54

Page 26: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Mobile Log Data

Log Information

GPS latitude, longitude, velocity, direction, date, time

Callcaller's phone number, call/receive/absence log, time

span, start/end time

SMSsender's phone number, call/receive/absence log, time

span, start/end time

Photographing photo file name, taking time

Weather

weather, visibility range (km), cloud degree (%),

temperature (°C), discomfort index, effective temperature

(°C), rainfall (mm), snowfall (cm), humidity (%), wind

direction, wind velocity (m/s), barometer (hPa)

MP3 Player title, time span, start/end time

Charging charging status, time span, start/end time

26/54

Page 27: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

Page 28: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Experimental Sensor Kits

• Introduction of famous experimental sensor kits

• LabPro

– An environmental sensor kit

– Vernier Software's data collection device

– Collects data from a wide variety of sensors

– Can be used with a computer, a TI graphing calculator, Palm handheld, or on its own as a remote data collector

• ArmBand

– A body sensor kit

– Body Media's data collection device

– Collects physiological data that would provide an insight for recognizing human activity and condition

28/54

Page 29: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

LabPro

• Vernier LabPro Interface

• Sensor

– Stainless Steel Temperature Probe

– Light Sensor

– Microphone

– Relative Humidity Sensor

• Logger Pro 3.1 Application

• LabPro Visual C++ SDK

29/54

Page 30: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Vernier LabPro Interface

• Main body for data collection– Having flexibility and mobility

• Data collection– Supporting 50,000Hz sampling– Can store 12,000 data in memory

• Companion devices– PC

• Linked by serial or USB cable • Real-time interaction

– TI Graphic Calculator• Running with LabPro

– Palm, Sony PDA– Stand-Alone Data Logger

• 6 channels for data collection– 4 analog channel: supporting 40 kinds of sensors

• temperature, oxygen determination, air pressure, pH, …– 2 digital channel: ultra-sonic sensor, pho, …

LabPro

30/54

Page 31: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Stainless Steel Temperature Probe

• Used in organic liquids, salt solutions, acids, and bases

• Measurement scope

– -40 ~ 135 °C (-40 ~ 275 °F)

– Heat resistance limit : 150 °C

• Accuracy

– ±0.2 °C at 0 °C

– ±0.5 °C at 100 °C

• Reaction time

– 95% in 11 sec

– 98% in 18 sec

– 100% in 30 sec

• Probe length: 15.5 cm

• Stainless steel body: length (10.5 cm), radius (4.0 mm)

• Probe handle: length (5.0 cm), radius (1.25 cm)

LabPro

31/54

Page 32: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Light Sensor

• Can be used for measurements of light intensity in a variety of situations

– Perform inverse square light intensity experiments using a point source of light.

– Conduct polarized filter studies

– Demonstrate the flicker of fluorescent lamps and other lamps

– Carry out solar energy studies

– Perform reflectivity studies

• Resolution

– Low: 0 ~ 600 lux

– Medium: 0 ~ 6000 lux.

– High: 0 ~ 150,000 lux.

Switch for resolution change

Light Sensor

LabPro

32/54

Page 33: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Microphone

• Can be used for a variety of activities with sound waves:

– Demonstrate how the wave pattern changes when frequency and amplitude are changed

– Compare the waveforms from various musical instruments

– Capture the waveform of the sound of a tuning fork and model the sine wave using a function

– Measure the speed of sound by using reflected sound waves in a tube

– Demonstrate beat patterns

– Display the fast Fourier transform (FFT) of a sound

• Resolution

– 20 Hz ~ 16,000 Hz

• Maximum frequency for LabPro: 5,000Hz

LabPro

33/54

Page 34: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Relative Humidity Sensor

• Measure relative humidity in the air as part of a weather station:

– Monitor indoor humidity for health reasons

– Optimize conditions in a greenhouse or terrarium

– Determine when static electrical discharges will be a problem

– Study transpiration rates of plants by monitoring relative humidity in sealed jars containing plants

• Range: 0 ~ 95%(± 5%)

• Response Time: (time for a 90% change in reading):

– In still air: 60 min

– With vigorous air movement: 40 sec

• Resolution

– 12-bit with LabPro: 0.04% RH

• Total Accuracy

– With Saturated salt calibration: ±2% RH

– With standard calibration: ±10% RH

• Operating Temperature Range: 0 ~ 85°C

LabPro

34/54

Page 35: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Logger Pro 3.1 (Data & Graph)LabPro

35/54

Page 36: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

ArmBand

• Famous wearable sensor of SenseWear

• Collection data

– heat flux, accelerometer, galvanic skin response, skin temperature, near body temperature

• Store about 5 days of data

Source: http://www.armband.it/

36/54

Page 37: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

ArmBand Log Data

• 참고 : Professional License Key 필요

ArmBand

37/54

Page 38: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

ArmBand - Generated ReportArmBand

38/54

Page 39: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

Page 40: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Accelerometer

• Measurement of static gravitational force

– e.g. Tilt and inclination

• Measurement of dynamic acceleration

– e.g. Vibration and shock measurement

• Inertial measurement of velocity and position

– Acceleration single integrated for velocity

– Acceleration double integrated for position

40/54

Page 41: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Accelerometers’ Principle

• Acceleration can be measured using a simple mass/spring system.

– Force = Mass * Acceleration

– Force = Displacement * Spring Constant

– So Displacement = Mass * Acceleration / Spring Constant

MASS

Add Acceleration

MASS

Change in Displacement

41/54

Page 42: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

MEM’s Accelerometers

• We use Silicon to make the spring and mass, and add fingers to make a variable differential capacitor

• We measure change in displacement by measuring change in differential capacitance

MASS

SPRING

SENSOR AT REST

FIXEDOUTERPLATES

ANCHOR TOSUBSTRATE

CS1 < CS2

APPLIEDACCELERATION

RESPONDING TO AN APPLIED ACCELERATION(MOVEMENT SHOWN IS GREATLY EXAGGERATED)

42/54

Page 43: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

MEM’s Accelerometer Example

Source: Great MEMS education sitewww.ett.bme.hu/memsedu/

43/54

Page 44: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Gyroscope

• A device that can measure angular motion or displacement

– An instrument to maintain a specific direction

– Mostly used in airplanes, and spacecrafts

• Key Phenomena:

– Precession: The gravity defying part of Gyroscope

• Gyro is spinning on its axis (1)

• A force is applied to rotate its spin axis (2)

• Gyro is reacting to the input force along an axis perpendicular to the input force (3)

44/54

Page 45: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Gyroscope Principles

• Principle of operation

– The simplest gyroscopes use a high speed, rotating inertial disk that is loosely coupled to the frame holding it.

– A rotation in the frame imparts a torque (rotation) on the spinning disk, which processes (rotates) as a result (conservation of angular momentum).

45/54

Page 46: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Principle of operation

• Practical uses usually limit the movement to measure only one axis of rotation (roll, pitch or yaw).

• The induced torque is monitored by a meter which counteracts the torque with springs or a similar restoring force.

46/54

Page 47: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

MEMS Gyroscope Principles

• Coriolis effect

– Motion in a rotating reference frame leads to “sideways” movement

– Can’t walk a straight line in a rotating reference (merry-go-round) without exerting a sideways force (or acceleration).

47/54

Page 48: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Gyroscope - Coriolis Effect

• This effect shows up on earth since we are in a rotating reference frame.

48/54

Page 49: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Measuring Coriolis Effect

• Constrained motion means a force is imparted.

• By measuring the imparted force (or its effect on an oscillator), we can measure the angular velocity. Almost all MEMS gyroscopes use this feature.

49/54

Page 50: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Tuning Fork Gyroscope

• A tuning fork is simple example of the Coriolis effect and how it can be used to monitor angular motion.

• By measuring the amplitude of oscillation in the sideways direction, the angular motion can be deduced. Used in Daimler Benz AG MEMS gyroscope.

50/54

Page 51: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Vibrating Ring Gyroscope

• A ring is flexured back and forth in resonant mode. The Coriolis effect induces flexure that is sideways (and out of phase) with the driving flexure.

• Since the Coriolis force vibrates the ring sideways, it produces a second mode of vibration which adds to the first. The result is a “rotation” of the mode pattern of the ring. Most MEMS gyros use this method in closed-loop mode.

51/54

Page 52: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Gyro-based Sensors

• Gyro-Compass:

– Gyroscopes mounted in a set of gimbals

– As the gyro spins, it maintains its direction

• Inertial Navigation System (INS):

– Gyro-Compass + 3 Accelerometers

52/54

Page 53: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Applications

• Aerospace:

– Inertial guidance systems

• Automotive:

– Angular rate sensors (for traction control, etc.)

• Entertainment/consumer:

– Virtual reality sensors, pointing devices, etc.

• Industrial automation:

– Motion control, robotics

53/54

Page 54: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Gyroscope Application Example

• Applications on the horizon: Human motion sensing VR, Human/Machine interface

– Consumer and game markets require lower performance specs and lower costs.

54/54

Page 55: Sensor Data Collection September 11, 2008 Sung-Bae Cho 0.

Gyroscope Application Example: Segway

• Silicon Sensing Systems VSG ring sensor “Dynamic Stabilization”

• Five sensors used to monitor orientation of the scooter, sampled at 100 times/second. Sensors include VSG ring gyroscopes and liquid-filled tilt sensors

55/54