Sensor Data Collection

September 11, 2008

Sung-Bae Cho

1

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

What is Sensor?

• Sensor

– A device that measures a physical quantity and converts it into a signal which can be read by an observer or by an instrument

• Sensor sensitivity

– How much the sensor's output changes when the measured quantity changes

3/54

Sensor Types

• Thermal:

– Temperature/heat sensors

• Electromagnetic:

– Electrical resistance/voltage/power sensors, magnetism sensors, metal detectors, RADAR

• Mechanical:

– Acceleration, position, pressure, switch, liquid sensors

• Chemical:

– Odor (smell) sensor, oxygen sensors

• Optical radiation:

– Light sensors, infra-red sensor, proximity sensor

• Acoustic: Sound sensors

• Motion sensors:

– Radar gun, speedometer, tachometer, odometer

• Orientation sensors: Gyroscope

4/54

Features of Sensor (1)

• Light Sensors

– Detecting light intensity, density, reflection, color temperature, type of light

– Rich information, very low cost

• C-MOS Camera

– Visual information about the environment

– Processing power and storage needs are often large

– Users feel uncomfortable

• Location sensor

– GPS(Global Positioning System) is mostly used

– Coarse location information

• Cellular network infrastructures: Global System for Mobile Communications (GSM)

5/54

Features of Sensor (2)

• Audio, Microphones

– Interesting information: Noise level, type of input, base frequency

– Using minimal processing: Less than 200 bytes of RAM

– Multiple microphones: Richer information

– Very cheap

– Can be extended up to speech recognition by using more processing power

– Ultrasonic sensors: Augment human sensory capabilities

• Accelerometers

– Information on the inclination, motion, acceleration of the device

– Typical: Mercury switches, angular sensors, accelerometers

– Especially interesting in examination of usage patterns

• Touch sensor

– Can reduce energy consumption: operative in the user's hand

6/54

Features of Sensor (3)

• Air pressure

– Some hints: Closing door

• Temperature sensor

– Most sensors are cheap and easy to use

– Detect body heat, arctic or desert environments

• Passive IR sensors (Motion detector)

– Movement of the device itself is detected as well

• Proximity sensors

– Determine a proximate distance between a physical object in the range and the device

• Gas sensor

– Problem: delay in measurement, enormous energy consumption

7/54

Features of Sensor (4)

• Biosensors

– User awareness

– Skin resistance, blood pressure: sports and medical applications

– Emotional state of the user may be obtained

• Magnetic field

– Similar to a compass

– Direction of a device or movement can be determined

– This sensor can give false information

• Tilt sensors

– Determine the tilt angles of the device

• No-power sensors

– Metal ball switches, mercury switches, solar panels

– Extremely low power consumption

8/54

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

Sensing Environments

• Information processing has been thoroughly integrated into everyday objects and activities Ubiquitous environments

• Paradigm change

– Ordinary: a single user consciously engages a single device for a specialized purpose

– New: engages many computational devices and systems simultaneously, in the course of ordinary activities, and may not necessarily even be aware that they are doing so

• Related technologies

– Ubiquitous computing, pervasive computing, ambient intelligence

– Haptic computing, things that think

10/54

Sensors in Ubiquitous Environments

• Body Sensor

– Physiological sensor

– Biosensor: Identity, emotion, facial expression, behavior, gait

– Location sensor (GPS)

• Environment Sensor

– Video camera

– Light

– Noise & sound

– Temperature & humidity

– Pressure

– Movement

– Acceleration

• Object Sensor

– Position & status of object

11/54

Service & Applications

• Application model

• Services

12/54

Sensor Data & Processing(ETRI’06)

Input Data Sensor Data Processing Techniques

VideoCCD

CMOS

•Compression: MPEGX, H.26X, JPEG•Facial detection techniques•Data streamining techniques

• Data mining techniques

• Data searching techniques

• Feature extraction techniques

Audio Microphone•Compression: MPEGX, G.7XX, AAC•Audio data processing techniques•Voice recognition

PositionGPS

RF (Radio Frequency) system

•Position detection•Map data mapping (addressing)•Time detection

Bio

ECG, EEG, EMG, PPG, GSR

Skin temperatureRespiration

Blood Pressure (BP)

•Heart Rate Extraction•Stress Level•Emotion Estimation•Alpha Wave Detection•Electrohystereogram, body temperature extraction•Health Monitoring•Noninvasive BP estimation

EnvironmentLight, Humidity,

Temperature, Ultraviolet sensor

•Noise reduction•Awareness Environment

Movement

•Falling detection•Gesture recognition (walking, running, ...)•Human interface

13/54

Development of Sensor Kit

14/54

Object Sensors

LoveGety

Smart Bag - MIT bYOB Project

Intelligent object of Swiss ETH

15/54

Body Sensors (1)

Microsoft’s SenseCam Microsoft’s Spot Watch

Body Media’s ArmBand

Adias’ Intelligent Shoes

16/54

Body Sensors (2)

Olympus Optical Co., Ltd. is pleased to announce its new wearable user interface technologies.

Employing gestures and other hand movements for input, the system is an ideal match for new wearable PCs.

17/54

Body Sensors (3)

http://www.redwoodhouse.com/wearable/index.htmlhttp://wearables.cs.bris.ac.uk/public/wearables/esleeve.htm

http://www.ices.cmu.edu/design/streetware/

eSleeve of Univ. of Bristol, UK

18/54

Environment Sensors

Smart Dust of UC Berkeley

19/54

Integrated Sensors (1)

20/54

Integrated Sensors (2)

21/54

Integrated Sensors (3)

22/54

Smart Car (GM/CMU)

23/54

Sensor Model for Smart Car

24/54

Sensor Data from Mobile Phone

GPS log

Battery log

MP3 Player log

PicView LogSMS log

Photo log Call log25/54

Mobile Log Data

Log Information

GPS latitude, longitude, velocity, direction, date, time

Callcaller's phone number, call/receive/absence log, time

span, start/end time

SMSsender's phone number, call/receive/absence log, time

span, start/end time

Photographing photo file name, taking time

Weather

weather, visibility range (km), cloud degree (%),

temperature (°C), discomfort index, effective temperature

(°C), rainfall (mm), snowfall (cm), humidity (%), wind

direction, wind velocity (m/s), barometer (hPa)

MP3 Player title, time span, start/end time

Charging charging status, time span, start/end time

26/54

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

Experimental Sensor Kits

• Introduction of famous experimental sensor kits

• LabPro

– An environmental sensor kit

– Vernier Software's data collection device

– Collects data from a wide variety of sensors

– Can be used with a computer, a TI graphing calculator, Palm handheld, or on its own as a remote data collector

• ArmBand

– A body sensor kit

– Body Media's data collection device

– Collects physiological data that would provide an insight for recognizing human activity and condition

28/54

LabPro

• Vernier LabPro Interface

• Sensor

– Stainless Steel Temperature Probe

– Light Sensor

– Microphone

– Relative Humidity Sensor

• Logger Pro 3.1 Application

• LabPro Visual C++ SDK

29/54

Vernier LabPro Interface

• Main body for data collection– Having flexibility and mobility

• Data collection– Supporting 50,000Hz sampling– Can store 12,000 data in memory

• Companion devices– PC

• Linked by serial or USB cable • Real-time interaction

– TI Graphic Calculator• Running with LabPro

– Palm, Sony PDA– Stand-Alone Data Logger

• 6 channels for data collection– 4 analog channel: supporting 40 kinds of sensors

• temperature, oxygen determination, air pressure, pH, …– 2 digital channel: ultra-sonic sensor, pho, …

LabPro

30/54

Stainless Steel Temperature Probe

• Used in organic liquids, salt solutions, acids, and bases

• Measurement scope

– -40 ~ 135 °C (-40 ~ 275 °F)

– Heat resistance limit : 150 °C

• Accuracy

– ±0.2 °C at 0 °C

– ±0.5 °C at 100 °C

• Reaction time

– 95% in 11 sec

– 98% in 18 sec

– 100% in 30 sec

• Probe length: 15.5 cm

• Stainless steel body: length (10.5 cm), radius (4.0 mm)

• Probe handle: length (5.0 cm), radius (1.25 cm)

LabPro

31/54

Light Sensor

• Can be used for measurements of light intensity in a variety of situations

– Perform inverse square light intensity experiments using a point source of light.

– Conduct polarized filter studies

– Demonstrate the flicker of fluorescent lamps and other lamps

– Carry out solar energy studies

– Perform reflectivity studies

• Resolution

– Low: 0 ~ 600 lux

– Medium: 0 ~ 6000 lux.

– High: 0 ~ 150,000 lux.

Switch for resolution change

Light Sensor

LabPro

32/54

Microphone

• Can be used for a variety of activities with sound waves:

– Demonstrate how the wave pattern changes when frequency and amplitude are changed

– Compare the waveforms from various musical instruments

– Capture the waveform of the sound of a tuning fork and model the sine wave using a function

– Measure the speed of sound by using reflected sound waves in a tube

– Demonstrate beat patterns

– Display the fast Fourier transform (FFT) of a sound

• Resolution

– 20 Hz ~ 16,000 Hz

• Maximum frequency for LabPro: 5,000Hz

LabPro

33/54

Relative Humidity Sensor

• Measure relative humidity in the air as part of a weather station:

– Monitor indoor humidity for health reasons

– Optimize conditions in a greenhouse or terrarium

– Determine when static electrical discharges will be a problem

– Study transpiration rates of plants by monitoring relative humidity in sealed jars containing plants

• Range: 0 ~ 95%(± 5%)

• Response Time: (time for a 90% change in reading):

– In still air: 60 min

– With vigorous air movement: 40 sec

• Resolution

– 12-bit with LabPro: 0.04% RH

• Total Accuracy

– With Saturated salt calibration: ±2% RH

– With standard calibration: ±10% RH

• Operating Temperature Range: 0 ~ 85°C

LabPro

34/54

Logger Pro 3.1 (Data & Graph)LabPro

35/54

ArmBand

• Famous wearable sensor of SenseWear

• Collection data

– heat flux, accelerometer, galvanic skin response, skin temperature, near body temperature

• Store about 5 days of data

Source: http://www.armband.it/

36/54

ArmBand Log Data

• 참고 : Professional License Key 필요

ArmBand

37/54

ArmBand - Generated ReportArmBand

38/54

• What is Sensor?

• Sensors in Ubiquitous Environment

• Experimental Sensor Kits

• Appendix: Acceleration Sensors

Agenda

Accelerometer

• Measurement of static gravitational force

– e.g. Tilt and inclination

• Measurement of dynamic acceleration

– e.g. Vibration and shock measurement

• Inertial measurement of velocity and position

– Acceleration single integrated for velocity

– Acceleration double integrated for position

40/54

Accelerometers’ Principle

• Acceleration can be measured using a simple mass/spring system.

– Force = Mass * Acceleration

– Force = Displacement * Spring Constant

– So Displacement = Mass * Acceleration / Spring Constant

MASS

Add Acceleration

MASS

Change in Displacement

41/54

MEM’s Accelerometers

• We use Silicon to make the spring and mass, and add fingers to make a variable differential capacitor

• We measure change in displacement by measuring change in differential capacitance

MASS

SPRING

SENSOR AT REST

FIXEDOUTERPLATES

ANCHOR TOSUBSTRATE

CS1 < CS2

APPLIEDACCELERATION

RESPONDING TO AN APPLIED ACCELERATION(MOVEMENT SHOWN IS GREATLY EXAGGERATED)

42/54

MEM’s Accelerometer Example

Source: Great MEMS education sitewww.ett.bme.hu/memsedu/

43/54

Gyroscope

• A device that can measure angular motion or displacement

– An instrument to maintain a specific direction

– Mostly used in airplanes, and spacecrafts

• Key Phenomena:

– Precession: The gravity defying part of Gyroscope

• Gyro is spinning on its axis (1)

• A force is applied to rotate its spin axis (2)

• Gyro is reacting to the input force along an axis perpendicular to the input force (3)

44/54

Gyroscope Principles

• Principle of operation

– The simplest gyroscopes use a high speed, rotating inertial disk that is loosely coupled to the frame holding it.

– A rotation in the frame imparts a torque (rotation) on the spinning disk, which processes (rotates) as a result (conservation of angular momentum).

45/54

Principle of operation

• Practical uses usually limit the movement to measure only one axis of rotation (roll, pitch or yaw).

• The induced torque is monitored by a meter which counteracts the torque with springs or a similar restoring force.

46/54

MEMS Gyroscope Principles

• Coriolis effect

– Motion in a rotating reference frame leads to “sideways” movement

– Can’t walk a straight line in a rotating reference (merry-go-round) without exerting a sideways force (or acceleration).

47/54

Gyroscope - Coriolis Effect

• This effect shows up on earth since we are in a rotating reference frame.

48/54

Measuring Coriolis Effect

• Constrained motion means a force is imparted.

• By measuring the imparted force (or its effect on an oscillator), we can measure the angular velocity. Almost all MEMS gyroscopes use this feature.

49/54

Tuning Fork Gyroscope

• A tuning fork is simple example of the Coriolis effect and how it can be used to monitor angular motion.

• By measuring the amplitude of oscillation in the sideways direction, the angular motion can be deduced. Used in Daimler Benz AG MEMS gyroscope.

50/54

Vibrating Ring Gyroscope

• A ring is flexured back and forth in resonant mode. The Coriolis effect induces flexure that is sideways (and out of phase) with the driving flexure.

• Since the Coriolis force vibrates the ring sideways, it produces a second mode of vibration which adds to the first. The result is a “rotation” of the mode pattern of the ring. Most MEMS gyros use this method in closed-loop mode.

51/54

Gyro-based Sensors

• Gyro-Compass:

– Gyroscopes mounted in a set of gimbals

– As the gyro spins, it maintains its direction

• Inertial Navigation System (INS):

– Gyro-Compass + 3 Accelerometers

52/54

Applications

• Aerospace:

– Inertial guidance systems

• Automotive:

– Angular rate sensors (for traction control, etc.)

• Entertainment/consumer:

– Virtual reality sensors, pointing devices, etc.

• Industrial automation:

– Motion control, robotics

53/54

Gyroscope Application Example

• Applications on the horizon: Human motion sensing VR, Human/Machine interface

– Consumer and game markets require lower performance specs and lower costs.

54/54

Gyroscope Application Example: Segway

• Silicon Sensing Systems VSG ring sensor “Dynamic Stabilization”

• Five sensors used to monitor orientation of the scooter, sampled at 100 times/second. Sensors include VSG ring gyroscopes and liquid-filled tilt sensors

55/54