Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

39
Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION

Transcript of Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Page 1: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Ross Micheals

Charles Sheppard

ASSESSING FACE AND IRIS ACQUISITION

Page 2: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Tasks

Component of 10-print study One image each of participant face, left iris,

right iris Two iris cameras • Sensor A—Participant looked straight ahead,

minimized amount of proprietary filtering • Sensor B—Participant interacted with camera

(lined self up with mirror)

Page 3: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

ContextMinimum instructions (demo & basic

documentation given to operators)Representative of applications lacking

strict control Goal was qualitative assessment of data• Effectiveness • Efficiency • User Satisfaction

Page 4: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

EffectivenessGoal is to measure image “quality” Ill-posed problem—depends on application No generally accepted definition (i.e.,

sample? Metadata? Therefore, we considered a wide variety of

factors

Page 5: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

FaceSource: ANSI INCITS 385-2004 Tools• Face Alignment Overlay• Transformed each factor into …

Simple categories (yes, no, N/A) OR Counts ORStandard five-point Lichert Scale

Page 6: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Face Alignment Overlay

*

*Images have been altered for privacy reasons

Page 7: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Measurable Qualitative Attributes for Face Images Eye color Hair color Pose Expression Assistance in positioning

face Shoulders Background Subject and scene lighting Shadows over the face Shadows in eye-sockets Hot spots

Eye glasses Eye patches Radical distortion of the

camera lens Horizontally centered face Vertical position of the face Width of head Length of head Facial hairs* Obstruction*

Page 8: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Face StatisticsEye Color Count Percentage

Indeterminate 35 13%

Black 47 18%

Blue 49 18%

Brown 50 19%

Dark Brown 73 27%

Dark Green 1 0.40%

Gray 1 0.40%

Green 11 4%

Hair Color Count

Percentage

Indeterminate 18 7%

Brown 68 25%

Dark Brown 89 33%

Graying Brown 10 4%

Graying Dark Brown 6 2%

Blond 21 8%

Gray Blond 4 1%

Black 36 13%

Black with reddish coloring

3 1%

Graying Black 4 1%

Gray 3 1%

Red 3 1%

Light Brown 2 0.70%

Attribute Count Percentage

Eye Glasses 67 25%

Eye Patches 0 0%

Facial Hairs 84 31%

Radical distortion of the camera lens

2 0.75%

Obstruction 19 7%

Page 9: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Pose

Grade

Count

Percentage

1 32 12.00%

2 31 11.60%

3 38 14.00%

4 162 60.70%

5 4 1.50%

1. Not full frontal (wearing head gear, top of head chopped off)

2. Not full frontal (completely chopping off of a shoulder)

3. Not full frontal (head turn at angle)

4. Full frontal (not centered)

5. Full frontal (centered)

*Images have been altered for privacy reasons

Page 10: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Expression

Grade

Count

Percentage

2 2 0.70%

3 37 14.00%

4 82 31.00%

5 146 55.00%

2. Eyes looking away from camera and/or squinting

3. A smile were mouth opened and teeth exposedNot full frontal (head turn at angle)

4. A closed jaw smile (no teeth showing)

5. Neutral (non-smiling) with both eyes open and mouth closed

*Images have been altered for privacy reasons

Page 11: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Shoulders

Grade

Count

Percentage

1 28 10.50%

2 3 1.00%

3 149 56.00%

4 11 4.00%

5 76 28.46%

1. Indeterminate squaring (excessive chopping) of shoulder

2. Indeterminate squaring (not enough shoulder shown)

3. Square shoulders (uneven chopping of shoulders)

4. Square shoulders (almost even chopping of shoulders)

5. Square shoulders (even chopping of shoulders)

*Images have been altered for privacy reasons

Page 12: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Background

Grade

Count

Percentage

1 2 0.75%

2 158 59.00%

3 77 29.00%

4 30 11.00%

1. Poor segmentation and lack of uniformity (several visible objects in background)

2. Poor segmentation and lack of uniformity (three or four objects in background)

3. Poor segmentation and lack of uniformity (two or three objects in background)

4. Poor segmentation and lack of uniformity (one object in background)

*Images have been altered for privacy reasons

Page 13: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Subject and Scene Lighting

Grade

Count

Percentage

1 3 1.00%

2 259 97.00%

3 4 1.49%

4 1 0.51%

1. Lighting not distributed equally on face (excessive shadows caused by head gear)

2. Lighting not distributed equally on face (excessive shadows caused by poor lighting)

3. Lighting not distributed equally on face (fewer shadows)

4. Lighting is distributed almost equally on face

*Images have been altered for privacy reasons

Page 14: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Shadows over the Face

Grade

Count

Percentage

1 5 1.87%

2 252 94.38%

3 8 3.00%

4 1 0.37%

5 1 0.37%

1. Excessive shadows caused by head gear

2. Large areas of shadows caused by poor lighting

3. Fewer shadow areas caused by better lighting

4. Only in the eye-sockets5. No shadows

*Images have been altered for privacy reasons

Page 15: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Shadows in Eye-sockets

Grade

Count

Percentage

1 8 3.00%

2 52 19.48%

3 154 57.68%

4 40 14.98%

5 13 4.87%

1. Shadows in both eye-sockets (caused by head gear)

2. Shadows in both eye-sockets (caused by poor sighting)

3. Shadows in only one eye-socket

4. Very little shadow in either eye-socket

5. No shadows in eye-sockets

*Images have been altered for privacy reasons

Page 16: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Hot Spots

Grade

Count

Percentage

2 56 20.97%

3 147 55.06%

4 58 21.72%

5 6 2.25%

2. There are multiple areas of hot spots (three or more)

3. There are one or two hot spots

4. Only one softly lighted hot spot

5. No hot spots

*Images have been altered for privacy reasons

Page 17: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Eye Glasses

Grade

Count

Percentage

3 28 10.49%

4 39 14.61%

5 200 74.91%

3. There is glare from the lenses and shadow casting by the rims

4. There is a small amount of glare

5. No glasses

*Images have been altered for privacy reasons

Page 18: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Horizontally Centered Face

Grade

Count

Percentage

1 2 0.75%

2 18 6.74%

3 184 68.91%

4 23 8.61%

5 40 14.98%

1. Severe chopping of image or excess amount of space on one side

2. There is a larger amount of space on one side than the other

3. There is a small amount of difference in the spacing on one side versus the other

4. There is a very small amount of difference in the spacing on one side versus the other

5. There is perfect centering*Images have been altered for privacy reasons

Page 19: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Vertical Position of Face

Grade CountPercentag

e

2 3 1.12%

3 75 28.09%

4 61 22.85%

5 128 47.94%

2. A large amount of head tilting

3. A small amount of head tilting (eyes are off the horizontal)

4. A very small amount of head tilting (eyes slightly off the horizontal)

5. No head tilting (eyes are perfectly on the horizontal)

*Images have been altered for privacy reasons

Page 20: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Width of Head

Grade

Count

Percentage

1 9 3.37%

2 7 2.62%

3 9 3.37%

4 7 2.62%

5 235 88.01%

1. Part of the head is chopped off

2. The image is chopped too close to the head

3. Part of the person's hair is chopped off

4. The head is turned slightly causing an ear to be out of sight

5. There is adequate head width

*Images have been altered for privacy reasons

Page 21: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Length of Head

Grade

Count

Percentage

1 28 10.49%

2 13 4.87%

3 8 3.00%

5 218 81.65%

1. There is head gear or the chopping off of the top the head

2. The image is chopped very close to the top of the head

3. There are sunglasses on top of the head or part of the hair on top of head is chopped off

5. There is adequate head length

*Images have been altered for privacy reasons

Page 22: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Obstruction

Grade

Count

Percentage

1 11 4.12%

2 6 2.75%

3 1 0.37%

5 249 93.26%

1. Some form of head gear (hat, cap,….)

2. Sun glasses on top of head or head band

3. Eye glasses on top of head

5. There are no obstructions

*Images have been altered for privacy reasons

Page 23: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

IrisSource: ANSI INCITS 379-2004Tools• Iris Overlay • Transformed each factor into …

Simple categories (yes, no, N/A) ORCounts ORStandard five-point Lichert Scale

Page 24: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Iris Overlay Example

Page 25: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Measurable Qualitative Attributes for Iris ImagesLocation of reflectionsGlassesFocusVisible IrisImage scaleNoiseImage OrientationCamera type

Page 26: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Iris Statistics

Attribute

Camera Type

Scanner A Scanner B

Count Percentage Count Percentage

Participants 124 44.44% 155 55.56%

Face image with no iris image 3 2.42% 3 1.94%

No face or iris images 0 0% 3 1.94%

No left iris images 3 2.42% 7 4.52%

No right iris images 1 0.81% 4 2.58%

Page 27: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

More Iris Statistics

Attribute

Camera Type

Scanner A Scanner B

Left Eye Right Eye Left Eye Right Eye

CountPercentag

eCount

Percentage

Count

Percentage

Count Percentage

Glasses Visible 29 24.58% 28 23.33% 24 16.90% 23 15.86%

Raw Images 296 - 377 - - - - -

Final Images 118 100% 120 100.00% 142 100% 145 100.00%

Extended Images 52 - 46 - - - - -

Pupil-Only reflections (final images) 70 59.32% 80 66.67% 116 81.69% 125 86.21%

Focus on glasses (final images) 9 7.63% 8 6.67% 20 14.08% 16 11.03%

Raw images with visible iris 292 - 340 - - - - -

Final images with visible iris 118 100% 116 96.67% 142 100% 145 100.00%

Page 28: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

More Iris StatisticsOperator tells participant to reposition

Scanner

Yes No

Count

Percentage

Count Percentage

A 63 44.37% 79 55.63%

B 56 35.44% 102 64.56%

Participant asks about glasses

Scanner

Yes No

Count

Percentage

Count

Percentage

A 21 14.79% 121 85.21%

B 16 10.13% 142 89.87%

Page 29: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

SegueBefore moving on, consider the following.

“When does 5315?”Answer is, “when we talk about…”Efficiency!

Page 30: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

EfficiencyDeceptively ill-posedExample: “How long does a photo

take?”Average camera shutter speed is .001

secondImplies we can take photos of 1,000

people in 1 secondDespite this obviously flawed leap in

logic, we continue to make this mistake

Page 31: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Efficiency10-Print Working Group RFI—Intended

requirement is five seconds from placement of hand to capture

Therefore, must a 4-4-2 sequence happen in under 15 seconds? (i.e., 5315)

Just as on the fingerprint side, our approach was to timestamp at a variety events—allows more flexible reporting

However, there is a compromise between what you would like to measure for each participant, and what you can measure

Page 32: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Sit Down

Picture Taken

Done with Picture

Picture Process

Iris Scanning Process

Moves to Iris Scanner

Finished

Time

Start of Iris Scan

Finish with Eye 1 (Scanner B Only)

Start of Eye 2 (Scanner B Only)

Picture and Iris Scan Process

Page 33: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Scanner-A Timing

0

2

4

6

8

10

12

14

16

Time For Iris Scan Only(From start of iris scan to finished)

Frequency

Average 0:34

Median 0:27

Page 34: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Scanner-A Timing

1

3

11

17

22

18

8

15

10

3

5

1 12 2 2

1 12

1 1 12

10 0

10

12

0:40

0:45

0:50

0:55

1:00

1:05

1:10

1:15

1:20

1:25

1:30

1:35

1:40

1:45

1:50

1:55

2:00

2:05

2:10

2:15

2:20

2:25

2:30

2:35

2:40

2:45

2:50

2:55

3:00

More

Total Time(From sit down to Finish)

Average 1:14

Median 1:03

Page 35: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Scanner-B Timing

0

2

4

6

8

10

12

14

0:14

0:18

0:22

0:26

0:30

0:34

0:38

0:42

0:46

0:50

0:54

0:58

1:02

1:06

1:10

1:14

1:18

1:22

1:26

1:30

1:34

1:38

1:42

1:46

1:50

Time For Iris Scan Only(From start of scan on iris 1 to finished)

Frequency

Average 0:44

Median 0:29

Page 36: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Scanner-B Timing

0

2

4

6

8

10

12

14

16

18

20

0:30

0:35

0:40

0:45

0:50

0:55

1:00

1:05

1:10

1:15

1:20

1:25

1:30

1:35

1:40

1:45

1:50

1:55

2:00

2:05

2:10

2:15

2:20

2:25

2:30

2:35

2:40

2:45

2:50

2:55

3:00

More

Total Time(From sit-down to finish)

Frequency

Average 1:25

Median 1:11

Page 37: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Face Picture Timing

0

10

20

30

40

50

60

70

0:04

0:06

0:08

0:10

0:12

0:14

0:16

0:18

0:20

0:22

0:24

0:26

0:28

0:30

0:32

0:34

0:36

0:38

0:40

0:42

0:42

0:44

0:46

0:48

0:50

More

Time For Picture Process(From sit-down to done with picture)

Frequency

Average 0:15

Median 0:13

Page 38: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

Large-scale Biometric System Data

Page 39: Ross Micheals Charles Sheppard ASSESSING FACE AND IRIS ACQUISITION.

User-satisfaction