Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is...

22
1 Color Reproduction Visual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies in how ‘close’ to the original Most of the time we do not have a reference

Transcript of Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is...

Page 1: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

1

Color Reproduction

Visual Perception

Slide 2 Aditi Majumder, UCI

What is color reproduction?

Use a device to capture/display the original sceneSuccess lies in how ‘close’ to the originalMost of the time we do not have a reference

Page 2: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

2

Slide 3 Aditi Majumder, UCI

Two types of color reproduction

SubtractiveDyes and inksAbsorbs parts of the spectraCyan, Magenta and yellow are primaries

AdditiveProjectors, monitors (based on projection of light)Red, Green and Blue

Slide 4 Aditi Majumder, UCI

Color Reproduction has become difficult

Traditionally linear model

Currently star model

Require a device independent color space

Image Capture Image DisplayOriginal Scene Perceived as original

Digital ImageImage Sources Output Systems

Page 3: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

3

Slide 5 Aditi Majumder, UCI

Basic Principles

Correct mapping of critical reference colors Correct mapping of the gray axis

Otherwise, color cast or color tintControl of tone reproduction

Maintain all details against tone compressionControl of overall colorfulnessControl of sharpness, texture and other artifacts

Slide 6 Aditi Majumder, UCI

Characterizing additive displays

Color gamutRepresented on chromaticity diagramMore saturated colors, bigger the gamutNot possible to cover the entire range of colors seen by humans

Page 4: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

4

Slide 7 Aditi Majumder, UCI

Characterizing additive displays

Color gamutIs this sufficient?Information about the luminance

White pointDynamic Range (contrast)Maximum luminance (brightness)

Can reconstruct a 3D gamut in XYZ space from this information

Slide 8 Aditi Majumder, UCI

Characterizing additive displays

Tone mapping How the input value maps to output intensityAffects brightness, contrast and saturation

Page 5: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

5

Slide 9 Aditi Majumder, UCI

Characterizing additive displays

Tone mapping How the input value maps to output intensityAffects brightness, contrast and saturation

Slide 10 Aditi Majumder, UCI

Transfer Function

Monotonic, smooth with no flat regionsBrightness and contrast controls

Page 6: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

6

Slide 11 Aditi Majumder, UCI

Histogram Stretching

Slide 12 Aditi Majumder, UCI

Characterizing additive displays

Color BalanceRelative proportions of primaries while forming a colorAffects hue, saturation and brightnessCan be changed by changing the transfer function

Page 7: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

7

Slide 13 Aditi Majumder, UCI

Characterizing additive displays

Intensity ResolutionNumber of levels perceptually distinguishableNumber of digital levelsContouring if insufficient resolution

Slide 14 Aditi Majumder, UCI

CRT Displays

sRGB gamutAging by decreasing brightness of primariesAging of blue is fasterYellowish cast in the pictureChromaticity of primaries remain sameBut brightness changes leads to shift in white point

Transfer functionI = k (V0+V)γ

Page 8: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

8

Slide 15 Aditi Majumder, UCI

LCD Displays

Saturated primaries imply dim displayUnsaturated primaries imply bright displayHigh brightness backlight and saturated filters to assure bright and colorful display

Trade off with power consumptionBlack offset or FlarePrimaries usually less saturated then CRTs

Smaller color gamut

Slide 16 Aditi Majumder, UCI

LCD Displays

Page 9: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

9

Slide 17 Aditi Majumder, UCI

Projection Displays

LCD arraysThree LCD micropanels

Light division and later combination via lensOne LCD micropanel

Color wheel, shared temporally between primaries

DLPArray of Digital Micromirror Devices (DMD)

Intensity controlled by the time they are onThree panels or color wheel with a single panel

Slide 18 Aditi Majumder, UCI

Projection Displays

LCD or DMDCan have an extra filterConsequence of 4 primaries

Page 10: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

10

Slide 19 Aditi Majumder, UCI

Subtractive Color System

Layers of cyan, yellow and magenta dyes

Absorb red, blue and green light

Depends on the illuminantAct as absorption filter

Ideally block filters

Overlaying all the three dyes absorbs all wavelengths creating black

Slide 20 Aditi Majumder, UCI

Creation of a color

CMY = (1, 1, 1) – RGB(0.25, 0.5, 0.75) = (1, 1, 1) – (0.75, 0.5, 0.25)This works only for block filters

Page 11: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

11

Slide 21 Aditi Majumder, UCI

Real Fiilters

Are not block filtersCross talk across different filtersDue to ink impuritiesGrays should be formed by equal amount of three primaries

Seldom happens

Slide 22 Aditi Majumder, UCI

Why use black?

Better contrastUse of inexpensive black in place of expensive colored dyesSuperimposing multiple dyes cause tearing of wet paperK for keyNot an independent primary

Hence makes dark colors darker

Page 12: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

12

Slide 23 Aditi Majumder, UCI

How to use black?

Initially only for neutral colorsCalled undercolor removal (UCR)

Colors with three componentsMinimum of the three is the gray component

Full gray component replacementOnly in inkjets where registration is a problem

Partial gray component replacementTo achieve the best contrast

Slide 24 Aditi Majumder, UCI

Gray Balancing

The first step in printing is to decide how much of GCR to be used for the neutral graysHowever, every gray needs to be decided separatelyCalled gray balancing Usually done by iterationNo simple tristimulus model to decide components

Page 13: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

13

Slide 25 Aditi Majumder, UCI

Display/Sensor Model

E ( i , u , v) = h r ( i r ) ( Q r (u , v ) , x r , yr )h g ( ig ) ( Q g (u , v ) , x g , y g )h b ( ib ) ( Q b (u , v ) , x b , y b )(B ( u , v) , x B , y B )

++

++

xxx

Slide 26 Aditi Majumder, UCI

Display/Sensor Model

E ( i ) = h r ( i r ) ( X r – X B , Y r - Y B , Z r - Z B )+ h g ( ig ) ( X g – X B , Y g - Y B , Z g - Z B )+h b ( ib ) ( X b - X B , Y b - Y B , Z b – Z B )+(X B , Y B , Z B )

E ( i , u , v) = h r ( i r ) ( Q r (u , v ) , x r , yr )h g ( ig ) ( Q g (u , v ) , x g , y g )h b ( ib ) ( Q b (u , v ) , x b , y b )(B ( u , v) , x B , y B )

++

++

xxx

Page 14: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

14

Slide 27 Aditi Majumder, UCI

Display/Sensor Model

( X r ,Y r ,Zr )

( Xg ,Yg ,Zg )

Xb ,Yb ,Zb )

(XB ,YB ,ZB )

E ( i ) = h r ( i r ) ( Xr – XB ,Yr - YB ,Zr - ZB )+ h g ( ig ) ( Xg – XB ,Yg - YB ,Zg - ZB )+ h b ( ib ) ( Xb - XB ,Yb - YB ,Zb – ZB )+ (X B ,Y B ,Z B )

Slide 28 Aditi Majumder, UCI

Display/Sensor Model

( X r – XB ,Y r– YB ,Zr– ZB )(XB ,YB ,ZB )

( X g – XB ,Y g– YB ,Zg– ZB )

( X b – XB ,Y b– YB ,Zb– ZB )

Page 15: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

15

Slide 29 Aditi Majumder, UCI

Display/Sensor Model

( X’r ,Y’r ,Z’r )

( X’g ,Y’g,Z’g )

( X’b ,Y’b ,Z’b )

(XB ,YB ,ZB )

Slide 30 Aditi Majumder, UCI

Display/Sensor Model

X = X’r X’g X’b X B h r ( i r )Y = Y’r Y’g Y’b Y B h g ( i g )Z = Z’ r Z’g Z’b Z B h b ( i b )

E ( i ) = h r ( i r ) ( X’r , Y’r , Z’r )+ h g ( ig ) ( X’g , Y’g , Z’g )+ h b ( ib ) ( X’b , Y’b , Z’b )+ (X B , Y B , Z B )

1 1

( X’r ,Y’r ,Z’r )

( X’g ,Y’g,Z’g )

( X’b ,Y’b ,Z’b )

(XB ,YB ,ZB )

= 0 0 0 1

Page 16: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

16

Slide 31 Aditi Majumder, UCI

Linear Devices

[X Y Z 1] T = M [R G B 1] T

Two devices[X Y Z 1] T = M1 [R1 G1 B1 1] T

[X Y Z 1] T = M2 [R2 G2 B2 1] T

[R2 G2 B2 1]T = M2-1[X Y Z 1]

= M2-1M1[R1 G1 B1 1]T

Slide 32 Aditi Majumder, UCI

Display/Sensor Model

Page 17: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

17

Slide 33 Aditi Majumder, UCI

Out-of-Gamut Colors

Slide 34 Aditi Majumder, UCI

Gamut Mapping

How to handle out of gamut colors?Mapping them to an in-gamut colorsMany methods

Used when going from devices to devicesMonitors to Printers

Page 18: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

18

Slide 35 Aditi Majumder, UCI

Gamut Matching

Find a common color gamut defined by Rc, Gc, Bc

Find the common function Mc[X Y Z 1]T = Mc [Rc Gc Bc 1]T

For any device i[Ri Gi Bi 1]T = Mi

-1Mc [Rc Gc Bc 1]T

Slide 36 Aditi Majumder, UCI

Two gamut

Page 19: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

19

Slide 37 Aditi Majumder, UCI

Find their intersection

Need not be a parallelopipped

Slide 38 Aditi Majumder, UCI

Find the common gamut

Page 20: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

20

Slide 39 Aditi Majumder, UCI

Find the mapping function

Slide 40 Aditi Majumder, UCI

Gamut Matching

Find a common color gamut defined by Rc, Gc, Bc

Find the common function Mc[X Y Z 1]T = Mc [Rc Gc Bc 1]T

For any device i[Ri Gi Bi 1]T = Mi

-1Mc [Rc Gc Bc 1]T

Page 21: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

21

Slide 41 Aditi Majumder, UCI

Three/Four Primary Systems

We dealt with only three primary systemsAny n non-parallel vector form a basis in n-dimensional space

Vectors will be linearly independentAll other vectors can be expressed as a linear combination of the basis vectorsGamut will always be convex polytope

The primaries form basis in 3D color space

Slide 42 Aditi Majumder, UCI

Additive subtractive mapping

Page 22: Visual Perceptionmajumder/vispercep/colrep.pdfVisual Perception Slide 2 Aditi Majumder, UCI What is color reproduction? Use a device to capture/display the original scene Success lies

22

Slide 43 Aditi Majumder, UCI

Gamut Mapping

PerceptualSaturatedRelative colorimetric