Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61....

30
Computer Graphics and Imaging UC Berkeley CS184/284A Lecture 20: Introduction to Color Science

Transcript of Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61....

Page 1: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Computer Graphics and Imaging UC Berkeley CS184/284A

Lecture 20:

Introduction to Color Science

Page 2: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property
Page 3: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property
Page 4: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles

Page 5: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Wassily Kandinsky, Color Study. Squares with Concentric Circles, 1913 Munich, The Städtische Galerie im Lenbachhaus

Page 6: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Anse

l Ada

ms,

Ric

hard

Zha

ng, P

hilip

Isol

a, A

lyos

ha E

fros

Page 7: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Recall: Real LCD Screen Pixels (Closeup)

iPhone 6S

Page 8: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Notice R, G, B sub-pixel geometry. Effectively three lights at each (x,y) location.

Page 9: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property
Page 10: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Color-Blind Reactions to Perceiving New Colors

Enchroma, https://www.youtube.com/watch?v=-rMjUsG--zo

Page 11: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Color-Blind Reactions to Perceiving New Colors

Enchroma, https://www.youtube.com/watch?v=-rMjUsG--zo

Page 12: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

• RGB can be used to represent almost any spectrum of color, but how important are these specifically?

• There's RGB, but also other color spaces, HSV and LAB -- separate out hue and lightness channels -- is there something like this in graphics?

• How are colors placed on a color wheel? Distance or radial position on wheel?

Discussion: Warm Ups (Breakout Rooms)What is a fact you know about color? What is something you want to learn about color?

• Humans have red, green and blue-like cone cells in our eyes -- trichromatic vision.

• How are enchroma glasses made, because color is so perception-based.

Page 13: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

What is Color?

• Color is a phenomenon of human perception; it is not a universal property of light

• Colors are the perceptual sensations that arise from seeing light of different spectral power distributions

• Technically speaking, different wavelengths of light are not “colors”

Page 14: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Color Reproduction Problem

Goal: at each pixel, choose R, G, B values for display so that the output color matches the appearance of the colors in the real world.

Display image of dragonfly on computer screenReal world dragonfly

Page 15: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

• Color is 3D in that we could try to combine any two colors to try to create any third color, if we cannot, then the dimensionality must be at least 3?

• In graphics, representation is RGB, so 3D color makes sense. But in the real world, things are not 3D...?

Discussion: What is The Dimensionality of Color?

How do we know?

• There are three types of "neurons" to perceive colors, and all perceptions are based on the combinations of these.

• If you look at the rainbow, which is monochromatic, not every color is on there -- e.g. purple/magenta, so we need more than one color.

• Are R, G, B linearly independent, and is that why we chose them?

Page 16: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

James Clerk Maxwell's Color Matching Experiment

Page 17: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Maxwell's Crucial Color Matching Experiment

http://designblog.rietveldacademie.nl/?p=68422

Portrait: http://rsta.royalsocietypublishing.org/content/366/1871/1685

Page 18: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Physical Basis of Color

Page 19: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

credit: Science Media Group.

Page 20: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS294-164

Isaac Newton's Experimentum Crucis

Isaac Newton performing his crucial prism experiment – the 'experimentum crucis' – in his Woolsthorpe Manor bedroom. Acrylic painting by Sascha Grusche (17 Dec 2015)

Page 21: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

The Fundamental Components of Light

• Newton showed sunlight can be subdivided into a rainbow with a prism • Resulting light cannot be further subdivided with a second prism

Page 22: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Electromagnetic radiation

• Oscillations of different frequencies (wavelengths)

The Visible Spectrum of Light

Image credit: Licensed under CC BY-SA 3.0 via Commons https://commons.wikimedia.org/wiki/File:EM_spectrum.svg#/media/File:EM_spectrum.svg

Visible electromagnetic spectrum

Page 23: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

MonochromatorHegyi et al. "Introduction to Practical Biochem

istry" http://elte.prom

pt.hu/sites/default/files/tananyagok/IntroductionToPracticalBiochemistry/ch04s07.htm

l

A monochromator delivers light of a single wavelength from a light source with broad spectrum.

Control which wavelength by angle of prism.

Page 24: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Spectral Power Distribution (SPD)

Salient property in measuring light

• The amount of light present at each wavelength

• Units:

• radiometric units / nanometer (e.g. watts / nm)

• Can also be unit-less

• Often use “relative units” scaled to maximum wavelength for comparison across wavelengths when absolute units are not important

Page 25: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Daylight Spectral Power Distributions Vary

Blue sky Solar disk

[Brian Wandell]

Page 26: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Spectral Power Distribution of Light Sources

Describes distribution of energy by wavelength

Figure credit:

Page 27: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

SpectrometerHegyi et al. "Introduction to Practical Biochem

istry" http://elte.prom

pt.hu/sites/default/files/tananyagok/IntroductionToPracticalBiochemistry/ch04s07.htm

l

For unknown light source, use a monochromator to isolate each wavelength of light for measurement

Detector

Page 28: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Superposition (Linearity) of Spectral Power Distributions[Brian W

andell]

Page 29: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

To Be Continued

Page 30: Lecture 20: Introduction to Color Science · Introduction to Color Science . Mark Rothko No. 61. Rust and Blue 1953, Museum of Contemporary Art, Los Angeles. ... not a universal property

Ren NgCS184/284A

Acknowledgments

Many thanks and credit for slides to Steve Marschner, Kayvon Fatahalian, Brian Wandell, Marc Levoy, Katherine Breeden, Austin Roorda and James O’Brien.

Credit to Michael S. Brown, "Understanding the In-Camera Image Processing Pipeline for Computer Vision", IEEE Computer Vision and Pattern Recognition - Tutorial, June 26, 2016. Mark D. Fairchild, "Color appearance, color order, & other color systems," ISCC-AIC Munsell Centennial Color Symposium, Boston (2018).