PSYC 330: Perception SEEING IN COLOR PSYC 330: Perception Seeing in Color.
Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect...
Transcript of Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect...
![Page 1: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/1.jpg)
Color language
9.59J; 24.905JTed Gibson
![Page 2: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/2.jpg)
Does language affect color perception?
Brown & Lennenberg (1954): codability of English color terms is correlated with recognition
Codability Recognition
Shown a color
Delay
Pick it from array Name each chip as quickly as
possible Codability = amount of
consensus between names
© Cambridge University Press. All rights reserved. This content is excluded from our Creative Commons license. For more information, see http://ocw.mit.edu/help/faq-fair-use/
![Page 3: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/3.jpg)
Does language affect color perception?
Brown & Lennenberg (1954): codability of English color terms is correlated with recognition
![Page 4: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/4.jpg)
What does this mean?
• Languagecanaffectcolormemory(perception?), evenonanon-linguistictask
• Colorperceptioncanaffectlanguage:Focal colorsarethemostlabelableones
![Page 5: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/5.jpg)
Does language affect color perception? Before we can address this question: Observation: Languages vary widely in the number of color terms: English: black, wide, red, blue, green, yellow, pink, brown, orange, purple/Berinmo: mehi, kel, wor, nol, wap (Roberson & Davies, 1999)/Dani: 2 color terms (Rosch Heider 1972): dark / light or “black” / “white”
© Cambridge University Press. All rights reserved. This content is excluded from our Creative Commons license. For more
information, see http://ocw.mit.edu/help/faq-
fair-use/
English Berinmo/
Reprinted by permission from Macmillan Publishers Ltd: Nature. Source: Davidoff, Jules, Ian Davies, and Debi Roberson. "Colour categories in a stone-age tribe." Nature 398, no. 6724 (1999): 203-204.
© 1999.
![Page 6: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/6.jpg)
Berlin & Kay (1969): The World Color Survey (WCS)
330 colors in World Color Survey color grid: Approximately a subset relation among sets of color terms across languages:
Berlin & Kay discuss the distribution of color terms in terms of “basic” color terms: basic color terms are thought to be visual-perception based: the most salient colors in the color space (e.g., Kay & Maffi, 1999)
These are the modal color terms in the WCS
The approximate subset relationship across languages is suggestive evidence for the perceptual hypothesis for the source of the similarities / differences
![Page 7: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/7.jpg)
Some color concepts never seem to appear
© Cambridge University Press. All rights reserved. This content is excluded from our Creative Commons license. For more information, see http://ocw.mit.edu/help/faq-fair-use/
“Blellow”
![Page 8: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/8.jpg)
Proposed universal distributionof color terms
Berlin & Kay, 1969/
![Page 9: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/9.jpg)
Does color perception affect language?
A Universal distribution of color terms?
• Claim 1: Focal colors (“best examples”) consistent across different speakers
• Claim 2: Speakers of all languages pick out the same kinds of groups of colors, based on the natural world
Ø Light vs. dark (Yes, this is true) Ø 4 primary color foci: red, green, yellow, blue (Wait: this isn’t true!)
Berlin & Kay, 1969/
![Page 10: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/10.jpg)
Why the wide variability among cultures? Puzzles for the perceptual hypothesis
1. What exactly is a “basic” color term? Is this term well-defined?
2. Why are there exceptions to the subset relationship (e.g., Berinmo)?
3. Why do more industrialized cultures have more color words?
Kay & Maffi, 1999: “As technology develops, the increased importance of color as a distinguishing property of objects appears to be an important factor in causing languages to add basic color terms, i.e., to refine the lexical partition of the color domain (Casson 1997).”
If we must appeal to culture to explain color distributions anyway, maybe we can do away with the notion of “basic” color term: Maybe color terms are just experience-based (Deutscher, 2010; cf. Gladstone, 1860)
People with different experiences with colors and color labeling will be different at their ability to use color words. E.g., painters, interior designers
![Page 11: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/11.jpg)
Research question 2: Does language affect color perception?
• Tentative answer for a long time: no
THEN….
• More cross-cultural evidence
• Exploration of more subtle effects – How might language affect color perception?
![Page 12: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/12.jpg)
More cross-cultural evidence
• Comparison of English and Berinmo(Roberson, Davies, Davidoff, 2000; Davidoff et al, 1999, Nature)
Reprinted by permission from Macmillan Publishers Ltd: Nature. Source: Davidoff, Jules, Ian Davies, and Debi Roberson. "Colour categories in a stone-age tribe." Nature 398, no. 6724
(1999): 203-204. © 1999.
![Page 13: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/13.jpg)
More cross-cultural evidence
• Comparison of English and Berinmo(Roberson, Davies, Davidoff, 2000; Davidoff et al, 1999, Nature)
Reprinted by permission from Macmillan Publishers Ltd: Nature. Source: Davidoff, Jules, Ian Davies, and Debi Roberson. "Colour categories in a stone-age tribe." Nature 398, no.
6724 (1999): 203-204. © 1999.
![Page 14: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/14.jpg)
More cross-cultural evidence
• Berinmo and English speakers each had a harder time learningto sort chips into categories based on color contrasts thatwere not in their language
![Page 15: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/15.jpg)
Language and color memory
Stimuli
BLUE GREEN
(Roberson, Davies, Davidoff, 2000)
![Page 16: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/16.jpg)
Language and color memory
Method
(Roberson, Davies, Davidoff, 2000)
![Page 17: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/17.jpg)
Language and color memory
Method
5 second delay
(Roberson, Davies, Davidoff, 2000)
![Page 18: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/18.jpg)
Language and color memory
Method
(Roberson, Davies, Davidoff, 2000)
![Page 19: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/19.jpg)
Language and color memory
BETWEEN CATEGORY
WITHIN WITHIN BLUE GREEN
(Roberson, Davies, Davidoff, 2000)
![Page 20: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/20.jpg)
Language and color memory
(Roberson, Davies, Davidoff, 2000)
![Page 21: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/21.jpg)
Language and color memory
perc
ent
corr
ect
reco
gniti
on
100
90
80
70
60
50
across boundary within category
no interference verbal interference
(Roberson, Davies, Davidoff, 2000)
![Page 22: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/22.jpg)
Does color perception really differ across languages? Language and color perception: Russian
blue
goluboy siniy
light blue dark blue
Winawer et. al. 2007
![Page 23: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/23.jpg)
Language and color perception
Which side is the edge on?
WITHIN BETWEEN CATEGORY CATEGORY
![Page 24: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/24.jpg)
Language and color perception: Russian
• Russian speakers have cross-category advantage, but Englishspeakers don’t
Courtesy of Proceedings of the National Academy of Sciences. Used with permission. Source: Winawer, Jonathan, Nathan Witthoft, Michael C. Frank, Lisa Wu, Alex R. Wade, and Lera Boroditsky. "Russian blues reveal effects of language on color discrimination." Proceedings of the National Academy of Sciences 104, no. 19 (2007): 7780-7785. Winawer et. al. 2007
![Page 25: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/25.jpg)
Language and color perception: Russian
• Potential issues with the Winawer et al. study:– /Main effect of language?– /Numerical effect in the reverse direction for verbal shadowing condition for Russian speakers: almost as large as the critical effect
– /No penalty for spatial interference conditioni n Russian
– /Only 24, 26 participants in English, Russian
• Whatcontrol experiment(s) would you run?
![Page 26: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/26.jpg)
Conclusionssofar
• There are cross-linguistic differences in perceptualdiscrimination, but the discrimination process seems toinvolve some language-related processing, because this partof the task can be interfered with
• Doesl anguage affect perception? Not to a large degree.– /Maybe only in difficult tasks where language processing might help too
• Further tests of effects of language on perception– /Test of this idea by Gilbert et al. (2005) uses the observation that language is processed on the left side of the brain
![Page 27: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/27.jpg)
Language and color in the brain
Visual search task: identify the different item
Gilbert et. al. 2005
![Page 28: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/28.jpg)
Language and color in the brain
• Reaction times were faster between categories, but only for itemspresented in the right visual field
Courtesy of Elsevier, Inc., http://www.sciencedirect.com. Used with permission. Source: Gilbert, Aubrey L., Terry Regier, Paul Kay, and Richard B. Ivry. "Support for lateralization of the Whorf effect
beyond the realm of color discrimination." Brain and language 105, no. 2 (2008): 91-98. Gilbert et. al. 2005
![Page 29: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/29.jpg)
Language and color in the brain
• Verbal (but not other) interference reversed the effects
Courtesy of Elsevier, Inc., http://www.sciencedirect.com. Used with permission. Source: Gilbert, Aubrey L., Terry Regier, Paul Kay, and Richard B. Ivry. "Support for lateralization of the Whorf effect
beyond the realm of color discrimination." Brain and language 105, no. 2 (2008): 91-98.
Gilbert et. al. 2005/
![Page 30: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/30.jpg)
Language and color in the brain
• The language effect appears to be primarily in the part of thebrain where language processing occurs
• Could be preprocessing (effects of language on perception overtime) and/or post-perceptual (language makes an online difference in how you process color) – Verbal interference indicates that it’s at least partly post-perceptual
Gilbert et. al. 2005/
![Page 31: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/31.jpg)
Language and thought: color perception
• Language / words change the cognition of their speakers: they help their speakers accomplish difficult cognitive tasks by creatingabstractions for the efficient processing and storage of information
• These abstractions complement rather than replace pre-existing non-verbal representations: when linguistic abstractions aretemporarily inaccessible, language users are able to fall back on therepresentations used by other animals, children, and speakers oflanguages without those abstractions.
![Page 32: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/32.jpg)
If true, why? Maybe it’s the shape of the space?
• “One possible explanation [for universalsi n color naming] is . . . the irregular shape ofthe color space. . . . Hue interacts with saturation and lightness to produce several large ‘‘bumps’’; one large bump is at focal yellow, and another at focal red. . . .We assume that the names that get assigned to the color space . . . are likely to be those names which are most informative about color.” Jameson & D’Andrade (1997)
• Regier et al. (2007) evaluated this hypothesis on Color-naming data from theWorld Color Survey
– 110 languages across the world– Recorded the modal color for each chip Courtesy of
Proceedings of the National Academy of Sciences. Used with permission. Source: Regier, Terry, Paul Kay, and Naveen Khetarpal. "Color naming reflects optimal partitions of color space." Proceedings of the National Academy of Sciences 104, no. 4 (2007): 1436-1441.
![Page 33: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/33.jpg)
Maybe it’s the shape of the space? • 3D color-space for the Munsell color chips
– Three dimensions of lightness, red/green, and yellow/blue– Approximate perceptual similarity in the human visual system
• Hypothesis: Color categories are clusters within this space– Optimal color categories should maximize perceptual similarity within categories, and minimize similarity between
– Tested on the 110 languages
Courtesy of Proceedings of the National Academy of Sciences. Used with permission. Source: Regier, Terry, Paul Kay, and Naveen Khetarpal. "Color naming reflects optimal partitions of color space." Proceedings of the National Academy of Sciences 104, no. 4 (2007): 1436-1441.
Regier et. al., 2007
![Page 34: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/34.jpg)
Qualitative results
N=3
N=4
Courtesy of Proceedings of the National Academy of Sciences. Used with permission. Source: Regier, Terry, Paul Kay, and Naveen Khetarpal. "Color naming reflects optimal partitions of color space." Regier et. al., 2007 Proceedings of the National Academy of Sciences 104, no. 4 (2007): 1436-1441.
![Page 35: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/35.jpg)
Qualitative results
N=5
N=6/Courtesy of Proceedings of the National Academy of Sciences. Used with permission. Source: Regier, Regier et. al., 2007/Terry, Paul Kay, and Naveen Khetarpal. "Color naming reflects optimal partitions of color space." Proceedings of the National Academy of Sciences 104, no. 4 (2007): 1436-1441.
![Page 36: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/36.jpg)
Some exceptions…
Courtesy of Proceedings of the National Academy of Sciences. Used with permission. Source: Regier, Terry, Paul Kay, and Naveen Khetarpal. "Color naming reflects optimal partitions of color space." Proceedings of the National Academy of Sciences 104, no. 4 (2007): 1436-1441.
Regier et. al., 2007
![Page 37: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/37.jpg)
Quantitative results
Rotated each language’s colors to see if they would match better in a different way
Courtesy of Proceedings of the National Academy of Sciences. Used with permission. Source: Regier, Terry, Paul Kay, and Naveen Khetarpal. "Color naming reflects optimal partitions of color space." Proceedings of the National Academy of Sciences 104, no. 4 (2007): 1436-1441. Regier et. al., 2007
![Page 38: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/38.jpg)
Quantitative results
Rotated each language’s colors to see if they would match better in a different way
Courtesy of Proceedings of the National Academy of Sciences. Used with permission. Source: Regier, Terry, Paul Kay, and Naveen Khetarpal. "Color naming reflects optimal partitions of color space." Proceedings of the National Academy of Sciences 104, no. 4 Regier et. al., 2007 (2007): 1436-1441.
![Page 39: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/39.jpg)
Color naming organization: Initial ideas
• Maybe color-naming is broadly universal, organized around perceptibility
• But there is some room forl anguage or culture-specific idiosyncracies
![Page 40: Lecture 14: Color Language - MIT OpenCourseWare · What does this mean? • Language can a ffect color memory (perception?), even on a non-linguistic task • Color perception can](https://reader030.fdocuments.in/reader030/viewer/2022040123/5e1dfc575e25a61909595c4d/html5/thumbnails/40.jpg)
9.59J/24.905J Lab in Psycholinguistics Spring 2017
For information about citing these materials or our Terms of Use, visit: https://ocw.mit.edu/terms.