Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination
description
Transcript of Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination
![Page 1: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/1.jpg)
Reinhard Blutner1
Linear Algebra and Geometric Approches to Meaning
5a. Concept Combination
Reinhard Blutner
Universiteit van Amsterdam
ESSLLI Summer School 2011, Ljubljana
August 1 – August 7, 2011
![Page 2: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/2.jpg)
Reinhard Blutner2
11. Outlook
2. Conditioned probabilities
3. Pitkowsky’s Correlation Polytopes
4. Conjunction and disjunction of natural concepts
5. Borderline contradictions
6. Combining prototypes
![Page 3: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/3.jpg)
Vagueness
• A concept is vague if it does not have precise, sharp boundaries and does not describe a well-defined set.
• Vagueness is the inevitable result of a knowledge system that stores the centers rather than the boundaries of conceptual categories
• Vagueness is different from typicality (centrality):
- both robins and penguins are clearly birds, but
- robins are more typical than penguins as birds
Reinhard Blutner3
![Page 4: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/4.jpg)
Reinhard Blutner4
Why a quantum approach?
• The geometric approach provides a new theory of vagueness in the spirit of Lipman. “ It is not that people have a precise view of the world but communicate it vaguely; instead, they have a vague view of the world. I know of no model which formalizes this. I think this is the real challenge posed by the question of my title [Why is language vague?]" [Barton L. Lipman, 2001]
• It is able to solve some hard problems such as the disjunction and the conjunction puzzle
• It is able to answer the question why boundary contradictions are quite acceptable (x is tall and not tall)
• Extensional holism coexists with intensional compositionality
![Page 5: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/5.jpg)
Vagueness & quantum probability
mx(A) = |Ax|2 degree of membership
- Instance x represents a vector state which is projected by the operator A
- The squared length of Ax is the probability that x is a member of A
Reinhard Blutner
x
Ax
A = 1
5
![Page 6: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/6.jpg)
Typicality & quantum probability
cx(A) = |a x|2
typicality
- The vector a represents the prototype of A
- the squared length of the projection of x onto the vector a is the probability that x collapses onto a (or a collapses onto x – symmetry)
cx(A) mx(A)
Reinhard Blutner
x
A = 1
a
6
![Page 7: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/7.jpg)
Reinhard Blutner7
21. Outlook
2. Conditioned probabilities
3. Pitkowsky’s Correlation Polytopes
4. Conjunction and disjunction of natural concepts
5. Borderline contradictions
6. Combining prototypes
![Page 8: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/8.jpg)
Conditioned Probabilities
• P(A|C) = P(CA)/P(A)
(A|C) = (CAC)/(A) (Gerd Niestegge)
• If the operators commute, Niestegge’s definition reduces to classical probabilities: CAC = CCA = CA
• Niestegge’s formalism is an adequate way for representing the close connection between interference effects and question order effects (non-commutativity)
• Introduce ‘sequence’ (C; A) =def CAC
Reinhard Blutner8
![Page 9: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/9.jpg)
Interference Effects• Classical:
P(A) = P(A|C) P(C) + P(A|C) P(C)
• Quantum:
(A) = (A|C) (C) + (A|C) (C) + (C, A)
where (C, A) = (CAC + C AC) [Interference Term]
Proof
Since C+C= 1, CC = CC = 0, we get
A = CAC + CAC + CAC + C AC
Reinhard Blutner9
![Page 10: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/10.jpg)
Calculating the interference term
• In the simplest case (when the propositions C and A correspond to projections of pure states) the interference term is easy to calculate:
(C, A) = (CAC + CAC)
= 2 ½ (C; A) ½ (C; A) cos
• The interference term introduces one free parameter: The phase shift .
Reinhard Blutner10
![Page 11: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/11.jpg)
Solving the Tversky/Shafir puzzle• Tversky and Shafir (1992) show that significantly
more students report they would purchase a nonrefundable Hawaiian vacation if they were to know that they have passed or failed an important exam than report they would purchase if they were not to know the outcome of the exam
(A|C) = 0.54(A|C) = 0 .57(A) = 0 .32
(C, A) = [(A|C) (C) + (A|C) (C)] (A) = 0.23
cos = -0.43; = 2.01 231Reinhard Blutner11
![Page 12: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/12.jpg)
Conjunction Puzzle for probabilities
Linda is 31 years old, single, outspoken and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations.
- Linda is active in the feminist movement. (A) (6,1)
- Linda is a bank teller. (C) (3,8)
- Linda is a bank teller and is active in the feminist movement. (C&A) (5,1)
Reinhard Blutner12
![Page 13: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/13.jpg)
Conjunction effect
(A) = 0.38 (Linda is a bank teller)(C) = 0.61(Linda is a feminist)(C ; A) = 0.51 (Linda is a feminist bank teller)
• Quantum: (C ; A) (A) = ((C; A) + (C, A))
Given example: (C; A) (A) = +0.13 (sign.)
cos = 0.7, = 2.35 270
Reinhard Blutner13
![Page 14: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/14.jpg)
Approaching vagueness • Graded membership: To what
degree is x a member of A ?
answer: x(A) = | Ax |2
- Instances x represent vector stateswhich are projected by the operator A
- The squared length of Ax is the probability that x is a member of A
• Conjunctions are represented by sequences: (C ; A) =def CAC
• Disjunctions are represented by the orthomodular dual of sequences: (C; A)
x
AxA = 1
Reinhard Blutner14
![Page 15: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/15.jpg)
Reinhard Blutner15
31. Outlook
2. Conditioned probabilities
3. Pitkowsky’s Correlation Polytopes
4. Conjunction and disjunction of natural concepts
5. Borderline contradictions
6. Combining prototypes
![Page 16: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/16.jpg)
Kolmogorov Probabilities
Monotonicity
XY P(X) ≤ P(Y)
Additivity
P(X)+P(Y) = P(XY)+P(XY)
X XY Y
X Y
YX
Reinhard Blutner16
![Page 17: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/17.jpg)
Pitkowsky diamond
ConjunctionP(AB) ≤ min(P(A),P(B)) P(A)+P(B)P(AB) ≤ 1
DisjunctionP(AB) ≥ max(P(A),P(B))P(A)+P(B)P(AB) ≤ 1
Reinhard Blutner17
![Page 18: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/18.jpg)
Reinhard Blutner18
41. Outlook
2. Conditioned probabilities
3. Pitkowsky’s Correlation Polytopes
4. Conjunction and disjunction of natural concepts
5. Borderline contradictions
6. Combining prototypes
![Page 19: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/19.jpg)
Hampton 1988: judgement of membership
A B
Furniture
FoodWeaponBuildingMachineBird
Household appliancesPlantToolDwellingVehiclePet
A and Boverextension
A B
Home furnishingHobbiesSpicesInstrumentsPetsSportswearFruitsHousehold appliances
FurnitureGamesHerbsToolsFarmyard animalsSports equipmentVegetablesKitchen utensils
A or Bunderextension, no additivity
Reinhard Blutner19
![Page 20: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/20.jpg)
Conjunction ‘building and dwelling’
Classical : cave, house,
synagogue, phone box.
Non-classical : tent, library,
apartment block, jeep, trailer.
Example ‘overextension’
library(building) = .95
library(dwelling) = .17
library(b_ d_) = .31
cf. Aerts 2009Reinhard Blutner
20
![Page 21: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/21.jpg)
Disjunction ‘fruits or vegetables’
Classical: green pepper,
chili pepper, peanut, tomato, pumpkin.
Non-classical: olive, rice,
root ginger, mushroom, broccoli.
Example ‘additivity’
olive(fruit) = .5
olive(vegetable) = .1
olive(f_ v_) = .8
cf. Aerts 2009Reinhard Blutner21
![Page 22: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/22.jpg)
Reinhard Blutner22
51. Outlook
2. Conditioned probabilities
3. Pitkowsky’s Correlation Polytopes
4. Conjunction and disjunction of natural concepts
5. Borderline contradictions
6. Combining prototypes
![Page 23: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/23.jpg)
Alxatib & Pelletier 2011Pictures with 5 persons of different size are presented. (Order of persons randomized)
Subjects have to judge forms with four sentences as True/False/Can’t Tell.(Order of questions randomized)
Reinhard Blutner23
#3 is tall True ❏ False ❏ Can’t Tell ❏
#3 is not tall True ❏ False ❏ Can’t Tell ❏
#3 is tall and not tall True ❏ False ❏ Can’t Tell ❏
#3 is neither tall nor not tall True ❏ False ❏ Can’t Tell ❏
![Page 24: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/24.jpg)
% judged true
1 2 3 4 5
20
40
60
80
Data
Reinhard Blutner24
x is tall
x is neither tall nor not tall
x is not tall
x is tall and not tall
![Page 25: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/25.jpg)
1 2 3 4 5
0
10
20
30
40
Tensor product as conjunction
Reinhard Blutner25
x is tall and not tall
theoretical prediction
(1 parameter fitted)
% judged true
A and B : A B xx(A B) = x(A) x(B)
![Page 26: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/26.jpg)
Reinhard Blutner26
Extension of the formalism• So far, we have two notions for the conjunction
– Asymmetric conjunction (A; B) = ABA
– Tensor product A B
x(A; A) = 0 ; xx(A A) = x(A) (1-x(A))
• Aerts (2009) proposes to combine both methods using the Fock space.
(allowing states such as (x + xx))
• In the Fock-space, then ‘A and B ’ corresponds to the operator
ABA + AB
21
![Page 27: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/27.jpg)
Reinhard Blutner27
Two arguments
• Aerts 2009: The combination is required for fitting the Hampton data of category membership
• Sauerland 2010: Borderline contradictions are not extensional in the sense of fuzzy logic, i.e.
x(A) = x(B) x(A and A) x(A and B)
![Page 28: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/28.jpg)
Reinhard Blutner28
61. Outlook
2. Conditioned probabilities
3. Pitkowsky’s Correlation Polytopes
4. Conjunction and disjunction of natural concepts
5. Borderline contradictions
6. Combining prototypes
![Page 29: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/29.jpg)
Effect of contrast classes
• A collie is a dog, but a tall collie is not a tall dog
• Red nose red flag red beans
• Striped applestone lion
Reinhard Blutner29
![Page 30: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/30.jpg)
Conjunction Effect of Typicality
• x=guppy is a poorish example of a fish, and a poorish example of a pet, but it's quite a good example of a pet fish
– cx(A&B) > cx(B)
• In case of "incompatible conjunctions" such as pet fish or striped apple the conjunction effect is greater than in "compatible conjunctions“ (red apple).
– cx(A‘ & B) – cx(B‘ ) > cx(A & B) – cx(B)
(if A invites B but A' does not invite B')
Reinhard Blutner30
![Page 31: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/31.jpg)
Compositional Semantics and
Global Effects• Fregean Formal Semantics is based on the
Principal of Compositionality
• Global effects: The meaning of one part can influence the meaning of another part. Context as a global (hidden) parameter
• Frege (1884) took this as an argument against compositionality in Natural Language
• Quantum Cognition can explain the global contextual effects without giving up compositionality because the different constituents can be entangled.
Reinhard Blutner31
![Page 32: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/32.jpg)
Prototypes as superposed instances
iii baba )(
i ii naa
• .
• |ai|2 is the probability for selecting
• if the prototype is not one of the presented instances it is still recognized as such.
• Modification rule
+ recalibrating to unit lengthReinhard Blutner
32
in
![Page 33: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/33.jpg)
Typicality of conjoined concepts
For conjoined concepts A B perform the following steps:
1. Build the corresponding vectors and
2. Construct the tensor product
3. Perform the compression operation in order to build an entangled state
4. The typicality of instance is the quantum probability that the entangled state collapses into
a
b
ba
)( ba
ii nn
in
Reinhard Blutner33
![Page 34: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/34.jpg)
The compression operator
• Definition
• Modification
[ ] =
• The resulting state is entangled, i.e.
iii iiij
jiij nnXnnX
)]([
)( baba
yxba
Reinhard Blutner
34
![Page 35: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/35.jpg)
Conjunction effect
2 4 6 8 10 12 14Instances
0.05
0.1
0.15
0.2
0.25
Typicality
striped apple
striped apple
Reinhard Blutner35
![Page 36: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/36.jpg)
Striped apple 2
Form
Texture
Apple
striped
Reinhard Blutner36
![Page 37: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/37.jpg)
Concept combination: a geometrical model (Peter
Gärdenfors)
Reinhard Blutner37
![Page 38: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/38.jpg)
Red Nose
General Distribution
Red
Color Distribution
NosesConjoined Concept
Red Nose
Reinhard Blutner38
![Page 39: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/39.jpg)
Red and White Beans
General Distribution
Red
Color Distribution
Beans
Color Distribution
Red Beans
Reinhard Blutner39
![Page 40: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/40.jpg)
Red and White Beans
Color Distribution
White Beans
Color Distribution
Beans
General Distribution
White
Reinhard Blutner40
![Page 41: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/41.jpg)
Tall Boy
5 10 15 20In s ta n c e s o rd e re d w ith s ize
0 .05
0 .10
0 .15
T yp ic a lity
tallboytallboy
Reinhard Blutner41
![Page 42: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/42.jpg)
5 10 15 20In s ta n c e s o rd e re d w ith c o lo r o f p e e l
0 .05
0 .10
0 .15
0 .20
T yp ic a lity
Red apple: color of peel
red
apple
redapple
Kullback-Leibler information = 0.25
dxx
xxKLI )
)(
)(log()(
0
Reinhard Blutner42
![Page 43: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/43.jpg)
5 10 15 20In s ta n c e s o rd e re d w ith c o lo r o f pu lp
0 .1
0 .2
0 .3
0 .4
0 .5
0 .6T yp ic a lity
Red apple: color of pulp
red
apple
redapple
Kullback-Leibler information = 0.06
Reinhard Blutner43
![Page 44: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/44.jpg)
Stone lion
5 10 15 20Ins tances
0 .05
0 .10
0 .15
0 .20
0 .25
0 .30
Typ ical i ty
stone
stone lion
lion
Kullback-Leibler Information
Reinhard Blutner44
![Page 45: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/45.jpg)
Reinhard Blutner45
Conclusions
• Several examples of context-sensitivity can be treated in a straightforward way by using a compositional operation on conceptual states.
• Since conceptual states contain (frozen) usage information, they combine semantic and pragmatic information.
• It makes superfluous ‘truth-conditional pragmatics’ as an inferential theory.
• The present account is non-inferential; it is ‘as direct as perception’ (cf. Millikan, Recanati).
![Page 46: Linear Algebra and Geometric Approches to Meaning 5a. Concept Combination](https://reader036.fdocuments.in/reader036/viewer/2022062423/5681481e550346895db5479e/html5/thumbnails/46.jpg)
Reinhard Blutner46
General Conclusions• Asymmetric conjunction accounts for
interference effects– Explaining probability judgments. If quantum probabilities
are rational constructs then this kind of rationality conforms to the judgment data
– Describing the combination of vague concepts
– Problems with borderline contradictions can be overcome by using the Fock space.
• The combination of prototypes likewise is using the Fock space and particular compression operations
• Extensional holism coexists with intensional compositionality