The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The...
Transcript of The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The...
![Page 1: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/1.jpg)
The Logic of Probability Theory
Deriving Bayesian Statistics from Boolean Algebra
William Sipes
July 14, 2010
![Page 2: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/2.jpg)
Probability Theory as Extended Logic
• George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical
propositions • Full Title: An Investigation of the Laws of Thought
on Which are Founded the Mathematical Theories of Logic and Probabilities (1854)
![Page 3: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/3.jpg)
Probability Theory as Extended Logic
• Cox and Jaynes • The Algebra of Probable Inference (1961) • Probability Theory: The Logic of Science (2003) • Boolean Logic and Three Desiderata necessitate
Bayesian Probability
![Page 4: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/4.jpg)
Boolean Algebra
• Commutative ring wrt operations of disjunction and conjunction
• Equivalence classes of [0] and [1] (representing FALSE and TRUE)
• Foundation of Computer Science
• Finite Field
![Page 5: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/5.jpg)
Boolean Algebra
Disjunction
Conjunction
Negation
![Page 6: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/6.jpg)
Boolean Algebra
Though there are three distinct operations, it can be shown that any combination of two that includes negation is complete.
Disjunction
Conjunction
Negation
![Page 7: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/7.jpg)
Boolean Algebra
F F F F T F T F F T T T
F F F F T T T F T T T T
F T
T F
![Page 8: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/8.jpg)
Double Negation
Commutativity
De Morgan’s Laws
Associativity
Idempotence
Boolean Algebra
![Page 9: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/9.jpg)
Bayesian Probability
• Conditional Probability • Differs from frequentist approaches • Based on prior distributions • Models can be updated with new information
![Page 10: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/10.jpg)
Bayesian Probability
Conditional: A given B
Conjunction: A and B
![Page 11: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/11.jpg)
The Desiderata
1) Representation of plausibility with real numbers
2) Qualitative correspondence with common sense
3) Structural Consistency
These uniquely determine the allowable operations of all probabilistic theory.
Assumption of twice differentiability in functions
![Page 12: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/12.jpg)
Product Rule
1. Require that any plausibilities obey all of the desiderata simultaneously, unambiguously, and completely
2. Assume that there is a functional relation for conjoined propositions
3. Argue (using the requirements imposed by the desiderata) that there is only one form for this rule
4. Derive the form of the rule using differential equations
![Page 13: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/13.jpg)
Product Rule
• Most basic assumption • Only functional form that does not degenerate
when tested at “extremes” • Key feature of familiar probability theory
![Page 14: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/14.jpg)
Product Rule
![Page 15: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/15.jpg)
Product Rule
![Page 16: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/16.jpg)
Sum Rule
1. Using the product rule, derive a function that relates propositions and their negations
2. Impose the conditions of the desiderata to derive another functional equation
3. Argue analytically about the functional equation 4. Reduce the functional equation to a differential
equation 5. This leaves a functional relation for complementary
plausibilities
![Page 17: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/17.jpg)
Sum Rule
![Page 18: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/18.jpg)
Sum Rule
![Page 19: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/19.jpg)
Sum Rule
![Page 20: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/20.jpg)
Sum Rule
![Page 21: The Logic of Probability Theory - Union University Theory as Extended Logic • George Boole • The Laws of Thought • Algebraic expression of Aristotelian logical propositions ...](https://reader035.fdocuments.in/reader035/viewer/2022062413/5aca446f7f8b9aa3298d7c62/html5/thumbnails/21.jpg)
Further Developing the Theory
• Conditional probability and the sum rule gives definition of independence
• Product rule can be used to derive Laplace’s definition of probability (frequentist)
• Demonstrate agreement with Kolmogorov’s axioms of probability