Multi-Entity Bayesian Networks Without Multi-Tears
description
Transcript of Multi-Entity Bayesian Networks Without Multi-Tears
![Page 1: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/1.jpg)
1
Multi-Entity Bayesian Networks Without Multi-Tears
Bayesian Networks Seminar
Jan 3-4, 2007
![Page 2: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/2.jpg)
2
Limitations of Bayesian networks
Not expressive enough for many realworld applications. fixed number of attributes varying numbers of related entities
of different types.
![Page 3: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/3.jpg)
3
Systems based on first-order logic (FOL) the ability to represent entities of
different types interacting with each other in varied ways. “has enough expressive power to define all of
mathematics .. and the semantics of every version of logic, including itself”
lack a theoretically principled, widely accepted, logically coherent methodology for reasoning under uncertainty.
![Page 4: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/4.jpg)
4
Multi-entity Bayesian networks (MEBN)
a knowledge representation formalism that combines the expressive power of first-order logic with a sound and logically consistent treatment of uncertainty.
not a computer language or an application.
![Page 5: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/5.jpg)
5
Multi-entity Bayesian networks (MEBN) (cont..)A formal system that instantiates first-order Bayesian logic. MEBN provides syntax, a set of model
construction and inference processes, and semantics that together provide a means of defining probability distributions over unbounded and possibly infinite numbers of interrelated hypotheses.
As such, MEBN provides a logical foundation for the many emerging languages that extend the expressiveness of Bayesian networks.
![Page 6: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/6.jpg)
6
An example: Star Trek
illustrate the limitations of standard BNs for situations that demand a more powerful representation formalism.
![Page 7: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/7.jpg)
7
Decision Support Systems in the 24th Century
![Page 8: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/8.jpg)
8
The Basic Starship Bayesian Network
![Page 9: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/9.jpg)
9
![Page 10: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/10.jpg)
10
Problems
little use in a real life starship environment
![Page 11: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/11.jpg)
11
The BN for Four Starships
![Page 12: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/12.jpg)
12
Limitations of Bayesian networks
BNs lack the expressive power to represent entity types (e.g., starships) that can be instantiated as many times as required for the situation at hand.
![Page 13: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/13.jpg)
13
The Premise
the likelihood ratio for a high MDR is 7/5 = 1.4 in favor of a starship in cloak mode.
Although this favors a cloaked starship in the vicinity, the evidence is not overwhelming.
![Page 14: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/14.jpg)
14
Repetition Repetition is a powerful way to boost
the discriminatory power of weak signals. an example:
from airport terminal radars, a single pulse reflected from an aircraft usually arrives back to the radar receiver very weakened, making it hard to set apart from background noise.
However, a steady sequence of reflected radar pulses is easily distinguishable from background noise.
![Page 15: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/15.jpg)
15
Repetition (cont..) Following the same logic, it is reasonable
to assume that an abnormal background disturbance will show random fluctuation, whereas a disturbance caused by a starship in cloak mode would show a characteristic temporal pattern.
Thus, when there is a cloaked starship nearby, the MDR state at any time depends on its previous state.
![Page 16: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/16.jpg)
16
The BN for One Starship with Recursion
![Page 17: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/17.jpg)
17
Temporal Recursion
DBNs PDBN a more general recursion
capability is needed, as well as a parsimonious syntax for expressing recursive relationships.
![Page 18: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/18.jpg)
18
Using MEBN Logic a more “realistic” sci-fi scenario.
different alien species: Friends, Cardassians, Romulans, and
Klingons while addressing encounters with other possible races using the general labelUnknown.
consider each starship’s type, offensive power, the ability of inflict harm to the Enterprise given its range, and numerous other features pertinent to the model’s purpose.
![Page 19: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/19.jpg)
19
Using MEBN Logic (cont..)
MEBN logic represents the world as comprised of entities that have attributes and are related to other entities.
Random Variables.
![Page 20: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/20.jpg)
20
Using MEBN Logic (cont..) Knowledge about attributes and relationships
is expressed as a collection of MFrags organized into MTheories.
MEBN Fragments (MFrags). represents a conditional probability distribution for
instances of its resident RVs given their parents in the fragment graph and the context nodes.
MEBN Theories (MTheories). a set of MFrags that collectively satisfies consistency
constraints ensuring the existence of a unique joint probability distribution over instances of the RVs represented in each of the MFrags within the set.
![Page 21: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/21.jpg)
21
The DangerToSelf MFrag
![Page 22: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/22.jpg)
22
Using MEBN Logic (cont..)
Nodes: Contex nodes. Input nodes. Resdent nodes.
Arguments. Unique identifier
Exclamation point.
![Page 23: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/23.jpg)
23
Using MEBN Logic (cont..) Instances of the RV.
HarmPotential(!ST1, !T1), HarmPotential(!ST2, !T1)
Home MFrag. Local distribution
Boolean context nodes. True, False, or Absurd. Relevant only for deciding whether to use a
resident random variable’s local distribution or its default distribution.
![Page 24: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/24.jpg)
24
Using MEBN Logic (cont..)
No probability values are shown for the states of the nodes. a node in an MFrag represents a
generic class of random variables. Identify all the instances
none pseudo code.
![Page 25: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/25.jpg)
25
Using MEBN Logic (cont..) Local distributions in standard BNs are
typically represented by static tables, which limits each node to a fixed number of parents.
An instance of a node in an MTheory might have any number of parents. MEBN implementations(i.e. languages based
on MEBN logic) must provide an expressive language for defining local distributions.
![Page 26: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/26.jpg)
26
An Instance of the DangerToSelf MFrag
![Page 27: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/27.jpg)
27
An Instance of the DangerToSelf MFrag (cont..)
the belief for state Unacceptable is .975 (.90 + .025*3) and the beliefs for states High, Medium, and Low are .02 ((1-.975)*.8), .005 ((1-.975)*.2), and zero respectively.
![Page 28: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/28.jpg)
28
Using MEBN Logic (cont..)
more complex knowledge patterns could be accommodated as needed to suit the requirements of the application.
MEBN logic has built-in logical MFrags that provide the ability to express anything that can be expressed in first-order logic.
![Page 29: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/29.jpg)
29
Recursive MFrags
One of the main limitations of BNs is their lack of support for recursion.
MEBN provides theoretically grounded support for very general recursive definitions of local distributions.
![Page 30: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/30.jpg)
30
Recursive MFrags (cont..)
MEBN logic allows influences between instances of the same random variable.
The recursion is grounded by specifying an initial distribution at time !T0 that does not depend on a previous magnetic disturbance.
![Page 31: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/31.jpg)
31
Recursive MFrags (cont..)
How recursive definitions can be applied to construct a situation-specific Bayesian Network (SSBN) to answer a query. Example:
!Z0, !T3, !ST0 and !ST1 ZoneMD(!Z0,!T3)
![Page 32: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/32.jpg)
32
The Zone MFrag
![Page 33: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/33.jpg)
33
SSBN Constructed from Zone MFrag
![Page 34: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/34.jpg)
34
Recursive MFrags (cont..)
Steps: begin by creating an instance of the
home MFrag of the query node ZoneMD(!Z0,!T3).
build any CPTs we can already build. recursively creating instances of the
home MFrags until we have added all the nodes.
![Page 35: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/35.jpg)
35
Building MEBN models with MTheories MFrags provide a flexible means to represent
knowledge about specific subjects within the domain of discourse.
but the true gain in expressive power is revealed when we aggregate these “knowledge patterns” to form a coherent model of the domain of discourse that can be instantiated to reason about specific situations and refined through learning.
just collecting a set MFrags that represent specific parts of a domain is not enough to ensure a coherent representation of that domain.
a set of MFrags with cyclic influences
![Page 36: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/36.jpg)
36
Building MEBN models with MTheories (cont..) In order to build a coherent model we have to
make sure that our set of MFrags collectively satisfies consistency constraints ensuring the existence of a unique joint probability distribution over instances of the random variables mentioned in the MFrags. Such a coherent collection of MFrags is called an MTheory.
An MTheory represents a joint probability distribution for an unbounded, possibly infinite number of instances of its random variables.
![Page 37: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/37.jpg)
37
Building MEBN models with MTheories (cont..) A generative MTheory
summarizes statistical regularities that characterize a domain. These regularities are captured and encoded in a knowledge base using some combination of expert judgment and learning from observation.
To apply a generative MTheory to reason about particular scenarios, we need to provide the system with specific information about the individual entity instances involved in the scenario.
Bayesian inference answer specific questions of interest refine the MTheory
![Page 38: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/38.jpg)
38
Building MEBN models with MTheories (cont..)
Findings the basic mechanism for
incorporating observations into MTheories.
a finding is represented as a special 2-node MFrag containing a node from the generative MTheory and a node declaring one of its states to have a given value.
![Page 39: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/39.jpg)
39
Building MEBN models with MTheories (cont..)
Inserting a finding into an MTheory corresponds to asserting a new axiom in a first-order theory.
In other words, MEBN logic is inherently open, having the ability to incorporate new axioms as evidence and update the probabilities of all random variables in a logically consistent way.
![Page 40: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/40.jpg)
40
Building MEBN models with MTheories (cont..)
A valid MTheory Each random variable must have a
unique home MFrag. It must ensure that all recursive
definitions terminate in finitely many steps and contain no circular influences.
![Page 41: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/41.jpg)
41
The Star Trek Generative MTheory
![Page 42: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/42.jpg)
42
Building MEBN models with MTheories (cont..)
It is important to understand the power and flexibility that MEBN logic gives to knowledge base designers by allowing multiple, equivalent ways of portraying the same knowledge.
![Page 43: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/43.jpg)
43
Equivalent MFrag Representations of Knowledge
![Page 44: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/44.jpg)
44
Inference in MEBN Logic BN
Assessing the impact of new evidence involves conditioning on the values of evidence nodes and applying a belief propagation algorithm.
MEBN have an initial generative MTheory, a Finding
set and Target set. construct SSBN.
Creating instances of Finding and Target random variables.
standard BN inference is applied. Inspecting the posterior probabilities of the target
nodes.
![Page 45: Multi-Entity Bayesian Networks Without Multi-Tears](https://reader035.fdocuments.in/reader035/viewer/2022062803/568146ac550346895db3c739/html5/thumbnails/45.jpg)
45
SSBN for the Star Trek MTheory with Four Starships within Enterprise’s Range