Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da...

26
Enabling Explanations: Enabling Explanations: The Inference Web and PML The Inference Web and PML Approach Approach Deborah McGuinness, Paulo Pinheiro da Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Silva, Li Ding Knowledge Systems Laboratory Knowledge Systems Laboratory Stanford University Stanford University info: info: [dlm | pp ] @ ksl.stanford.edu [dlm | pp ] @ ksl.stanford.edu Inference Web and PML is joint work with Fikes, Inference Web and PML is joint work with Fikes, Chang, Deshwal, Ding, Narayanan, Glass, Makarios, Chang, Deshwal, Ding, Narayanan, Glass, Makarios, Jenkins, Millar, and has particularly benefited Jenkins, Millar, and has particularly benefited from input from Batelle, IBM, SRI, MIT, UMBC, and from input from Batelle, IBM, SRI, MIT, UMBC, and others others More info:

TAGS:

Transcript of Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da...

Page 1: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

Enabling Explanations:Enabling Explanations:The Inference Web and PML ApproachThe Inference Web and PML Approach

Deborah McGuinness, Paulo Pinheiro da Silva, Li DingDeborah McGuinness, Paulo Pinheiro da Silva, Li DingKnowledge Systems LaboratoryKnowledge Systems Laboratory

Stanford UniversityStanford University info: info: [dlm | pp ] @ ksl.stanford.edu[dlm | pp ] @ ksl.stanford.edu

Inference Web and PML is joint work with Fikes, Chang, Deshwal, Inference Web and PML is joint work with Fikes, Chang, Deshwal, Ding, Narayanan, Glass, Makarios, Jenkins, Millar, and has particularly Ding, Narayanan, Glass, Makarios, Jenkins, Millar, and has particularly benefited from input from Batelle, IBM, SRI, MIT, UMBC, and othersbenefited from input from Batelle, IBM, SRI, MIT, UMBC, and others

More info: More info: http://iw.stanford.edu/documents_papers.htmlhttp://iw.stanford.edu/documents_papers.html

mailto:[email protected]
Page 2: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

22

OutlineOutline

MotivationMotivation Background - Inference WebBackground - Inference Web PMLPML Building a PML document by exampleBuilding a PML document by example Browsing PMLBrowsing PML Directions and plansDirections and plans DiscussionDiscussion

Page 3: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

33

Motivation – Trust throughTransparencyMotivation – Trust throughTransparency

If users (humans and agents) are to use, reuse, and If users (humans and agents) are to use, reuse, and integrate system answers, they must trust them. integrate system answers, they must trust them.

System transparency supports understanding and trust.System transparency supports understanding and trust.

Even simple “lookup” systems benefit from providing Even simple “lookup” systems benefit from providing information about their sources.information about their sources.

Systems that manipulate information (with sound Systems that manipulate information (with sound deduction or potentially unsound heuristics) benefit from deduction or potentially unsound heuristics) benefit from providing information about their manipulations.providing information about their manipulations.

Goal: Provide interoperable infrastructure that supports explanations of sources, assumptions, and answers as an

enabler for trust.

Page 4: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

44

Inference Web ConcernsInference Web ConcernsInformation Manipulation Traces Information Manipulation Traces

hybrid, distributed, portable, shareable, hybrid, distributed, portable, shareable, combinable encoding of proof fragments combinable encoding of proof fragments supporting multiple justificationssupporting multiple justifications

PresentationPresentation multiple display formats supporting browsing, multiple display formats supporting browsing,

visualization, summaries,…visualization, summaries,…AbstractionAbstraction

understandable summariesunderstandable summariesInteractionInteraction

multi-modal mixed initiative options including multi-modal mixed initiative options including natural-language and GUI dialogues, adaptive, natural-language and GUI dialogues, adaptive, context-sensitive interactioncontext-sensitive interaction

TrustTrust source and reasoning provenance, automated source and reasoning provenance, automated

trust inferencetrust inference[McGuinness & Pinheiro da Silva, ISWC 2003, J. Journal of Web [McGuinness & Pinheiro da Silva, ISWC 2003, J. Journal of Web

Semantics 2004]Semantics 2004]

Page 5: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

55

Inference Web Inference Web Framework for Framework for explainingexplaining question answering tasks by abstracting, question answering tasks by abstracting,

storing, exchanging, combining, annotating, filtering, comparing, and storing, exchanging, combining, annotating, filtering, comparing, and rendering justifications from question answerersrendering justifications from question answerers

IW’s Proof Markup Language (PMLIW’s Proof Markup Language (PML)) is an interlingua for proof is an interlingua for proof interchange. Represented in OWL interchange. Represented in OWL

IWBaseIWBase is a distributed repository of meta-information is a distributed repository of meta-information IW RegistrationIW Registration and Validation services and Validation services provide support for PML provide support for PML

generation, validation, and checking*generation, validation, and checking* IW BrowserIW Browser provides display capabilities for PML documents provides display capabilities for PML documents IW AbstractorIW Abstractor provides rewriting capabilities enabling more provides rewriting capabilities enabling more

understandable presentationsunderstandable presentations IW ExplainerIW Explainer provides multi-modal dialogue options including provides multi-modal dialogue options including

alternative strategies for presenting explanations, visualizations, and alternative strategies for presenting explanations, visualizations, and summariessummaries

IW TrustIW Trust provides methods for propagating trust values provides methods for propagating trust values IW SearchIW Search (enhanced SWOOGLE for PML documents) (enhanced SWOOGLE for PML documents)

Page 6: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

66

How to achieve transparency How to achieve transparency using IWusing IW

Question Answering system gets Question Answering system gets registered with Inference Web (using registered with Inference Web (using registration services)registration services)

Question Answering system encodes Question Answering system encodes justifications of its answers in PML justifications of its answers in PML (using PML generation and validator (using PML generation and validator services)services)

Application provides access to Application provides access to explanations via IW’s explainer, explanations via IW’s explainer, browser, and search featuresbrowser, and search features

Page 7: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

77

One Proof BrowserOne Proof Browser

Page 8: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

88

Page 9: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

99

Page 10: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1010

IW Explanation Application AreasIW Explanation Application AreasTheorem provingTheorem proving

First-Order Theorem Provers – Stanford (JTP First-Order Theorem Provers – Stanford (JTP (KIF/OWL/…)); SRI (SNARK); (KIF/OWL/…)); SRI (SNARK);

SATisfiability Solvers – University of Trento (JSAT)SATisfiability Solvers – University of Trento (JSAT)Information extraction – IBM (UIMA), Stanford (TAP)Information extraction – IBM (UIMA), Stanford (TAP)Information integration/aggregation – USC ISI Information integration/aggregation – USC ISI

(Prometheus,Mediator -> Fetch); Rutgers , Stanford (Prometheus,Mediator -> Fetch); Rutgers , Stanford (TAP)(TAP)

Task processing – SRI International (SPARK)Task processing – SRI International (SPARK)Service composition – Stanford, U. of Toronto, UCSF (SDS)Service composition – Stanford, U. of Toronto, UCSF (SDS)Semantic matching – University of Trento (S-MATCH)Semantic matching – University of Trento (S-MATCH)Problem solving – University of Fortaleza (ExpertCop)Problem solving – University of Fortaleza (ExpertCop)Trust Networks – U. of Trento (IWTrust)Trust Networks – U. of Trento (IWTrust)New collaboration with W3C / MITNew collaboration with W3C / MIT

Govt. Program Usage: ARDA NIMD, DARPA PAL, SAPIENT, Govt. Program Usage: ARDA NIMD, DARPA PAL, SAPIENT, Explainable Knowl. Agg, UIMA …Explainable Knowl. Agg, UIMA …

Company Usage: IBM, SRI, Sandpiper, …Company Usage: IBM, SRI, Sandpiper, …

Page 11: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1111

Proof Markup LanguageProof Markup Language

PML is a proof interlinguaPML is a proof interlingua It can be used to represent It can be used to represent

justification of information justification of information manipulation steps done by theorem manipulation steps done by theorem provers, extractors, etc.provers, extractors, etc.

The main components concern The main components concern inference representation and inference representation and provenance issues such as author, provenance issues such as author, source, etc.source, etc.

Page 12: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1212

StructureStructure

Page 13: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1313

John asks Google 2.0 the following questionJohn asks Google 2.0 the following question: :

What happened in The Night Club on March 1What happened in The Night Club on March 1stst, 1997?, 1997?

AnAn Answer Answer: There was smoke and fire: There was smoke and fire Sources:Sources:

““The whole place got tons of black The whole place got tons of black smokesmoke.”.”http://www.cnn.com/1997/03/03/US/XYZ.htmlhttp://www.cnn.com/1997/03/03/US/XYZ.html

““firefire took hold with devastating speed” took hold with devastating speed” http://news.bbc.co.uk/1/hi/world/279w1119.stmhttp://news.bbc.co.uk/1/hi/world/279w1119.stm ““Where there's Where there's smokesmoke there's there's firefire”” http://www.giga-usa.com/quotes/topics/proverbs_t374.htmhttp://www.giga-usa.com/quotes/topics/proverbs_t374.htm ““the the firefire quickly spread, filling the building with quickly spread, filling the building with thick, black thick, black smokesmoke” ” http://www.redcross.org/article/947,00.htmlhttp://www.redcross.org/article/947,00.html

Querying the WebQuerying the Web

(S^F)

(S)

(F)

(S->F)

(S^F)

(=>S^F)

Page 14: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1414

Proof Markup LanguageProof Markup LanguageTop-Level ConceptsTop-Level Concepts

ModelElement

ProofElement ProvenanceElement

NodeSet Question Query

Ontology

Person

Organization

…

InferenceStep

Mapping

SourceUsage

Page 15: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1515

Proof Markup Language:Proof Markup Language:Node Sets and Inference Steps Node Sets and Inference Steps (1/2)(1/2)

iw:hasConclusion:

Direct Assertion (DA)

iw:NodeSet

iw:isConsequenceOf

iw:InferenceStep

iw:hasLanguage:(S^F)

N3

iw:hasRule:iw:hasSourceUsage:

A trivial justification: (S^F) has been asserted from the Red Cross (RC) website

Encoding this justification in PML:

iw:hasEngine: CWM

http://foo.com/Example.owl#SmokeFire

824,1058 on RC

Page 16: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1616

Proof Markup Language:Proof Markup Language:Node Sets and Inference Steps Node Sets and Inference Steps (2/2)(2/2)

And this is the same NodeSet in XML:

<iw:NodeSet rdf:about="http://foo.com/Example.owl#SmokeFire"> <iw:hasConclusion>(S^F)</iw:hasConclusion> <iw:hasLanguage rdf:resource="http://inferenceweb.stanford.edu/registry/LG/N3.owl#N3" /> <iw:isConsequentOf> <iw:InferenceStep> <iw:hasIndex rdf:datatype="http://www.w3.org/2001/XMLSchema#int">0</iw:hasIndex> <iw:hasRule rdf:resource="http://inferenceweb.stanford.edu/registry/DPR/Told.owl#Told"/> <iw:hasInferenceEngine

rdf:resource="http://inferenceweb.stanford.edu/registry/IE/CWM.owl#CWM"/> <iw:hasSourceUsage> <iw:SourceUsage> <iw:spanFromByte rdf:datatype="http://www.w3.org/2001/XMLSchema#int">824</iw:spanFromByte> <iw:spanToByte

rdf:datatype="http://www.w3.org/2001/XMLSchema#int">1058</iw:spanToByte> <iw:hasSource rdf:resource="http://inferenceweb.stanford.edu/registry/PUB/RC.owl#RC"/> </iw:SourceUsage> </iw:hasSourceUsage> </iw:InferenceStep> </iw:isConsequentOf></iw:NodeSet>

Page 17: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1717

Justification Collections and ProofsJustification Collections and Proofs

AND Intro (^I)

DAS^F

S^F

DirectAssertion (DA)

from RC

A DAG ofPML Node Sets(a collectionof justifications)

ExtractedProofs for the conclusion S^F

F

DirectAssertionfrom CNN

S

DirectAssertionFrom BBC

iw:hasAntecedent

S F

S^F

^I

DADA

Page 18: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1818

The The CombineCombine Operation Operation

S

DirectAssertionFrom BBC

F

DirectAssertionfrom CNN

S->F

Direct Assertion

From Prov

S^F

DirectAssertion (DA)

from RC

ModusPonens

(MP)

AND Intro (^I)S

DirectAssertionFrom BBC

F

DirectAssertionfrom CNN

S^F

DirectAssertion (DA)

from RC

AND Intro (^I)

S

DirectAssertionFrom BBC

F

S->F

Direct Assertion

From Prov

ModusPonens

(MP)

#B

#A

Combine(#A,#B)= #C

#C

Page 19: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

1919

A Result of Combining JustificationsA Result of Combining Justifications

S

DirectAssertionFrom BBC

F

DirectAssertionfrom CNN

S->F

Direct Assertion

From Prov

S^F

DirectAssertion (DA)

from RC

ModusPonens

(MP)

AND Intro (^I)

#C

DAS^F

S F S^F ^I

DADA

S F S^F ^I

MPDAS S->F

DADA

{RC}

{BBC,CNN}

{BBC,Prov}

Page 20: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

2020

SWOOP SWOOP Class ViewClass View

Page 21: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

2121

ProtegeProtege

Page 22: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

2222

SWOOP SWOOP Property ViewProperty View

Swoop 2.2.1 loaded with: iw.stanford.edu/2004/07/iw.owl

http://iw.stanford.edu/2004/07/iw.owl
Page 23: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

2323

Proof ElementsProof Elements

Page 24: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

2424

Provenance ElementsProvenance Elements

Page 25: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

2525

Potential Usage in TAMIPotential Usage in TAMI PML as a justification interlinguaPML as a justification interlingua Inference Web tools for browsing, abstracting, Inference Web tools for browsing, abstracting,

summarizations, etc.summarizations, etc. IW Registry for componentsIW Registry for components IW Search for finding proofsIW Search for finding proofs

Next steps:Next steps: Review PML for representational adequacy (chris’ Review PML for representational adequacy (chris’

issue of markers for ignoring terms, …)issue of markers for ignoring terms, …) Register question answerers (CWM, Pychyncho?, TMS)Register question answerers (CWM, Pychyncho?, TMS) Augment question answerers to generate PMLAugment question answerers to generate PML Review output leveraging existing strategies and Review output leveraging existing strategies and

tacticstactics Generate new strategies and tactics as neededGenerate new strategies and tactics as needed

Page 26: Enabling Explanations: The Inference Web and PML Approach Deborah McGuinness, Paulo Pinheiro da Silva, Li Ding Knowledge Systems Laboratory Stanford University.

2626

DiscussionDiscussion

http://iw.stanford.edu/

http://iw.stanford.edu/2004/07/iw.owl

http://iw.stanford.edu/
http://iw.stanford.edu/2004/07/iw.owl

Technology Partnerships Office...2021/04/12  · Curry, John/PML Schlenoff, Craig/EL Tullman, Jennifer/MML Ahmed, Zeeshan/PML Aksyuk, Vladmir/PML Artiusio-Glimpse, Alexandra/PML Band,

Technology Partnerships Office...2021/04/12  · Curry, John/PML Schlenoff, Craig/EL Tullman, Jennifer/MML Ahmed, Zeeshan/PML Aksyuk, Vladmir/PML Artiusio-Glimpse, Alexandra/PML Band,

Matlab/Simulink Support Packagemechatronics.aerospace.utoronto.ca/PML/Simulink PML Manual.pdfThe Simulink PML (short for personal mechatronics laboratory) block set was designed as

Matlab/Simulink Support Packagemechatronics.aerospace.utoronto.ca/PML/Simulink PML Manual.pdfThe Simulink PML (short for personal mechatronics laboratory) block set was designed as

PML net Mag

PML net Mag

Blood, sweat and sawdust - LT McGUINNESS magazine, Brian...Brian McGuinness, Managing Director of Wellington construction firm LT McGuinness and recipient of the Member of the New

Blood, sweat and sawdust - LT McGUINNESS magazine, Brian...Brian McGuinness, Managing Director of Wellington construction firm LT McGuinness and recipient of the Member of the New

The Pinheiro Principles

The Pinheiro Principles

M. R. Pinheiro

M. R. Pinheiro

McGuinness - epawebapp.epa.ie

McGuinness - epawebapp.epa.ie

Human-Aware Sensor Network Ontology (HASNetO): Semantic Support for Empirical Data Collection Paulo Pinheiro 1, Deborah McGuinness 1, Henrique Santos 1,2.

Human-Aware Sensor Network Ontology (HASNetO): Semantic Support for Empirical Data Collection Paulo Pinheiro 1, Deborah McGuinness 1, Henrique Santos 1,2.

Jesus, luz do mundo - Fernando Pinheiro - · PDF fileFERNANDO PINHEIRO – 4 . CPI - Brasil. Catalogação–na–fonte . Pinheiro, Fernando . JESUS, LUZ DO MUNDO / Fernando Pinheiro

Jesus, luz do mundo - Fernando Pinheiro - · PDF fileFERNANDO PINHEIRO – 4 . CPI - Brasil. Catalogação–na–fonte . Pinheiro, Fernando . JESUS, LUZ DO MUNDO / Fernando Pinheiro

Explainable Systems: The Inference Web Approach Paulo Pinheiro da Silva Stanford University In collaboration with Deborah L. McGuinness, Richard E. Fikes,

Explainable Systems: The Inference Web Approach Paulo Pinheiro da Silva Stanford University In collaboration with Deborah L. McGuinness, Richard E. Fikes,

Kessler McGuinness & Associates, LLC 2007

Kessler McGuinness & Associates, LLC 2007

PML Fundiciones Chile

PML Fundiciones Chile

PML N Manifesto

PML N Manifesto

Fernando Krein Pinheiro

Fernando Krein Pinheiro

targeting strategy Pml targeting strategy d e f Pml+/+ Pml ...10.1038/s41467-017... · Supplementary Figure 3 | Pml expressed in MSCs regulates non-cell-autonomously LICs. (a) Schematic

targeting strategy Pml targeting strategy d e f Pml+/+ Pml ...10.1038/s41467-017... · Supplementary Figure 3 | Pml expressed in MSCs regulates non-cell-autonomously LICs. (a) Schematic

Cartilla pml

Cartilla pml

WRITER JEPh LOEB ED McGUINNESS · writer jeph loeb penciler ed mcguinness cover by ed mcguinness, dexter vines, & marte gracia variant covers by adi granov, marcos martin, joe quesada,

WRITER JEPh LOEB ED McGUINNESS · writer jeph loeb penciler ed mcguinness cover by ed mcguinness, dexter vines, & marte gracia variant covers by adi granov, marcos martin, joe quesada,

Pinheiro hands

Pinheiro hands

Explaining Answers from the Semantic Web: The Inference ...The Inference Web Approach Deborah L. McGuinness Paulo Pinheiro da Silva KnowledgeSystemsLaboratory, StanfordUniversity,StanfordCA94305

Explaining Answers from the Semantic Web: The Inference ...The Inference Web Approach Deborah L. McGuinness Paulo Pinheiro da Silva KnowledgeSystemsLaboratory, StanfordUniversity,StanfordCA94305

Inference Web: Portable and Sharable Proofs for Hybrid Systems Deborah L. McGuinness, Paulo Pinheiro da Silva and Bill MacCartney with Richard Fikes, Gleb.

Inference Web: Portable and Sharable Proofs for Hybrid Systems Deborah L. McGuinness, Paulo Pinheiro da Silva and Bill MacCartney with Richard Fikes, Gleb.