ConceptNet 5
description
Transcript of ConceptNet 5
1
ConceptNet 5Jason Gaines
2Overview
• What Is ConceptNet 5?• History• Structure• Demonstration• Questions• Further Information
3
What Is ConceptNet5
• Semantic Network (Common-Sense Knowledge)• Concepts and Relations• Weights and Sources
4History
• Started by Marvin Minsky, Push Singh, and Catherine Havasi
• Open Mind Common Sense (OMCS) - MIT Media Lab Artificial Intelligence Project (1999)
• Website launched in 2000• By 2002, 700,000 English sentences from 14,000
contributors• Reorganized in 2007 ConceptNet 3• Over 1,000,000 facts from 15,000 contributors• 2013 ConceptNet 4 Takes I.Q. test
5Structure
•Hypergraph•Nodes • Edges
6
Structure - Hypergraph
• Generalization of a graph where an edge can connect many nodes
7Structure - Nodes
•Words•Word Senses• Short Phrases
8Structure - Edges
• Node to Node relationship• Data sets provide the link
9
Structure – Edge Fields
• license• dataset• context• features• surfaceText
• id• uri• rel• start• end• weight• sources
10Structure - URI
• /[OBJECT TYPE]/[LANG]/[CONCEPT]• Object Types /a/, /c/, /d/, /e/, /l/, /r/, /s/ ,/and and /or:
/c/en/toast
11
Structure - Relations
• RelatedTo• IsA• PartOf• MemberOf• HasA• UsedFor• CapableOf• AtLocation• Causes• HasSubevent• HasFirstSubevent• HasLastSubevent
• HasPrerequisite• HasProperty• MotivatedByGoal• ObstructedBy• Desires• CreateBy• Synonym• Antonym• DerivedFrom• TranslationOf• DefinedAs
12Structure - Edge
{ "endLemmas": "toast", "context": "/ctx/all", "end": "/c/en/toast", "features": [ "/c/en/bread /r/RelatedTo -", "/c/en/bread - /c/en/toast", "- /r/RelatedTo /c/en/toast" ], "license": "/l/CC/By-SA", "start": "/c/en/bread", "startLemmas": "bread", "text": [ "toast", "bread" ], "uri": "/a/[/r/RelatedTo/,/c/en/bread/,/c/en/toast/]", "weight": 8.650268, "dataset": "/d/conceptnet/5/combined-sa", "sources": [ "/or/[/and/[/s/activity/omcs/Verbosity/,/s/contributor/omcs/verbosity/]/,/s/site/verbosity/]" ], "score": 46.555122, "rel": "/r/RelatedTo", "timestamp": "2013-09-12T16:51:30.594Z", "nodes": [ "/r/RelatedTo", "/c/en/toast", "/c/en/bread" ], "id": "/e/3da69c641f2e786bd5f07043c2ef51d9f146b431", "surfaceText": "[[bread]] is related to [[toast]]" }
13
Structure – Data Sources
• ConceptNet 4 (OMCS)• Wikipedia (English)• DBPedia• ReVerb
• Wiktionary (English)• WordNet• “Game With A Purpose”• Verbosity (GWAP)• Nadya.jp (Japanese)
14Using ConceptNet
•Website - Web API• ConceptNet Module - Python• Dataset• Flat JSON• Solr JSON• CSV
15Web API
• Representational State Transfer (REST) API
URL: http://conceptnet5.media.mit.eduRequest: “web” or “data/5.2”
Lookup: “lookup” with “limit”, “offset” and “filter”Search: “search” with edge fieldsAssociation: “assoc” with “limit” and “filter”
URI: “c/en/toast”
http://conceptnet5.media.mit.edu/data/5.2/assoc/c/en/cat?filter=/c/en/dog&limit=1
16Demonstration
http://conceptnet5.media.mit.edu/web/c/en/toasthttp://conceptnet5.media.mit.edu/data/5.2/assoc/c/en/cat?filter=/c/en/dog&limit=1http://conceptnet5.media.mit.edu/data/5.2/assoc/list/en/happy,sad@-1?limit=20http://conceptnet5.media.mit.edu/data/5.2/assoc/list/en/happy,sad@-1?limit=20&filter=/c/enhttp://conceptnet5.media.mit.edu/data/5.1/c/en/off_hook
17Summary
•What Is ConceptNet5?• History• Structure• Demonstration
18Questions
19Additional Info
• http://csc.media.mit.edu/conceptnet• http://csc.media.mit.edu/docs/conceptnet/• http://github.com/commonsense/conceptnet5/wiki• https://github.com/commonsense/conceptnet5/wiki/_
pages• http://en.wikipedia.org/wiki/Hypergraph