Where 2.0 NoSQL Presentation 2008 - GeoIQ

27
From Data Chaos to Actionable Intelligence: How the Convergence of the GeoWeb and Semantic Web is Revolutionizing the Way We Process Information Where 2.0 2008 Sean Gorman FortiusOne Inc.

description

Presentation at Where 2.0 2008 where we discuss our rational for building a NoSQL data store after reaching limitations with the spatial SQL solution that were available at the time.

Transcript of Where 2.0 NoSQL Presentation 2008 - GeoIQ

Page 1: Where 2.0 NoSQL Presentation 2008 - GeoIQ

From Data Chaos to Actionable Intelligence: How the Convergence of the GeoWeb and Semantic Web is Revolutionizing the Way We Process Information

Where 2.0 2008Sean Gorman

FortiusOne Inc.

Page 2: Where 2.0 NoSQL Presentation 2008 - GeoIQ

AKA: Trying to GeoHack Without Getting Arrested

Page 3: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Geography of the Web

Paul Torrens

Steve Coast

Martin Dodge

Anthony Townsend

Matt Zook

Page 4: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Big Data Sets

Algorithmic Analysis

Map Logical Results to Physical Realities

Page 5: Where 2.0 NoSQL Presentation 2008 - GeoIQ

NYSE – SIAC Routing Vulnerabilities

Page 6: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Then these guys show up

Page 7: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Then these guys rescue you

Page 8: Where 2.0 NoSQL Presentation 2008 - GeoIQ
Page 9: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Geography on the Web

Page 10: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Small data sets with largely unstructured content

Page 11: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Crowdsourcing large structured data sets with quantitative capabilities

Page 12: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Didn’t we try this last year?

Page 13: Where 2.0 NoSQL Presentation 2008 - GeoIQ

What happens when your database reaches 1,683,185,246 features

Page 14: Where 2.0 NoSQL Presentation 2008 - GeoIQ
Page 15: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Rinse and repeat per query type

Page 16: Where 2.0 NoSQL Presentation 2008 - GeoIQ

or

Page 17: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Build a lightweight object database

Page 18: Where 2.0 NoSQL Presentation 2008 - GeoIQ
Page 19: Where 2.0 NoSQL Presentation 2008 - GeoIQ
Page 20: Where 2.0 NoSQL Presentation 2008 - GeoIQ

OpenLocation

Lots of silos of GeoData how can we begin to interconnect them

Infochimps.org

Page 21: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Can we federate our data

Page 22: Where 2.0 NoSQL Presentation 2008 - GeoIQ

OpenLocation

Linked repositories of data form a graph of content

Page 23: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Structured Dataset “Structured Dataset “X”X”

Third Party URL “Third Party URL “Y”Y”

Node “Y” is connected to Node “X” by the link “User Action”

User adds structured dataset “X” to their 3rd Party URL string “Y”

Page 24: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Structured Dataset “Structured Dataset “X”X”

Third Party URL “Third Party URL “Y”Y” Third Party URL “Third Party URL “Z”Z”

Data Set Degree

X 2

Y 1

Z 1

Page 25: Where 2.0 NoSQL Presentation 2008 - GeoIQ

Creates the Ability to Intelligently Serve Content

Structured Dataset “Structured Dataset “X”X”

Third Party URL “Third Party URL “Y”Y” Third Party URL “Third Party URL “Z”Z”

User searches on a term and gets a result based on tags and full text query then weighted by degree and user ratings:

The system can now recommend data URL “Y” and “Z” as data that may be useful context for dataset “X” even though they may have no tags in common

The graph can be encapsulated in code and communicated to the outside world

Page 26: Where 2.0 NoSQL Presentation 2008 - GeoIQ

1. Bring a new class of content/data to the Web

2. Intelligently mix that content with the rest of the Web

3. Enable the content to answer meaningful questions for users

Page 27: Where 2.0 NoSQL Presentation 2008 - GeoIQ

If you would like to check out the Finder! Beta see us for a card or go here:

http://finder.geocommons.com/

If you would like to talk about federating geodata email me at:

[email protected]