MarkLogic: Moving from Headache to Headstart

Post on 24-Jan-2015

148 views 1 download

Tags:

description

For more than 25 years, data management has been relegated to IT back rooms. But in a world where data is king (and also changing and growing lightning pace), you have to rethink the technologies you use to empower your organization to monetize and extract value from all that data. In this session, you’ll learn how this new shift in IT — data emerging as the next killer app — requires a new generation of database. You’ll learn about new features and capabilities that will unlock the potential in your data, and enable you to do things you never thought possible. You’ll hear how enterprises are benefiting from today’s modern technology, and how they’ve moved beyond data headaches to getting a head start in this new data and information economy.

Transcript of MarkLogic: Moving from Headache to Headstart

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Moving from Headache to Head Start @MarkLogic

Data Integration is Really Hard

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 3

Pre-defined schemas

Complex ETL processes

Tradeoffs in app development

Data Integration With Relational Databases

X

X RDF

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 4

Schema-agnostic

Scale-out infrastructure

Straightforward data integration

Data Integration With Enterprise NoSQL

RDF

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 5

Publishing and Media

Editorial Content

Relationships

Images and Video

Information Delivery Platform (Including Dynamic Publishing and Custom Publishing)

Metadata Solutions (Including DAM, Digital Supply Chain, Syndication)

Content Creation

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 6

Financial Services Trade Store

Enterprise Reference Data

Research Management

Records Retention Compliance

Customer 360

Know Your Customer

Executed Trades

Reference Data

Research Documents

60.50 103.0100 5,000,000

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 7

Healthcare and Life Sciences Patient 360˚ Repository

Interoperability Enablement

Analytics and Forecasting

Health Information Exchange

Healthcare Data Layer

Information Product Delivery

Patient / EHR Data

Insurance Claims Data

Public Health Data

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 8

Public Sector Decision Support

Object Based Intelligence

Enterprise Data Layer

Metadata Catalog

Open Government Initiatives

IT Asset Management

XML and JSON Documents

RDF Triples

Geospatial Data

SLIDE: 9

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Healthcare.gov

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 10

Health Insurance Payers

Income and Eligibility Confirmation Millions of Subscribers

HIM

Data Services Hub DSH

State Exchanges

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 11

Health Insurance Payers

Income and Eligibility Confirmation Millions of Subscribers

HIM

Data Services Hub DSH

State Exchanges

SLIDE: 12

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Schema-agnostic to Handle Change

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 13

Flexible, Composable Indexes JSON and XML are self-describing: { "insuranceApplication": { "applicant": "Colin Novaks", "dateOfBirth": "1987-07-23", "contactPreference": "spoken language", "telephone": { "type": "home", "number": "(651) 555-1212" }, "location": [ 37.49705, -122.363319 ], "facilitatorNotes": "Applicant is on an H1B visa, but needs to find…", "triples": [ { "subject": "visa", "predicate": "status", "object": "H1B_visa" }, { "subject": "lawful_presence", "predicate": "status", "object": "inconsistent" } ] } }

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 14

Flexible, Composable Indexes Insurance Application

applicant

Colin Novaks

dateOfBirth

1987-07-23Z

contactPreference

telephone

home phone number

(651) 555-1212

mailingAddress

37.497075 -122.363319

facilitatorNotes

Applicant is on an H-1B visa, but needs to find…

subject subject

predicate

object Lawful_presence

visa

status

status

H-1B_Visa

inconsistent predicate

object

spoken-language

type

triple

triple

English

SLIDE: 15

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Had to Be Enterprise-ready

SLIDE: 16

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Security

Replication ACID Transactions

Point-in Time Recovery

Enterprise Ready From the Start

Automated Failover Database Rollback

SLIDE: 17

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Scalability & Elasticity Required

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 18

Scalability & Elasticity with Scale-out Architecture

D-NODE D-NODE

E-NODE E-NODE

D-NODE

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 19

8,000,000+ new beneficiaries

150,000+ concurrent users

0 zero data loss

BBC: Powering 2012 Olympics

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 21

MySQL Millions of Viewers Millions of Viewers Different Devices Streaming Updates

Static Publishing X X X

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 22

Dynamic Semantic Publishing

XML

RDF Millions of Viewers Different Devices Streaming Updates

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 23

Dynamic Semantic Publishing

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 24

25k+ transactions per second

2.8 PB of data delivered in one day

35 M+ global browsers

10k+ pages updated in real-time

Top Investment Bank

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 26

Front Office Systems Sybase ASE Sybase IQ Bespoke Application

Reporting Applications

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 27

Front Office Systems

Workflow Components (Reconciliation,

Clearance, Settlement)

Sybase IQ

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 28

1,000+ inserts per hour

1 DBA, not 10

1 golden copy of trade data

1 Database, not 20

Hierarchical Era “For your application data!"

Application- and hardware-specific

The NoSQL Generation

Relational Era “For all your structured data!”

Normalized, tabular model Application-independent query User control

Any Structure Era “For all your data!”

Schema-agnostic Massive scale Search and query Analytics Application services Faster time-to-results

SLIDE: 30

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Built-in Search

Scalability and Elasticity

ACID Transactions

Government-grade Security

HA/DR

Cloud Deployment

Hadoop-ready

Enterprise NoSQL From The Start.

SLIDE: 31

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Tiered Storage

Bitemporal

Semantics

Alerting

Elasticity

Differentiated Hadoop Use Cases

Geospatial

Composable Queries & Powerful Search

More Features. Do More.

SLIDE: 32

© COPYRIGHT 2014 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Want to Learn More? marklogic.com

#1 Rated DBMS for Operational Data Warehouse*

*Critical Capabilities for Data Warehouse Database Management Systems, Gartner, 18 Aug 2014