AE Foyer: Information Management in the Digital Enterprise

THE LONG DOG LEASH Information Management Challengesin the Digital Enterprise

Agenda

Key Concepts

The Long Dog Leash

The Enterprise Data Hub

Case: Innovate

Case: Renovate the core

Conclusions, takeaways

BS Bingo!

A look in the mirror?

Operational Systems

MDM

Data Governance

Innovation

Decision Support

BIODS Analytics

Everyone is BI?

Apply traditional IT mentality to next-generation applications and services

Failing to adopt new technologies

75% of enterprises

admit to havingthis need

50%

willfail

Organization

Application Architecture

Information Architecture

IM Challenges

Organization

Application Architecture

Information Architecture

IM Challenges

ALREADY EXISTS: LEGACY IT

ENVIRONMENT, LED BY CIO

OFTEN SILOS BUT UNDER CONTROL.

KNOWN TECHNOLOGIES AND ROBUS

MOSTLY RDBMS TECHNOLOGIES, HIGH

AVAILABILITY IN OPS,SEPERATE DWH

MASTER DATA MANAGEMENT, DATA

GOVERNANCE, DATA QUALITY

LED BY CDO – CHIEF DIGITAL OFFICER.

SOMETIMES CALLED SHADOW-IT, SPIN-

OFFS, INNOVATION LABS, EXTERNAL

EXPERIMENTAL NEW TECHNOLOGIES,

POOR KNOWLEDGE, POOR SUPPORT

MOSTLY NEW TECHNOLOGIES (NOSQL,

HADOOP, APPLIANCES, CLOUD CLUSTERS..

BIG AND LOTS OF DATA, QUICK

PROCESSING, EXTERNAL DATA

Easy? Then why does it fail?

THE LONG DOG LEASH

InnovationTraditional

Process

Application

Information

Does this work for information management?


Process

Application

InformationInformation


Process

Application

Information

Agenda

Key Concepts

The Long Dog Leash


Case: Innovate



Definitions

An enterprise data hub, also referred to as a data lake, is a new big data management model for big data that utilizes Hadoop as the central data repository.-- Whatis.com --

Enterprise data hubs are designed to address the challenge of data that is ballooning in volume, variety and velocity (3Vs). This term is largely associated with Cloudera and MapR.

-- Whatis.com --

Vendor Enterprise Data Hub (EDH)

The Essence

Enterprise

Data

HUB

YOUR ENTIRE ORGANIZATION. NOT JUST A PART OF IT.

ONES AND ZEROES.

THE CENTRAL PART OF A WHEEL. WHERE SPOKES ARE INSERTED.

THE CENTRAL PART OR AXLE END FROM WHICH BLADES RADIATE

A CENTER AROUND WHICH OTHER THINGS REVOLVE.

A DEVICE FOR CONNECTING COMPUTERS IN A NETWORK.

True EDH Architecture

0

Data Governance

Data Quality

Master Data Management

Data Security

API

0

...Innovation DMZOpen DataCommodity AnalyticsOperational

API

Operational Systems

Big Data Cluster BI Platform Cloud StorageNew Repositories

(Column, Graph, )

Data Integration Layer

Agenda

Key Concepts

The Long Dog Leash


Case: Innovate



CASE 1: INNOVATIE – PROJECT BACON

Goals

Count the number of commuters at stops or on buses

Gather statistics on usage and duration

Track actual user routes

Deliverables

Tracker SDK for Android

Out of the box beacon detection and communication to backend

Integrates with existing applications.

Demo application

Uses Tracker SDK

Commuter functionality: check for vacant seats on a line… and perhapswait for the next bus

Technical Implementation

Results

ResultsCommuter/Device identifier

Ping: I just saw a beacon with major 1 (type stop) and minor 5 (stop identifier)

Results

Route Optimization

Transfer Descend

Route Optimization

Commuterperspective

Adherenceto schedule

Agenda

Key Concepts

The Long Dog Leash


Case: Innovate



CASE 2: RENOVATE

Renovation and Innovation

Renovate Innovate

BUDGET

B2B B2C

Data Migration

Data Migration

Confidential

Data Migration Approach

Example Business Entity and High Level Requirements

Example Business Entity and High Level Requirements

Data profiling

Realistic goals

Alternatives

Decision log

Automation of quality standards

CRUCIAL IN OBJECTIVE MEASUREMENT OF

ITERATIVE MIGRATION

ESSENTIAL TO INCORPORATE IN DATA GOVERNANCE

AFTER PROJECT

Insights and Added Value

Formal method for establishing data quality requirements

Formal embedding in Data Governance of the organization

Automated periodical reports for management

Direct alerting (treshold bases or individually blocking)

Business ownership for data determined (MDM)

• Who are the correct stakeholders to include in projects

Baseline for quality

Estimated efforts for all kinds of scenarios (also ones that weren’t used)

Agenda

Key Concepts

The Long Dog Leash


Case: Innovate



THE LONG DOG LEASH


Process

Application

Information

Pitfalls

Pitfalls

Innovation MaturityGateway




Pitfalls





Pitfalls

Pitfalls





Pitfalls

DQMDM

TAKEAWAYS

The Long Dog Leash

Gateways and Maturity Cycle

It’s more than technologies

Dont build a Frankenstein monster

Play bullshit bingo, but don’t get hustled

The earth is not the center of our solar system

Recycle and Share Best Practices and Insights

… and tomorrow?Does renovation improve innovation?

Does innovation challenge yourtraditional IT?

INSIGHTS ON A STRATEGIC LEVEL THAT

COULD/SHOULD BE SHARED?

WON’T ISSUES IN THE TRADITIONAL

ENVIRONMENT HAVE A SIMILAR EFFECT ON

YOUR INNOVATION?

Think two steps further down the line.

NEW REQUIREMENTS FOR YOUR ESTABLISHED

DATA? IS LACKING MATURITY IN ESTABLISHED

SYSTEMS AN IMPEDIMENT FOR INNOVATION.

HOW WILL EXISTING ISSUES IMPACT

INNOVATION (FURTHER DOWN THE ROAD?)

MAKE INFORMED DECISIONS ABOUT THE

INNOVATIVE PROJECTS EVER REACHING THE

RIGHT LEVEL OF MATURITY (PASS THE

APPROPRIATE GATEWAYS)

Thank you!

AE Foyer: Information Management in the Digital Enterprise

Presentations & Public Speaking

Transcript of AE Foyer: Information Management in the Digital Enterprise