The Future of Business Intelligence

Helping yourself to insightIan Pepper, 27/03/17

What I’m going to cover

• Me • Future of BI?– Data Lakes– Self-service

Who is Ian Pepper?• Head of Strategy and Integration for Novartis– Big Data, Analytics, Blockchain, RPA and IoT

• Previously was CTO and co-founder of a bunch of companies

@ianpepper linkedin.com/in/ianpepper

DisclaimerThis presentation was prepared in a

personal capacity. The opinions expressed here are my own and do not

reflect the views of Novartis.

Data Lakes

The future of data management and BI?

Often more of a Data Swamp

Why?

As business leaders what do you really need to

know?Really?

Tips from the Field• Don’t ingest data unless you are sure you’re going to use

it• Governance is a must• Metadata is key, repeat metadata is key!• Deploy multiple SQL-on-Hadoop tools for flexibility (Drill,

Impala, ...) – Logical warehouse• Use Spark for processing (inc. SparkSQL)• Data warehouses and marts are not dead!

We have a Data Lake. So, how do we extractreal value?

Often that’s this guys responsibility

Introducing the Data Wizard or Data Scientist

Jargon Buster• How to talk to a Data Scientist– Data Extraction, Preparation, Model Building,

Testing, Validation and Deployment, Rinse and Repeat

– Leading to Actionable Insight (Value)

Flavours of Analytics/BI

The Advanced Stuff or the Future!

But, we have a problem where are all the data

scientists?

Can we do without them?

Data Availability and Tooling are key to success

Self-Service tools do the heavy lifting.

So we can focus on the problem

Characteristics of Self-Serve• Point and click (code optional)• ML and Model Library• Seamless data blending and preparation• In-database joins (server side push down)• Auto-create MapReduce and Spark jobs• Visualization (e.g. produce Tableau output)

Remember – data with a

lot of information

… and a lot of noise.

The ability to hear the signalfrom the noise is the key…

Thank you!