Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build,...

19
© 2018 IBM Corporation Watson Knowledge Catalog An intelligent asset catalog, providing a 360-degree view of your Data & AI Rick Buglio Digital Technical Engagement IBM Watson Data & AI [email protected] November 7, 2018

Transcript of Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build,...

Page 1: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

© 2018 IBM Corporation

Watson Knowledge CatalogAn intelligent asset catalog, providing a 360-degree view of your Data & AI

Rick BuglioDigital Technical Engagement

IBM Watson Data & [email protected]

November 7, 2018

Page 2: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Legal Disclaimer

• © IBM Corporation 2018. All Rights Reserved.

• The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

• References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

• If the text contains performance statistics or references to benchmarks, insert the following language; otherwise delete:Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

• If the text includes any customer examples, please confirm we have prior written approval from such customer and insert the following language; otherwise delete:All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

• Please review text for proper trademark attribution of IBM products. At first use, each product name must be the full name and include appropriate trademark symbols (e.g., IBM Lotus® Sametime® Unyte™). Subsequent references can drop “IBM” but should include the proper branding (e.g., Lotus Sametime Gateway, or WebSphere Application Server). Please refer to http://www.ibm.com/legal/copytrade.shtml for guidance on which trademarks require the ® or ™ symbol. Do not use abbreviations for IBM product names in your presentation. All product names must be used as adjectives rather than nouns. Please list all of the trademarks that you use in your presentation as follows; delete any not included in your presentation. IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.

• If you reference Adobe® in the text, please mark the first use and include the following; otherwise delete:Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

• If you reference Java™ in the text, please mark the first use and include the following; otherwise delete:Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.

• If you reference Microsoft® and/or Windows® in the text, please mark the first use and include the following, as applicable; otherwise delete:Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.

• If you reference Intel® and/or any of the following Intel products in the text, please mark the first use and include those that you use as follows; otherwise delete:Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

• If you reference UNIX® in the text, please mark the first use and include the following; otherwise delete:UNIX is a registered trademark of The Open Group in the United States and other countries.

• If you reference Linux® in your presentation, please mark the first use and include the following; otherwise delete:Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.

• If the text/graphics include screenshots, no actual IBM employee names may be used (even your own), if your screenshots include fictitious company names (e.g., Renovations, Zeta Bank, Acme) please update and insert the following; otherwise delete: All references to [insert fictitious company name] refer to a fictitious company and are used for illustration purposes only.

Page 3: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Data & AI

Every Every Business

and Enterprise

is Embracing AI

Leaders everywhere are

monetizing data and

developing strategies to

embed AI in business

Sales

Market basket analysis,

next-best offer, customer

churn, propensity to buy,

and smart engagement.

Marketing

Discount targeting, email

optimization, and lifetime

client value.

Human Resources

Medicare fraud, AI-

assisted diagnosis, and

drug demand forecasting.

Supply Chain

Predictive maintenance,

process optimization, and

demand forecasting.

Energy & Utilities

Power usage prediction,

maintenance, and smart

grid management.

Finance

Customer segmentation,

credit risk, and credit card

fraud detection.

Security

Activity monitoring,

intrusion detection, and

log analysis.

Data & Technology

Dynamic pricing, call

center assistance, tourism

forecasting, and self-

driving cars.

Page 4: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Data is becoming a new natural resource. It promises to be for the 21st century what steam power was for the 18th, electricity

for the 19th and hydrocarbons for the 20th

- IBM CEO, Ginni Rometty

But yet, there are still obstacles keeping companies from exploiting data and AI for analytics…

IDC’s Digital Universe study predicts the world's data will amount to 44

zettabytes by 2020, 10% of it from the internet of things

Page 5: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

9 Harvard Business ReviewFROM DATA TO DISRUPTION: INNOVATION THROUGH DIGITAL INTELLIGENCE10businesses require faster data & AI analytics to compete in the market.out

of

59%of decision makers say it takes months or years to meet new complex requests to turn data into business intelligence.ForresterREPORT

40%of a business professional’s time is spent fixing and validating data, before they can put it to use.ForresterREPORT

80%of an analyst’s time is spent preparingdata, instead of analyzing data.Information-Management.comREPORT

Page 6: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

80% of their time searching for the correct data

…imagine if that time was spent actually doing analytics!

60

75

80

30

15

17

10

10

3

LOB Knowledge Workers

Business Analysts

Data Scientists

% Time spent working with data

Finding Data Using Data Sharing Data

Users spent significantly more time finding the correct data, rather than extracting value from it

Knowledge workers spend

IDC Report written by Susan Feldman and Chris Sherman

Page 7: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Data Steward

Data ScientistData Engineer

App Developer

CollaborateFind Share

Business Analyst

…imagine if all that data was brought together, indexed, organized and easily accessible to

everyone that needs it

Information is coming from everywhere…

Page 8: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Build, Deploy, Learn

Watson Studio

Watson Data & AI

One Unified Data & AI Platform, Built with Watson

AI Designed for Business

Watson API

Explore, Shape, Operationalize

Data Refinery

Knowledge CatalogDiscover, Catalog, Govern

Page 9: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Data & AI

One Unified Platform

Watson StudioBuild, Deploy, Learn

Explore, Shape, Operationalize

Knowledge CatalogDiscover, Catalog, Govern

Watson Business SolutionsVoice of the Customer, Customer Care, Expert Assist, Compliance Assist

Watson Machine & Deep LearningContainer-Based Orchestration, Lifecycle Management, Drag-and-Drop Interfaces, Deployable as Web & API Services

Watson DataSelf-Service Integrated Data & Analytics, Machine Learning & Data Science, Watson Data Kits

Watson APIsNatural Language Understanding & Classifier, Machine Translation, Visual Recognition, Speech to Text, Conversation

Data Refinery

IntegrateConsolidate data under one roof — from cloud, private & on-premises

DiscoverIntelligent discovery of data with

advanced classification and profiling for context

CatalogA rich metadata index of all

data with social collaboration and enhanced findability

GovernPowerful governance tools to protect access to data with visibility into data

usage

Page 10: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Data & AI

Knowledge Catalog

Watson StudioBuild, Deploy, Learn

DiscoverIntelligent discovery of data with

advanced classification and profiling for context

CatalogA rich metadata index of all

data with social collaboration and enhanced findability

GovernPowerful governance tools to protect access to data with visibility into data

usage

Knowledge Catalog

360-DegreeBusiness View

Easily catalog, organize, find and access all of your information assets together with context. Intelligent profiling, classification and metadata indexing, unlocks the full richness of your company’s assets.

DataDiscovery

Find and discover data across both on-premises, cloud & 3rd

party sources. Rediscover value in isolated assets and catalog new data feeds — wherever they reside using a robust set of built in connectors and automated methods.

DataGovernance

Protect visibility to sensitive, classified and PII data with automated and actionable policy enforcement that denies access or masks, anonymizes or redacts data using flexible business rules.

Integrate Dataand AI

Enrich your data with Watson APIs— AI designed for business —with industry-specific knowledge and assurances that data is protected end-to-end.

Data RefineryExplore, Shape, Operationalize

Discover, Catalog, Govern

Page 11: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Data & AI

Build a Trusted Currency for Data with Watson Knowledge Catalog

Discover, Catalog, Govern

KnowledgeCatalog

DiscoverData Discovery

Surface new insights by bringing together your

data silos with context

Page 12: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Data & AI

Build a Trusted Currency for Data with Knowledge Catalog

KnowledgeCatalog

DiscoverData Discovery

Surface new insights by bringing together your

data silos with context

Catalog360-Degree View of Business

Automated discovery, data profiling and classification

that adds context for better understanding and usage

Discover, Catalog, Govern

Page 13: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Catalog360-Degree View of Business

Automated discovery, data profiling and classification

that adds context for better understanding and usage

GovernInformation Assets

Share data assets securely across your organization, with

policies & access that you control

DiscoverData Discovery

Surface new insights by bringing together your

data silos with context

Watson Data & AI

Build a Trusted Currency for Data with Knowledge Catalog

KnowledgeCatalog

Discover, Catalog, Govern

Page 14: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Catalog360-Degree View of Business

Automated discovery, data profiling and classification

that adds context for better understanding and usage

GovernInformation Assets

Share data assets securely across your organization, with

policies & access that you control

DiscoverData Discovery

Surface new insights by bringing together your

data silos with context

Watson Data & AI

Build a Trusted Currency for Data with Knowledge Catalog

IntegrateData & AIConsolidate assets from cloud, private,and on-premises

Watso

n A

PI

AI D

esigned

fo

r Bu

siness

KnowledgeCatalog

Watson StudioBuild, Deploy

Learn

Data RefineryExplore, Shape,Operationalize

Discover, Catalog, Govern

Page 15: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Data & AI

Data Refinery

Watson StudioBuild, Deploy, Learn

Knowledge CatalogDiscover, Catalog, Govern

Connect to Data Where it Resides

Access and explore data that resides across a myriad of endpoints — on-premises or on-cloud. Connectors to IBM, non

IBM and third party data

sources. Shared connections

across all Watson experiences.

Visualize Your Data

Interactive explorations and data visualizations to gain deeper insights from your datausing dozens of built-in charts and graphs with intelligent recommendations for you.

Explore, Prepare, Deploy

Data Refinery

CatalogA rich metadata index of all

data with social collaboration and enhanced findability

GovernPowerful governance tools to protect access to data with visibility into data

usage

Explore and Prepare Your Data

Uncover patterns and refine your data through shaping and cleansing techniques. The types of data manipulation tasks you do today — but via self-service methods (or code, if that’s your preference).

Deploy and Operationalize

Operationalize for repeatability, scalability and accountability. Define and scheduled data flows for repeatable out comes. Monitoring and

inspection of results. Scale on demand to support variant sized workloads.

Understand Your Data

Statistical techniques built into our tooling will automatically detect & label data types, anomalies, or sensitive fields. Easily identify problematic data.

DiscoverIntelligent discovery of data with

advanced classification and profiling for context

Page 16: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Data & AI

Watson Studio

Watson StudioBuild, Deploy, Learn

Knowledge Catalog

Machine andDeep Learning

Craft models and compare results. Run experiments backed by automated lifecycle management. Direct integration with Watson Machine Learning for the latest in deep learning techniques.

Open SourceTechnologies

Powered by Jupyter Notebooksand Apache Spark. Supports your favorite languages & tools: Python, Scala, and R.

EasyVisualizations

Design and train machine learning models without a single line of code. Visual modeling tools allow you to quickly identify patterns, gain insights, and make decisions faster.

All-In-OneExperience

Collaborate across teams by bringing together data & talent under one roof. Deploy your models directly to the web with application-friendly APIs.

Data RefineryExplore, Shape, Operationalize

CatalogA rich metadata index of all

data with social collaboration and enhanced findability

GovernPowerful governance tools to protect access to data with visibility into data

usage

Discover, Catalog, Govern

DiscoverIntelligent discovery of data with

advanced classification and profiling for context

Page 17: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Watson Knowledge Catalog

One Integrated and Unified CatalogWatson Studio

IBM Data RefineryExplore, Shape, Operationalize

Knowledge CatalogDiscover, Catalog, Govern

Build, Deploy, Learn

IBM Information ServerInformation Governance Catalog

IGC Asset CompatibilityBusiness & technical metadata

IGC-Catalog SyncBi-directional

IGC Policy CompatibilityDefined once, enforced everywhere

Coming soon ( 1Q19 )1

1

External Applications

and Users

External Data Sources

and Feeds

1

Page 18: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

IBM Watson Knowledge Catalog, was recently

recognized by Forrester as a Leader in: “The Forrester

Wave™: Machine Learning Data Catalogs, Q2 2018.”

Read the Report

Page 19: Watson Knowledge Catalog - PR3 Systems · 2018-11-15 · Knowledge Catalog Watson Studio Build, Deploy, Learn Discover Intelligent discovery of data with advanced classification and

IBM Watson & Cloud PlatformIBM Watson Data & AIIBM Watson & Cloud PlatformIBM Watson Data & AI

Thank you

Rick BuglioDigital Technical EngagementWatson Data & AI—[email protected]

Visit the Digital Technical Engagement website to learn more about Watson Knowledge Catalog, Information Governance Catalog and a whole lot more…

Watson Knowledge Catalog

Informatin Governance Catalog

Digital Technical Engagement for Watson Data & AI

Digital Technical Engagement for Unified Governance and Integration