Database Freedom - IT Business
Transcript of Database Freedom - IT Business
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Database FreedomMigrate from Traditional Licensed Database Engines to AWS or How can AWS help you unshackle and achieve transformation
Darko MeszarosSenior Developer Advocate, Amazon Web Services
@darkosuboticaln/darko-mesaros
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Market trends
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Trends that impact the way you think about data
Data grows 10x every 5 years driven by network connected
smart devices
Transition from IT to DevOps increases rate of
change
Micro-services architecture decreases need for one-size fits all databases and
increases need for real-time monitoring and analytics
Explosion of data Micro-services changes data and analytics requirements
Rapid rate of change driven by DevOps
Dev Ops
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
24%
15%
Leaders Followers
Organic revenue growth
Drivers of change: Data needs have evolved
every 5years
15years
live for
1,000xscale
>10xgrows
There are more ways to analyze data than ever before
11 8 5 4
How do I provide democratized access to data to enable informed decisions while at the same time enforce data governance and prevent mismanagement of the data?
Data is more valuable than ever before. Organizations that mine data create more business value than others
Hadoop Elasticsearch Presto Spark
Democratization of data
Governance& control
There are more people working with data than ever beforeThere is more data than people think
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Commercial databases are restricting innovation and driving up IT costs…
AUDIT
Very expensive Proprietary Lock-in Punitive licensing You’ve got mail
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is Database Freedom?
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Database Freedom is an AWS database and analytics modernization initiative focused on accelerating enterprise migrations from Oracle,
Microsoft SQL Server, Teradata, Cassandra, Netezza or MongoDB platforms to AWS cloud-native database services.
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Programs
Discover Database Freedom with AWS
Innovation• Database and analytics portfolio discovery and assessment• Improved automation with migration tools to reduce level of manual effort• Purpose built database and analytics services to meet your business needs
Expertise
• Complement your existing data and analytics teams with AWS migration specialists i.e. AWS Professional Services, System Integrators, Architects
• Reduce migration timeline by leveraging best practices as documented in Migration Playbooks
• Reduce risk and cost of migration efforts by utilizing POC/Pilot credits• Build migration business case by taking advantage of generous financial incentives and reduce
legacy database vendor licensing costs• Kick-off your migration journey by leveraging AWS and partner resources
Customer Benefits
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customer Examples
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customers are migrating their workloads to AWSVerizon is migrating over 1,000 business-critical applications and database backend systems to AWS, several of which also include the migration of production databases to Amazon Aurora.
By migrating from Microsoft SQL Server to Amazon Aurora, Ryanair can run one of the largest email campaigns in Europe with higher performance at a fraction of the cost, sending out 22 million emails daily to customers.
Trimble migrated their Oracle databases to Amazon RDS and project they will pay about 1/4th of what they paid when managing their private infrastructure.
Intuit migrated from Microsoft SQL Server to Amazon Redshift to reduce data-processing timelines and get insights to decision makers faster and more frequently.
Equinox Fitness migrated its Teradata on-premises data warehouse to Amazon Redshift. They went from static reports to a modern data lake that delivers dynamic reports.
Migrated their Market Data system from SQL Server to Aurora MySQL using AWS Database Migration Service(DMS) to replicate data nightly. Reduces their processing times from 8 hours to 3 hours.
Amazon.com migrated 100% of their fulfillment centers from Oracle DBs to Amazon Aurora. They migrated their 50PB of Oracle Data Warehouse to AWS (Amazon S3, Amazon Redshift, Amazon EMR).
Samsung Electronics migrated their Cassandra clusters to Amazon DynamoDB for their Samsung Cloud workload with 70% cost savings.
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Services, Tools, and Resources
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Our portfolioBroad and deep portfolio, purpose-built for builders
RedshiftData warehousing
EMRHadoop + Spark
AthenaInteractive analytics
Kinesis Data Analytics Real time
Elasticsearch ServiceOperational Analytics
RDSMySQL, PostgreSQL, MariaDB, Oracle, SQL Server
AuroraMySQL, PostgreSQL
QuickSight SageMaker
DynamoDBKey value
ElastiCacheRedis, Memcached
NeptuneGraph
TimestreamTime Series
QLDBLedger Database
S3/Glacier GlueETL & Data Catalog
Lake FormationData Lakes
Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams
Data Movement
Analytics Databases
Business Intelligence & Machine Learning
Data Lake
Managed Blockchain
BlockchainTemplates
Blockchain
RDS on VMware
DocumentDBDocument
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Migrate with minimal risk
AWS DMS
Database migration and replication managed service
Benefit
• Easily and securely migrate and/or replicate your databases and data warehouses to AWS
• Migrate between different database engines
• Low cost and global availability
AWS SCT
Development tooling to convert schemas between databases and data warehouses
Benefit
• Automates schema conversion including database structure and code
• Minimizes manual effort of performing a schema re-write
• Allows conversion from commercial to open source platforms
Native Tooling
Migration options included with the engine
Benefit
• Leverage a familiar environment
• Full support for native features
Open Source
Ora2Pg and others
Benefit
• Tailored solution for a specific problem
• Multiple tools can offer a more complete solution than any one product
• Free
Commercial
Attunity, Golden Gate, Informatica, Talend, and others
Benefit
• Commercial solutions are available for a wide range of migration sources and targets including legacy mainframe systems
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Workload Qualification Framework (WQF)WQF is a framework that includes a questionnaire, and design review guidance that Solutions Architects, System Integrators can use to classify workloads
• Determine ease of migration, staff-hour consumption and target AWS database services
• There are two main types of database workloads:
• Online Transaction Processing (OLTP): many small/fast transactions and queries via indexes that return few rows
• Data Warehouse (DW): interactive and long-running queries that scan millions of rows and batched updates
• WQF classifies OLTP and DW workloads into five categories:
Category 1 Standards based database access Candidate for Re-Factor
Category 2 Light, proprietary feature workloads Candidate for Re-Factor
Category 3 Heavy, proprietary feature workloads Candidate for Re-Factor/Re-Platform
Category 4 Engine-specific workloads Candidate for Re-Platform/Re-Host
Category 5 Non-portable, high-risk or lift-and-shift Candidate for Re-Host
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Legacy Databases to AWS Migration Playbooks• Topic-by-topic overview of how to migrate databases and data
warehouses to AWS services• Covers all proprietary features and the different database objects• Migration best practices• Oracle to Aurora PostgreSQL – available• SQL Server to Aurora MySQL – available• SQL Server to Aurora PostgreSQL – available• Oracle to Aurora MySQL – Q2• Cassandra to DynamoDB, Data warehouses to Redshift, and Db2
LUW to Aurora PostgreSQL – Coming soon
SCT DMS Playbook
Schema Data Best Practices
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS database and analytics partners
Migration System Integrators License Advisory Partners
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How to get started with Database Freedom?
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Database Workload Analysis
Disparate DB Workloads
Oracle EBS
CassandraMongoDB
Siebel / CRMERP
TeradataDW / Lakes
Custom Apps
SQL*Server / OtherDB’s
Big Data
OutcomesRe-Factor
Gathering Data and Organizing“Discovery & Planning”
Workload Qualification Framework Assessment
Questionnaires
2-Day Workshops
• Application Discovery
RDS-Aurora MySQL
RDS-Aurora PostgreSQL
DynamoDB
Redshift/Others
Re-PlatformRDS-Oracle
RDS-SQL Server
RDS-MySQL
RDS-PostgreSQL
Re-HostElastic Compute (EC2)
Elastic Block Storage (EBS)
Other Options
Simple Storage (S3)
• Migration Hub
• Migration Readiness Program
Incr
easin
g Va
lue
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ASSESSMENT WORKSHOP AND PILOT WORKLOAD MIGRATIONS
Database Freedom: Customer migration journey
Portfolio Discovery MigrationWorkload Analysis and POC
Landing Zone Skills/CoE
Discovery & Planning
MigrationExpertise
Migration Business Case
Migration PlanDirectional
Business Case
Rapid Discovery
Migrate
Integrate
Test
Transform
Optimize
Monitor
Operating Model
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ASSESSMENT WORKSHOP AND PILOT WORKLOAD MIGRATIONS
Database Freedom: Migration investment
Total AWS Investment = up to 100% of annual AWS usage from migrations, dependent on customer commitment*
Discover
Design
Build
Integrate
Cutover
Validate
Portfolio Discovery Migration
Landing Zone Skills/CoE
Discovery & Planning
MigrationExpertise
Migration Business Case
Migration Plan
Operating Model
Workload Analysis and POC
``
AWS Investments• AWS Solution Architects, Pro Services,
Product Teams
• Partner consulting investment • On-site training classes / workshops• Platform credits for pilot migrations
• Platform credits to help you offset the cost of migration
*4x multiplier of standard MAP discount in year 1, 2x in year 2
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Getting started
1. Determine Database Migration Path
2. Complete Database Freedom Questionnaire and run SCT tool on 5-7 representative databases
3. Review SCT tool assessment results with AWS Migration Specialist
4. If appropriate, schedule on-site Database Migration Workshop*
5. Select System Integrators to assist with pilot database migration and plan for larger scale migration
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Resources
Database Freedom:https://aws.amazon.com/solutions/databasemigrations/database-freedom/
Database Migration Service:https://aws.amazon.com/dms/resources/
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank You@darkosuboticaln/darko-mesaros