Enterprise Manager 12c Database as a Service Snap Clone Overview

30
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1

description

Oracle Enterprise Manager 12c Snap Clone allows administrators to create fully functional copies of databases using the copy-on-write capabilities of the underlying storage layer. Users can request databases from Oracle Enterprise Manager 12c's self-service portal and have them provisioned within minutes instead of hours while keeping storage needs to a minimum. Part of Oracle Enterprise Manager 12c Cloud Management Pack for Oracle Databases, Snap Clone can fundamentally improve the efficiency and agility of administrators and QA engineers while saving storage costs and other capital expenses. In this presentation, learn how Oracle Enterprise Manager 12c Snap Clone can help: - Leverage storage copy-on-write technologies for fast provisioning - Integrate cloning with other Oracle Enterprise Manager 12c Lifecycle Management features, such as data masking and sub-setting - “Time travel” across multiple database snapshots to restore and access past data - Reduced administrative overhead from integrated lifecycle management

Transcript of Enterprise Manager 12c Database as a Service Snap Clone Overview

Page 1: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1

Page 2: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 2

EM12c DBaaS Snap Clone Overview

Page 3: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 3

What is Snap Clone?

Customer Scenarios

Challenges

EM12c Solution Overview

Licensing

Table of Contents

Page 4: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 4

Snap Clone is a storage agnostic & self service

approach to creating rapid & space efficient clones

of large (~TB) databases

What is Snap Clone?

Storage Agnostic

Supports ALL

storage vendors

(NAS & SAN)

Rapid

Clone DBs in

minutes not

days/weeks

Space Efficient

Significantly

reduce the storage

footprint

Self Service

Empower the

user to make

adhoc clones

Page 5: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 5

12 TB database in production for an internal

application

The production DB is running on Exadata, while

a standby database is running on ZFSSA

Agile development is used for the internal app

with 7 sprints running in parallel

Each sprint requires a clone of the production

DB

Each sprint lasts for a month, and clones need

to be refreshed monthly as well

Customer Scenario 1 [Telecom Industry]

Storage requirements

using traditional cloning

Prod DB = 12 TB

Standby DB = 12 TB

7 Clones (7 * 12 TB)

= 84 TB

------------------

Total 108 TB

Time = days/weeks

Page 6: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 6

5 production databases total 30 TB of storage

All 5 production DBs have a standby

Clones of the production database are required

for data analysis and reporting

6 total clones across different teams every

quarter

For security reasons, sensitive data has to be

masked prior to cloning

Customer Scenario 2 [Banking Industry]

Storage requirements

using traditional cloning

5 Prod DB = 30 TB

5 Standby DB = 30 TB

5 Masked DB = 30 TB

6 Clones (6 * 30 TB)

= 180 TB

------------------

Total 270 TB

Time = days/weeks

Page 7: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 7

Challenge 1: Lack of Automation

“Provisioning a database server takes us 4-5 days with involvement

of different groups to create a system meeting enterprise

standards. Need to roll out services on short order in matter

of minutes and hours”

51% DBAs state dealing with manual tasks like provisioning & cloning

of new databases for test/dev systems is too time consuming

Page 8: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8

Developer Request DB Get access to

DB

Manager Approval

DBA Request HW and

Storage

Configure Cluster

and create DB

System

Admin

Setup OS &

Network

Storage

Admin Allocate Storage

Current Database Provisioning Process Time Consuming and Inefficient

Page 9: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 9

Challenge 2: DBA Unfriendly Solutions

64% DBAs use

RMAN scripts for

cloning databases

Most point solutions or storage solutions are DBA

unfriendly

Clone ‘Storage Volumes’ instead of

‘Databases’

No visibility into the database stack; difficult to

triage performance issues

No way to track configuration or compliance /

data security issues

Lack of lifecycle capabilities or lineage

tracking

Page 10: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 10

Challenge 3: Storage Issues & Archaic Processes

Storage Issues

Large & growing data volume

51% say that data growth outpaces storage capacity

Degraded performance due to increased sharing amongst users

Throwing more disks to the problem, but it is never enough

Archaic Processes

Clones shared by multiple users

Fixed refresh cycle; no adhoc cloning requests

Different priorities and processes between DBA and Storage teams

Page 11: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11

Competing Priorities at Odds

Users Want Flexibility

Simplified Self Service Access

Rapid cloning

Time Travel to revert data

changes

IT Wants Standardization &

control

Standardization across database

platform + Governance / Control

Reduction in storage use

Reduction in administrative

overhead

Visibility into complete database

stack

Lineage tracking

Page 12: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 12

EM 12c Solution Overview

Single tool for all

your datacenter

management and

cloud needs

Page 13: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 13

Database as a Service

• Database as a Service provides

• A shared, consolidated platform to provision database services on

• Elasticity to scale out and scale back database resources

• Chargeback based on database usage

• Database as a Service needs to cater to various use cases

• A developer or a project owner requiring a new database service with/without seed data

• QA requiring a full database refresh for intense load testing

• QA requiring to create multiple clones for functional testing on subset of data

Page 14: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 14

DBaaS “Snap Clone” Database Cloning in Minutes

Page 15: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 15

DBaaS “Snap Clone” Storage Options

EM 12c Snap Clone

Sto

rage M

gm

t F

ram

ew

ork

(S

MF

)

Storage Management Framework

(SMF) plug-in:

– Abstracts different storage vendors

and technologies from DBAs

– Analyze storage utilization and track

lineage of clones

Hardware Solution [Vendor Specific]

Supports DB on File and ASM

Software Solution [Vendor Agnostic]

Supports DB on File Only

Page 16: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16

Comparison between Storage Options

*Licenses for ZFSSA are included with snap clone

Software Solution Hardware Solution

Vendors

supported

… and others

ALL Storage Vendors, SAN or NAS NFS+NAS ASM+SAN

Pre-requisites

• A physical/virtual server with Solaris 11

and ZFS file system

• Storage (Volumes/LUNs) mounted to this

server

• Network access to Storage appliance

• Credentials and privileges to connect

and perform actions

Storage

Licenses

• Does NOT require storage licenses from

vendor for snapshot and clone capabilities

• Additional benefits include compression,

deduplication, I/O caching, etc

• Need to license snapshot and clone

capabilities*

Page 17: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 17

Deployment Scenario 1: Using Standby Using standby database for cloning across different storage systems

Continuous Replication using:

Golden Gate or Dataguard

Standby

Database Production Database [Exadata or any commodity hardware]

Snap Clones using Standby

Private backups

(snapshots) for SSA

user

Benefit:

No additional

databases required

for cloning

Page 18: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18

Deployment Scenario 2: Using Test Master Using a clone master with sanitized or subset data

Discrete Replication using: RMAN

backups, Netapp SnapMirror, etc

Test Master Production Database [Exadata or any commodity hardware]

Masking and Subsetting using EM

Snap Clones using Clone Master

Private backups

(snapshots) for SSA

user

Benefit:

Massage data

before cloning

Page 19: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 19

Customer Scenarios with Snap Clone

Customer Scenario 1

[Telecom Industry]

Prod DB = 12 TB

Standby DB = 12 TB

7 Clones (7 * 2 GB of writable space)

= 84TB 14 GB

-------------------

Total 108 ~24 TB

Time = days/weeks minutes

Customer Scenario 2

[Banking Industry]

5 Prod DB = 30 TB

5 Standby DB = 30 TB

5 Masked DB = 30 TB

6 Clones (6 * 5 * 2 GB of writable space)

= 180TB 60 GB

---------------------

Total 270 ~90 TB

Time = days/weeks minutes

Page 20: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 20

Self Service Provisioning and Service Catalog

• Out-of-box self service portal

• Catalog of different database configuration

with varied datasets

• Resource quota based on role

• Integrated monitoring, snapshot/rollback, etc

Page 21: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 21

DBaaS Metering and Chargeback

Flexible metering and chargeback based

on:

– Configuration and monitoring information

– Host, Database, DB Service, and PDB level

Automated rollup using LDAP hierarchy

Out-of-box reporting for business users

(via BI Publisher)

Extend coverage via custom charge items

APIs for integration with billing systems

Page 22: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 22

Lifecycle Management of Snap Clone Databases

Cloning the database is not enough, it needs to be managed and monitored

like any other enterprise database!

Every Snap Clone database has the following enabled:

Inventory tracking and trending (to prevent sprawl and uncontrolled growth)

Association tracking with clone master

Track configuration compliance

Track drift from golden configuration standards

1-1, 1-n comparison

Patching Automation

Patch Advisories, pre-flight checks, rollouts, reporting

Page 23: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23

Snap Clone Analyzer

Overview Tab

– Storage summary and

usage details

– Snap Clone Storage

Savings

Hierarchy Tab

– Track database lineage

– Clone master

– Snapshot Profile

– Clone

– Backup Snapshots

Page 24: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 24

Snap Clone: Key Usage Scenarios

Snap Clone is most useful when creating clones of large databases

(~TBs) for the following purposes:

Application upgrade testing

Example: EBusiness Suite upgrade to R12

Functional testing

Example: Test with production datasets

Agile development

Example: Maintain parallel streams of development on same dataset

Data analysis and reporting

Example: Analyze stock market trends on a daily basis

Oracle Development uses Snap Clone across

9000 environments for

testing of products like EBS,

Fusion, PeopleSoft, MOS,

RDBMS, and EM.

Page 25: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25

Database as a Service in Action

Dedicated Database

Pluggable Database

Full Clone

Database Schema

Page 26: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 26

Self-Service Portal APIs Comprehensive RESTFUL APIs for Integration and Orchestration

List

DBaaS Portal & API

Deploy

Delete Manage

List Zones

List Service

Templates

List Service

Instances

Request DBs

Request PDBs

Request Schemas

Track request

progress

Service Control

(start/stop)

Backup

Restore

Snapshot

Get Chargeback info

Delete

Service

Extend

reservation

Page 27: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 27

Licensing

Snap Clone is licensed as part of the ‘Cloud Management Pack for Oracle

Database’.

This pack provides:

– Database, schema, and pluggable database provisioning

– Full clone and Snap Clones of databases

– Out-of-the-box Self Service portal and Service catalog

– Chargeback/showback, metering, quota, role based access

– Lifecycle Management of cloud resources

– APIs (RESTful and EMCLI) for all cloud operations

– Rapid Start Kit for quick setup of EM12c DBaaS

Page 28: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 28

Summary

Snap Clone is a storage agnostic and self service approach to creating rapid

and space efficient clones of large (~TB) databases

Supports ALL storage vendors and configurations (NAS and SAN)

Supports database version 10g to 12c

It satisfies the needs of both IT (in terms of control and standardization) and

the end users (in terms of flexibility)

Reduces storage and administrative costs

Page 29: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 29

References

Enterprise Manager Page on O.com

Cloud Management Page on OTN

Cloud Administration Guide (Documentation)

MOS Note: EM12c Recommended Plug-Ins and Patches for DBaaS

(1549855.1)

Page 30: Enterprise Manager 12c Database as a Service Snap Clone Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 30