Extending ASM to Manage All Your Data

31
Oracle Confidential Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2 Ara Shakian Principal Product Manager 

Transcript of Extending ASM to Manage All Your Data

Page 1: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 1/31

Oracle Confidential

Extending Automatic Storage Management toManage ALL Data

Oracle Database 11g Release 2Ara ShakianPrincipal Product Manager 

Page 2: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 2/31

Oracle Confidential

The following is intended to outline our generalproduct direction. It is intended for informationpurposes only, and may not be incorporated into anycontract. It is not a commitment to deliver any

material, code, or functionality, and should not berelied upon in making purchasing decisions.The development, release, and timing of anyfeatures or functionality described for Oracle’s

products remains at the sole discretion of Oracle.

Page 3: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 3/31

Oracle Confidential

Table of Contents

• Storage management challenges

• ASM Overview

• ASM in 11gR2 takes it the next level• What is it

• How does it work

• How do I manage it

• Benefits

• How do I get from here to ASM

• ASM reference customers

Page 4: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 4/31

Oracle Confidential

Challenges of Managing

Data Explosion

• Lack of a single optimal solution for all data• Lack of automation to reduce complexity

• Managing multiple software layers

• Complexity of managing performance• Eliminating hot spots

• Multi-vendor support logistics and finger pointing

• Reducing storage Total Cost of Ownership

Page 5: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 5/31

Page 6: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 6/31

Oracle Confidential

ASM is Storage Management Platform of Choice

  An optimal storage management solution for database and general purpose files

ASM Disk

ASM Disk

ASM Disk

ASM Disk

ASM Disk

ASM Disk Group• Simplifies and automates storage management

• Integrated cluster and single node framework

• Storage pooling with easy provisioning

• Optimal performance by default• Best availability and scalability

• Lowest TCO

• Consolidates and eliminates waste

• No additional cost

• Manages ALL data 11.2

Lowers the cost of storage management

Page 7: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 7/31Oracle Confidential

Dynamic Rebalancing

Benefits:

• On-line capacity management

• Eliminates manual I/O tuning

• Maintain optimal performance

• Storage migration on line

Disk Group

ASM Disk ASM Disk

• Simple provisioning

• Add, drop or resize

ASM Disk ASM Disk ASM DiskASM Disk ASM Disk

Page 8: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 8/31Oracle Confidential

Enables Storage ConsolidationClustered Pool of Storage

• Shared storage acrossseveral databases• RAC and Single Instance

• Benefits:• Simplified and Centralized

management

• Higher storage utilization• Higher performance

Local Area Network

ERP Database

HR Database

CRM Database

RAC

ASM

RDBMS

ASM

RDBMS

ASM

ASM Disk Group

ERP CRMFIN HR

FIN Database

Page 9: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 9/31Oracle Confidential

Striping, Mirroring and Performance

• Striping designed to meet• RDBMS I/O characteristics

• General purpose files

• Flexible file-based mirroring• External, Normal and High

• Optimal performance• No tuning

Percentagerelative toBaseline

(TPS)

Non-ASM

ASM

Time

Page 10: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 10/31Oracle Confidential

Why You Should Care

• Reduced complexity thru automation• No I/O tuning, reshuffling data files

• Simplified solution stack• No finger pointing, 3rd party LVM/FS

• Increases utilization and database and

application uptime• No down-time for storage provisioning or migration

• Managing storage pool vs. islands

• Single vendor cross-platform integrated solution• Bundled and tested as one solution

• Same cross platform tools to install, configure and manage

• No additional cost!

Page 11: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 11/31

Oracle Confidential

Taking It To The Next Level

WithASM in 11gR2

Page 12: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 12/31

Oracle Confidential

Oracle Grid Infrastructure(ASM + Oracle Clusterware)

• ASM and Oracle Clusterware integrated and installed ina single ‘Grid Infrastructure’ home

• Integrated installation, configuration and upgrade

• Installed using Oracle Universal Installer (OUI)

• Not a part of database install

• Option to minimally configure ASM and ACFS

• Automate creation of Oracle DB Homes on ACFS

Page 13: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 13/31

Oracle Confidential

ASM Configuration Assistant (ASMCA)

• Manage ASM before db install

• Upgrade previous versions of ASMto the current version (11g R2) 

• One tool to initialize & manage

* Disk Groups* Dynamic Volumes* ACFS file systems

Page 14: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 14/31

Oracle Confidential

3rd Party FSApplication

Extending ASM to Manage ALL Data

Automatic Storage Management (ASM)

 

ASM InstanceManagingOracle DB Files

ASM Cluster & SingleNode File System

(ACFS)

Database RAC

ACFS Snapshot

Dynamic Volume Manager 

ACFS FSOracle

Bin

3rdPartyFS

DB DatafilesDB DatafilesDatabase files

OCR & Voting files

ASM

Disk

Group

General Purpose FilesDatabase Files

Dynamic Volumes

Page 15: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 15/31

Oracle Confidential

What is ASM Dynamic Volume Manager 

• A new cluster (and single host) volumemanagement service

• Standard disk device interface to clients

• Loadable kernel driver 

• Dynamic Volume is a volume file createdin an ASM disk group (new file type‘asmvol’)• An OS device file is created automatically when

a dynamic volume is created• Managed by SQL/ASMCMD and EM

ASM DG

/dev/asm/vol1-123

+DATA/vol1

OS

Page 16: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 16/31

Oracle Confidential

• General purpose scalable file system

• Journaling, extent based

• Single node and cluster 

• POSIX, X/OPEN file system solution for UNIX/Linux

• Windows file system solution for Windows platforms 

• Accessible through NAS protocols (NFS, CIFS)• Leverages ASM technology for volume mgt

• Integrated with Oracle Clusterware for cluster support

• Multi OS platform (Linux and Windows at initial release)

• Integrated with Oracle system mgt tools

• Oracle installation and configuration

• Enterprise Manager and ASM Storage mgt tools

• Native OS File System Management tools

What is ASM Cluster File System

(ACFS)

Page 17: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 17/31

Oracle Confidential

What are ACFS Snapshots

• Dynamic, fast, space efficient, “point in time” read-only

copies of ACFS file system files• Captures ASM FS file block/extent updates

• An enabler for: • On-line, disk-based, file backup model using snapshots• Individual file recoveries

• Up to 64 snapshot images per ASM file system • Policy based snapshots:

Schedule snapshots on an interval basis: every 5seconds, every 30 minutes, daily, …

• Create an ACFS snapshots 

• acfsutil snap create snap_name mountp

Page 18: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 18/31

Oracle Confidential

Leveraging the Power of ASM

• Even distribution of data

• Dynamic provisioning

Dynamic volumes andACFS FS may be resizedleveraging ASM file resize

features% asmcmd volresize dga vol1 -s 50G

• Can also use EnterpriseManager for managementand threshold alerts

+DATA/dga/vol1

3

Primary ASM File Extent

Mirrored ASM file Extents

ACFS File System: /usr1

Linux: /dev/asm/vol1Win: \\.\asm_dgname_volname

ACFS file A

ACFS file B

Mirrored

Mirrored

1

1

Page 19: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 19/31

Oracle Confidential

Managing the Dymanic Volumes and

ACFS File System

Is Simple And Flexible

1. Native Linux, UNIX, and Windows OS file systemcommands and extensions

2. acfsutil platform independent commands

3. ASM Configuration Assistant (ASMCA)

4. Enterprise Manager 

Page 20: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 20/31

Oracle Confidential

An Example: Creating an ACFS File

System

$ mkfs -t acfs -b 4k /dev/asm/volume1-62 ; Create fs on ASM volume

$ su - root# mount -t acfs /dev/asm/volume1-62 /tmp/images

# su – oracle_usr 

$ acfsutil registry -a /dev/asm/volume1-62 /tmp/images

$ mount –t acfs –o all none none ; Mount everything in the registry

$ cd /tmp/images$ cp /home/my_images .

Page 21: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 21/31

Oracle Confidential

ACFS Use Cases

• Oracle Home• Shared or node-local

• Not Grid Infrastructure home

• External files

• Application binaries

• Not an OS boot FS

Page 22: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 22/31

Oracle Confidential

Managing

Oracle Database Files

ASM Core Enhancements

Page 23: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 23/31

Oracle Confidential

• All files on ASM

• Oracle Cluster Registry,

Voting Disk and SPFILE

• Tunable Performance

• Intelligent Data Placement(IDP)

• Improved Management

• Full Featured ASMCMD

• ASM File Access Control

• ASM Disk Group Rename

• Datafile to Disk Mapping

•Installation &Configuration mgt

• ASM Install & ConfigurationAssistant (ASMCA)

ASM 11g Release 2 New Features

for 

Database Files

Page 24: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 24/31

Oracle Confidential

OCR and Voting Disk on ASM

• OCR is a regular ASM file

• A new ASM file type

• Voting Disk

• Stored in selected ASM disks

• ‘crsctl’ used to specify a disk group for Voting disks

• ASM auto creates1/3/5 Voting Disks based onExt/Normal/High redundancy on Failure Groups

• Quorum failure group

• ASM determines redundancy for OCR and Voting Diskbased on disk group redundancy level

• ASM SPFILE is also supported on ASM now

Page 25: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 25/31

Oracle Confidential

Intelligent Data Placement (IDP)

• Placement of files on high performanceregions of disk• 50% performance difference from outer to

inner tracks

• Classify or mark an ASM file to beHOT/COLD

• Alter diskgroup dgname modify file ‘xxx’attributes HOT/COLD or based on a templates at creation time

• Rebalance to migrate the ‘file’ to HOT/COLDIDP region

• IDP regions are dynamic

• New V$ASMFILE recording IO stats

• The IDP feature better leveraged when ASMdisks are whole disks

Disk Platter 

Hot Files

Cold Files

Page 26: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 26/31

Oracle Confidential

Complete ASMCMD FunctionalityA complete API for the system admin

• Extending ASMCMD to manage:• ASM instance (startup/shutdown, init.ora, .)

• Disk group, disk and failure group (create, mount,add, drop, …)

• Attribute (list, set)

• User/Group (add user, change password, …)

• Template (list, add, alter drop)

• Iostat and df 

•lsof: list files that are open by ASMlsod: list disks that are open by ASM

• Dynamic Volume

Page 27: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 27/31

Oracle Confidential

Other Features

• ASM File Access Control (ACL)• Introducing 3 classes of permissions:

• owner, group, and other 

• ASM Disk Group Rename

• Oracle File Mapping support (OFM)• View mapping of datafiles to physical devices

• 4k sector size disk I/O support• Possible values are: 512b or 4096b (4k)

Page 28: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 28/31

Oracle Confidential

In Summary…

Page 29: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 29/31

Oracle Confidential

One Integrated Solution for ALL Data

Always On-LineOptimal UtilizationScalable

High PerformanceLow CostSimple

Cross PlatformLinux, Windows, Solaris,

HP-UX, AIX

StructuredData

Un-structured

Data

One Vendor for Support

One ManagementInterface

One ClusterwareFramework

One Install andConfigure

ASM Database filesASM Cluster FS

&

Dynamic Volumes

Oracle ClusterwareOracle Database

&

RAC

ACFS Snapshot

S S f C

Page 30: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 30/31

Oracle Confidential

Some ASM Reference Customers In Production

Page 31: Extending ASM to Manage All Your Data

8/8/2019 Extending ASM to Manage All Your Data

http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 31/31

O l C fid i l