Extending ASM to Manage All Your Data
Transcript of Extending ASM to Manage All Your Data
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 1/31
Oracle Confidential
Extending Automatic Storage Management toManage ALL Data
Oracle Database 11g Release 2Ara ShakianPrincipal Product Manager
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 2/31
Oracle Confidential
The following is intended to outline our generalproduct direction. It is intended for informationpurposes only, and may not be incorporated into anycontract. It is not a commitment to deliver any
material, code, or functionality, and should not berelied upon in making purchasing decisions.The development, release, and timing of anyfeatures or functionality described for Oracle’s
products remains at the sole discretion of Oracle.
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 3/31
Oracle Confidential
Table of Contents
• Storage management challenges
• ASM Overview
• ASM in 11gR2 takes it the next level• What is it
• How does it work
• How do I manage it
• Benefits
• How do I get from here to ASM
• ASM reference customers
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 4/31
Oracle Confidential
Challenges of Managing
Data Explosion
• Lack of a single optimal solution for all data• Lack of automation to reduce complexity
• Managing multiple software layers
• Complexity of managing performance• Eliminating hot spots
• Multi-vendor support logistics and finger pointing
• Reducing storage Total Cost of Ownership
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 5/31
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 6/31
Oracle Confidential
ASM is Storage Management Platform of Choice
An optimal storage management solution for database and general purpose files
ASM Disk
ASM Disk
ASM Disk
ASM Disk
ASM Disk
ASM Disk Group• Simplifies and automates storage management
• Integrated cluster and single node framework
• Storage pooling with easy provisioning
• Optimal performance by default• Best availability and scalability
• Lowest TCO
• Consolidates and eliminates waste
• No additional cost
• Manages ALL data 11.2
Lowers the cost of storage management
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 7/31Oracle Confidential
Dynamic Rebalancing
Benefits:
• On-line capacity management
• Eliminates manual I/O tuning
• Maintain optimal performance
• Storage migration on line
Disk Group
ASM Disk ASM Disk
• Simple provisioning
• Add, drop or resize
ASM Disk ASM Disk ASM DiskASM Disk ASM Disk
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 8/31Oracle Confidential
Enables Storage ConsolidationClustered Pool of Storage
• Shared storage acrossseveral databases• RAC and Single Instance
• Benefits:• Simplified and Centralized
management
• Higher storage utilization• Higher performance
Local Area Network
ERP Database
HR Database
CRM Database
RAC
ASM
RDBMS
ASM
RDBMS
ASM
ASM Disk Group
ERP CRMFIN HR
FIN Database
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 9/31Oracle Confidential
Striping, Mirroring and Performance
• Striping designed to meet• RDBMS I/O characteristics
• General purpose files
• Flexible file-based mirroring• External, Normal and High
• Optimal performance• No tuning
Percentagerelative toBaseline
(TPS)
Non-ASM
ASM
Time
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 10/31Oracle Confidential
Why You Should Care
• Reduced complexity thru automation• No I/O tuning, reshuffling data files
• Simplified solution stack• No finger pointing, 3rd party LVM/FS
• Increases utilization and database and
application uptime• No down-time for storage provisioning or migration
• Managing storage pool vs. islands
• Single vendor cross-platform integrated solution• Bundled and tested as one solution
• Same cross platform tools to install, configure and manage
• No additional cost!
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 11/31
Oracle Confidential
Taking It To The Next Level
WithASM in 11gR2
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 12/31
Oracle Confidential
Oracle Grid Infrastructure(ASM + Oracle Clusterware)
• ASM and Oracle Clusterware integrated and installed ina single ‘Grid Infrastructure’ home
• Integrated installation, configuration and upgrade
• Installed using Oracle Universal Installer (OUI)
• Not a part of database install
• Option to minimally configure ASM and ACFS
• Automate creation of Oracle DB Homes on ACFS
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 13/31
Oracle Confidential
ASM Configuration Assistant (ASMCA)
• Manage ASM before db install
• Upgrade previous versions of ASMto the current version (11g R2)
• One tool to initialize & manage
* Disk Groups* Dynamic Volumes* ACFS file systems
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 14/31
Oracle Confidential
3rd Party FSApplication
Extending ASM to Manage ALL Data
Automatic Storage Management (ASM)
ASM InstanceManagingOracle DB Files
ASM Cluster & SingleNode File System
(ACFS)
Database RAC
ACFS Snapshot
Dynamic Volume Manager
ACFS FSOracle
Bin
3rdPartyFS
DB DatafilesDB DatafilesDatabase files
OCR & Voting files
ASM
Disk
Group
General Purpose FilesDatabase Files
Dynamic Volumes
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 15/31
Oracle Confidential
What is ASM Dynamic Volume Manager
• A new cluster (and single host) volumemanagement service
• Standard disk device interface to clients
• Loadable kernel driver
• Dynamic Volume is a volume file createdin an ASM disk group (new file type‘asmvol’)• An OS device file is created automatically when
a dynamic volume is created• Managed by SQL/ASMCMD and EM
ASM DG
/dev/asm/vol1-123
+DATA/vol1
OS
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 16/31
Oracle Confidential
• General purpose scalable file system
• Journaling, extent based
• Single node and cluster
• POSIX, X/OPEN file system solution for UNIX/Linux
• Windows file system solution for Windows platforms
• Accessible through NAS protocols (NFS, CIFS)• Leverages ASM technology for volume mgt
• Integrated with Oracle Clusterware for cluster support
• Multi OS platform (Linux and Windows at initial release)
• Integrated with Oracle system mgt tools
• Oracle installation and configuration
• Enterprise Manager and ASM Storage mgt tools
• Native OS File System Management tools
What is ASM Cluster File System
(ACFS)
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 17/31
Oracle Confidential
What are ACFS Snapshots
• Dynamic, fast, space efficient, “point in time” read-only
copies of ACFS file system files• Captures ASM FS file block/extent updates
• An enabler for: • On-line, disk-based, file backup model using snapshots• Individual file recoveries
• Up to 64 snapshot images per ASM file system • Policy based snapshots:
Schedule snapshots on an interval basis: every 5seconds, every 30 minutes, daily, …
• Create an ACFS snapshots
• acfsutil snap create snap_name mountp
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 18/31
Oracle Confidential
Leveraging the Power of ASM
• Even distribution of data
• Dynamic provisioning
Dynamic volumes andACFS FS may be resizedleveraging ASM file resize
features% asmcmd volresize dga vol1 -s 50G
• Can also use EnterpriseManager for managementand threshold alerts
+DATA/dga/vol1
3
Primary ASM File Extent
Mirrored ASM file Extents
ACFS File System: /usr1
Linux: /dev/asm/vol1Win: \\.\asm_dgname_volname
ACFS file A
ACFS file B
Mirrored
Mirrored
1
1
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 19/31
Oracle Confidential
Managing the Dymanic Volumes and
ACFS File System
Is Simple And Flexible
1. Native Linux, UNIX, and Windows OS file systemcommands and extensions
2. acfsutil platform independent commands
3. ASM Configuration Assistant (ASMCA)
4. Enterprise Manager
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 20/31
Oracle Confidential
An Example: Creating an ACFS File
System
$ mkfs -t acfs -b 4k /dev/asm/volume1-62 ; Create fs on ASM volume
$ su - root# mount -t acfs /dev/asm/volume1-62 /tmp/images
# su – oracle_usr
$ acfsutil registry -a /dev/asm/volume1-62 /tmp/images
$ mount –t acfs –o all none none ; Mount everything in the registry
$ cd /tmp/images$ cp /home/my_images .
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 21/31
Oracle Confidential
ACFS Use Cases
• Oracle Home• Shared or node-local
• Not Grid Infrastructure home
• External files
• Application binaries
• Not an OS boot FS
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 22/31
Oracle Confidential
Managing
Oracle Database Files
ASM Core Enhancements
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 23/31
Oracle Confidential
• All files on ASM
• Oracle Cluster Registry,
Voting Disk and SPFILE
• Tunable Performance
• Intelligent Data Placement(IDP)
• Improved Management
• Full Featured ASMCMD
• ASM File Access Control
• ASM Disk Group Rename
• Datafile to Disk Mapping
•Installation &Configuration mgt
• ASM Install & ConfigurationAssistant (ASMCA)
ASM 11g Release 2 New Features
for
Database Files
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 24/31
Oracle Confidential
OCR and Voting Disk on ASM
• OCR is a regular ASM file
• A new ASM file type
• Voting Disk
• Stored in selected ASM disks
• ‘crsctl’ used to specify a disk group for Voting disks
• ASM auto creates1/3/5 Voting Disks based onExt/Normal/High redundancy on Failure Groups
• Quorum failure group
• ASM determines redundancy for OCR and Voting Diskbased on disk group redundancy level
• ASM SPFILE is also supported on ASM now
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 25/31
Oracle Confidential
Intelligent Data Placement (IDP)
• Placement of files on high performanceregions of disk• 50% performance difference from outer to
inner tracks
• Classify or mark an ASM file to beHOT/COLD
• Alter diskgroup dgname modify file ‘xxx’attributes HOT/COLD or based on a templates at creation time
• Rebalance to migrate the ‘file’ to HOT/COLDIDP region
• IDP regions are dynamic
• New V$ASMFILE recording IO stats
• The IDP feature better leveraged when ASMdisks are whole disks
Disk Platter
Hot Files
Cold Files
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 26/31
Oracle Confidential
Complete ASMCMD FunctionalityA complete API for the system admin
• Extending ASMCMD to manage:• ASM instance (startup/shutdown, init.ora, .)
• Disk group, disk and failure group (create, mount,add, drop, …)
• Attribute (list, set)
• User/Group (add user, change password, …)
• Template (list, add, alter drop)
• Iostat and df
•lsof: list files that are open by ASMlsod: list disks that are open by ASM
• Dynamic Volume
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 27/31
Oracle Confidential
Other Features
• ASM File Access Control (ACL)• Introducing 3 classes of permissions:
• owner, group, and other
• ASM Disk Group Rename
• Oracle File Mapping support (OFM)• View mapping of datafiles to physical devices
• 4k sector size disk I/O support• Possible values are: 512b or 4096b (4k)
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 28/31
Oracle Confidential
In Summary…
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 29/31
Oracle Confidential
One Integrated Solution for ALL Data
Always On-LineOptimal UtilizationScalable
High PerformanceLow CostSimple
Cross PlatformLinux, Windows, Solaris,
HP-UX, AIX
StructuredData
Un-structured
Data
One Vendor for Support
One ManagementInterface
One ClusterwareFramework
One Install andConfigure
ASM Database filesASM Cluster FS
&
Dynamic Volumes
Oracle ClusterwareOracle Database
&
RAC
ACFS Snapshot
S S f C
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 30/31
Oracle Confidential
Some ASM Reference Customers In Production
8/8/2019 Extending ASM to Manage All Your Data
http://slidepdf.com/reader/full/extending-asm-to-manage-all-your-data 31/31
O l C fid i l