- Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of...
Transcript of - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of...
![Page 1: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/1.jpg)
<Insert Picture Here>
![Page 2: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/2.jpg)
<Insert Picture Here>
Live on Oracle Database 11g XML DB
Carlo Tiu (NCPA)Geeta Arora (Oracle)Bhushan Khaladkar (Oracle)
![Page 3: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/3.jpg)
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
![Page 4: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/4.jpg)
Agenda
• XMLDB 11.2 enhancements– Schema and XQuery– Structured usecases– Semistructured and Unstructured
usecases– Repository
• NCPA demo
![Page 5: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/5.jpg)
XML Use Cases
“Data-Centric”Static Schema
withOccasionalVariability
No ANY or MIXED
content
Structured
“Variable Data”Dynamic
& ComplexSchema
Islands of ANY or MIXED
content
SemiStructured
“Doc-centric”No Schema
Variable&
FlexibleSchema
RepeatingANY & MIXED
content
Unstructured
![Page 6: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/6.jpg)
Agenda
• XMLDB 11.2 enhancements– Schema and XQuery– Structured usecases– Semistructured and Unstructured
usecases– Repository
• NCPA demo
![Page 7: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/7.jpg)
XML Schema Enhancements
• Schema registration performance– Eliminate internal and external memory fragmentation– Optimized schema loading– Time and memory improved by 50x for US-GAAP, HL7,
NIEM
• Schema Validator Cache– Improves XML schema validation by around 5x, more for
small docs
• Can handle complex industry schemas– GJ-XML, GML, US GAAP, NIEM, HL7, FixML, MPEG-7, KML– ACORD, SDMX, FPML, Reed, OAGIS, MPEG7: Binary & O-R
![Page 8: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/8.jpg)
XML SchemaPerformance Improvements over 11gR1
7.9x
4.1x
6.4x
10.5x
2.4x
4x
1.7x
2.7x
0
2
4
6
8
10
12
Registration Validation Insert/Load Update
Elapsed Time ImprovementMemory Improvement
Avg. improvement for NIEM, HL7, US GAAP, FPML
![Page 9: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/9.jpg)
XQuery and SQL/XML Storage Independent Enhancements
• XQuery 1.0 / SQL/XML standard compliant• Handling Large XQueries
– Re-write enabled for large size Xquery (upto 32K)– 8x increase in size and complexity of supported
XQuery operations• 20x improvement in functional evaluation of
Xquery• Up to 60x improvement for XML Generation
from relational data
![Page 10: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/10.jpg)
Agenda
• XMLDB 11.2 enhancements– Schema and XQuery– Structured usecases– Semistructured and Unstructured
usecases– Repository
• NCPA demo
![Page 11: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/11.jpg)
Object-Relational StorageEnhancements
• Inheritance constructs like xsi:type and “instance of” now rewrite
• Default storage of collections is “table” across the board
– leads to relational query performance• Document ingestion and fragment retrieval
faster and more scalable
![Page 12: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/12.jpg)
Ingestion of Large Documents in Object-Relational Storage
• Files upto 4G can be ingested in an O-R table – up from 500M pre-11gR2
• “Direct Insert” : Greedily flushes document fragments directly to destination tables
• Scalable and Performant– Minimizes fragments in memory
• Applied when documents are uploaded to XDB using
– FTP protocol– PL/SQL function DBMS_XDB.createResource
![Page 13: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/13.jpg)
Agenda
• XMLDB 11.2 enhancements– Schema and XQuery– Structured usecases– Semistructured and Unstructured
usecases– Repository
• NCPA demo
![Page 14: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/14.jpg)
XMLIndex Table-based (New in 11gR2)Example
<Address><city>Fremont</city><state>CA</state>
</Address>….
<Address><bold> <city>Melbourne</city></bold> <font size=“21”>
<state><!– state is not in US --></state></font><country>Australia</country>
</Address>
XML Data XMLTable Index
Key City State Country
10 Fremont CA
20 Melbourne Australia
![Page 15: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/15.jpg)
• Complements Path based XML Index• Project commonly searched structured data into a
table• Secondary relational indexes can be created on
top of index content tables• Text Index can be created on projected text
column– Speed up text search in XML content
• Rewrites queries for relational performance
XMLIndex Table-based
![Page 16: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/16.jpg)
XMLIndex Path-basedEnhancements
• Partitioning, parallel index creation and parallel query supported
• Physical rewrite for path subsets• Many queries improve 5-20x• Asynchronous DML performance improves 2.5x
![Page 17: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/17.jpg)
Binary XML Enhancements
• Improved query performance without indexes• New Search based decoder • Document level Summary• Improved XPath Caching
• Improved End to End Binary XML performance for Thin and OCI drivers
• Caching of Tokens on the client side.
4x3.75x
3.3x
5.16x
0
1
2
3
4
5
6
Schema Based Non Schema Based
THIN DriverOCI Driver
![Page 18: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/18.jpg)
Agenda
• XMLDB 11.2 enhancements– Schema and XQuery– Structured usecases– Semistructured and Unstructured
usecases– Repository
• NCPA demo
![Page 19: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/19.jpg)
XML DB RepositoryEnhancements
• Secure files for all repository content• Create Operations
– Improved creation performance of documents conforming to system schemas (ACLs etc).
– Avoid creating intermediate DOMs while creating resources
– Optimized in-memory structures• Retrieval
– Improved resource_view queries where predicates involve equals_path and under_path – 3x improvement.
– Avoid copies during full retrieval of documents - 2-3x improvement.
• Delete– ACL Deletion performance increase by 5x using ACL OID
Index on resources.
![Page 20: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/20.jpg)
XML DB RepositoryPerformance Improvements over 11gR1
1.5x1.1x
1.6x
3x 3.3x
1.5x1x
1.4x
3x
5x
0
1
2
3
4
5
6
Non-XML
![Page 21: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/21.jpg)
Agenda
• XMLDB 11.2 enhancements– Schema and XQuery– Structured usecases– Semistructured and Unstructured
usecases– Repository
• NCPA demo
![Page 22: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/22.jpg)
• NCPA supplies and purchases power from the California grid on behalf of it’s members
• Settlement system leverages SOA and XML• “XML DB Short Circuits the Data Transformation”
– NCPA is able to process large volumes of XML using commodity hardware
– System has proven flexible and adjusts quickly to ongoing changes
– Source code available as ‘open-source’ – being adopted by other market participants
• In-house solution developed at a fraction of the cost of an off-the-shelf solution
• Currently live on 11gR1 with RAC
Northern California Power Agency (Structured)
![Page 23: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/23.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
1
Live on Oracle Database 11g XML DB
Presented by:
Carlo TiuSenior Programmer, NCPA
[email protected] 651 Commerce Drive, Roseville, CA 95678
ORACLE OpenWorld US 2009San Francisco, CA
October 11-15, 2009
![Page 24: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/24.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
Brief Background on NCPA
NCPA supplies and purchases in the California grid on behalf of it’s 16 cities in Northern California
Our load is about 1000 MW We celebrate 41 years of service this year Our members’ value is derived in large part from: Our ability to be a cost leader Our ability to be agile under different market conditions
and regulations
October 25, 2009 2
![Page 25: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/25.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
Start of XMLDB Project
CAISO was formed in 1997 as a result of market restructuring in California
The meltdown of 2000 formed the basis for the current Market Redesign.
The aging equipment at the CAISO was the basis for a system refresh of the equipment and technology under MRTU.
Web Services, B2B Communication and XML Payload Delivery
October 25, 2009 4
![Page 26: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/26.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
Project Challenges for NCPA and MRTU
MRTU Challenges Evolving
Requirements Complex Market Large Payloads
Business Challenges High Reliability Agility Built In Cost Control
October 25, 2009 5
![Page 27: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/27.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
XML DB Short Circuits the Data Transformation
XML DB Register XSD Load XML Write Queries
Traditional Approach Design Tables Build Tables Parse Data Write Queries
October 25, 2009 6
![Page 28: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/28.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
DEMO XML Schema Registration XMLType tables generated from the registration Loading XML Instances Xquery Views In-Place Schema Evolution Copy-Evolve Schema Evolution Schema-Based Binary XML
October 25, 2009 7
![Page 29: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/29.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
November 12, 2007 8
BillDeterminantData.xsd Schema Evolution
OLD
NEW
Solution: DBMS_XMLSCHEMA.InplaceEvolve()
![Page 30: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/30.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
November 12, 2007 9
StatementData.xsd Schema Evolution
NEW
Solution: DBMS_XMLSCHEMA.CopyEvolve()
OLD
![Page 31: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/31.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
Major Systems Built
26 Different Systems Were ImpactedMajor Systems Built For MRTU: Bidding System Settlement System Master File System Dispatch Retrieval System
October 25, 2009 10
![Page 32: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/32.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
Costs Hardware, Software, and Third Party
Components $300 thousand (one time cost)
Labor (two year effort) $900 thousand (internal)
$1.2 Million Invested $250K Per System…..A Real Bargain
October 25, 2009 11
![Page 33: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/33.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
Hardware and Software Configuration
64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software is Oracle Database
11g Release 11.1.0.7.0 – 64bit Production
October 25, 2009 12
![Page 34: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/34.jpg)
N O R T H E R N C A L I F O R N I A P O W E R A G E N C Y
End
October 25, 2009 13
![Page 35: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/35.jpg)
The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
![Page 36: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/36.jpg)
For More Information
search.oracle.com
ororacle.com
![Page 37: - Oracle Cloud · 64-bit Windows Server 2003 SP 2 on 2 Intel Xeon 5160 dual-core CPUs, with 8 GB of RAM. The database is 220 GB (today). The Oracle software](https://reader035.fdocuments.in/reader035/viewer/2022070906/5f768a18f99a715bd15ef1ee/html5/thumbnails/37.jpg)