Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes...
Transcript of Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes...
![Page 1: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/1.jpg)
Oracle Spatial Summit 2015
Performance Gains with Spatial & Graph Using Oracle Database 12c Steve Pierce, CEO Think Huddle
Nick Salem, Distinguished Engineer Neustar
![Page 2: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/2.jpg)
Think Huddle and Neustar Performance Gains with 12c /
OVERVIEW • “Big Data” and its impact on Spatial performance • Testing configurations • Use cases / techniques for improving performance • Performance improvement data
CHALLENGES / OPPORTUNITIES • With 11g, performance sometimes limited interactions
with Big Data • Making improvements was time-consuming
SOLUTIONS • Oracle Database 12c Enterprise Edition
• Spatial Option with GeoRaster, Network Data Model • Partitioning
• Oracle Fusion Middleware 11.1.1.7 • MapViewer
• Oracle Business Intelligence Enterprise Edition
RESULTS • Achieving at least 2x performance improvement – in
some cases up to 300x improvement • Only small configuration changes are needed • Time to develop and maintain these solutions is reduced
0 500
1,000 1,500 2,000 2,500 3,000 3,500 4,000 4,500 5,000
11g 12c 12c SVA
6.5x faster performance 11m 53s vs 1hr 17m 26s
![Page 3: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/3.jpg)
Oracle Spatial Summit 2015
Speaker Bio
• Oracle Spatial and MapViewer • Big Data and BI for Spatial • Fortune 500 clients
• Steve Pierce • Chair – Oracle Spatial SIG • 15 years Oracle
• Internet, telco, information services, retail, media and advertising industries
• Publicly held - $902M+ company • Extensive data assets (4 billion phone
numbers, 2.8 billion IP addresses, etc.) • 20 billion requests a day (DNS, text
messages, phone) • Nick Salem
• Technical Chair – Oracle Spatial SIG • 16 years Oracle
![Page 4: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/4.jpg)
Oracle Spatial Summit 2015
The Spatial & Graph SIG • The SIG promotes interaction
and communication that can drive the market for spatial technology and data
• Members connect and
exchange knowledge via online communities and at annual conferences and events
• Meet us at the Summit
Morning Reception Tuesday and Wednesday 7:45 to 8:30 a.m. Registration Area
Social Hour Wednesday 6 to 7 p.m. Registration Area
• Join us online – LinkedIn (search for “LinkedIn Oracle Spatial”) – Google+ (search for “Google+ Oracle Spatial”) – IOUG SIG (sign up for free membership through
www.ioug.org) – OTN Spatial – Communities (search for “Oracle Spatial and
Graph Community”) • Contact the Board at [email protected]
![Page 5: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/5.jpg)
Oracle Spatial Summit 2015
Agenda • Big Data: What’s the big deal? • Testing configurations • Use cases and performance data • Q&A
![Page 6: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/6.jpg)
Oracle Spatial Summit 2015
What’s the Big Deal? • Data growing
• Big Data systems for spatial processing
• Fundamental changes in 12c • Faster vector algorithms • Better caching • Improved memory management
• 12c works for Big Data • (and maintains data integrity • … and keeps data secure • … and supports relational integrity • … and your users can access it)
BIG DATA
![Page 7: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/7.jpg)
Oracle Spatial Summit 2015
Test Environment Environment
Oracle 11g
Oracle 12c
OS Oracle Linux 6.5 Oracle Linux 6.5
Processor E5 Xeon 2.9Ghz x 2
E5 Xeon 2.9Ghz x 2
Disk Intel SSD s Intel SSD s
Memory 32GB 32GB
Huge Pages Yes Yes
SGA/PGA 8GB/2GB 8GB/2GB
Source data Census / Generated
Census / Generated
• 1 Server – 2 Oracle Databases
![Page 8: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/8.jpg)
Oracle Spatial Summit 2015
Aggregation of census tracts into larger geometries based on neighbor relationships
INTERACT UNION
Use Case: Geometry Aggregation
![Page 9: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/9.jpg)
Oracle Spatial Summit 2015
• Each Census tract in Virginia • Aggregate Union of Neighbors
• SDO_ANY_INTERACT + SDO_AGGR_UNION • 2,000 Aggregations • Tracts have 7 neighbors = 14,000 tracts • 280 tracts processed per second
0
50
100
150
200
250
300
350
11g 12c 12c SVA
Elapsed Time (s)
Use Case: Geometry Aggregation
![Page 10: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/10.jpg)
Oracle Spatial Summit 2015
Use Case: Joins Which objects are in which region?
And there?
What’s in there? And here?
![Page 11: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/11.jpg)
Oracle Spatial Summit 2015
Use Case: Joins
• SDO_JOIN – For bulk joins • sdo_join('LARGE', 'GEOM', 'STATES',
'GEOM', 'mask=anyinteract'
• Works in 11g
• Faster in 12c
0
100
200
300
400
500
600
700
11g 12c 12c SVA
Elapsed Time (s)
![Page 12: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/12.jpg)
Oracle Spatial Summit 2015
Neustar’s ElementOne Platform Geospatial Analytics in the Cloud
• Highly flexible and high performance mapping
• Rich market and trade area capability • Road network / drive time analysis • Heat themes • GeoRaster images • Aerials / terrain map overlays • Scalable and high performance data
retrieval • Centralized secure data repository
![Page 13: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/13.jpg)
Oracle Spatial Summit 2015
• Oracle VM Server 3.0 (Xen version 4.1 PVM) • Created 2 identical VMs with Oracle Linux 6.5
• Installed Oracle 11g on one and 12c on the other
• Database configuration • 8G of SGA / 2G of PGA • 4 x 8 Core CPUs (Intel Xeon 2.70GHz)
• Loaded core ElementOne database on each • Compare 11g to 12c w/ & w/o spatial vector acceleration
Neustar’s ElementOne Platform 11g vs. 12c Test Benchmark Environment
![Page 14: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/14.jpg)
Oracle Spatial Summit 2015
Neustar’s ElementOne on 12c SDO_AGGR_UNION – CA ZIPs
• Use case consisted of aggregating all ZIP Codes in California using plain SDO_AGGR_UNION and with mod/group by functions
• Achieved up to 300x faster performance w\ SDO_AGGR_UNION and 40x faster with mod/group by method in12c with SVA enabled vs 11g
• Reduced elapsed time from 1 hour 54 seconds to just 12 seconds
0 500
1,000 1,500 2,000 2,500 3,000 3,500 4,000
11g 12c 12c SVA
Elapsed Time In Seconds
Using SDO AGGR UNION
SDO AGGR UNION + Mod/Group
![Page 15: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/15.jpg)
Oracle Spatial Summit 2015
Neustar’s ElementOne on 12c SDO_TOUCH – CA ZIPs touch BGs
• For all California ZIP codes, retrieve the block groups that they touch
0
50
100
150
200
250
11g 12c 12c SVA
8x faster performance 25s vs 3m 23s
SDO_TOUCH
![Page 16: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/16.jpg)
Oracle Spatial Summit 2015
Neustar’s ElementOne on 12c SDO_WITHIN_DISTANCE Benchmarks
• For 544 super regional shopping centers, retrieve all businesses with a 10-mile radius
0 100 200 300 400 500 600 700 800 900
1,000
11g 12c 12c SVA
6x faster 2m 17s vs 14m 32s
SDO WITHIN DISTANCE
![Page 17: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/17.jpg)
Oracle Spatial Summit 2015
Neustar’s ElementOne on 12c SDO_JOIN – ZIP & Block Group Tables
• Join using mask=anyinteract
0 500
1,000 1,500 2,000 2,500 3,000 3,500 4,000 4,500 5,000
11g 12c 12c SVA
6.5x faster performance 11m 53s vs 1hr 17m 26s
SDO_JOIN
![Page 18: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/18.jpg)
Oracle Spatial Summit 2015
Neustar’s ElementOne on 12c SDO_CS.TRANSFORM – US block groups
0 200 400 600 800
1,000 1,200 1,400 1,600
11g 12c 12c SVA
10x faster performance 2m 10s vs 22m 26s
SDO CS Coordinate Transform
![Page 19: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/19.jpg)
Oracle Spatial Summit 2015
Neustar’s ElementOne on 12c Oracle Spatial - 12c Benchmarks
• 3x faster using SDO_GEOM.RELATE to determine topological relationship for CA ZIPs and surrounding BGs
• 2.6x faster using SDO_GEOM.DISTANCE to calculate distances between a site and surrounding 112k sites
• 2.1x faster using SDO_INSIDE to retrieve all businesses inside NY block groups
• 1.8x faster using VALIDATE_GEOM to validate all US county geometries
![Page 20: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/20.jpg)
Oracle Spatial Summit 2015
![Page 21: Oracle Spatial Summit · 2015-02-24 · 2015 . The Spatial & Graph SIG • The SIG promotes interaction and communication that can drive the market for spatial technology and data](https://reader034.fdocuments.in/reader034/viewer/2022042803/5f44b804c52d3424876d5d17/html5/thumbnails/21.jpg)
Oracle Spatial Summit 2015