Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle...

22
OVERVIEW Comprehensive cloud based GIS analytics platform Feature rich, secure and highly scalable application Provide rich data and cutting edge analytics to help clients acquire, retain and grow high value customers CHALLENGES / OPPORTUNITIES Need for 200% improvement in performance for batch spatial reporting needs Faster processing time for core spatial operations Faster query response time for large customer and transaction level datasets SOLUTIONS Oracle Database 12c Enterprise Edition Spatial Option with GeoRaster, Network Data Model Partitioning Real Application Clusters Advanced Security Option Oracle Fusion Middleware 11.1.1.7 MapViewer RESULTS Achieved up to 300x performance improvement for aggregating spatial geometries 10x performance gains in processing coordinate transformations Up to 8x performance improvement for spatial touch interaction queries 4x performance gains in spatial dataset join operations Up to 2.6x faster distance calculations Consolidation of vector, raster, network data in 1.5 TB sized central repository Neustar’s ElementOne on Oracle 12c Insert

Transcript of Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle...

Page 1: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

OVERVIEW •  Comprehensive cloud based GIS analytics platform •  Feature rich, secure and highly scalable application •  Provide rich data and cutting edge analytics to help clients

acquire, retain and grow high value customers

CHALLENGES / OPPORTUNITIES •  Need for 200% improvement in performance for batch

spatial reporting needs •  Faster processing time for core spatial operations •  Faster query response time for large customer and

transaction level datasets

SOLUTIONS •  Oracle Database 12c Enterprise Edition

•  Spatial Option with GeoRaster, Network Data Model •  Partitioning •  Real Application Clusters •  Advanced Security Option

•  Oracle Fusion Middleware 11.1.1.7 •  MapViewer

RESULTS •  Achieved up to 300x performance improvement for

aggregating spatial geometries •  10x performance gains in processing coordinate

transformations •  Up to 8x performance improvement for spatial touch

interaction queries •  4x performance gains in spatial dataset join operations •  Up to 2.6x faster distance calculations •  Consolidation of vector, raster, network data in 1.5 TB

sized central repository

Neustar’s ElementOne on Oracle 12c

Insert

Page 2: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Oracle Spatial Summit Presentation

Page 3: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

May 2014 Oracle Spatial Summit

Page 4: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

May 21, 2014 Walter E. Washington Convention Center

Washington, DC USA

Page 5: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Nick Salem Distinguished Engineer Neustar

Page 6: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s Experience with Oracle Spatial & Graph 12c

Page 7: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Program Agenda

• Neustar / ElementOne Introduction •  11g vs 12c Test Benchmark Environment •  Spatial Aggregations Benchmarks •  Spatial Utility Function Benchmarks •  Spatial Query Benchmarks •  Various 12c Performance Enhancements

Page 8: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar Corporate Overview

•  Trusted company serving the internet, telco, information services, retail, media and advertising industries

•  Publicly held - $902M+ Company •  1,600+ employees worldwide – HQ’d in Sterling, VA •  Extensive data assets (4 billion global phone numbers,

2.8 billion global IP addresses, 6.4 million global domain names and 13.1 US business listings)

•  20 billion requests a day (DNS, text messages, phone)

Real Intelligence. Better Decisions

Page 9: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne Platform Geospatial Analytics in the Cloud

•  Highly flexible and high performance mapping

•  Rich market and trade area capability •  Road network / drive time analysis •  Heat themes •  GeoRaster images •  Aerials / terrain map overlays •  Scalable and high performance data

retrieval •  Centralized secure data repository

Page 10: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne Platform

• Oracle VM Server 3.0 (Xen version 4.1 PVM) • Created 2 identical VMs with Oracle Linux 6.5

–  Installed Oracle 11g on one and 12c on the other

• Database configuration –  8G of SGA / 2G of PGA –  4 x 8 Core CPUs (Intel Xeon 2.70GHz)

•  Loaded core ElementOne database on each • Compare 11g to 12c w/ & w/o spatial vector acceleration

11g vs 12c Test Benchmark Environment

Page 11: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_AGGR_UNION – CA ZIPs

•  Use case consisted of aggregating all ZIP Codes in California using plain SDO_AGGR_UNION and with mod/group by functions

•  Achieved up to 300x faster performance w\ SDO_AGGR_UNION and 40x faster with mod/group by method in12c with SVA enabled vs 11g

•  Reduced elapsed time from 1 hour 54 seconds to just 12 seconds

0  500  

1,000  1,500  2,000  2,500  3,000  3,500  4,000  

11g   12c  12c  SVA  

Elapsed  Time  In  Seconds  

Using  SDO  AGGR  UNION  

SDO  AGGR  UNION  +  Mod/Group  

Page 12: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_AGGR_SET_UNION – CA ZIPs

0  

50  

100  

150  

200  

11g   12c  12c  SVA  

14x  faster  performance  12s  vs  2m  51s  

SDO  AGGR  SET  UNION  

Page 13: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_CS.TRANSFORM – US block groups

0  200  400  600  800  

1,000  1,200  1,400  1,600  

11g   12c  12c  SVA  

10x  faster  performance  2m  10s  vs  22m  26s  

SDO  CS  Coordinate  Transform  

Page 14: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_TOUCH – CA ZIPs touch BGs

•  For all California ZIP codes, retrieve the block groups that they touch

0  

50  

100  

150  

200  

250  

11g   12c  12c  SVA  

8x  faster  performance  25s  vs  3m  23s  

SDO_TOUCH  

Page 15: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_JOIN – ZIP & Block Group Tables

•  Join using mask=anyinteract

0  

1,000  

2,000  

3,000  

4,000  

5,000  

11g   12c  12c  SVA  

6.5x  faster  performance  11m  53s  vs  1hr  17m  26s  

SDO_JOIN  

Page 16: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_WITHIN_DISTANCE Benchmarks

•  For 544 super regional shopping centers, retrieve all businesses with a 10 mile radius

0  

200  

400  

600  

800  

1,000  

11g   12c  12c  SVA  

6x  faster  2m  17s  vs  14m  32s  

SDO  WITHIN  DISTANCE  

Page 17: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_GEOM.RELATE – CA ZIPs & BGs

•  Determine spatial topological relationship for California ZIP codes and surrounding block groups

0  50  

100  150  200  250  300  350  400  450  

11g   12c  12c  SVA  

3x  faster  performance  16s  vs  7m  2s  

SDO_GEOM  RELATE  (mask  =  determine)  

Page 18: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_GEOM.DISTANCE Benchmarks

•  Calculate distances between a single site and 112,610 surrounding sites

0  

50  

100  

150  

200  

250  

11g   12c  12c  SVA  

2.6x  faster  performance  1m  13s  vs  3m  11s  

SDO_GEOM  DISTANCE  

Page 19: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_INSIDE – Businesses inside NY BGs

•  Retrieve all businesses inside New York state block groups

0  

50  

100  

150  

200  

11g   12c  12c  SVA  

2.1x  faster  performance  1m  22s  vs  2m  53s  

SDO_INSIDE  

Page 20: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on 12c SDO_GEOM.VALIDATE_GEOM Benchmarks

•  Validate all US county geometries

0  5  10  15  20  25  30  35  

11g   12c  12c  SVA  

1.9x  faster  performance  15s  vs  29s  

SDO_GEOM  Validate  Geometry  with  Context  

Page 21: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Neustar’s ElementOne on Oracle 12c

• Reduction in redo/undo generation using global temporary tables resulting in 1.7x performance boost

•  2x performance gains with inline PL/SQL functions • Up to 10x faster processing time with constructing large

CLOBs / BLOBs •  Faster response times with cross session result set

cache

Miscellaneous 12c Features

Page 22: Neustar’s ElementOne on Oracle 12c · Neustar’s ElementOne on Oracle 12c Insert . Oracle Spatial Summit Presentation . May 2014 Oracle Spatial Summit . May 21, 2014 Walter E.

Q&A