Enterprise PostgreSQL - EDB's answer to conventional Databases
44
1 CONFIDENTIAL © 2011 EnterpriseDB. All rights reserved. Will you buy a Ferrari to commute within Makati City everyday?
-
Upload
ashnikbiz -
Category
Technology
-
view
1.034 -
download
1
description
"By default, PostgreSQL is probably the most security-aware database available ...” - Database Hacker's Handbook-David Litchfield
Transcript of Enterprise PostgreSQL - EDB's answer to conventional Databases
1
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Will you buy a Ferrari to commute within Makati City
everyday?
Lock-in
Costly Add-on components
Losing out on other investment opportunities
High maintenance cost
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. A
ll ri
ghts
re
serv
ed.
Does it sound familiar?
Is your Database story the same?
3
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Forced to live with mediocre performance without table partitioning and in-memory tables?
Did you compromise the security of your Database to save cost?
Forced to choose between DR site and Clustering solution due to cost of add-on component?
Are your DBAs struggling with day-to-day maintenance job in absence of enterprise class tools?
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. A
ll ri
ghts
re
serv
ed.
IT Strategic Budget Problem
5
An Overview of PostgreSQL and PPAS
Enterprise Class PostgreSQL Database from EDB
21/3/2014
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
• Independent & Thriving Development Community for over 20 years
• Thousands of active deployments worldwide in public and private sector organizations of all sizes
PostgreSQL and the Community
7
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Postgres’ IMPACT
8
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
• Fast development cycles
• Thousands of developers
• Better code
• Lower cost
• 24/7 support
• Services and training
• Certification
• Indemnification
• Product strategy
Bringing the Advantage to Enterprises
9
Open Source Software
CommercialSoftwareEnterpriseDB
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
About PPAS
10
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
PostgreSQL – Postgres Plus Users, Globally
11
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
12
Malaysia
Philippines
Singapore
Vietnam Thailand
Indonesia
PostgreSQL – Postgres Plus Users, across ASEAN
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Architecture of PostgreSQL
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.Fundamentally same as any other RDBMS with support for vast tech-stack
Architectural Overview
11
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Process Architecture
12
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Stuck with Oracle Database?
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.Oracle Compatibility is made just for you
Oracle Compatibility
17
• Run applications written for Oracle virtually unchanged
• No need to re-train Oracle DBAs and developers
• Support for PL/SQL language and OCI interoperability
• Replication for easy sharing of data
• Dramatic Cost Savings
• No Vendor Lock-in
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
High End Performance Features
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
It’s all Part of the Bundle!No add-ons, no hidden cost
• Infinite Cache- In-Memory Tables for Faster Access
• Developed for High Performance Transaction Environments (OLTP)
• DynaTune: • Dynamic tuning of the database server to make the
optimal usage of the system resources available on the host machine
• Better insert and load performance with Table PartitioningScheme
• Index Advisor: • Helps determine which columns you should index to
improve performance in a given workload.
• Query Optimization Hints, Hi-Speed Bulk Loader, Multi-Threaded Replication
Performance enhancement in PPAS
19
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Scalability with Infinite Cache
20
• Single Machine Performance
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Advanced Server is 16X faster on a single machine with large amounts of memory (e.g. greater than 2 GB)
Infinite Cache can be usedon a single machine!
Best-in-Class Security
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
“By default, PostgreSQL is probably the most security-aware database available ...”
Database Hacker's Handbook- David Litchfield
Security Features
22
• Object level privileges assigned to roles and users
• Virtual Private Database
• Kerberos and LDAP authentication
• Host base authentication
• SSL communication
• Data Level Encryption (AES, 3DES, etc)
• Ability to utilize 3rd party Key Stores in a full PKI Infrastructure
• Foundation for full compliance with the strictest of security standards(PCI Data Security Standard)
• Flexible field level encryption and row level security
• SQL/Protect against SQL Injection Attacks
• EDB Wrap - Obfuscate Logic in Procedures and Packages CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Highly Available Database- with built-in and add-on Replication
and Recovery Features
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Availability
• Multi-Master Replication –Active-Active Technology
• Near real-time Replication
• Multi-Version Concurrency Control (MVCC)
• Point-in-Time Recovery
• Log Shipping for Standby (~ Oracle® Data Guard)
High Availability
24
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
• Streaming Replication – WAL Based replication
• Archive/Log File Based Replication
• xDB and slony Replication – Trigger Based
• Heterogeneous Replication – using xDB Replication Server
• Read Balancing – pgpool and Streaming Replication
• EDB Failover Manager – Management of PPAS Clusters for High Availability
• Multi Master Replication – High Availability or Geographic Load distribution or Geographic Mirror
Replication Solutions
25
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Backup and Recovery Options
26
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
• Physical and Logical Backup
• Logical Backup using pg_dump
• Instance level logical backup using pg_dumpall
• Table level, Schema level or DB level logical backup
• pg_restore
• Physical Backups
• pg_basebackup
• Compressed backup
• Recovery with WAL and archived WAL
• Point in Time Recover
Enterprise Class DBA Tool
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Grow your Datacenter footprint without worrying about management
and maintenance
• Performance Monitoring Dashboards
• Capacity Manager
• Postgres Expert
• Alert Management
• Browser based console and dashboard
• Audit Manager
• Team Support
• Distributed Architecture
• Convenient Access
PEM For DBAs: Centralized Tool
28
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Helps you apply patches and updates for all the EnterpriseDB Products
Stackbuilder Plus
29
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
xDB Single-Master Replication (SMR)
30
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
• Split input files into multiple files
• Load single tables in parallel
• Magnitudes better load time performance
• Parallel load capabilities also in Migration Toolkit and Migration Studio
Parallel Data Loader
31
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Oracle• Data• Schemas• Stored Procedures• Triggers• Functions• Sequences• Packages• Views• Database Links• Synonyms
SQL Server
• Data
• Schemas
• Views
Migration Toolkit- Oracle an SQL Server Migration
32
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
• A solution to aid in the creation of highly available configurations of Postgres
• Monitors the health of a Postgres HA configuration
• Automates the failover process in the event of a failure
• Used in conjunction with Streaming Replication
Postgres Plus Failover Manager
33
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
How to start adoption
34
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
REPLICATION SERVER
BACKUP / DR SERVER
NEW APPLICATION
MIGRATION
You have a ‘Real’ alternative to conventional proprietary Databases
Conclusion
35
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
EnterpriseDB’s
Postgres Plus Advanced Server
is power-packed!
Customer Stories
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Issues in Environment
- Delayed Reports
- Additional Oracle Server for reporting = Extra Cost
- Extra Add-on component needed for Replication between OLTP and Reporting DB
- Reports being pulled from two Databases- ArchiveDB and LiveDB
- No Primary Keys in database to implement change data capture
Solution Suggested
- Migrate Archive DB to Postgres Plus
- Do daily snapshot of changes from Oracle to Postgres Plus
- Use xDB replication for Snapshot
Implementation
- Migrated 1.2TB of Archive and 700MB of Live DB
- 500MB of Differential data replicated on daily basis
- Result – Reports are generated on time!
- OLTP Performance improved due to offloading
A Major Telco in Malaysia improves Reporting Performance with EnterpriseDB
38
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
ToT, Thailand plans to replace Oracle Exadata-TimesTen In-memory database with HP-EnterpriseDB stack
39
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Background
• Largest public sector company in telecom in Thailand
• Has very stringent response time SLA (20ms response time for user requests ~ 3-5 read queries)
• Current setup has Oracle Exadata and four TimeTen In-memory databases
Current Challenges in Oracle Stack
• Issues in sync of Exadata with In-memory databases
• Full refresh locks the tables
• Current system can go upto 1500 tps
• Dynamic Partitioning for huge table
• Current system load is 750 TPS with write operations
• 5000 user requests (16.5K read queries) per second with 4 servers
HP-EnterpriseDB Stack Proposed to be DR for Exadata• HP DL-980 (4 CPU * 10 cores, 256GB RAM)
• 1TB VMA Disks for faster access
• Simulation tests show 2800 write-TPS achieved
• Flexible Partitioning scheme in PPAS (add partition on the fly for
each new date, no manual intervention)
• Currently this server is being tested as DR for Exadata
• Replication using xDB near-relatime replication for 1000 tps
• Scalability achieved using cascaded replication and Infinite Cache
• Setup can handle 5500 user requests (18K queries per second)
with 1.5-2.5ms response time per query
InMobi Delivers Mobile Ads with Postgres
40
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
Background
• One of the fastest growing mobile advertising networks
• Huge scalability and performance requirements, billions of ads per month
• Uses HP Proliant server
Mobile Ad Platform Project
• Postgres the best fit for a scalable open-source
database
• Community support not sufficient to meet business
requirements, EnterpriseDB a partner
• Initial database install supported organic growth
• 25 instances across 4 data centers with replication
• Database sizes upwards of 600 GB
• 200K txns/minute with 3 ms response time
Why Postgres
• Most scalable open-source database
• Lower cost than traditional databases
• Performance and reliability up to the task at internet scale, supporting the most extreme workloads
• Customizations by EnterpriseDB rapidly incorporated into the product ensuring costly customization maintenance is avoided
FTD Replicates Oracle Data for Volume Peaks
Background
FTD is the world’s leading provider of floral-related products and services
Processes 15M+ orders annually through 20,000 retail florists in the US
The ARGO System Project
FTD deployed new shipping administration system (ARGO)
ARGO’s performance deteriorated during peak holiday loads
Oracle-based system couldn’t handle peak reporting volumes
Off-load reporting data form Oracle to Postgres using Postgres Plus Replication Server
Why Postgres
No major changes required to run Oracle apps on Postgres
Project completed in 6 weeks (Valentines Day Mother’s Day)
Out of the Box Compatibility with existing database
Improved Vendor Service – response times decreased dramatically
Performance of order processing systems improved 400% by offloading reporting to Postgres
“When someone comes in at a sixth of the cost [of Oracle]
and 500 times the customer service, that makes it very easy.”
Jason Weiss, Software Architect
Sony Reduces TCO of database environment by 80%
42
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.Free Realms Project
• Lower TCO and improve licensing flexibility
• Leverage existing Oracle DBA and Developer talent
• Migrate key Oracle apps to Postgres
• Commercial-grade quality and reliability, including backup and recovery standards, to support mission-critical applications
• Scalable, high performance execution
Why Postgres
• Reduced TCO by 80%
• East of Migration – majority of Oracle apps could run unmodified on Postgres Plus
• Skills re-use – Oracle – trained staff could immediately work with Postgres Plus
• Exceptional technical support from EnterpriseDB
“Postgres Plus has proven to be a cost-effective database that can accommodate Free Realms’ massive growth.”
- Andy Sites, Free Realms Senior Producer, SOE
Background
• Free Realms massively multiplayer online game
• >9M registered players since April 2009
• IT Oracle scale-up was cost-prohibitive
Background
• Multi-terabyte Oracle DB and needed to reduce DB costs
• Running old, unsupported version of Oracle and had to pay to upgrade
The EPBS Project
• Engaged EnterpriseDB consulting services to migrate
• Unique migration process developed and implemented
Why Postgres
• 2.2 TeraByte system migrated and now running on Postgres Plus Advanced Server
• Current performance is comparable to Oracle
• Costs reduced significantly by migrating to EnterpriseDB solutions
Achieved Comparable Performance Replacing Oracle
43
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
44
CO
NFI
DEN
TIA
L©
20
11
En
terp
rise
DB
. All
righ
ts r
ese
rved
.
