2009/11 Database Architechs Presentation

47

Click here to load reader

Transcript of 2009/11 Database Architechs Presentation

Page 1: 2009/11   Database Architechs Presentation

Database Architechs

November, 2009

Page 2: 2009/11   Database Architechs Presentation

Operations• USA (17 years) • and France (10 years)• Database/Data Architecture

– Sybase– Oracle– Microsoft SQL Server– DB2, Postgres, MySQL, and others …

• Database talent pool:– Top database experts from around the globe.– Acclaimed Authors.– Speakers to many events and conferences.

• Database Tools: P&T Tool - highly graphical (Sybase, Oracle and MS SQL Server)

• Database Education & Training

Page 3: 2009/11   Database Architechs Presentation

Our strengthsDatabase Architechs global consulting team has delivered hundreds of high scale, high impact database, data architecture, high availability and performance and tuning engagements.

Our strengths are:• Database Design and Data Analysis/Modeling• Distributed Data Architectures/Data Replication• Database Encryption/Security Frameworks• High Availability, Disaster Recovery/Business Continuity • Database and SQL Performance & Tuning• Data Standards and Governance• Delivery on time and within budget• Extreme Quality of deliverables• Knowledge Transfer and Education

Page 4: 2009/11   Database Architechs Presentation

Our value propositionOur services are database-focused and include inexpensive 2-day assessments moving you down the path to:

• Reducing your overall costs. • Achieving high availability and scalability. • Meeting or exceeding your service level requirements. • Allowing you to put off server and storage purchase

because of better utilization of what you have. • Enabling server and database consolidations. • Using our data expertise surgically for short bursts with

highly skilled and experienced data professionals. • Optimally designing and architecting your data to meet

your company's needs.

Page 5: 2009/11   Database Architechs Presentation

Our Consulting Focus • Database Consulting:

– Database Architecture– Database Design– Data Modeling & Data Analysis– Database & SQL Performance & Tuning– Distributed Data & Data Replication – Data Integration & Transformation– Data Warehouse

& Business Intelligence– Database High Availability– Master Data Management– Metadata Management– Disaster Recovery

& Business Continuity– Database Security & Compliance– Database Education & Training– Database Performance & Tuning tools

• High Availability Consulting:– HA Assessments– HA Design/Architecture– HA Build-outs– Mirroring, Snapshots …

• Enterprise Architecture – EA Tools– EA Organization, Roles,

Responsibilities– Architecture

• Education and Training– SQL training– Data Modeling– P&T training– Data Replication training– Physical DB Design– Multi-dimensional OLAP– Process Modeling

Page 7: 2009/11   Database Architechs Presentation

Our past and upcoming Events

PASS Summit 2009 – Seattle, Nov 2-5

Oracle OpenWorld – SF, Oct 11-15

MDM Summit – San Francisco, Aug 24-26

MS SQLSUG – San Diego, Aug 20

SQL Saturday – Portland, Jun 6

MS SQL Server 2008 Migration WS – SF, April 29

MS SQLS UG – Portland, Apr 23

MS SQLS UG – Silicon Valley, Feb 17

MS SQLS UG – SF, Feb 11

Page 8: 2009/11   Database Architechs Presentation

Our past and current customers• Healthcare:

• AGIS Network• Breg International

• Finance:• Visa International• Bank of America• Charles Schwab• Merrill Lynch• Robert Half• Wells Fargo

• Insurance:• CSAA

• Education:• Aplia• Thomson Learning

• Retail:• Safeway Stores

And many others around the world

• High Tech Industry:• Apple Computers• Applied Materials• Cisco• Intel• Juniper Networks• Metalinc• Silicon Graphics• Sybase• Symantec Corporation• Toshiba Computers• Veritas

• Automotive Industry:• Nissan Motors• Honda Motors

• Others:• PG&E• Federal Express

Page 9: 2009/11   Database Architechs Presentation

Methodology Oriented“Data by Design”

Elaboration

Initial assessment- Project Planning- Project Sizing- Deliverables Identified- Schedules/milestones- High-Level Data needs

Requirements- Detail Requirements - Data details identified- Dirty data/cleansing

requirements- data integration identified

High-level Requirements/Prototyping- High-level requirements - Prototyping- Designs/integrations

Design- Detail DB/Architecture Designs- Data Integration designs/architecture

Early Code & Test- Early code and testing of integration/DB- Heavy use of Data prototypes/profiling

Code & Test- Code Dev/Unit Testing- Database Coding- Database Testing

System Test-Acceptance- Full Test/User Acceptance- Full Integration/ Verification/Acceptance

Implementation- Production Build/Implementation

Inception

Construction

Transition

Page 11: 2009/11   Database Architechs Presentation

Database Architecture

Complete or subset data architecture creation for current and the future (strategic) data architectures of any complexity.

Our data architects have done this for multi-billion dollar companies such as Symantec, Veritas, SGI, and others.

Page 12: 2009/11   Database Architechs Presentation

References/Examples• SGI – Quote to Collect – Data Architecture lead,

multi-dimensional OLAP, DW/BI Architecture, Data Integration

• Veritas – Data Architecture, standards, movement to data services/SOA, and data methodology

• Symantec – Data Architecture, Master Data Management, Architecture Guiding Principles, Data Standards, and SOA.

• Many others.

Page 13: 2009/11   Database Architechs Presentation

Database DesignOptimized database design and implementation of large and small, simple and complex database systems using:• DB2, • Oracle, • Microsoft SQL Server, • Sybase, • MySQL, • Informix, • Postgres, • and massively parallel database

architectures such as ParAccel, Green Plum, Netezza, and others.

Working with the top database designers in the world.

Page 14: 2009/11   Database Architechs Presentation

References/Examples• Charles Schwab – Performance and Tuning,

Database redesigns (Oracle/SQL Server)• Intel Corporation – OLTP Marketing database

design, Performance and Tuning, Sales & Marketing data warehouse (SQL Server)

• JDSU – Instrument test results data collection, data replication, data warehouse (Oracle/SQL Server)

• Toshiba – Demand Planning OLAP multi-dimensional cube design, data integration

• Author of Sybase’s “Physical Database Design” methodology and courseware.

Page 15: 2009/11   Database Architechs Presentation

Data Modeling & Data AnalysisCapturing even the most complex data requirements into well defined and robust data models coupled with full data analysis and validation of all objects/entities. A few of our data modelers apprenticed under the originator of data modeling (Dr. Peter Chen – father of entity/relationship modeling).

Page 16: 2009/11   Database Architechs Presentation

References/Examples• Intel Corporation – Data modeling/data analysis

sales and marketing• Sony Corporation – Data modeling/Object models

for geospatial and mapping technologies• AGIS – Full Logical data models/physical data

models of health provider• Lnx Research – Entity/Relationship Models/Behavior

models for researcher/provider/ratings• PG&E – Complex Entity/Relationship models of

there financial data/revenue systems.• Many others.

Page 17: 2009/11   Database Architechs Presentation

Database & SQLPerformance and Tuning

Industry leading performance and tuning tools coupled with the deepest Performance and Tuning experts on most major database platforms. Database tuning, indexing strategies, SQL performance.

Page 18: 2009/11   Database Architechs Presentation

References/Examples• Intel Corporation – VLDB database performance

and tuning.• Metalincs – Database and SQL tuning (SQL Server)• Channel Corporation – Oracle Database & PL/SQL

Performance and Tuning.• Charles Schwab – Database and SQL Performance

and Tuning (Sybase and SQL Server).• Author of Sybase’s “Performance and Tuning”

methodology.• SQL Server Unleashed – Performance and Tuning

Page 19: 2009/11   Database Architechs Presentation

Distributed Data & Data ReplicationOur experts excel in multi-site distributed solutions and design using various technology solutions from replication, to mirroring, to log shipping. Mitigating architectures and load balancing.

Page 20: 2009/11   Database Architechs Presentation

References/Examples• JDSU – heterogeneous data replication (SQL Server

to Oracle)• AMD – Master/Master symmetric replication (Oracle)• Intel Corporation – Central Publisher/Subscriber

(SQL Server Replication)• Symantec Corporation – Central Publisher

/Subscriber (SQL Server Replication)• Many others.

Page 22: 2009/11   Database Architechs Presentation

Database ConsolidationUsing a proven step-by-step methodology, helping in:• Leveraging your existing IT architecture and investments. • Reengineering, Consolidating, and redesigning your data architecture to

better use what you have. • Optimizing your entire database layer for performance, stability, and

availability. • Reducing your IT expenses and putting off those planned server and

storage purchases. • Focusing on enabling you to better serve your internal and external

customers.

Page 23: 2009/11   Database Architechs Presentation

Data Integration & TransformationDecades of ETL, EAI and other data integration solutions for data migration, data warehouse, data marts, and data synchronization requirements.

Page 24: 2009/11   Database Architechs Presentation

References/Examples• JDSU – Data transformation Services/SQL Server• Intel Corporation – Data Transformation

Services/SQL Server• Sony Corporation – SSIS/SQL Server• SGI – Informatica/SQL Server/Oracle• Many others.

Page 25: 2009/11   Database Architechs Presentation

Data Warehouse &Business Intelligence

Snow-flake, Star-schema, multi-dimensional OLAP cubes. Using most major DBMS offerings from Microsoft, Oracle, IBM and others.

Page 26: 2009/11   Database Architechs Presentation

References/Examples• Intel Corporation – Sales and Marketing DW/BI• Toshiba Corporation – Multi-dimensional OLAP

demand planning and Forecasting• Apple Computers – Multi-dimensional OLAP

demand planning and Forecasting, supply chain management.

• Cisco Systems – Attach Rate forecasting, Multi-dimensional OLAP cube demand planning and forecasting.

• PG&E – Financial and Management DW (revenue).• Many others.

Page 27: 2009/11   Database Architechs Presentation

Database High AvailabilityFive-9’s at the database tier via many different solutions, architectures, and technologies. Our consultants live by the mantra of “continuous uptime”. We feature a high availability “assessment” for anyone serious about High Availability.

Page 28: 2009/11   Database Architechs Presentation

References/Examples• Symantec Corporation – Chat DB 24x7x365 SLA• Breg International – SQL Clustering ERP application• Aplia – SQL Clustering/Log Shipping• Intel Corporation – Marketing/Ad Database –

24x7x365 Global replication topology• HerbaLife – SQL Clustering/Log Shipping secondary• PeaceHealth – Database Mirroring/SQL Clustering• Many others.

Page 29: 2009/11   Database Architechs Presentation

Master Data ManagementCore data categories such as customer data and product data comprise the cornerstone of this practice offering. A specialized MDM methodology geared towards an optimal MDM architecture and

solution is embodied in our delivery model for MDM. Often taking advantage of hub and spoke architectures to enable MDM for major organizations.

Page 30: 2009/11   Database Architechs Presentation

References/Examples• Veritas Corporation – Customer Master Data

management (internal solution).• Symantec Corporation – MDM solution (CDH

Oracle)• Master Data Management methodology hybrid

developed in conjunction with Oracle MDM practice.• MDM readiness assessment available that includes

data profiling and governance recommendations.

Page 31: 2009/11   Database Architechs Presentation

Metadata ManagementOne of the forgotten elements of good data management is metadata management. Our consultants can help to implement a robust metadata repository and management framework to help you with:• Impact analysis, • eDiscovery, • Compliance, • Data integrity, • and data quality across your IT landscape.

Page 32: 2009/11   Database Architechs Presentation

References/Examples• Veritas – Internal metadata repository creation and

reporting (impact analysis, metadata definition and web services).

• Symantec – formal metadata repository built using System Architect (IBM). Used for impact analysis, architecture reach, eDiscovery, and many others.

• Many others.

Page 33: 2009/11   Database Architechs Presentation

Disaster Recovery &Business Continuity

Full DR and BC assessment and solution design for any companies’ disaster recovery/business continuity goals. Fully automated/active-active patterns form the popular approaches we often recommend to customers.

Page 34: 2009/11   Database Architechs Presentation

References/Examples• Veritas – Disaster Recovery/Business Continuity• Symantec Corporation – Disaster

Recovery/Business Continuity planning/patterns

Page 35: 2009/11   Database Architechs Presentation

Database Security & ComplianceMeeting global security and compliance regulations such as PII, and others are at the heart of this offering. Creating the most secure framework and solutions will vary according to your needs and your industry requirements.

Page 36: 2009/11   Database Architechs Presentation

References/Examples• Symantec Corporation – create/define enterprise

security policies and framework. Vulnerability testing integration into the development life cycle. Data privacy/risk assessments.

• Many others.

Page 37: 2009/11   Database Architechs Presentation

Database Education & TrainingOffer several time tested and exciting database courses such as:• Multi-dimensional database design. • SQL Programming, • Logical Data Modeling and

Database design.• Performance and Tuning.• Data Replication.• Master Data Management ramp up.

Page 38: 2009/11   Database Architechs Presentation

Supported databases: Sybase: SQL Supervision Oracle: Database Tuning MS SQL Server: SQL Shot

Strengths:• Designed and developed by the top DB experts.• Highly “Graphic-Oriented” interactive design – drill-

down through the graphs!• Easily isolate performance issues in seconds.• Optimization strategies can be implemented and

verified.• Safe “production” monitoring in real time.• Performance counters utilized include OS level.• Plug-and-play - no change to your IT architecture.• Monitor, Isolate, Drill-down approach.• Also runs in off-line mode with easy data export.• Track Record – 10 years of SQL and Database

performance and tuning tools.

Database Performance & Tuning tools

Video Demonstration

Page 39: 2009/11   Database Architechs Presentation

References/ExamplesWe are using Database Architechs' Performance and Tuning tools in all our production and test environments. Thanks to these tools we can anticipate and fix any performance issues. Isolating and fixing performance issues is now 16 times faster (down from 2 days to 1 hour). We can also log all the database performance metrics and information to isolate any past performance issue and produce some monthly reports on specific metrics. In addition, Database Architechs Performance and Tuning tools are helping us in identifying users' behavior, anticipating the required tuning to optimize response time.

We are using Database Architechs' Performance and Tuning tools for the following: 1) Monitor applications' response time before moving to production. 2) Isolate poor performing SQL queries, stored procedures, triggers ... on production databases. Thanks to Database Architechs' Performance and Tuning tools we've been able to improve SQL queries performances from few minutes to few seconds. Database Architechs' Performance and Tuning tools has also helped us to isolate performance issues during our database migration process.

I'm using Database Architechs' Performance and Tuning tools since several years. I appreciate very much these tools for real-time database server monitoring. I appreciate particularly: - The GUI, to visualize and isolate any performance issue in seconds. - How easy and fast it is, to install the tools and start monitoring any database server. - The logging feature, to analyze past performance issues. - The batch mode, to log performance metrics automatically based on events.

Page 41: 2009/11   Database Architechs Presentation

Overall send rate 41 % faster (2005 vs. 2008)Overall restore rate 52% faster (2005 vs. 2008)

Overall availability topology inherits the restore rate ~ 50% more available

Example:• 743 ms Transaction (in 2005 mirroring configuration)• 379 ms Transaction (in 2008 mirroring configuration)

In failover, what would have been 20 seconds before mirror becomes principal turns into roughly

8-10 seconds (or 3 seconds turns into 1.5 seconds, so on).

DB Mirroring Benchmark: 2005 vs. 2008

Page 42: 2009/11   Database Architechs Presentation

Overall send rate 26 % faster (2008 Conventional versus SSD)Overall restore rate 17% faster (2008 Conventional versus SSD)

Overall db mirroring topology garners ~ 20% more availability

Examples:10 min 17 seconds to complete• 4:32:37am 4:43:00am (principal send’s)• 4:32:48 am 4:43:05am (mirror restore’s)8 min 38 seconds to complete• 3:45:19am 3:53:20am (principal send’s)• 3:45:20am 3:53:20am (mirror restore’s)

100% Transparent (zero DB & application changes) !

DB Mirroring Benchmark 2008: SSD

Page 43: 2009/11   Database Architechs Presentation

Remote ServicesUsing our P&T Tools and a proven methodology, we are extending our database-focused services:• Available through a secured connection.• Top database experts available as needed using a pool of hours.• Remote Physical Database Design:

We have designed and deployed all kinds of systems, from OLTP databases to Decision support systems (Data warehouse, Business Intelligence and OLAP cube technologies). Our intervention quite often involves using advanced techniques such as data replication, clustering, and database mirroring.

• Remote Performance and Tuning:As part of any P&T engagement, we use a detailed performance and tuning methodology that has been developed over many years to offer predefined deliverables that maximize the end-result of our customers.Typically, our results include an improvement in database throughput ranging from 100% to 750% as well as a massive reduction in response times.

Page 44: 2009/11   Database Architechs Presentation

DATABASE Architechs’ Team

Paul [email protected]• DB Architechs Founder and Advisor:

– DB Design– P&T for MS SQL Server, Sybase, DB2 and

Oracle.• Data design expert: with Dr. Peter Chen• Primary Author of SQL Server 2000, 2005 &

2008 Unleashed• Co-Author of ADO.NET in 24 hours• Author MS SQL Server High Availability• Author Sybase Performance & Tuning• Author Sybase Physical DB Design• Veritas SQL Server Performance Series

Thierry [email protected]

• Managing Principal & Co-owner:– Management – Research and Development,– DB Design– P&T for MS SQL Server, Sybase and Oracle

• European focus until recently, company growth leader – multiple years

• Expanding DB Architechs consulting practices to USA and Asia

• Sybase P&T and DBA Certified Professional• Contributor to SQL Server 2005 Unleashed

Page 45: 2009/11   Database Architechs Presentation

Our past and current partners

Services Partners:•Fusion Storm•Ascent Services Group•Computer Science Corporation (CSC)•Cap Gemini Ernst & Young (CGEY)•i2 Technologies •Collaborative Consulting (Boston)

Joint Proposals, as a named sub, and as augmentation

High Tech Partners:•HP / Mercury•Microsoft•Paraccel•Solid Data•Sybase

Page 46: 2009/11   Database Architechs Presentation

Database Architechs’ new Website

www.dbarchitechs.com

Leveraging our database expertise our new Website includes:• Table-driven contents

allowing dynamic and real-time updates.

• A full and automatic workflow for our P&T Tools allowing to:• Download the product.• Request and get in few minutes

a free-trial license key.• Buy and get in few minutes a

license key.• Manage technical support

requests.

Page 47: 2009/11   Database Architechs Presentation

Feel free to ask questions.Thank you for your time and participation.

Contact us at 415-944-8184or [email protected]