SERUG - System Architecture Design and Capacity...

System Architecture Designand

Capacity Planning Dave PetersDave Peters

ESRIESRI –– Redlands, CARedlands, CA

J8338J8338 Slide 1-1 of 52

System Architecture Designand

Capacity Planning

Dave Petersesri.com/systemdesign

J8338J8338 Slide 1-2 of 52

System Architecture Design What Is System Architecture Design?

Hardware

Applications

Data Resources

NetworkDesign

User Needs Hardware Specifications

3/20/07

People(Information Products)

J8338J8338 Slide 1-3 of 52

Why is System Architecture Design Important? Performance Chain

Reduce Cost Improve Productivity

System Architecture Design Framework for Productive Operations

Balanced System DesignServers Network DBMS Geodatabase

Storage Clients ArcSDE Application

User WorkflowDatabase DesignHardware Infrastructure

4/1/2005

J8338J8338 Slide 1-4 of 52

Implementation

Construction

Design

System Implementation Stages

Requirements

StagesTasks

Cost of a change(Implementation Risk)

$1

$10

$100

$1000

GIS Cost WaterfallGIS Cost Waterfall

(Moody)Database Programming & Design

October 1996, p57–64

PlanningPlanningPlanning

DevelopmentDevelopmentDevelopment

DeploymentDeploymentDeployment

ProductionProductionProductionProduction DeploymentSystem Acceptance Testing

System Performance TestingSystem Load Testing (performance harness)System Tuning (Tofino tools)

Initial System Deployment

Prototype Functional TestingApplication Functional Acceptance TestingSoftware Performance Validation TestingInitial Application and Database Tuning

System DevelopmentUser Applications Database DesignData Migration

System Architecture DesignHardware SpecificationsStrategic Implementation Plan

GIS User RequirementsUser WorkflowsData Requirements

Understand the TechnologyTechnology ExchangeStaffing and Training

How can we manage implementation risk?How can we manage implementation risk?

CommonCapacity PlanningFramework

8/1/2005

J8338J8338 Slide 1-5 of 52

Implementation Strategy

Hardware Sizing/SelectionSystem Loads AnalysisSystem Design ComponentsSystem Configuration AlternativesGIS User Needs Overview

Existing Environment

Technology Overview

System Architecture Design

Implementation StrategyApplication NeedsData RequirementsInformation ProductsUser Workflows

GIS Needs Assessment

System Design Process

1/1/2007

Proj

ect T

imel

ine

GIS Workflow Analyst(Customer Business Processes)

GIS System Design Consultant(Customer System Design)

User Workflows

Implementation Schedule

Application NeedsData Requirements

Information Products

Implementation Schedule

Hardware Sizing/SelectionSystem Loads AnalysisSystem Design ComponentsSystem Configuration Alternatives

GIS User Needs OverviewExisting Environment

GIS System Architect(Customer Business Processes + Capacity Planning Framework)

Integrated Business Needs Assessment

GIS Software Solutions

GIS User Needs AssessmentTechnology Overview


J8338J8338 Slide 1-6 of 52

ArcInfo

ArcEditor

ArcView Arc

GIS

Ext

ensio

ns

Desktop GIS

ArcGIS Engine

ArcReader

ArcGIS Software Technology

XMLDBMSFilesGeodatabase

ArcPad

Mobile Devices

Mobile GIS

ESRI Developer Network (EDN)

Developer GIS

ArcWeb Services

GIS Web Services

Web Browsers

LightweightViewers

Server GIS ArcGIS Server ArcSDE ArcIMS

Network

11/11/2005

ArcGIS Online

J8338J8338 Slide 1-7 of 52

ArcGIS Desktop

Concurrent User Licensing (Client Desktop and Windows Terminal Server)- FlexLM License Manager

Concurrent User Licensing (Client Desktop and Windows Terminal Server)- FlexLM License Manager

Single Use Licensing (Client Desktop Only)- Software License Key

Single Use Licensing (Client Desktop Only)- Software License Key

ArcReader is a free, easy-to-use mapping application that allows users to view, explore, and printmaps and globes.

ArcReader is a free, easy-to-use mapping application that allows users to view, explore, and printmaps and globes.

ArcInfo is the most complete GIS available. It includes all the functionality of ArcView and ArcEditor and adds advanced spatial analysis, data manipulation, and high-end cartography tools. Professional GIS users use ArcInfo for all aspects of data building, modeling,analysis, and map display.

ArcEditor is a powerful GIS desktop system for editingand managing geographic data. ArcEditor is a member of the ArcGIS family of GIS products and includes all the functionality of ArcView and adds a comprehensive set of tools to create, edit, and ensure the quality of your data.

ArcView is full-featured GIS software for visualizing, analyzing,creating, and managing data with a geographic component. Most data has a component that can be tied to a place: an address, postal code, global positioning system location, census block, city, region, country, or other location. ArcView allows you to visualize, explore,and analyze this data, revealing patterns, relationships, and trendsthat are not readily apparent in databases, spreadsheets, or statistical packages.

Scalable Licensing

J8338J8338 Slide 1-8 of 52

Scalable ArchitectureAdvanced- Web Editing - Mobile ADF Clients- Advanced Geoprocessing- Advanced Extensions

Standard- Standard Map Publishing - Globe Server (ArcGIS Explorer)- Standard Geoprocessing- Standard Extensions

ArcGIS Server

11/11/2005

Basic- Geodatabase Management (SDE)- Check in/Check out- Geodatabase Replication

Scalable Licensing

ArcGIS Server

DBMS Connect

Web Applications

DBMS

Server Object ContainerDirect Connect

Server Object Manager

EnterpriseArcGIS Server

DBMS Connect

Web Applications

DBMS



EnterpriseArcGIS Server

DBMS Connect

Web Applications

DBMS

ArcGIS Server

DBMS Connect

Web Applications

DBMS





High Available EnterpriseArcGIS Server

DBMS Connect

Web Applications

DBMS

ArcGIS Server

DBMS Connect

Web Applications

DBMS





High Available Enterprise

DBMS DBMS


Web Applications Web Applications

Web Server Web Server



DBMS Connect

Container MachineServer Object Container

Direct Connect

DBMS Connect

Container Machine

Three Tier High Available Enterprise


DBMS Connect

Container Machine

DBMS DBMS






DBMS Connect


Direct Connect

DBMS Connect

Container Machine



DBMS Connect

Container Machine

ArcGIS Server

DBMS Connect

Web Applications

SQL Express DBMS



WorkgroupArcGIS Server

DBMS Connect

Web Applications

SQL Express DBMS



Workgroup

Single Socket Platform

J8338J8338 Slide 1-9 of 52

Mobile Operations

11/11/2005

Geodatabase

ArcGIS Server

Mobile ADF(smart clients)

Synchronization

Protected Data Cache

ArcGIS DesktopArcGIS Engine

SQL Express DB< 4GB Geodatabase

Geodatabase Replication


File Geodatabase> 1TB Geodatabase

Check out/Check in

J8338J8338 Slide 1-10 of 52


Web Operations

11/11/2005

Geodatabase

ArcGIS Server

Data ServicesGeoprocessing Services

Globe Services

ArcGIS Desktop 3D Analyst

ArcGIS Explorer

Web Services

HTML BrowserAJAX Client

J8338J8338 Slide 1-11 of 52

GIS Is Deployed In Many Ways

EmergingEmerging

TraditionalTraditional

DepartmentalDepartmental EnterpriseEnterprise

12/1/05

J8338J8338 Slide 1-12 of 52

Federated Architecture

Homeland Security- ETL Data Flows- Geodatabase Replication

Homeland Security- ETL Data Flows- Geodatabase Replication

Portal Toolkit- Map Viewer- Metadata Catalog

Portal Toolkit- Map Viewer- Metadata Catalog

12/1/05

J8338J8338 Slide 1-13 of 52

Service-Oriented Architecture

An approach for building distributed computing systems based on encapsulating business functions as services

that can be easily accessed in a loosely coupled fashion

Bind/Invoke

ServiceConsumerService

ConsumerServiceProviderServiceProvider

ServiceDirectoryService

Directory

Find/Details Publish

11/11/2005

WebCommonProtocols

J8338J8338 Slide 1-14 of 52

Why SOA?• Technology Change Component Architecture

• Business Continuance Reduce Vendor Dependence

• Leverage Investments Reusable Components

• Customer Flexibility More Vendor Choices

• Business Integration Open System Communications

SOA supports more adaptive enterprise operations

J8338J8338 Slide 1-15 of 52

. . . Standard IT Infrastructure. . . Standard IT Infrastructure

GIS in a Services Oriented ArchitectureProviding A Framework For Integration

AuthoringAuthoringTierTierDesktop

Globe Globe ServicesServices

Map &Map &ChartChart

ServicesServices

ImageImage--ProcessingProcessing

ServicesServices

Open Open WebWeb

ServicesServices

TrackingTracking& RSS & RSS

ServicesServicesServing/Serving/

PublishingPublishingTierTier

MetadataMetadataCatalog Catalog ServicesServices

GeoGeo--ProcessingProcessing

ServicesServicesServer

Presentation TierPresentation Tier(Any Viewer)(Any Viewer)

22--DDViewersViewers

33--DDViewersViewers

COPCOP

3 Tiers3 TiersMobileMobile

•• OpenOpen•• InteroperableInteroperable•• Standards BasedStandards Based•• On DemandOn Demand

Enterprise Service Bus

J8338J8338 Slide 1-16 of 52

Desktop ApplicationsProfessional GIS UsersDatabase MaintenanceHeavy Business WorkflowsGIS Project EffortsData Conversion

NetworkServices

Published Network ServicesDistributed Batch Processing

Mobile ApplicationsDisconnected OperationsLoosely Connected Workflows

WAN

LAN

Workstations

WTS

Terminals

ArcIMS

Web Server

Browser

Browser

ArcGISServer

PDAPDACellCell

File Server DBMS Server

Internet Service

GIS Data SourceRemote Data SourcesInternal Data Sources

Software Technology Selection

Web ServicesPublished Map ProductsPublished Geoprocessing ServicesIntegrated Business Workflows

4/1/2005

J8338J8338 Slide 1-17 of 52

CentralData Center

Consolidation

WHY CONSOLIDATE?•Reduced hardware cost•Reduced administration cost•Lower implementation risk•Integrated operations•Improved data access•Improved security•Reduced network traffic

WHY CONSOLIDATE?•Reduced hardware cost•Reduced administration cost•Lower implementation risk•Integrated operations•Improved data access•Improved security•Reduced network traffic

Map ServerWeb Server

Browser

Browser

Database Configuration OptionsCentralized Computing Environment

Geodatabase Server Attribute ServerFile Server

Geographic Data Resources

LAN

Workstations

WTS

WAN

Terminals

4/1/2005

J8338J8338 Slide 1-18 of 52 Slide 6-16 of 16

Corporate

CorporateEditor

ArcSDE

Geodatabase Multi-generation Replication ( ArcGIS 9.2)

Reconcile and PostRegional Updates

Reconcile and PostRegional Updates

ArcSDE

Region 1

CV-1

ArcSDE

Region 2

CV-2

Check OutRegionalDatabase

Check OutRegionalDatabase

PGDRegional

EditorV1

DisconnectedEditing

PGDRegional

EditorV1

DisconnectedEditing Regional

EditorRegional

Editor

V1 V2

RegionalEditor

V1

RegionalEditor

V2

Unlimited Update

Transactions

Unlimited Update

Transactions

Reconcile and Post Corporate Updates Reconcile and Post Corporate UpdatesDownload Corporate Version Updates Download Corporate Version Updates

4/1/2005

Upload Regional Version UpdatesUpload Regional Version Updates

Remote DesktopSQL Express DBMS4 GB Geodatabase

Slide 6-15 of 16

Data CenterMaintenance

ArcGISEditors

ArcSDE

Geodatabase Single- generation Replication(Database Checkout – ArcGIS 8.3+)

Peer to Peer – Database Checkout One DirectionCheckout/Refresh

Transaction

One DirectionCheckout/Refresh

Transaction

Check OutDatabase

ArcGISViewers

Distribution

ArcSDE

ArcGISViewers

ArcGISViewers

ArcGIS 9.2 Incremental Updates

Database Configuration OptionsDistributed Computing Environment

ArcGIS Desktop Clients

RegionalData

Server


RegionalData

Server

Data Replication Data Replication


CentralData

Server

DISTRIBUTED DATA SOLUTIONS•Increased hardware cost•Increased administration cost•Higher implementation risk•Disconnected operations•Limited data access•Reduced security•Increased network traffic

DISTRIBUTED DATA SOLUTIONS•Increased hardware cost•Increased administration cost•Higher implementation risk•Disconnected operations•Limited data access•Reduced security•Increased network traffic

Why use distributed architecture?•Organizational Precedence•Management Confidence•Physical Security•Infrastructure Limitations

Why use distributed architecture?•Organizational Precedence•Management Confidence•Physical Security•Infrastructure Limitations

Remote Desktop

Data Replication

J8338J8338 Slide 1-19 of 52

System Design Strategies

Capacity Planning

J8338J8338 Slide 1-20 of 52

$Market$


Balanced Loads

Understanding the TechnologySystem Performance Factors

InternetBandwidth

InternetBandwidth

Wide Area NetworkBandwidth

Wide Area NetworkBandwidth

Network Communications Bandwidth

Workstation Performance(user productivity)

Server Performance/Capacity(single server)

Storage

Peak Client Loads Hardware Specifications

Technology

Performance Bar

HardwarePerformance

Allocation

ArcSDE Connection

Database Technology(DBMS, data types, indexing, tuning)

Geodatabase Design(tables, dependencies, relationships)

GIS SoftwareClient Applications

Display layers/features/complexity

User Workflow

How do we address performance sizing?

J8338J8338 Slide 1-21 of 52

0 5 10 15 20 25 30 35 40

Intel Xeon MP 2 Core (2 socket) 2000 MHz Intel Xeon 4 Core (2 socket) 2800 MHz Intel Xeon 2 Core (2 socket) 2800 MHz

Intel Xeon MP 2 Core (2 socket) 3000 MHz Itanium 2 Core (2 socket) 1600 MHz

Intel Xeon 2 Core (2 socket) 3200 MHz AMD 4 Core (2 socket) 2400 MHzAMD 2 Core (2 socket) 2600 MHzAMD 4 Core (2 socket) 2600 MHz

Intel Xeon 4 Core (2 socket) 3730 MHz Intel Xeon 2 Core (2 socket) 3600 MHz Intel Xeon 2 core (2 socket) 3800 MHz

Intel Xeon 4 Core (2 socket) 2000(4) MHz AMD 4 Core (2 socket) 2800 MHzAMD 4 Core (2 socket) 2600 MHzAMD 2 core (2 socket) 2800 MHzAMD 2 core (2 socket) 3000 MHz

Intel Xeon 4 Core (2 socket) 2333(4) MHz Intel Xeon 4 Core (2 socket) 2666(4) MHz Intel Xeon 4 Core (2 socket) 3000(4) MHz

Plat

form

Tec

hnol

ogy

Relative Performance per Core (SPECrate_int2000)

Platform Performance Makes a Difference2006 Supported Windows Technology

Performance Baseline2006

22

2004 and 2005

18

4 MB L2 Cache

J8338J8338 Slide 1-22 of 52

0 5 10 15 20 25 30 35 40

Sun Fire V250 2 core (2 socket) 1280 MHz


Sun Fire V490 4 Core (2 socket) 1350 MHz

PA-8800 8 Core (4 socket) 1000 MHz


Sun Fire E4900 8 Core (4 socket) 1500 MHz

Sun Fire V490 8 Core (4 socket) 1600 MHz

Itanium 2 core (2 socket) 1300 MHz

IBM p575 16 Core (8 socket) 1500 MHz

Itanium 2 core (2 socket) 1500 MHz

Itanium 8 Core (8 socket) 1600 MHz

IBM JS21 4 core (2 socket) 2500 MHz


IBM p550 4 core (2 socket) 1900 MHz

IBM p550 4 core (2 socket) 2100 MHz


Plat

form

Tec

hnol

ogy

Relative Performance per Core (SPECrate_int2000)

Platform Performance Makes a Difference2006 Supported UNIX Technology

Performance Baseline2006

22

2004 and 2005

18

J8338J8338 Slide 1-23 of 52

0

500

1000

1500

2000

2500

3000P

entiu

m P

ro 2

00P

entiu

m II

233

Pen

tium

II 2

66P

entiu

m II

300

Pen

tium

II 3

33P

entiu

m II

350

Pen

tium

II 4

00P

entiu

m II

450

Pen

tium

III 5

00P

entiu

m II

I 55

0P

entiu

m II

I 650

Pen

tium

III 7

00P

entiu

m II

I 733

Pen

tium

III 8

00P

entiu

m II

I 866

Pen

tium

III 9

00P

entiu

m II

I 933

Pen

tium

III 1

000

Pen

tium

III 1

200

Inte

l Xeo

n 14

00In

tel X

eon

1500

Inte

l Xeo

n 16

00In

tel X

eon

1700

Inte

l Xeo

n 20

00In

tel X

eon

2400

Inte

l Xeo

n 28

00In

tel X

eon

3000

Inte

l Xeo

n 32

00-2

Inte

l Xeo

n 3

400-

2In

tel X

eon

3600

-2In

tel X

eon

3800

-1In

tel X

eon

3000

-4

Rel

ativ

e Pe

rfor

man

ce

Sint2000Sfp2000

Arc03

Arc02Arc01

Arc00

Arc99Arc98

Arc04/Arc05

Arc06

Platform Performance ChangeArc06 = 2006 Single UserArcInfo Workstation Performance

Arc01 = 2001 Single UserArcInfo Workstation Performance




Arc04-05 = 2004–2005 Single UserArcInfo Workstation Performance

J8338J8338 Slide 1-24 of 52

How do we handle change?

Performance of Server APerformance of Server B

Clients of Server AClients of Server B=

Theory of Relative PerformanceThe relative performance of two servers is

directly proportional to their compute capacity.

J8338J8338 Slide 1-25 of 52

Standard Performance Evaluation Corporation(SPEC Mission)

To develop technically credible and objective benchmarks so that both computer designers and purchasers can make

decisions on the basis of realistic workloads

How do we measure relative performance?

ESRI System Design History• 1992–1996, SPEC92 benchmark results• 1996–2000, SPEC95 benchmark results• 2000–2006, SPEC2000 benchmark results• New release UC2007+, SPEC2006 benchmark results

J8338J8338 Slide 1-26 of 52

ArcGIS DesktopSizing Models

J8338J8338 Slide 1-27 of 52

Tightly Coupled Execution(hundreds of sequential database transactions per map display)

Client/Server ConfigurationsArcGIS Desktop Workstations

File Data Source

File Data Source

ArcGIS DesktopCIFSNFS or

CIFSNFS or

UNIX Windows

SDE

DBMS

SDE DBMS Connect

ArcGIS DesktopSDE Connect

*Note: ArcSDE executables are included in Direct Connect API

SDE Server Connect

ArcGIS Server Basic

DBMS

DBMS Client


SDE

DBMS

Direct Connect

ArcGIS DesktopDirect Connect*

DBMS Client

SDE

J8338J8338 Slide 1-28 of 52

Workstation Platforms

ArcGISEngineDesktop

WindowsTerminalClients------------ArcIMSBrowsers

8/21/2006

ArcGISDesktop

ArcGIS Memory = 1 GBUp to 2 GB may be required to support large file-based data sources

Pentium III 500Pentium III 550

Pentium III 650Pentium III 700

Pentium III 733Pentium III 800Pentium III 866Pentium III 900Pentium III 933Pentium III 1000Pentium III 1200Intel Xeon 1400Intel Xeon 1500Intel Xeon 1600Intel Xeon 1700

Intel Xeon 2000Intel Xeon 2400

Intel Xeon 2800Intel Xeon 3000

Intel Xeon dual core 1600-4Intel Xeon 3200-2

Intel Xeon 3400-2Intel Xeon 3600-2

Intel Xeon dual core 2000-4AMD 3000Intel Xeon 3800-1

Intel Xeon dual core 2333-4Intel Xeon dual core 2666-4

Intel Xeon dual core 3000-4

0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000 3200 3400

Win

dow

s W

orks

tatio

ns

Platform Performance (SPECint2000)

Arc 2004-Arc 2005

Arc 2006

Arc 2003

Arc 2002

Arc 2001

Arc 2000

J8338J8338 Slide 1-29 of 52


Client/Server ConfigurationsArcGIS Desktop Server

Windows Terminal Server

File Data Source

ArcGIS DesktopDisk Mount

File Data Source

CIFSNFS or

CIFSNFS or

UNIX Windows

TerminalICARDP

CitrixMicrosoft


SDE Server Connect

ArcGIS Server Basic

DBMS

DBMS Client



TerminalICARDP

CitrixMicrosoft

SDE


DBMS

DBMS Client


Direct Connect

TerminalICARDP

CitrixMicrosoft

SDE


DBMS


SDE DBMS Connect

TerminalICARDP

CitrixMicrosoft

SDE

J8338J8338 Slide 1-30 of 52

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

150

5 10 15 20 25 30 35 40 45 50 55 60 65 70 75

Peak Users

SPE

Cra

te_i

nt20

00

6 dpm

8 dpm10 dpm

8 GB RAM

16 GB RAM

32 GB RAM

Windows Terminal ServerGeodatabase Direct Connect


ArcGIS DesktopDirect Connect

DBMS

GeodatabaseDirect Connect

DBMS Client

81.0Intel 4 core (2 socket) 3733 MHz

120Intel Xeon 4 core (2 socket) 3000(4) MHz

90.3AMD 4 core (2 socket) 2800 MHz


44.5AMD 2 core (2 socket) 2800 MHz42.9Intel Xeon 2 core (2 socket) 3800 MHz34.0

Intel Xeon 2 core (2 socket) 3200 MHz

J8338J8338 Slide 1-31 of 52


Client/Server ConfigurationsCentralized ArcGIS Desktop Client


File Data Source


File Data Source

CIFSNFS or

CIFSNFS or

UNIX Windows

TerminalICARDP

CitrixMicrosoft


SDE Server Connect

ArcGIS Server Basic

DBMS

DBMS Client



TerminalICARDP

CitrixMicrosoft

SDE


DBMS

DBMS Client


Direct Connect

TerminalICARDP

CitrixMicrosoft

SDE


DBMS


SDE DBMS Connect

TerminalICARDP

CitrixMicrosoft

SDE

J8338J8338 Slide 1-32 of 52

File Data Source

File Server

GIS File Servers

Workstations

GIS Data Server SizingGIS File Server

Memory4 GB/Core

Memory4 GB/Core

Average 50 Mb Traffic per Map Display(assume 1 display every 6 seconds)

Capacity Planning Matrix


File Data Source


File Data Source

(20 clients/100 Mbps NIC)

ArcGIS Desktop service time varies with size of the GIS data files

ArcGIS Desktop service time varies with size of the GIS data files

J8338J8338 Slide 1-33 of 52


Client/Server ConfigurationsCentralized ArcGIS Desktop Client


File Data Source


File Data Source

CIFSNFS or

CIFSNFS or

UNIX Windows

TerminalICARDP

CitrixMicrosoft


SDE Server Connect

ArcGIS Server Basic

DBMS

DBMS Client



TerminalICARDP

CitrixMicrosoft

SDE


DBMS

DBMS Client


Direct Connect

TerminalICARDP

CitrixMicrosoft

SDE


DBMS


SDE DBMS Connect

TerminalICARDP

CitrixMicrosoft

SDE

J8338J8338 Slide 1-34 of 52

Geodata

base Model

ASCUnve

rsioned

ASCVers

ioned

DCUnve

rsioned

DCVers

ioned

Clie

nt/S

erve

r Pro

cess

ing

Load

s

Data Server CPU TimeWait TimeClient CPU Time

ArcSDE Server Performance Baseline

ASC = ArcSDE installed on database server DC = ArcSDE direct connect communicationsModel does not apply to Oracle Spatial data types (use DC configurations only)

Geodatabase Performance(ArcGIS 9.0 ArcMap/ArcSDE Vector and Raster Client/Server core Loads)

0.655

0.164


ArcGIS DesktopArcSDE Connect

ArcSDE

DBMS

ArcSDE Server Connect


ArcGIS DesktopArcSDE Connect

ArcSDE

DBMS



DBMS


DBMS Client



DBMS


DBMS Client


J8338J8338 Slide 1-35 of 52

Geodatabase LoadsArcGIS 9.0 Data Server Loads

Geodata

base M

odel

ASCUnve

rsioned

ASC Versioned

DCUnve

rsioned

DC Versioned

Dat

abas

e Pr

oces

sing

Loa

ds

Data Server GSRVR CPU LoadData Server CPU Load

ArcSDE Server Capacity Sizing Baseline


0.082

0.082

ArcSDE

DBMSDBMS

J8338J8338 Slide 1-36 of 52

Relative Capacity SizingArcGIS 9.0 Test Results

0

20

40

60

80

100

120

140

160

180

200

Geodata

base Model

ASCUnve

rsioned

ASC Versioned

DCUnve

rsioned

DC Versioned

Rel

ativ

e Pe

ak U

ser W

orkf

low

Relative Performance Capacity

ArcSDE Server Capacity Sizing Model


ArcSDE

DBMSDBMS

J8338J8338 Slide 1-37 of 52

0

50

100

150

200

250

300

350

400

450

500

550

600

650

700

750

800

100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500

Peak Concurrent Users

SPE

Cra

te_i

nt20

00 6 dpm

8 dpm

10 dpm

294IBM p575 16 core (8 socket) 1900 MHz

619Sun Fire E6900 48 core (24 socket) 1800 MHz


Geodatabase Server SizingArcSDE DBMS ServerWindows Terminal Server

ArcGIS Desktop

SDE Connect

ArcSDE

DBMS

ArcSDE Connect

148.9IBM p570 8 core (4 socket) 1900 MHz173Sun Fire E4900 16-1500 MHz

Server memory = 4 GB/Core



42.9Intel Xeon 2 core (2 socket) 3800 MHz


104Sun Fire V490 8 core (4 socket) 1800 MHz

J8338J8338 Slide 1-38 of 52

0

50

100

150

200

100 200 300 400 500 600 700 800 900 1000

Peak Users

SPE

Cra

te_i

nt20

00

6 dpm

8 dpm10 dpm

148.9IBM p570 8 core (4 socket) 1900 MHz

134HP Itanium rx7620 8 core (8 socket) 1600 MHz*

104Sun Fire V490 8 core (4 socket) 1800 MHz


Geodatabase Server SizingDBMS Direct Connect and ArcSDE Remote Server (up to 8 core)

ArcSDERemote Server

DBMS

DBMS Client

ArcSDE




120.0Intel Xeon 4 (2 socket) 3000 MHz


144AMD 8 core (4 socket) 2400 MHz*



J8338J8338 Slide 1-39 of 52

0

100

200

300

400

500

600

700

800

900

1000

500 1000 1500 2000 2500 3000 3500 4000 4500 5000

Peak Users

SPE

Cra

te_i

nt20

00

6 dpm

8 dpm10 dpm

4/1/2006

Geodatabase Server SizingLarge DBMS Direct Connect and ArcSDE Remote Server




266HP Itanium rx8620 16 core (8 socket) 1600 MHz*

554HP Itanium rx8620 32 core (16 sockets) 1600 MHz*

* ArcSDE Direct Connect Support Only


ArcSDERemote Server

DBMS

DBMS Client

ArcSDE





J8338J8338 Slide 1-40 of 52

FileData

Source

ArcSDE

DBMSDBMS

ArcGIS ServerMap Server

Web Server


Web Applications

SDE Connect

Direct Connect

Disk Mount

Server Object Container

Server Performance and ScalabilityTwo Tier Implementations

FileData

Source

ArcSDE

DBMSDBMS

Web Server

Application Server

Web Applications

Spatial Server

ArcIMSImage Service

SDE Connect

Direct Connect

Disk Mount

FileData

Source

ArcSDE

DBMSDBMS

ArcIMSArcMap Image Service

Web Server

Application Server

Web Applications

Spatial ServerSDE

ConnectDirect

ConnectDisk

Mount

J8338J8338 Slide 1-41 of 52

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

150

6,000 12,000 18,000 24,000 30,000 36,000 42,000 48,000 54,000 60,000 66,000 72,000 78,000 84,000 90,000 96,000

Display Transaction Rate

SPE

Cra

te_i

nt20

00

ArcIMSImage Service

ArcIMSArcMap Service

ArcGIS ServerMap Service

100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500 1600 Displays/hrDisplay/min

DC SDE DC SDE DC

SDEFile File File

10050 150 200 250

ArcIMS/ArcGIS Server SizingWeb Two Tier Architecture

120Intel Xeon 4 Core (2 socket) 3000(4) MHz

90.3AMD 4 Core (2 Socket) 2800 MHz

44.5AMD 2 core (2 socket) 2800 MHz42.9Intel Xeon 2 core (2 socket) 3800 MHz

81.0Intel 4 Core (2 Socket) 3733 MHz



Peak Users(6 displays per minute)



FileData

Source

ArcSDE

DBMSDBMS


Web Server


Web Applications

SDE Connect

Direct Connect

Disk Mount


FileData

Source

ArcSDE

DBMSDBMS


Web Server


Web Applications

SDE Connect

Direct Connect

Disk Mount


J8338J8338 Slide 1-42 of 52

Web Server

SOM

Web Applications


Container Machine

SDE Connect

DBMSConnect

Disk Mount


FileData

Source

ArcSDE

DBMSDBMS

Web Server

Application Server

Web Applications

ArcIMSArcMap Image Service

FileData

Source

ArcSDE

DBMSDBMS

Spatial ServerSDE

ConnectDBMS

ConnectDisk

Mount

Map Server

Web Server

Application Server

Web Applications

ArcIMSImage Service

FileData

Source

ArcSDE

DBMSDBMS

Map Server

Spatial ServerSDE

ConnectDBMS

ConnectDisk

Mount

Server Performance and ScalabilityLarger Three Tier Implementations

J8338J8338 Slide 1-43 of 52

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

150

12,000 24,000 36,000 48,000 60,000 72,000 84,000 96,000 108,000 120,000


SPEC

rate

_int

2000

ArcIMSImage ServiceArcIMS

ArcMap Service

ArcGIS ServerMap Service

100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500 1600 1700 1800 1900 2000 Displays/hrDisplay/min

DC SDEDC

SDEDC SDEFile

File

10050 150 200 250 300

ArcIMS/ArcGIS Server SizingWeb Three Tier Architecture



44.5AMD 2 core (2 socket) 2800 MHz42.9Intel Xeon 2core (2 socket) 3800 MHz







Web Server

SOM

Web Applications


Container Machine

SDE Connect

DBMS Connect

Disk Mount


File Data

Source

ArcSDE

DBMSDBMS

Web Server

SOM

Web Applications


Container Machine

SDE Connect

DBMS Connect

Disk Mount


File Data

Source

ArcSDE

DBMSDBMS

J8338J8338 Slide 1-44 of 52

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

150

18,000 36,000 54,000 72,000 90,000 108,000 126,000 144,000 162,000 180,000 198,000 216,000 234,000 252,000 270,000 288,000 306,000 324,000


SPE

Cra

te_i

nt20

00

300 600 900 1200 1500 1800 2100 2400 2700 3000 3300 3600 3900 4200 4500 4800 5100 5400 Displays/hrDisplay/min

Catalog ServiceArcIMS Web Applications

MXD

Web ApplicationAJAX Enabled

Web ApplicationNon-AJAX

200100 300 400 500 600

Web Server SizingWeb Application Server



44.5AMD 2 core (2 socket) 2800 MHz42.9Intel Xeon 2 core (2 socket) 3800 MHz




700 800



Web Server

SOM

Web Applications


Container Machine

SDE Connect

DBMS Connect

Disk Mount


File Data

Source

ArcSDE

DBMSDBMS

Web Server

SOM

Web Applications


Container Machine

SDE Connect

DBMS Connect

Disk Mount


File Data

Source

ArcSDE

DBMSDBMS

J8338J8338 Slide 1-45 of 52

ArcIMS Image and ArcMap ServiceScalable Architecture (based on Intel Xeon single core socket 3.8 GHz Platform Baseline)

[Single Socket (1 single core) Workgroup Server/Dual Socket (2 single core) Enterprise Servers]

ArcIMS Server

Spatial ServerDirect Connect

DBMS Connect

Application Server

Web Applications

DBMS

ArcIMS Server


DBMS Connect

Application Server

Web Applications

DBMS

ArcIMS Server


DBMS Connect

Application Server

Web Applications

DBMS

DBMS DBMS


DBMS Connect


DBMS Connect

Application Server

Web Applications

Application Server

Web Applications


Map Server Map ServerSpatial Server

Direct Connect

DBMS Connect


DBMS Connect

Map Server Map Server

Target CapacityImage Server = 387 dpm (25,740 dph)

ArcMap Server = 224 dpm (13,800 dph)





Enterprise High Available Enterprise


Intel Xeon 2 core (2 socket) 3.8 GHz 2 x Intel Xeon 2 core (2 socket) 3.8 GHz

4 x Intel Xeon 2 core (2 socket) GHz

2 x Intel Xeon 2 core (2 socket) 3.8 GHz

2006 Technology

J8338J8338 Slide 1-46 of 52

ArcGIS Server Map ServiceScalable Architecture (based on Intel Xeon new dual core socket 3.0 GHz Platforms)

[2 core (1 socket) Workgroup Server 4 core (2 socket) Enterprise Servers]

ArcGIS Server

DBMS Connect

Web Applications

SQL Express DBMS

ArcGIS Server

DBMS Connect

Web Applications

DBMS

ArcGIS Server

DBMS Connect

Web Applications

DBMS

ArcGIS Server

DBMS Connect

Web Applications

DBMS

DBMS DBMS


DBMS Connect




Container Machine

Target CapacityMap Server = 182 dpm (10,905 dph)

Up to 30 concurrent user sessions (6 dpm)





Target CapacityMap Server = 2,285 dpm (137,099 dph)

Up to 381 concurrent user sessions (6 dpm)Server Object Manager


DBMS Connect


Direct Connect

DBMS Connect


Direct Connect

DBMS Connect

Container Machine









Intel Xeon 2 core (1 socket) 3.00 GHz Intel Xeon 4 core (2 socket) 3.00 GHz 2 x Intel Xeon 4 core (2 socket) 3.00 GHz



Workgroup Enterprise High Available Enterprise


2007 Technology

J8338J8338 Slide 1-47 of 52

0

200

400

600

800

1,000

1,200

5,000 10,000 15,000 20,000 25,000 30,000 35,000 40,000 45,000 50,000 55,000 60,000 65,000 70,000

Displays per Hour

Dis

play

s per

Min

ute

Displays per Hour Conversion(DBMS Direct Connect Data Source)

1161

1084

680

627

400

ArcIMS ArcMap ServiceArcIMS ArcMap Service

ArcIMS Image ServiceArcIMS Image Service

Capacity based on Intel Xeon 4 core (2 socket) 3000 MHz ServerCapacity based on Intel Xeon 4 core (2 socket) 3000 MHz Server

571

Small Enterprise (Composite Server)

Large Enterprise (SOC Machine)Small Enterprise (Composite Server)

Large Enterprise (Map Server)

Small Enterprise (Composite Server)_

Large Enterprise (Map Server)

ArcIMS Map Server 2005 Baseline

ArcIMS Map Server 2005 Baseline

ArcGIS Server Map Server

ArcGIS Server Map Server

J8338J8338 Slide 1-48 of 52

Selecting the Right Hardware

Capacity and PerformanceUnderstand the Difference

Hardware Selection Does Make a Difference

J8338J8338 Slide 1-49 of 52

Vendor Published Hardware Metrics(www.specbench.org)

Hardware vendor benchmarks are published on the SPEC websiteHardware vendor benchmarks are published on the SPEC website

We use vendor published SPECrate_int2000 benchmarks for capacity sizingWe use vendor published SPECrate_int2000 benchmarks for capacity sizing

New June 2006 Processors OLD ProcessorsRelative

Performance

Higher MHz means Higher Energy BillsHigher MHz means Higher Energy Bills

J8338J8338 Slide 1-50 of 52

Identifying the Right PlatformHow do we select the platform we want?

SRint2000/core

30

22

17

Second processor doubles capacity

High memory gets expensive

Disk is not expensive

Real value in picking the right processor

J8338J8338 Slide 1-51 of 52

Platform Vendor Selection(Section Overview)

• Factors Supporting Hardware Selection

– Platform Performance– Purchase Price– System Supportability

– Vendor Relationships

– Total Life-Cycle Costs

4/1/2005

J8338J8338 Slide 1-52 of 52

System Design Strategies

Capacity Planning ToolDEMO

System Design Strategies TRDwww.esri.com/systemdesign

+System Architecture Design Strategies

Training Class

SERUG - System Architecture Design and Capacity...

Documents

Transcript of SERUG - System Architecture Design and Capacity...