Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies
-
Upload
walter-simonazzi -
Category
Technology
-
view
463 -
download
0
description
Transcript of Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies
![Page 1: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/1.jpg)
Walter Simonazzi &
Christopher Brown
Geodatabase
Efficiencies
![Page 2: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/2.jpg)
Agenda
• Geodatabase design and how it can assist you
• Geodatabase Storage and Migration
• Versioning
– When to use?
– How to manage
• Geodatabase Replication
• Performance and Maintenance
![Page 3: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/3.jpg)
Department of Spatial Awareness
Dave
• New Spatial Data Administrator
• Existing Organisation
Planning Operations Media
![Page 4: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/4.jpg)
Department of Spatial Awareness
Dave
• Lots of Corporate Data stored in “silo’s”
• A lot of project data stored on peoples computers
• No specified data standards
• The data has been stored in SDE
– Where no one knows what is there
– Everyone complains about poor performance
![Page 5: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/5.jpg)
Department of Spatial Awareness
What should Dave do now?
• Identify the workflows in the organisation
• Create a data governance document
– What do the users need to do to make the data useful to
the organisation
• Create a Data Model
• Import the data into the new data model
• Setup an edit workflow
• Manage the ongoing performance of the Database
![Page 6: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/6.jpg)
What’s in a geodatabase design?
Single-user Multiuser
Tools
GIS behavior
Elements
Rules
Geodatabase
![Page 7: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/7.jpg)
Geodatabase functionality
Subtypes
Single-user Multiuser Attribute domains
Relationship classes
Topology Attachments
Default attribute values
![Page 8: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/8.jpg)
Workflow: From design to prototype
Add
data
Obtain
schema
Modify
schema
Prototype geodatabase
Design the geodatabase
![Page 9: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/9.jpg)
What should Dave do next?
• Speak to Barry
• Barry is the Corporate DBA
– It is Barry’s job to make sure that the
databases perform
The key to Enterprise GIS is a
collaboration between the business
systems and the spatial architecture
![Page 10: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/10.jpg)
Diagrammer & Case Tools (free tools)
• ArcGIS Diagrammer is a
productivity tool for GIS
professionals to create, edit or
analyze geodatabase schema.
• Is a visual editor for Esri’s .xml
Workspace Document
• *Supports complex geodatabase
elements such as topology and
parcel fabrics
http://www.arcgis.com/home/item.html?id=5af1723bab4e413bae63dd89daa87984
![Page 11: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/11.jpg)
ArcGIS Geodatabase and CASE Tools
If I build it, they will come
CDB
![Page 12: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/12.jpg)
What’s in the Geodatabase?
![Page 13: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/13.jpg)
What’s in the Geodatabase?
![Page 14: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/14.jpg)
![Page 15: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/15.jpg)
What’s inside the Geodatabase?
![Page 16: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/16.jpg)
What’s inside the Geodatabase?
- Pre-configured table - 370 configuration parameters
![Page 17: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/17.jpg)
Database Server
ArcSDE and the DBTUNE table
Client Translator
Select…
DBTUNE
Repository
![Page 18: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/18.jpg)
ArcSDE compressed binary
• Better performance for advance geodatabase elements • Reduce the storage size in the RDBMS • Difficult to access with SQL commands and third party applications
![Page 19: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/19.jpg)
Spatial field types
• The default format in ArcSDE • Easy access with SQL operators and spatial functions.
![Page 20: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/20.jpg)
Supported Storage types
![Page 21: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/21.jpg)
Migrating spatial types
Supported migration paths
• SDE binary to Geometry • SDE binary t Geography
• SDE binary to ST_Geometry • SDO_Geometry to ST_Geometry
SQLServer
Oracle
![Page 22: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/22.jpg)
Storage and Migration
Put it in the bucket
WS
![Page 23: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/23.jpg)
Like a Version
SHAPE NAME OBJECTID SDE_STATE_ID
1 Riverside NE 1 0
2 Riverside SE 2 0
3 Riverside W 3 0
SHAPE NAME OBJECTID SDE_STATE_ID
SDE_STATE_ID SDE_DELETES_ROW_ID DELETED_AT
Unique object ID
Constant for all versions of a row
Database state
Identifies when row was added
A77
D77
CELL_TOWERS
#
#
#
![Page 24: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/24.jpg)
Like a Version - Adding
SHAPE NAME OBJECTID SDE_STATE_ID
4 4 1
A77
D77
CELL_TOWERS
SHAPE NAME OBJECTID SDE_STATE_ID
1 Riverside NE 1 0
2 Riverside SE 2 0
3 Riverside W 3 0
SDE_STATE_ID SDE_DELETES_ROW_ID DELETED_AT
#
#
#
#
![Page 25: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/25.jpg)
Like a Version - Deleting
SDE_STATE_ID SDE_DELETES_ROW_ID DELETED_AT
SHAPE NAME OBJECTID SDE_STATE_ID
4 4 1
0 2 2
Created at state
Deleted at state
A77
D77
CELL_TOWERS
SHAPE NAME OBJECTID SDE_STATE_ID
1 Riverside NE 1 0
2 Riverside SE 2 0
3 Riverside W 3 0
#
#
#
![Page 26: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/26.jpg)
Like a Version - Updating
SDE_STATE_ID SDE_DELETES_ROW_ID DELETED_AT
SHAPE NAME OBJECTID SDE_STATE_ID
4 4 1
1 4 3
0 2 2
4 Riverside Mid 4 3
A77
D77
CELL_TOWERS
SHAPE NAME OBJECTID SDE_STATE_ID
1 Riverside NE 1 0
2 Riverside SE 2 0
3 Riverside W 3 0
#
#
# Riverside Mid
![Page 27: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/27.jpg)
Versioned Editing Performance
• Performance affected by: – Volume of states
– Stale statistics
– Unnecessary versions*
– Proper workflow
• Manage your version – Reconcile
– Post
– Compress
State 0
Version
pinning
state tree
0
v2
v1
v4 DEFAULT
![Page 28: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/28.jpg)
To Version or not to Version
![Page 29: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/29.jpg)
Version Creation and Management
Who’s afraid of the big bad version?
CDB
![Page 30: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/30.jpg)
What is Geodatabase Replication?
• Geodatabase replication allows you to create copies of data across two or more geodatabases and to keep data synchronized. • Geodatabase replication allows to replicate just the elements you want.
![Page 31: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/31.jpg)
Three types of Replication
Two-way
One-way
Check-out/ check-in
PARENT CHILD Sync both
directions
Sync one
direction
Check-out once
Check-in once
![Page 32: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/32.jpg)
Preparing data for replication
Data requirements
Stored in high-precision spatial format
Registered as fully versioned in 2wR (no move to base)
Non-versioned or fully versioned in 1wR (no move to base)
Must have global ids
The database user must have write permission to the data
![Page 33: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/33.jpg)
Create a Replica
• Distributed Geodatabase toolbar • Create Replica tool • Arcpy
![Page 34: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/34.jpg)
Using Replication
Replica versus Replicant
WS
![Page 35: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/35.jpg)
No LAN/WAN between offices?
Replication using Geodata services
![Page 36: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/36.jpg)
Real time edits
Use Replication to avoid service interruptions
![Page 37: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/37.jpg)
Privileges
• Data set privileges managed from ArcCatalog
![Page 38: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/38.jpg)
Performance Bottlenecks
User interaction
TCP/IP
TCP/IP
ArcMap
ArcMap
Results presented
SQL
SQL
Multiuser geodatabase
DBMS server
Client
interaction Network
Server
hardware
DBMS/
ArcSDE
![Page 39: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/39.jpg)
Attribute indexes
WHERE value > 10
Use Index
![Page 40: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/40.jpg)
Spatial indexes
Select by Location
Use Spatial Index
![Page 41: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/41.jpg)
Statistics
Full Table Scan
Use Index
Small table
Large table
![Page 42: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/42.jpg)
Scheduling tasks
Windows Scheduler
Python Script
arcpy.RebuildIndexes_management… arcpy.AnalyzeDatasets_management…
![Page 43: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/43.jpg)
Responsibilities
Dave Barry
Compress
Analyse
Attribute Indexes Attribute Indexes
Spatial Indexes
Database Statistics
![Page 44: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/44.jpg)
Performance and Management Techniques
Keep on Running
ALL
![Page 45: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/45.jpg)
Summary
• Design and maintain your geodatabase to support your business
processes.
• Every minute you spent thinking about the design of your geospatial
database can save you hours of frustration.
See you at the Booth
* The view of the presenters is not always the views of anybody else
![Page 46: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/46.jpg)
Training
• Building Geodatabases
• Configuring and Managing the Multiuser Geodatabase
• Implementing Versioned Workflows in a Multiuser Geodatabase
• Distributing Data using Geodatabase replication
Training website
http://esriaustralia.com.au/training
![Page 47: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/47.jpg)
Other Resources
• Come chat to us at the Industry Solution booth on the conference
• ArcGIS Resources – Geodatabase Community
http://resources.arcgis.com/en/communities/geodata/
• GIS Wiki
http://wiki.gis.com/wiki/index.php/Main_Page
• Esri Online Training Gateway
http://training.esri.com/gateway/index.cfm
![Page 48: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/48.jpg)
Questions?
Thank you
![Page 49: Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies](https://reader033.fdocuments.in/reader033/viewer/2022051212/5580fba0d8b42a9d198b4c80/html5/thumbnails/49.jpg)