Sep. 21, 2006 v FME Worldwide User Conference - Vancouver Geomatics and FME from a Corporate...

Sep. 21, 2006v FME Worldwide User Conference - Vancouver

Geomatics and FME from a Corporate PerspectiveNadia Shahriari Namini – City of Calgary, Alberta

Geomatics and FME 2

Geomatics and FME 3

City of Calgary

Population ~ 1,000,000

22,583 growth last year

Area - 286 square miles and growing

Hosted 1988 Winter Olympics

Home of the Calgary Stampede

Alberta’s main industries are oil, gas and cattle

Geomatics and FME 4

The City of CalgaryMunicipal Government

City Council

Mayor and 14 Aldermen

Municipal Administration

City Manager, 6 Major Departments, 27 Business Units

11,733 Employees

Geomatics and FME 5

How Does Geomatics Fit In?

Utilities & Environm entalProtection

Land Inform ation &M apping

Geomatics M unicipalRights-of-W ay

EngineeringSurvey

InfrastructureInform ation

Corporate DataAccess & M arketing

City M anager

Geomatics and FME 6

Geomatics

Cadastral Mapping

Field Services

GIS Mapping

Base MappingManagement

Tri-ServicesDispatch Mapping

Rural RoadnetPhotogrammetric

ServicesCustom Mapping

GIS Analysis

Geomatics Division

Geomatics and FME 7

Provides data conversion/GIS analysis services to numerous IT projects and Business Unit clients

Responsible for loading and QA of numerous datasets to Corporate SDE (~350 SDE layers)

GIS Analysis

Geomatics and FME 8

Numerous technologies: FME, ArcGIS, ArcSDE, AML, Pro-C,

PL/SQL, … Batch jobs: nightly, weekly, monthly,

… Ad-hoc processes

GIS Analysis (Cont.)

Geomatics and FME 9

CLIENTS

Water ServicesWater Resources Roads

Parks

Fire

Police

LIM-CDAM

LIM- Infrastructure Information

Assessment

Trans. Planning

Calgary Transit

Information Technology

Urban Development

Development & Building

Approvals

Geomatics and FME 10

SERVICES

Spatial/Non-Spatial Data

Integration/Conversion

Maintenance of more than 350

Corporate SDE layers

Data Translations / Transformations

Data Schema Change

Spatial/Non-Spatial GIS Analysis

Quality Assurance

GIS Analysis Consultation

Data Conversion Consultation


SDE Layers

56 Legal Survey Fabric (LSF) Layers 10 Ownership Parcel Fabric (OPF) Layers 2 Address POSSE Layers 44 Digital Aerial Survey (DAS) Layers 6 Road Network (RoadNet) Layers 42 Waterworks Layers 16 Sanitary Layers 26 Storm Layers 15 Layers for Transit/Transportation 14 Layers for Calgary Parks 5 Layers for Calgary Fire 7 Layers for Calgary Police 31 Layers for Calgary Census 8 Layers for Calgary Schools …..


Example Projects

Trip Planning Application Street Lighting Enterprise

Geodatabase Permitted Use Building Envelope

Analysis Open Space GIS Analysis Parks Asset Management Waterworks and Wastewater Asset

Management …..


Waterworks: a multi-million dollar public utility that manages all aspects of the water treatment and delivery process for The City of Calgary.

Wastewater: responsible for the design, construction, and maintenance of two separate collection systems: Storm drainage system: helps prevent flooding by

diverting rain and snow melt. Sanitary system: protects public health and the

environment by collecting and treating wastewater from residences, schools, hospitals, businesses, and industries.

Waterworks and Wastewater Asset Management


Source data sets: MicroStation Design files (387 sections) Oracle database (about 100 tables)

Destination data sets: 39 Water Works SDE layers 14 Sanitary SDE layers 24 Storm SDE layers



Sample Source DGN Files


Database Schemas

Sanitary StormWaterworks


DGN files

Oracle DB

AML ScriptsCoverages SDE layers

ARCSDE commands

Old process:

New process:

DGN files

Oracle DB

FMESDE layers



- Data filtering

- Data Integration

- DB tables Join

- DB to DGN Join - Geometric Operations

- Linear Referencing - Data Manipulation

- Overlay Analysis- …

FME Processes Destination Data Sets

Source Data Sets



4 Filtering Transformers: Perform tests on feature geometry/attribute and route the features to different ports.

9 Geometric Transformers: Operate on the geometry of individual features /groups of features.

9 String Transformers: Operate on character strings.

1 Linear Referencing Transformers: Create and apply measure related information onto the geometry.

3 Collector Transformers: Operate on collections of features at a time.

Utilized FME Tools


8 Manipulator Transformers: Modify the geometry/attribute of individual features.

2 Database Transformers: Allow interactions with external databases.

6 Infrastructure Transformers: Interaction with the underlying FME engine facilities.

6 Calculator Transformers: Calculate a value and supply it to a new attribute.

8 List Transformers: Operate on FME attribute lists.

Utilized FME Tools (Cont.)


Quality Assurance/Quality Control


FME Workspaces: 20 for Water Works 16 for Sanitary 20 for Storm

Batch files: 3 batch files Running time: ~10 hrs.

Intel Pentium 4 CPU 2.80 GHz 2.00 GB of RAM

Output Data sets: 77 SDE layers

Summary


Challenges

Backward Compatibility (with older versions)

Line-linked vs. Point-linked Annotation

StringReplacer and StringPairReplacer

Help Document Data cleaning (MRFCleaner

transformer)


What Do We Like about FME?

Easy to maintain Easy to document Data Integration from Multiple sources Multiple Destination datasets No intermediate data sets required Complex spatial and non-spatial

analysis all in a single FME workspace QA/QC processes Batch mode Safe Software Support FUN …


Thank You.

Sep. 21, 2006 v FME Worldwide User Conference - Vancouver Geomatics and FME from a Corporate...

Documents

Transcript of Sep. 21, 2006 v FME Worldwide User Conference - Vancouver Geomatics and FME from a Corporate...