STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take...

109
STORIES FROM AROUND THE WORLD

Transcript of STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take...

Page 1: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

STORIES FROM AROUND THE

WORLD

Page 2: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

LEVEL LEADERBOARD

123

Discover FME InnovationExplore New IdeasTake Inspiration Home

Page 3: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Suncor Energy Inc. Alonzo de la Cruz, Canada

Page 4: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Performing geospatial data integration for subsurface engineers.

● Reduce time spent on straightforward but time -consuming data integration tasks.

● Reduce human error.

Page 5: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges● Existing processes involved

manual steps across several applications.

● Large data volumes needed cleaning and formatting.

Page 6: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

Source Datafrom many systems

SolutionConvert, Manipulate, Clean

Usable Datafor engineers

START FINISH

Page 7: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

FME Workspace: Get corners of

GeoTIFFs

Page 8: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

FME Workspace: Transform data from 3 database tables

Page 9: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results

● Subsurface teams (geologists & geotechs) access data within minutes of their requests.

● Geospatial data tasks are reduced from hours of manual work to minutes of automated work.

Page 10: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

Alonzo is the hero at work.

● Data integration reduced from hours to minutes.

● Removed manual work to create an automated process.

● Reduced risk of human error.

Page 11: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tips

● FME is great for data cleaning and reformatting.

● A simple FME Workspace can be your most powerful tool.

Page 12: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“By automating mundane tasks with FME, you can mass ively improve the quality of

your work, and your work life.”

- Alonzo de la C ruz, S uncor E nergy Inc.

Page 13: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Buccleuch Estates Christine Brown, Edinburgh, Scotland

Page 14: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Increase efficiency of farm maintenance inspections (fences, gates, troughs).

● Automate compiling and delivering farm condition inspection reports.

Page 15: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges● Existing processes involved

manually compiling photos and notes into a Word doc.

● Images and text needed to be converted into a report automatically.

Page 16: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

Source data from Trimble device

GPS coordinates and photos

FME Workflow

Buffer, read, clip features and

attributes

Output to PDF

Farm condition inspection report

with photos

START FINISH

Page 17: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Input:Data from

Trimble device

Page 18: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Input:Shapefiles and photos online

Page 19: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

FME Workspace:Generate farm

condition report

Page 20: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output: PDF report

Page 21: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results● Multi-page PDF showing two

features per page.

● This method is now being tested throughout Buccleuch Estates.

Page 22: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

Farm condition reports are created:

● Faster● More easily● In a standardized

format

Page 23: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tips

● PDFFormatter and PDFStyler are helpful and easy to use.

● Use Counter and Grouper to ‘pass’ features in order.

Page 24: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Future Plans

● Expand the attribution data following user feedback.

● Include the option to produce reports in a Word format.

Page 25: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“Using FME with Trimble is a huge time saver for compiling

Farm C ondition reports .”- C hristine B rown, B uccleuch E states

Page 26: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Valeron Enviro Consulting Jaroslav Hruskovic, Slovakia

Page 27: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Visualize windfields for urban architects.

● Convert and analyze windfield data models.

Page 28: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges

● Windfield data models were previously discarded, unused.

● Generate windfield maps.

● Perform analysis and calculations on the data.

Page 29: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

Windfield Matrices FME Workspace

Calculate, analyze, visualize

Result

Multi-page PDF with results

START FINISH

Page 30: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Input

Page 31: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 32: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 33: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results● A fully developed product offering

wind analysis.

● In demand by architects, especially for designing outdoor activity spaces.

Page 34: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

● Reduced the number of applications to create an automated workflow from many to just one.

● Shortens calculations from days to hours.

Page 35: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tips

● Complex challenges can be simple to solve.

● Group -by makes processing simple.

Page 36: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“With FME this project can be easily modified and the outputs can be updated with ease.”

- Jaroslav Hruskovic, Valeron Environ Consulting

Page 37: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Future Plans

Extend workflows to identify:

● Typical snow deposition locations.

● Pollen spread for allergen prediction map.

Page 38: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

STORIES FROM AROUND THE

WORLD

Page 39: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

LEVEL LEADERBOARD

123

Discover FME InnovationExplore New IdeasTake Inspiration Home

Page 40: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tesera Systems Michael Kieser, Canada

Page 41: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Create high-resolution forest inventories.

● Integrate high-resolution raster and precise vector data.

Page 42: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges● Integrating high-resolution remotely

sensed imagery and LiDAR, with precise ground measured plots

● Managing this data over large project areas 10,000-150,000 km2.

Page 43: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

SolutionTiling Scheme

Standard across all projects

FME WorkspacesGeneric across

projects

Tiled Project DataUniversal data

storage & access

START FINISH

Disparate Source DataLiDAR, CIR, LCC, plot

Page 44: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Example (re -tile imagery)● Tiled imagery layers derived from CIR

and LiDAR (colour, false colour, NDVI, hillshade, CHM)

● Generate Google Compatible slippy map tiled imagery layers

● Tile layers stored on AWS S3● Deliver layers in desktop GIS & web

viewer (Leaflet, Mapbox)

Page 45: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Add screenshot here

Input

Page 46: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Add screenshot here

FMECloud - 1 kick -off job

Page 47: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Add screenshot here

Tilings

Page 48: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Add screenshot here

FMECloud - 491 server jobs

Page 50: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

● Tiling data is fundamental to

automation

● FME Workspaces require only

a few parameter adjustments

for each client

● FMECloud provides scalability

Page 51: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tip● BoundingBoxReplacer: 3rd party data

● SpatialRelator: project tile with 3rd party

BB

● Process by project tile

● WebMapTiler: static raster tiles

● AWS S3: storing & serving static raster

tiles

● Can’t wait for vector tiles in FME

Page 52: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“FME Cloud is a critical tool for orchestrating and running our

integration processes.”- Michael Kieser, Tesera Systems

Page 53: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Australian Rail Track Corporation (ARTC) Mike Gresham, Australia

Page 54: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Visualize properties for the design & feasibility phase of railway construction.

● Create geospatial representations of land access agreements.

Page 55: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges● Integrate an Excel register of land access

agreements with GIS land parcel data.

● Agreements may contain multiple land parcels.

● Program covers three states with unique cadastral identifiers.

Page 56: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

Excel Land Agreements +

GIS Land Parcels

FME Workspace

Split, join, cache, and validate land agreement data

Comprehensive GIS Layer

START FINISH

Page 57: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

FME Workspace

Page 58: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

FME Workspace

Page 59: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output Data

Page 60: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results● Visualization of properties and

related access agreements.

● Lowers risk of trespassing.

● Ensures amicable relationships with land owners.

Page 61: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

● Ordinary GIS software would not have been able to accomplish this process.

● Automated daily updates.

Page 62: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tip

● Take time to understand FME’s unique capabilities, how they work, and how they contribute to the end result.

Page 63: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“FME produced a result where mainstream GIS software couldn’t without the use of scripting.”

- Mike Gresham, ARTC

Page 64: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Plains Midstream Canada Patrick Cheng, Canada

Page 65: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Create models for simulating fluid in pipelines.

● Automate data integration for pipeline design, optimization, and leak detection.

● Keep up-to-date with business demands of using hydraulic profiling/pressure models.

Page 66: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

ChallengeAutomate a previously month -long model creation process.

Page 67: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

FME Workflow

Integrate data and convert into a text -

based format

SPS

Fully functioning system

GIS spatial data+

PODS attribute data

START FINISH

Page 68: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

B b

Input

Page 69: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

FME Workspace

Page 70: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 71: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 72: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results● A fully functioning system replaces models.

● 1 month of effort has been reduced to 1 -2 hours.

Page 73: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

● Increased standardization and accuracy of pipeline attributes.

● Automation of model creation.

● Time is saved to free up resources and staff workload.

Page 74: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tips

● ListBuilder, Sorter, and Concatenator are helpful for creating multiline attributes.

● ExpressionEvaluator is helpful for creating scaling factors.

● StringConcatenator is helpful for generating script syntax.

Page 75: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“I have definitely seen a much greater scope of functionality for FME that is not limited to just

G IS data.”- P atrick C heng, P lains Midstream C anada

Page 76: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

GHDSteven Cyphers, California, USA

Page 77: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Gather business intelligence from monetary data.

● Analyze company spending for abnormalities.

● Find investment diversification opportunities.

Page 78: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges

● Large data volumes. Must extract relevant data from 21 million filings (450 GB).

● Cleaning, formatting, and categorizing unstructured text.

Page 79: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

EDGAR Files

Pull filings from the web via API.

FME Workspace

Pull, retrieve, aggregate,& apply machine learning.

Data Collation

Put into SAP HANA for further BI tasks.

START FINISH

Page 80: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Input

Page 81: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Add screenshot here

FME Workspace

Page 82: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results

Data is in SAP HANA for business intelligence:

● Financial data collation.● Keywords are flagged for

further exploration.

Page 83: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

● Gathered publicly available data and derived business intelligence for a competitive edge.

Page 84: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“I would never want to tackle this with just Python, Spark or AWS Glue.

I use FME for everything.”- Steven Cyphers, GHD

Page 85: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tip

AttributeManager + HTTPCaller are your BFFs for building APIs.

Page 86: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Santa Clara CountySteven Hong, California, USA

Page 87: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

● Improve the call location accuracy and response time for 911 dispatch system.

● Empower cities to become data stewards and contribute addresses on a regular basis.

Page 88: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges

● Aggregate and standardize 15 different city data schemas.

● Supplement data schemas with public safety layers.

Page 89: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

15 unique city datasets

FME Workflow

Transform the data into standardized schemas

Aggregated address datasets:

RAM + RAMPS

START FINISH

Page 90: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

PRE- RAMPS

Page 91: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

RAM/RAMPS

Page 92: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results

● Cities are empowered to contribute accurate addresses to a county -wide aggregation.

● Project completed on time.

Page 93: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results

50% increase in number of addresses available to 911 operators

Page 94: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

● Allowed for fast, iterative changes to workflows as new data was discovered.

● Flexibility means being prepared for future changes.

Page 95: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tip

● DuplicateFilter helps identify duplicate data points (a great help for a 911 dispatcher working with addresses)

Page 96: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“FME’s ability to generate multiple formats within the same workflow is a

huge timesaver. ”- Steven Hong, County of Santa Clara

Page 97: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

AbleyTodd Davis, New Zealand

Page 98: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Objectives

Improve road safety with a new Safe View product.

● Analyze roads and calculate overtaking vis ibility and limitations .

● S calable, automated process .

Page 99: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Challenges● Developing a methodology. Workflow

allows for varying input/scenarios.

● Handling large data volumes ofhigh-accuracy LiDAR.

● Building an optimised, scalable workflowthat can perform billions of calculationsquickly and accurately.

Page 100: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Solution

Road CenterlineDigital Surface Model/

LiDAR

FME Workspace

Integrate datasets, calculate visibility

Visibility Obstruction

Dataset

START FINISH

Page 101: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 102: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 103: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 104: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 105: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Output

Page 106: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Results● Safe View was field validated and accepted as

accurate by the New Zealand Transport Agency.

● Scalable road safety product that can be utilised anywhere within the world.

● Enhanced existing road safety processes.

Page 107: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Benefits

● Allows roading authorities to have confidence in their placement of yellow “no overtaking” lines.

● Highlights area that can be considered for minor realignment, regrading, or vegetation management to create or extend overtaking opportunities.

Page 108: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

Tip● Point Cloud processing in FME is very

fast.

● Point Clouds don’t need to have geometry.

● Getting rid of attributes/components that aren’t used will make your process run quicker.

Page 109: STORIES FROM AROUND THE WORLD · 2019-05-23 · Discover FME Innovation. Explore New Ideas. Take Inspiration Home. Suncor Energy Inc. Alonzo de la Cruz, ... data following user feedback.

“FME enabled us to add value to existing datasets , re-purpos ing and leveraging

data that was already captured.”- Todd Davis , Abley