Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch...
Transcript of Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch...
![Page 2: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/2.jpg)
This is your world – ask us today about best practicesAutomate Moving Data
No Domain Limitations
![Page 3: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/3.jpg)
ArcGIS Data Interoperability
• Formats –well, yes….
Trends
![Page 4: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/4.jpg)
ArcGIS Data Interoperability
• Formats –well, yes….• Web Integration increasingly defines ETL
Trends
ArcGIS
JSON
XML
GML RSS APIS
![Page 5: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/5.jpg)
ArcGIS Data Interoperability for ArcGIS Pro
• ArcGIS Pro 1.3 improves the ETL Tool authoring experience- ETL Tools may reference or import FMW files- Supports bringing FME-based work into Projects- Supports sharing work as FMW files
• Launch Workbench from the ribbon’s Analysis tab- Ad-hoc workflows starting from a blank workspace- Drag and drop in a FMW file to a blank workspace- Drag and drop in a recognized format file to a blank workspace- Drag and drop in a custom transformer FMX from store.safe.com
Where the extension is at in Pro
![Page 6: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/6.jpg)
![Page 7: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/7.jpg)
DemoArcGIS ProSynchronizing GDB with AGOL
![Page 8: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/8.jpg)
LiDARPoint Cloud Scenarios
![Page 9: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/9.jpg)
• Write- LAS, LASD, ZLAS, LAZ
Convert Point Cloud Formats
• Read- ASPRS LAS- ASTM E57- Microsoft (Mojang) Minecraft- Oracle Spatial Point Cloud- Point Cloud XYZ- RIEGL Laser Scan Database- Terrasolid Terrascan- Z+F LaserControl ZFS
Create LASD, ZLAS from Airborne or Terrestrial Point Clouds
Drone Acquired Point Clouds Are Coming!
![Page 10: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/10.jpg)
DemoConvert Terrascan to ZLAS
![Page 11: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/11.jpg)
Transforming Point Clouds
• Thin, Clip to reduce data• Overlay on Raster• Create a Surface Model• Slice or Profile along a line• Update Extents• Combine Clouds, Merge Components• Set Components Manually• Point-by-point Calculate Components• Point-by-point Filtering• Convert from or to Geometry Features• …
![Page 12: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/12.jpg)
Reprojection
• Ideally LiDAR has a spatial reference- LAS for example requires this to be compliant- But often it is missing or incorrect
• ArcGIS cannot Project LASD datasets- Do this in Workbench during import
• ArcGIS will see the projection in LASD/ZLAS• Common conversion is from ECEF coordinates
![Page 13: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/13.jpg)
Clipping
• Discard points outside a defined area or volume• Cubic Clipping: Clip to a 3D Solid• Data becomes more manageable
![Page 14: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/14.jpg)
Tiling
• Chop the Point Cloud into a Series• Tile by tile size in ground units• Tile by tile count in each axis
Tiler Transformer
![Page 15: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/15.jpg)
Splitting
• Split by Component Value- Classification, Color, Intensity….- Exact values or ranges
Subset Point Cloud
![Page 16: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/16.jpg)
DemoSplit a Point Cloud
![Page 17: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/17.jpg)
Colorization
• Automatically set color components• View in ArcScene or ArcGIS Pro
Inject component values for RGB
![Page 18: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/18.jpg)
DemoColorize point Cloud with Orthophoto
![Page 19: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/19.jpg)
3D GISWorking with 3D Data
![Page 20: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/20.jpg)
Working with 3D Data
• Z-enabled features read and written• Multipatch features are supported• CAD solids become GDB multipatch• Create 3D from 2D data:
- 3D Buffering- Extrusion- By Attribute Value or Expression
Data Interoperability works in 3D
![Page 21: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/21.jpg)
DemoCreate 3D Sketchup Building Model
- 2D Shapefile building outlines- LiDAR elevation values for rooftops- LiDAR ground surface model- Extrude Buildings- Set Appearance- Write Sketchup
![Page 22: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/22.jpg)
BIM and GISWorking with BIM Data
![Page 23: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/23.jpg)
Working with BIM
• Important touch point with AEC world• File size and complexity make BIM data hard to use• BIM exports IFC (too complex) or DWG (too simple)• Key: keep what you need, discard what you don’t
Web Scene Visualization
![Page 24: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/24.jpg)
![Page 25: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/25.jpg)
BIM to GIS: Mount Vernon
• George Washington’s home laser scanned to create high quality BIM in Revit
• Data Interoperability extension used to convert BIM to GIS
• Export Revit data (plus added georeferencing) with FME Revit Exporter
• Import to ArcGIS with Data Interoperability extension• Reconnect attribution• Web Scene delivery• Rich detail of BIM with spatial context of GIS
![Page 26: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/26.jpg)
BIM to GIS Scenarios
• Read IFC or RVZ• Translate Revit floorplan to Geodatabase• Extract/use BIM georeferencing• Complete control over IFC hierarchies• Reduce BIM data volumes• Update BIM from Excel tables• Webinar: GIS and BIM Interoperability - fme.ly/gisbim
•
![Page 27: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/27.jpg)
MinecraftAs Outreach Technology
![Page 28: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/28.jpg)
Working with Minecraft
• A Minecraft world is a point cloud• BlockID and BlockData components• Convert any data to Minecraft• Vector• Raster• LiDAR• BIM• etc.
![Page 29: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/29.jpg)
ExampleBowen Island: GIS + DEM to Minecraft
![Page 30: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/30.jpg)
Workspace Summary
• Read road lines (Shapefile), forest polygons (MapInfo), and raster DEM• Buffer and clip vectors to avoid overlap• Rasterize vector layers
- Make numeric rasters for Z, blockID, blockData
• Convert raster pixels to points- Set Z value and point cloud components
GIS & DEM to Minecraft
Publish as Public Consultation
![Page 31: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/31.jpg)
![Page 32: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/32.jpg)
![Page 33: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/33.jpg)
Minecraft and the real world
• Hypothetical scenarios- Lava flow- Forest fires- Rising sea levels
• Geodesign- Sweden used Minecraft for public urban planning
• Fun: fme.ly/MazeGenerator
![Page 34: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/34.jpg)
Try it, Learn it
• 60-day Trial:• http://www.esri.com/software/arcgis/extensions/datainteroperability/evaluate• Courses – search ‘ETL’ in the Training Catalog:
- Transforming Data Using Extract, Transform, and Load Processes- http://training.esri.com/gateway/index.cfm?fa=catalog.webCourseDetail&courseid=2571- Controlling Data Translations Using Extract, Transform, and Load Processes- http://training.esri.com/gateway/index.cfm?fa=catalog.webCourseDetail&courseid=2737- Data Validation checklist and webinar – fme.ly/validation- FME and ArcGIS Online resources – fme.ly/agol
Why Data Interoperability?
![Page 35: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/35.jpg)
Please take our Survey – Session 218 Offering 213Your feedback allows us to help maintain high standards and to help presenters
Find the session you want to review
Find your event in the Esri Events App
Scroll down to the bottom of the session
Answer survey questions and submit
![Page 36: Data Interoperability Advanced Use · 2016-07-25 · Supports sharing work as FMW files • Launch Workbench from the ribbon’s Analysis tab-Ad-hoc workflows starting from a blank](https://reader031.fdocuments.in/reader031/viewer/2022011819/5e9288e2a0bda807895ca1f7/html5/thumbnails/36.jpg)