Liberating Government Data with FME Cloud
21
Liberating government data with FME Cloud Adrian Laurenzi Lead Developer of Integration
-
Upload
safe-software -
Category
Technology
-
view
243 -
download
2
Transcript of Liberating Government Data with FME Cloud
Liberating government data with FME CloudAdrian LaurenziLead Developer of Integration
Who are you?
Our customers
Open
Data
Portals
Financial Transparency Apps
Core Challenge
Customer data systems are heterogeneous
FME Socrata Writer
Data on source system
Socratadataset
Performs Extraction,
Transformation, and Loading
Liberating gov’t data with FME Cloud
FME Cloud
• Apps• Data portal
Multitenant ETL services
Permits Standard - Zillow
Custom ETLs• Apps schema correction• FTP to Socrata
Version Control on FME Cloud
FME Cloud
FME Server REST API
Why is version control sooo COOL?!?
Versioning / code reviews for Python code in workflows
Not useful understanding changes in .fmw files,but…
“Oh NOOO I broke their data!”
Rollback to the rescue
git checkout 7b12120 .
git commit
git push
YESSSS!!! Smooth sailing again
Git/BitBucket Hook Integration Demo
Show example publishing via BitBucket workflow that uses PythonCaller
Thank You!
Questions?
For more information:
Adrian Laurenzi <[email protected]>
Socrata, Inc.
socrata.com
FME/Socrata Connector Templates
FME Socrata Writer Resources
FME Connector Templates
Towards more “plug-in-play” ETLs
