Processing Near Real-Time Global Vessel Data

9
CONNECT. TRANSFORM. AUTOMATE. Using Safe FME to ETL Near Real- Time Global Ship Tracking Geodata Taylor Nicholls Product Manager, exactEarth Ltd.

description

exactEarth describes its close work with Safe to allow the seamless integration of exactAIS global vessel data that is managed and processed through FME 2014.

Transcript of Processing Near Real-Time Global Vessel Data

Page 1: Processing Near Real-Time Global Vessel Data

CONNECT. TRANSFORM. AUTOMATE.

Using Safe FME to ETL Near Real-Time Global Ship Tracking Geodata Taylor Nicholls Product Manager, exactEarth Ltd.

Page 2: Processing Near Real-Time Global Vessel Data

exactEarth Tracks Ships

CONNECT. TRANSFORM. AUTOMATE.

Page 3: Processing Near Real-Time Global Vessel Data

How Do We Track Ships?

CONNECT. TRANSFORM. AUTOMATE.

Page 4: Processing Near Real-Time Global Vessel Data

What Data is Collected?

!  NMEA v.4 Automatic Identification System (AIS)

CONNECT. TRANSFORM. AUTOMATE.

\c:1376505330*5A\!AIVDM,1,1,,B,15BVJ@001UImQG1i3cS:g`Vt1W3h,0*10 \c:1376505331*5B\!AIVDM,1,1,,B,13F;ER7Oh9ImjK3hFw10A1i008Bm,0*04 \c:1376505332*58\!AIVDM,1,1,,A,13EWsr000tIiR25h;oRSL2k206B<,0*64 \c:1376505332*58\!AIVDM,1,1,,B,34WN660viTG<dVcm<c7cG93000wh,0*6E \c:1376505333*59\!AIVDM,1,1,,B,33F86P7P0Rq8;@uf>ucM3gw42C9C,0*60 \c:1376505334*5E\!AIVDM,1,1,,A,33F;ER7Oh9ImjK3hFw2P7Ai60200,0*43

MMSI   Msg  Type   Time   Channel   SOG   Longitude   La9tude  355048000   1  20130814_183530   B   10.1   -­‐86.1752   -­‐26.1139  224581000   1  20130814_183531   B   0.9   -­‐86.11695833   -­‐27.33439333  224001000   1  20130814_183532   A   6   -­‐87.04671667   -­‐27.63795667  309823000   3  20130814_183532   B   10   -­‐123.0554317   -­‐18.87781667  224528000   3  20130814_183533   B   3.4   -­‐96.08101667   -­‐31.04867167  224581000   3  20130814_183534   A   0.9   -­‐86.11695833   -­‐27.33438333  

Page 5: Processing Near Real-Time Global Vessel Data

How Much Data is Collected?

!  5,000,000 satellite and coastal messages / day !  > 100,000 ships

CONNECT. TRANSFORM. AUTOMATE.

Page 6: Processing Near Real-Time Global Vessel Data

Customer Challenges & Solution

!  TCP/IP data stream !  NMEA v.4 binary format !  Millions of messages !  How to decode and transform !  How to store and use data

!  Enter… FME 2014 !  Supports NMEA Automatic Identification System

(AIS Data)

CONNECT. TRANSFORM. AUTOMATE.

Page 7: Processing Near Real-Time Global Vessel Data

FME & AIS How-to 101

!  Connect !  TCP/IP

!  Transform !  AIS to 325 different formats

!  Automate !  Workspace w/ WorkspaceRunner loops main

Workspace !  … Repeat 5,000,000 times / day

CONNECT. TRANSFORM. AUTOMATE.

Page 8: Processing Near Real-Time Global Vessel Data

Demo

CONNECT. TRANSFORM. AUTOMATE.

Page 9: Processing Near Real-Time Global Vessel Data

Thank You!

!  Questions?

!  For more information: !  Taylor Nicholls, [email protected] !  exactEarth Limited

!  www.exactearth.com

CONNECT. TRANSFORM. AUTOMATE.