The Synapse IoT Stack: Technology Trends in IOT and Big Data

13
The Synapse IoT Stack: Accelera4ng Startups with Technology

Transcript of The Synapse IoT Stack: Technology Trends in IOT and Big Data

The  Synapse  IoT  Stack:  Accelera4ng  Startups  with  Technology  

What does THE HIVE provide?

Business Design & Go-To-MarketIn-house operating team and expert advisors working with entrepreneurs

Synapse Technology StackApplication back-end technology stack covering Big Data, Cloud & Mobile

Entrepreneur Access & Team DesignUnique access to top talent due to brand & relationships in Silicon Valley

Brand & EcosystemBig Data think tank driving thought leadership with 4500+ members and weekly talks and panel discussions

Seed & Follow-on CapitalInvest $1.5M + $1.5M per company and help syndicate with VCs

Unique value creation structure to start and launch Big Data companies

11/21/14   2  

Goals  of  Synapse  Tech  Stack  

11/21/14   3  

Accelerate product development & go-to-market for The Hive startups

Seamlessly plug-in the latest open source innovations in data science & infrastructure

Engage & contribute back to relevant open source communities

THE  HIVE  Startups  

Internet  of  Things   Enterprise   Online  

11/21/14   4  

5  

Demys4fying  IoT  Market  

Ac*ve  Energy  Mgmnt,  Wind,  Solar,  Hydro,    Oil  &  Gas,  Grid  Mgmt.  

Energy  

IoT  Specific  Networks  &  Infrastructure/PaaS  Security  &  Data  Privacy  

Telco/SPs   Fleet  Management  Asset  Tracking  Infotainment  Ford  Sync  GM  OnStar    

Transporta4on  /  Connected  Car  

Process  Control,  Maint.,    Manufacturing  Execu*on  Systems  (MES)  Asset  Loca*on  (RFID,  NFC)  Smart  Agriculture  &  Farming  

Manufacturing  

Smart  Home  Management  Energy,  Water,  Security,  Climate  

Home  Automa4on  

At  Home  Care,  Remote  Monitoring,  Tele-­‐Health,  Post-­‐Surgery  Analy*cs/Diagnosis  

Healthcare  

Supply  Chain  Control  NFC  payments/games  Intelligent  Shopping  (WiFi,  BLE,  iBeacon)  Smart  Restocking/Rota*on  

Retail  

Waste  Management  Smart  Parking,  Pollu*on  Intelligent  Traffic  Systems  

Public  Sector  

Energy  Management  Automa*on  Structural  Health  Security  

Building  Video  surveillance,    Access  control,    Radia*on,  Explosives,    Hazardous  Gases    

Public  Safety  

Industrial  

Commercial  

Consumer  $1.6tr  (CY17)  

$1.2tr  (CY17)  

$1.0tr  (CY17)  

Source:  IDC  Internet  of  Things  Spending  Guide  by  Ver*cal  Market  2014  

Smart  Home  Management  Energy,  Water,  Security,  Climate  

Wearables  

Synapse  Stack  for  IoT  

Network  Communica*on  

Appliance  So]ware  

Appliance  Hardware  

Rules  /  Analy*cs  Engine  

Applica*on  Pla^orm  

Database  

Applica*ons  

S  E  C  U  R  I  T  Y  

E  X  T  E  R  N  A  L    S  O  U  R  C  E  S  

B  U  S  I  N  E  S  S  

11/21/14   6  

Big  Data  Challenge  

11/21/14   7  

Synapse  Lambda  Architecture  

11/21/14   8  

Master Data Set

Batch Processor

Batch View 1

Batch View 2

Batch View n

Bulk Uploader

Machine Learning

Batch Serving DB

Batch Layer

Realtime LayerTransaction Data Stream

Realtime Processor

Realtime Serving DB

Realtime Machine Learning

Append Only

Query Processor

Synapse  Components  

11/21/14   9  

Data  Inges*on  &  Lineage  

Storage  

Stream  Processing  

Batch    Processing  

Machine  Learning  

Service  API  

Visualiza*on  P  D  R  E  O  P  V  L  I  O  S  Y  I  M  O  E  N  N  I  T  N  G  

The  Hive  IoT  Startups  

Synapse  Components  

11/21/14   10  

Ukoo  (Data  Inges*on  and  Lineage)  

Duka  (Storage)  

Tempus  (Real*me  Processor)  

Huduma  (Batch  Processor)  

Akili  (Machine  Learning)  

Alchemy  (API  Services)  

Tasvira  (Visualiza*on)  

P  D  R  E  O  P  V  L  I  O  S  Y  I  M  O  E  N  N  I  T  N  G  

The  Hive  IoT  Startups  

Synapse  Internals  

11/21/14   11  

Machine  Learning  

The  Hive  Startups  

Kaga   Flume   Morphlines   Kite  SDK   MQTT   Falcon  

HBase   HDFS   Cassandra   Redis   PostGreSQL  

Data  Inges*on  &  Lineage  

Storage  

Spark    Streaming     Storm    

Stream  Processor  Spark     Hadoop    

Batch  Processor  

REST   SQL  Service  API  

Tableau     Gephi     D3.js    

Visualiza*on  

P  D  R  E  O  P  V  L  I  O  S  Y  I  M  O  E  N  N  I  T  N  G  

D  O  C  K  E  R  

AKILI  –  Synapse  Machine  Learning  

11/21/14   12  

HDFS

Database

Local File

I  N  T  E  R  F  A  C  E  

P  R  E    P  R  O  C  E  S  S  O  R  

Transformation / Feature Selection

Large  Scale  Recommeder  Engine  

Naive Bayes

Decision Trees

Your Custom Model

Code  Genera*on  

Embedded Models

APIService

Model Storage

ML Black BoxInput Data

Custom Adapter

THANK  YOU  

11/21/14   13  

   @hivedata              /HiveData    Jobs:  h\p://hivedata.com/jobs/  Events:  h\p://hivedata.com/events/