DevTalks Bucharest

24
‹#› xPattern Connect 5.0 Mesos, Tachyon, Spark, Spark SJR, JAWS, Hive, Cassandra, Solr Radu MOLDOVAN Senior Team Lead BUCHAREST July 2015

Transcript of DevTalks Bucharest

Page 1: DevTalks Bucharest

‹#›

xPattern Connect 5.0

Mesos, Tachyon, Spark, Spark SJR, JAWS, Hive, Cassandra, Solr

Radu MOLDOVANSenior Team Lead

BUCHAREST July 2015

Page 2: DevTalks Bucharest

About me

• 20 years of programming (open source)

• last 3 years worked in Big Data

• Team Lead @

• building the 5th generation of xPatterns Platform

Page 3: DevTalks Bucharest

What is xPatterns Connect?

xPatterns is a software platform to build intelligent, self-improving, petabyte-scale, enterprise-grade, data driven applications.

Connect is a pre-build big data analytics technology that bypasses traditional ETL & cluster configuration

Page 4: DevTalks Bucharest

Where can I find it?

Page 5: DevTalks Bucharest

Main features

Page 6: DevTalks Bucharest
Page 7: DevTalks Bucharest

Data Import

Page 8: DevTalks Bucharest

Workflow (Oozie)

Page 9: DevTalks Bucharest
Page 10: DevTalks Bucharest
Page 11: DevTalks Bucharest
Page 12: DevTalks Bucharest
Page 13: DevTalks Bucharest

Warehouse explorer - powered by JAWS

Page 14: DevTalks Bucharest

Experimentation

Page 15: DevTalks Bucharest

Monitoring

Page 16: DevTalks Bucharest

Monitoring - Nagios

Page 17: DevTalks Bucharest

Monitoring - Ganglia

Page 18: DevTalks Bucharest

REST API (swagger)

Page 19: DevTalks Bucharest

Documentation

Page 20: DevTalks Bucharest

For the enterprise. For developers. For the breakthrough.

Page 21: DevTalks Bucharest

Applications built on top of services (Fraud)

Page 22: DevTalks Bucharest

Applications built on top of services (Medical)

Page 23: DevTalks Bucharest

Open Source contributions

Spark Job Server - https://github.com/Atigeo/spark-job-restSolves inability to run multiple Spark contexts from the same JVMMultiple Spark contexts with distinct JVMJob submission in Java + Scala

Jaws - http://github.com/Atigeo/http-spark-sql-server Restful service for running Spark SQL/Shark queries on top of Spark

xPatterns API & sampleshttps://github.com/Atigeo/xpatterns-spark-api

https://github.com/Atigeo/xpatterns-spark-demo

Page 24: DevTalks Bucharest

© 2015 Atigeo, Corporation. All rights reserved. Atigeo and the xPatterns logo are trademarks of Atigeo. The information herein is for informational purposes only and represents the current view of Atigeo as of the date of this presentation. Because Atigeo must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Atigeo, and Atigeo cannot guarantee the accuracy of any information provided after the date of this presentation. ATIGEO MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.