PTLSergey Lukjanov
Data Processing UpdateOpenStack Sahara
To provide a scalable data processing stack
and associated management interfaces Sahara
● provisions & operates data proc. clusters● schedules & operates data proc. jobs /
workloads
Elastic Data Processing (EDP) is Sahara’s take on data processing workflow management.
Juno release overview
● 540+ code commits from 50 people● 32 blueprints implemented
● ~5000 code reviews● ~168 bugs fixed
details: https://launchpad.net/sahara/juno
Moved to specs for new features
Sahara UI completely merged into Horizon
Pluggable framework-agnostic EDP
Vanilla Apache Hadoop 2.4.1 support
Cloudera Distribution of Apache Hadoop 5.X support
Apache Spark 0.9.1 and 1.0.0 support
Ceilometer integration
Heat resources for Sahara available
Auto security groups creation
Kilo plans
● New versions for CDH, HDP, etc.● Dashboard UX improvements
● Better Heat integration● Ironic support
Top Related