OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator:...

47
OpenStack Community Meeting August 30, 2018

Transcript of OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator:...

Page 1: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

OpenStack Community MeetingAugust 30, 2018

Page 2: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Agenda● OpenStack “Rocky” Release Overview● Pilot Projects Updates

AirshipKata ContainersStarlingXZuul

● Berlin Summit Updates

Page 3: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

OpenStack RockyAugust 30, 2018

Page 4: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Rocky Feature

High Level Category Potential Use Case

Page 5: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Increasing interest in bare metal

Page 6: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

OpenStack User SurveyIronic usage2016: 11% in production2017: 15% in production2018: Coming soon!

Page 7: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Ramdisk deployment interfaceNew interface in Ironic supports diskless

deployments

For ephemeral workloads, no writing to local storage

Large-scale computing, quick deployment

Scalability HPC

Page 8: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Management for BIOS settingsIronic adds ability for users to manage BIOS

Giving flexibility and customization options

Enable virtualization/hyperthreading; enable SR-IOV,

DPDK

Manageability NFVPerformance

Page 9: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Improving the upgrade experience

Page 10: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Fast Forward Upgrades

TripleO helps users quickly get to newer releases

Bug fixes and testing in the Rocky cycle

Users can speed from N→N+3 release

Upgrades Manageability

Page 11: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Delivering Rocky on Day 1A user story of being on OpenStack Rocky out of the

gates, and delivering the latest to customers

Page 12: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Advances in new components

Page 13: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

FaaS for OpenStack cloudsQinling 1.0.0

Function-as-a-Service on top of OpenStack

Uses K8S for containers that run on OpenStack clouds;

servers “hidden” from the user

Scalability FaaS / Serverless

Page 14: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Introspective instance monitoring

Expanding Masakari’s monitoring to include internal

VM faults

Hung guest OS, scheduling failures by the guest OS,

data corruption

Stability HA

Page 15: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

FPGA programming supportCyborg lets users reprogram FPGA devices

FPGA used as CPU accelerator: Machine learning,

image recognition, POCs

REST API for FPGA now in Cyborg

Scalability HPCManageability

Page 16: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Ease of operations and expanding functionality

Page 17: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Community Wide Goals

Enable mutable configuration across projects

Ability to change configuration options without a service

restart

Manageability Performance

Page 18: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Port forwarding for floating IPsForwarding for TCP and UDP supported via Neutron

When operators have limited IP addresses, lets them

reuse floating IP addresses

Access to port-mapping tools in the larger ecosystem

Manageability Ops Integration

Page 19: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Specifying AZ in reservations

Blazar expanding availability zone awareness

Expanding Blazar’s awareness of availability zones to

support multiple AZs, and let users specify an AZ at

reservation

Compliance Manageability

Page 20: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Introducing “hidden” images Glance image service adds the option to “hide”

images

Operators can hide an image from the image list

(outdated, not to be used), but have it available for

rebuilds if needed

Security OpsManageability

Page 21: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

UDP support in load balancing

Scalability IoT/Edge

Octavia adds load balancing for User Datagram Protocol

UDP used in streaming, voice, video, real-time performance applications

Page 22: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Secure hash to verify image integrityGlance image service adds hash support

Operators can generate a secure hash to be used by

image consumers to verify integrity of an image

Security Ops

Page 23: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Rocky Release Resourcesopenstack.org/software/rocky

releases.openstack.org/rocky/highlights.html

Page 24: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Pilot Project Updates

Page 25: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Join the Community

Mailing Lists: lists.airshipit.org

Freenode IRC: #airshipit

Page 26: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 27: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 28: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 29: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 30: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 31: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 32: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 33: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 34: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 35: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 36: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 37: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

Join the Community

Mailing Lists: lists.katacontainers.io

Freenode IRC: #kata-dev

Slack: bit.ly/KataSlack

GitHub: github.com/kata-containers

Page 38: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 39: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 40: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 41: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 42: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 43: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 44: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 45: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

OpenStack Summit BerlinNovember 13-15, 2018openstack.org/summit/berlin-2018/

Page 46: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability
Page 47: OpenStack Community Meeting...Cyborg lets users reprogram FPGA devices FPGA used as CPU accelerator: Machine learning, image recognition, POCs REST API for FPGA now in Cyborg Scalability

The Digital Cyborg Assemblage: Haraway’s Cyborg · PDF file1 The Digital Cyborg Assemblage: Haraway’s Cyborg Theory and the New Digital Health Technologies Deborah Lupton, Department

The Digital Cyborg Assemblage: Haraway’s Cyborg · PDF file1 The Digital Cyborg Assemblage: Haraway’s Cyborg Theory and the New Digital Health Technologies Deborah Lupton, Department

Cyborg Report Final

Cyborg Report Final

Cyborg Seminar

Cyborg Seminar

Presentation cyborg

Presentation cyborg

Cyborg Ppt

Cyborg Ppt

Cyborg Beetle

Cyborg Beetle

Cyborg or Goddess?

Cyborg or Goddess?

CYBORG Report-Ujjawalk

CYBORG Report-Ujjawalk

Cyborg paradise klinkowstein

Cyborg paradise klinkowstein

Cyborg Training for Payroll Adjustments Keying Time Entry in Cyborg.

Cyborg Training for Payroll Adjustments Keying Time Entry in Cyborg.

Texturizar Cyborg

Texturizar Cyborg

Cyborg Distortion Manual

Cyborg Distortion Manual

cyborg-by almas

cyborg-by almas

Cyborg consciousness

Cyborg consciousness

Curtis Garland - Cyborg

Curtis Garland - Cyborg

Cyborg Mouse

Cyborg Mouse

Cyborg Glove ExcerptNick and Tesla’s Super Cyborg Gadget Glove [Excerpt]

Cyborg Glove ExcerptNick and Tesla’s Super Cyborg Gadget Glove [Excerpt]

PPT E-cyborg

PPT E-cyborg

Cyborg Pantocrator

Cyborg Pantocrator

The Cyborg Experiments

The Cyborg Experiments