Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator...

36
2019 Storage Developer Conference India © All Rights Reserved. 1 Workshop on SNIA Swordfish Tools Nidhi Malhotra Microchip

Transcript of Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator...

Page 1: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 1

Workshop on SNIA Swordfish Tools

Nidhi MalhotraMicrochip

Page 2: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 2

Learning Objectives

r SNIA Swordfish toolsr Swordfish API Emulatorr Swordfish Basic Web Clientr Swordfish Sample Dashboard Datadog Integrationr Swordfish Sample Dashboard Power BI Integration

Page 3: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 3

What is Swordfish™

r Provides a unified approach for the management of storage and servers in hyperscale and cloud infrastructure environments

r SNIA Swordfish is an extension of the DMTF Redfish specificationr Swordfish was developed by SNIA SSM TWG

Page 4: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 4

Swordfish API Emulator

r Emulates a Swordfish system with storage servicesr Responds to Create, Read, Update and Delete operations r Extends the DMTF Redfish Interface Emulatorr Adds code for Swordfish resources

Page 5: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 5

Installation

r Emulator python environmentr About the emulatorr Setting up the emulator

Page 6: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 6

Emulator python environment

r Python 3.6 or abover Virtualenv recommended but not mandatoryr Python packages required:

r Flask, flask_restful, flask_httpauth, requests, aniso8601r markupsafe, pytz, itsdangerous, StringGenerator, urllib3

Page 7: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 7

About the emulator

r The Redfish Interface Emulator README.md file tells about setting r Emulator.py flags and emulator-config.json

r api_emulator\resource_manager.py file establishes which emulator resources are static and which emulator resources are dynamicr Static resources are read-only and cannot be changed via the

emulator API. These are taken from Swordfish mockupr Dynamic resources can be modified by CRUD operations using

tools like Postman, (https://www.getpostman.com)

Page 8: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 8

Setting up the Emulator

r Create a folder for the emulatorr Copy the Redfish Interface Emulator files into the emulator folder.r Install the Python packages required by the emulator.r Copy the Swordfish API Emulator files into the emulator folder, and

allow some of the Redfish Interface Emulator files to be overwritten.r Run with python emulator.py

Page 9: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 9

Running the Swordfish API Emulator

Page 10: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 10

Demo

r Emulator files and browser output

Page 11: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 11

Swordfish Basic Web Client

Page 12: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 12

Swordfish Basic Web Client

r Web client that can connect to multiple Redfish and/or Swordfish services simultaneously

r Presents the entire Swordfish hierarchy in a browser web framer Provides basic capabilities for viewing resources and updating

properties that are writable

Page 13: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 13

Page 14: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 14

Page 15: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 15

Page 16: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 16

Page 17: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 17

Demo

r Storage services, storage pools and corresponding storage volumes

Page 18: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 18

Swordfish Datadog

Page 19: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 19

Sample Dashboard Integration

r Connects to a Swordfish service and provides an integration to the Datadog User Interface

r Displays storage system capacity information and the available storage capacity thresholds

Page 20: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 20

Sample Dashboard functionality

r Swordfish Dashboard views: Capacity data and threshold values for different collections like Volumes, Storage pools and filesystems.

r Data Collection: Using different custom metrics, Datadog will collect all the required data and visualize it in to a Graph or Gauge and later can configure to throw alerts and report events

Page 21: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 21

Steps for Datadog Integration

r Run Emulator/server in local or host machines or vm.r Install datadog agent everywhere – vm, server, instancesr Configure datadog r Submit custom application metrics by writing code r Open https://www.datadoghq.com in browser or user agent.r Register and login to https://www.datadoghq.comr Create dashboards and show the required data in graphs

Page 22: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 22

Page 23: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 23

Submit custom application metrics

r After all the installation of Datadog Agent. We need to go through /etc/dd-agent folder

r We have two Directories , one is checks.d and conf.dr conf.d contains .yaml files & checks.d contains python files.r The agent checks and some logic are written in python and they rely

on yaml file configuration.r The name of the check file and the config file must match

Page 24: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 24

Page 25: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 25

Page 26: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 26

Time Board

r User selects different type of graphs where just drag and drop time series widget onto dashboard

r If users want to show more flexibility with placement of graphs, can go for screenboards.

Page 27: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 27

Page 28: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 28

ScreenBoard

r To create a ScreenBoard, just create a new dashboard and choose Screenboard

r User can control period shown on per graph basis

Page 29: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 29

Dashboard with consumed and allocated

Page 30: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 30

Swordfish Power BI

Page 31: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 31

Sample Dashboard Integration

r Connects to a Swordfish service and provides an integration to the Power BI User Interface

r Displays storage system capacity information and the available storage capacity thresholds

Page 32: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 32

Access to Swordfish server

Page 33: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 33

Page 34: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 34

Demo

r Show bar chart creation for allocated volume and consumed bytes

Page 35: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 35

Swordfish API Emulator - Datacenter simulation - Test vehicle - Development tool- Feeder for analytics and monitoring tools

Swordfish Basic Web Client- Ease of data visualization- Scripting possibility- Development tool

Datadog- Data monitoring - Data analytics- Alerts- Events- Graphical representation- Time based monitoring- Integration with major cloud business applications

Power BI- Data monitoring- Data analytics- Business intelligence- Feeder for ML applications- Ease of use as based on query

Page 36: Workshop on SNIA Swordfish Tools update - Workshop on SNIA...rCopy the Redfish Interface Emulator files into the emulator folder. r Install the Python packages required by the emulator.

2019 Storage Developer Conference India © All Rights Reserved. 36

Useful linksr www.snia.org/swordfishr http://swordfishmockups.com/r https://github.com/SNIAr https://github.com/SNIA/SSMr https://github.com/SNIA/Swordfish-API-Emulatorr https://github.com/SNIA/Swordfish-datadog-sample-dashboard-

integrationr https://github.com/SNIA/Swordfish-basic-web-clientr https://github.com/SNIA/Swordfish-powerBI-sample-dashboard-

integration