Performance Testing of Storage Stack for Cloud (OpenStack)

Venkata Krishna Vedams Inc.

Agenda

Storage stack components involved

How to attach volumes to vm’s in Cloud

Performance Testing in cloud

Different ways of running FIO on Linux distributions

StorPerf Features

StorPerf introduction and work flow

ELK stack Work flow

Summary

Storage stack components

Storage array

Switch

Volume server Controller server

Compute server

VM

VM

VM

Attach volumes to instances in a Cloud Environment

What is Performance testing in cloud

Process of determining the speed or effectiveness of a computer, network, software program or device.

name rw iodepth group_reporting numjobs time_based_filename ioengine size direct fsync_on_close runtime invalidate

bs

Run FIO in different ways

Command for a single job FIO test configuration fio –name=sqread --rw=read --bs=512b --ioengine=libaio --iodepth=16 --numjobs=64 - -runtime=60 --size=100m --direct=1 --invalidate=1 --group_reporting --fsync_on_close=1 --time_based --filename=/dev/vdb

Run single test configuration FIO parameters

name rw iodepth group_reporting numjobs time_based bs

ioengine size direct fsync_on_close runtime invalidate

Run multiple jobs using job file Create a job file with fio parameters. Run the below command # fio <jobfile>

Run FIO in different ways

Client-Server Model Allows to run FIO test on single client/multiple clients at a time. Setup client-server model Client machine Run the fio server(listen on 8765 port) by running below command # fio –server Server machine Run fio by providing client details # fio –client <client Ip1> <job file1> --client <client ip2> <job file 1> …

FIO test output for a single test configuration

StorPerf – Storage performance testing for the cloud

StorPerf workflow

Instance1

Instance 2

Instance 3 Run StorPerf UI Instance 4

LINUX Machine

fio

fio

fio

fio

FIO Output Directory ELK Stack

FIO Output

Indexing & Save FIO Output

Visualize the data in Graphs

StorPerf – Features

Simple UI to setup tests

Allows to provide multiple Instance login details as inputs

Allows to choose FIO parameters using check boxes

Easily setup single or multiple FIO Job configurations

Provides multiple visualization graphs/charts (Area chart, line chart)

Visualize single or multiple graphs in the same pane/tab/dashboard

StorPerf - FIO parameters selection

StorPerf – Visualization parameters selection

ELK stack – Work Flow

GS Logs (FIO output)

Log stash Elastic search

Kibana

Process the data through filters

Store the data and can do search and analyze

Build dashboards for data visualization

StorPerf – Visualization through Kibana graphs

Summary : StorPerf – Value-Add

Easy to scale test runs on compute instances - using “+ button“

Multiple checkboxes allows users to select tests with more granularity

Graph parameters are customizable, allows for various comparative graphs

Allows user to visualize data in multiple graphs with different parameters

Easily re-run tests after changing any component in the storage stack

Thank You Questions ?