Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document...

24
www.softwaretoolhouse.com Meta-Databot Software Tool House Inc. This presentation describes the Meta-Databot, a Meta-Update solution for ITSM mass changes. It comprises Instructions for use and configuration as a Quick Start Guide.. Ben Chernys Release 5.72 2017-Sep-15 Software Tool House is a BMC Partner Please see the User’s Guide for more details.

Transcript of Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document...

Page 1: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot

Software Tool House Inc.

This presentation describes the Meta-Databot, a Meta-Update solution for ITSM mass changes.

It comprises Instructions for use and configuration as a Quick Start Guide..

Ben Chernys

Release 5.72

2017-Sep-15

Software Tool House

is a BMC Partner

Please see the

User’s Guide for

more details.

Page 2: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Objectives

Agenda

ITSM Data Wizard Pain Points & Challenges

Introducing Software Tool House’s Meta-Databot

The Meta-Databot Mass Change Solution

Meta-Databot Configuration

Input Files

Running Meta-Databot

More Information, Next Steps

Page 3: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

ITSM Data Wizard Pain Points

Manual

One data change can be done at a

time

It takes time to wait to do the next one tying up resources

unproductively

SQL driven

Workflow is not fired and the

Remedy application layer is bypassed

Integrations may be bypassed

Bespoke Tables

Adding additional tables presents

more challenges.

Validation

Difficult, tedious troubleshooting.

BMC ITSM Data Wizard

Page 4: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot

Introducing Meta-Databot

Page 5: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot

Introducing Meta-Databot

Automated

An input file of data changes is processed.

Fire and forget. Zero human

resources taken.

Workflow can be fired

Forms can be configured to not

use SQL.

Integrations will fire.

Bespoke Tables

Adding additional tables and fields is

trivial.

Adding your own data admin jobs is

easy.

Validation

Change Logs are generated.

All changes can be undone!

Page 6: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot

Meta-Databot Mass Change Solution

Configuration

Configuration is an Excel sheet of Root requests and a tree sheet for each root.

You name input file columns, add your

forms, add new data admin jobs.

Input File

The input file has the columns of the configuration root, specifying old and

new values.

Scripts

Databot

Effects the data operation by

processing the input file.

Databot_Undo

Processes the Databot generated

Undo log to reverse all changes.

Meta-Update

Script Engine

Easy to tailor.

Full logging including server

logs.

Page 7: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

This allows very quick customizations

to Meta-Archive:

➢ Changing or adding archive targets:

file system, database

➢ Adding processes, integrations,

notifications

Meta-Archive can be “single stepped” in the Meta-Update debugger.

➢ Adding fields to, or additional,

output files

You can watch how Meta-Archive checks and archives your data!

Meta-Databot is a Meta-Update script

Meta-Databot Mass Change Solution

Page 8: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Features

Meta-Update In a Nutshell

Debugger

Auditable

No Server Changes

ARS API

Regular Expressions

Cached Look-Ups

Variable Targets

Attachments

Robust Assignments

ARS Output

File Output

SQLMultiple Servers

No Staging Forms No Merge Filters

Page 9: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot Distribution Contents

Meta-Databot Mass Change Solution

File Name What is it? Comments

120-Databot.ini The Meta-Databot

script

You run Meta-Update with this script.

Arguments specify the Data-Admin operation, the

configuration files, and the input files.

140-DatabotUndo.ini The Undo script You run this script with the same configuration and

Data-Admin operation but with the generated Undo

log as input.

Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-

Databot and the Meta-DatabotUndo.

Databot-cfg.xlsm The Meta-Databot configuration spreadsheet.

Macros should be enabled to automatically generate

the CSV files.

Page 10: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot Configuration

Page 11: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot Configuration

Meta-Databot Config Sheets

Home

Contents

Help pages

Go!

Generate CSV files on this page.

Specify an output file prefix to which

is appended “-root”, etc.

Root

Defines a Data Admin operation

Specifies input file name columns.

Specifies output file suffixes used by the

Go! Sheet.

Specifies tree sheet name.

Tree Sheets

One sheet for each Data Admin operation

Specifies forms and fields.

Test Sheets

Simple test sheets to change data

values and change them back again.

Page 12: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot Configuration

Meta-Databot Config Sheets

Macros must be enabled

to produce the CSV files.

Page 13: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Root – Define Data Admin Operations

Meta-Databot Configuration

To create a new

operation, add a

row here, and a

new sheet for

the child forms.

Page 14: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Root – Define Data Admin Operations

Meta-Databot Configuration

Column

NameExplanation Values for Support Org

Data Admin

Keyword

Specified as an argument to the Meta-Databot script. Support Group

Root Form A form name that contains the data to be changed and for

which all tree forms can be considered children of.

CTM:Support Group

Enabled Must be 1 or the row is ignored. 1

Config Sheet

Name

This is the name of the sheet within this spreadsheet that

defines the tree of forms related to this admin job.

Support Group

Output File

Name

A minus sign, this value, and “.csv” is the file generated by the

Go! Macro.

SupOrg

Query A query with input file fields wrapped in dollar signs. Used to

select and change data in the root form.

'Company' = "$Company Name$"

and 'Support Organization' =

"$OLD Support Organization$"

key1

key2

Up to two fields in the root form to be used in some tree forms

to determine records to change. Generally an indexed field

like Request ID or Instance ID.

Support Group ID

179

f1..f5 Up to 5 fields of the root form that may have data changes

corresponding to the input file fields. Fields can be used for

selecting and/or changing.

Support Organization

Company

Finp1o..Finp5o

Finp1n..Finp5n

Up to five fields in the input sheet corresponding to the fields

f1..f5 of the root form. “o” designates the old value, “n”, the

new. If there is an “o” field but no “n” field, then that value is

used for selection and will not change.

OLD Support Organization

NEW Support Organization

Company Name

Uses same root

form and same

tree sheet as

Support Group

Page 15: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Tree – Define Forms

Meta-Databot Configuration

Column

NameExplanation Values for Support Org

Form Name A form name that contains the data to be changed and for

which may or may have a key of the root form as a key

AAS:Activity

Enabled Must be 1 or the row is ignored. 1

Merge Option Normally blank to use an SQL Update statement like the BMC

Data Wizard.

Can be used to allow workflow to fire by specifying “Workflow”.

Other options are available. Will slow down the job

considerably.

f1..f5 These column names are the Root’s f1..f5 Field Names.

If and only if the Root has a single field defined, this can be a

comma separated list of fields. See the Login Data Admin on

the next slide.

Company Support Group Name

Support Organization

ASCPY ASGRP ASORG

Comments &

Labels

Configuration files have been generated using both the OOTB

BMC Data Wizard data and our Freebie Fields & Forms

spreadsheets. Items not included in the BMC Data Wizard are

identified. Labels are added to make rows easier to

understand though just the field names.

Page 16: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Meta-Databot Configuration

Login Root & Tree configuration

Page 17: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Test Input Files

Meta-Databot Input Files

Column

NameExplanation Values for Support Org

Company

Name

All the column names defined in the root configuration must

exist in the input file. They can appear in any order and be

mixed amongst other, ignored columns.

Software Tool House Inc.

Software Tool House Inc.

NEW Support

Organization

Support2

Support

OLD Support

Organization

Support

Support2

Row 2 changes Support Organization data in

configured forms from “Support” to “Support2”,

row 3, from “Support2” to “Support3”,

row 4, back to “Support3”,

and row 5, back to “Support”,

so that all the ITSM data should be back as it

was before the run began.

An Undo run will reverse this process with the

same data at the end.

Note: to change Support Organizations

on a Group by Group basis, use the

Support Group Data Admin operation.

Page 18: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

➢ Set PATH

➢ Set Script and Config file Path

➢ Change to your working directory

➢ Set Meta-Update Licensing

Running Meta-Databot

Help on setting up and

using a Command Prompt.

Running

path D:\Apps\SoftwareToolHouse\bin;%path%

export PATH=/apps/STH/bin:$PATH

export LD_LIBRARY_PATH=/apps/STH/bin:$LD_LIBRARY_PATH

set SthScriptPath=e:\STH\scripts\Meta-Databot;

e:\STH\scripts\Meta-Databot\cfg\;%SthScriptPath%

export SthScriptPath=/apps/STH/scripts/Meta-Databot:

/apps/STH/scripts/Meta-Databot/cfg/:$SthScriptPath

cd D:\Dta\Dev\Arch\wrk

cd ~/wrk

Windows

Linux / SolarisPreparing the command prompt

SthLic.cmd dev

. SthLic.sh dev.

Help on generating your

SthLic file on next page.

120-Databot.ini

Page 19: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Build your SthLic.cmd file➢ Run SthLicUpd.exe to build your

SthLic.cmd (or SthLic.sh) file. This

file will set environment variables.

➢ SthLic.cmd needs to be run once when you open a new command or

terminal window.

➢ Run SthLicUpd.exe to encrypt other ARS server passwords if needed.

Running Meta-Databot

Will generate SthLic.sh

in the –out directory

Page 20: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Run the count first

SthMupd.exe 120-Databot.ini Do

–cmd Report

-CfgRt cfgDatabot-root.csv

-Cfg cfgDatabot-SupOrg

-rt ”Support Org”

-Finp My_SupOrg_Changes.csv

find " i " SthMupd.log | find "Msg: " | find /v "Msg: 0" | more

grep ' i.*Msg’ SthMupd.log | grep -v 'Msg: 0' | less

Will report a set of counts for all forms configured.

Running Meta-Databot

Page 21: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Run the update

SthMupd.exe 120-Databot.ini Do

–cmd Update

-CfgRt cfgDatabot-root.csv

-Cfg cfgDatabot-SupOrg

-rt ”Support Org”

-Finp My_SupOrg_Changes.csv

find " i " \trc\trc.60 | find "Msg: " | find /v "Msg: 0" | more

grep ' i.*Msg’ SthMupd.log | grep -v 'Msg: 0' | less

Running Meta-Databot

Will change data as expected by the counts.

Page 22: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Optional: Run the Undo

SthMupd.exe 140-DatabotUndo.ini Do

–Finp 120-Databot-65772.idlog.csv

04173739.318 i terminating successfully in 46 sec.

Will reverse data as expected by the counts.

Running Meta-Databot

Page 23: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Output file – ID / Undo Log

Running Meta-Databot

Page 24: Meta-Archive Quick Start Guide · 2017-10-16 · Meta-Databot-Quick-Start-Guide.pdf This document Explains how to configure, run, and test Meta-Databot and the Meta-DatabotUndo. Databot-cfg.xlsm

www.softwaretoolhouse.com

Contact Uswww.SoftwareToolHouse.com

Next Steps

➢Binaries, trial licenses, User’s Guide

available on the web.

➢Pick up a trial license with our Live

Install and Scripting 101 presentation

➢Download the Scripting 101 presentation

and the Meta-Update User’s Guide

➢Look at the samples in the Script Library

➢Contact Us at www.softwaretoolhouse.comBen Chernys

+49 171 380 2329

+1 403 554 0887Software Tool House

is a BMC Partner