Copyright © 2010, SAS Institute Inc. All rights reserved.

Company Confidential – For Internal Use Only.

Copyright © 2014, SAS Institute Inc. All rights reserved.

SAS Environment Manager

Ole-Martin Hafslund

FANS Møte 10.9.2015

Oslo

2

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Manager

Overview

SAS-Specific Functions

Basic Exercises

Controlling Access

Extra

3

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Manager

Overview

SAS-Specific Functions

Basic Exercises

Controlling Access

Extra

4

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS 9.4 Environment Manager (EV)

Main nerve center of an entire SAS installation

Provides enterprise-level monitoring and control in a

web-based console

This type of comprehensive monitoring/control is new

to SAS

Will gradually replace functions of the SAS

Management Console, throughout the lifetime of the

SAS 9.4 release.

5

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS 9.4 EV Overview

Auto-discovery of resources

Personal and role-based dashboards

Monitoring of remote systems and metric collection

Event tracking and record events of interest

Alerting for events and metrics that relate to system health

Visualizations for server monitoring, memory and processor

usage

Resource control and configuration—SAS servers, third-party

servers, web application servers

Live Data (OS commands and utilities)

Environment Manager includes the following key

monitoring and management capabilities:

6

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS 9.4 EV Overview

View and browse most SAS metadata

Apply SAS authorization rules to metadata objects

Create/modify Access Control Templates

Create/delete content folders

Create new users/groups and assign to roles

Monitor SAS metadata server clusters

….much more to come soon…..

Environment Manager includes the following

additional SAS-specific functions:

7

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS 9.4 EV Overview

Components of SAS Environment Manager:

A central server to which agents report

An agent on each managed host

A store of information about managed resources (in a

database)

Plug-ins to customize which resource types are to be

monitored

Web-based administrative console

dfdadf

8

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Manager Components

Technologies:

• a web-based admin GUI

• an agent on each managed host

• solution aware plug-ins

• central server to manage and deploy the plug-ins

• centralized operational datastore

• collection of reports and graphs helping characterize

resource usage across the whole operational deployment.

• single sign-on with other SAS and customers’ enterprise

web applications

9

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

10

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Web GUI

Dashboard

Control Center

Platform 1 ( machine )

Agent

Tc

Object

Spawner

Mid-Tier

Servers

Server 1

Agent

tc Server

Instance 1

Spring

tc Server

Instance 1

Spring

tc Server

Instance 1

Spring

Platform 2 ( machine 2 )

Agent

tc S

Object

Spawner

Metadata

server

CLI

Open API

RESTful

Upgradeable

via XML and

JAVA agent

pluginsCMDB Service

Database

Inventory, Events,

Alerts

Management Server

GUI Administration,

Provisioning, Groups,

Metrics, Alerts, Events,

Logs, Agents

SAS Environment Manager Architecture

11

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Service

Database

Collects a Broad Set Of Operational Metrics

Availability

Performance

Configuration changes

Events

Log entries

Solutions

Web Application Servers

WIP Services and DB

ActiveMQ Messaging

Apache TC server

SAS Servers

• Metadata

• Object Spawner

• Stored Process Server

…

Operating Systems

• Memory

• Processor

• IO

Storage & IO systems

• LASR

• SPDS

• SAS Dataset

Virtualization

12

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS 9.4 EV Overview - functioning

Agents, installed on each machine, discover, monitor, and gather data

about the resources (OS, platforms, servers, services) that are running

on that machine.

Agents periodically send that information to the server, where it is stored

in a database as part of the inventory.

Administrators use the web-based interface to view/manage/manipulate

that data, generate reports, and construct alerts about problems

Administrators can also perform control actions via the agents, such as

starting/stopping a server, configuring various servers, or deploying

applications.

13

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS 9.4 EV Overview – Software Components

The Main SAS EV Server is a Tomcat 6 Server with custom applications

The SAS EV agents are small, standalone background processes--1 per

machine

The Database is part of the postgreSQL installation—it is the

EVManager database

The browser can be any SAS-supported web browser

Plug-ins are small Java-based modules that are installed with the agent

and the server, 1 per resource type

14

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EV Components – Windows Services

sfdsas

sdf

asdffdadfSAS EV ServerSAS EV Agent

Database

15

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EV Components – Linux Server

Database

SAS EV Server

SAS EV Agent

16

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

16

SAS EV Resource Inventory Model

Platform

Server

Service

Platform

Machine, OS, network switch, or SAS

Deployment

ServiceComponent of a Server

database tables, SAS

logical workspace

server, work directory,

etc.

ServerRuns on a Platform

SAS Object Spawner,

SAS Metadata server,

tc Server,– and many

others

Platforms, servers, and services are all types of Environment Manager resources,

The relation between service, server, and platform is a resource hierarchy. Plugins

typically focus on a particular Server or Server + Service.

17

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EV Resource Examples

Platforms

– Machines (ie, sasbap.demo.sas.com)

– SAS Deployments (ie, SAS 9.4 Application Server Tier)

Servers

– tc Server, Apache server, postgreSQL, etc.

– SAS Object Spawner, OLAP Server

– SAS Config Directory, SAS Home Directory

Services

– SAS Logical (Workspace, Stored Process) Server

– postgreSQL database or database table

– Work Directory

18

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

18

PerformanceDatabase

Availability

Performance

Configuration changes

Events

Log entries

SAS Foundation Servers

Application Servers

Web Servers / Caches

Messaging Middleware

Databases & Dataset Libraries

Directory Services

SAS Local Services

Operating Systems

Virtualization

19

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

19

SAS 9.4 Plugins (M2 release):

sas-appserverqueries metadata for application server contexts and logical server definitions.

sas-serversdetects foundation servers including metadata, object spawner, wss, pwss, olap, sps details sas local servers including saswork, tmp, also provides log file tracking, and notifications of config file changes

sas-hadoopdetects and monitors hadoop nodes

emi-servicesprovides a mechanism to manage PostgreSQL high availability as well as miscellaneous general purpose monitors such as ping

sas-lasrprovides basic monitoring of SAS LASR SMP processes

emi-framework, emi-reportcenter, emi-snapshot for various functions of the new Service Architecture Framework

20

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EV Administrative Interface

Highest-level menu consists of the following items:

Dashboard with summary portlets

Resources – main screen for monitoring resources

Analyze – events, alerts, report center, environment

snapshot

Administration – SAS metadata components

Manage – internal administrative functions

21

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

URL: http://machine.name:7080/

22

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

23

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

24

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

25

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Administration tab

26

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

27

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Manager

Overview

SAS-Specific Functions

Basic Exercises

Controlling Access

Extra

28

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS-specific management with SAS EV

Viewing SAS metadata/folders

Setting access controls on SAS metadata objects

Creating new access control templates and users

Monitor a SAS metadata cluster

Generate an environment snapshot for troubleshooting

Grid Manager SASMC plugin functionality

29

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

30

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

31

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Modifying SAS Authorization Metadata

32

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Create custom Access Control Templates

33

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Administration->Users

34

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Monitor a SAS Metadata Cluster

35

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Snapshot

36

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Manager

Overview

SAS-Specific Functions

Basic Exercises

Controlling Access

Extra

37

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Demo: Using SAS Environment Manager

Customize the Dashboard

Basic Monitoring of Resources

Configuring a Resource

Controlling Servers (start/stop/restart) and

Scheduling Downtime

Monitoring logs and event tracking

Setting up an alert

Create a mixed group of resources for monitoring

(optional)

38

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Manager

2.1 Overview

2.2 SAS-Specific Functions

2.3 Basic Exercises

2.4 Controlling Access

Extra

39

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Controlling access to the SAS EV

Mapping SAS users/groups to SAS EV users/roles

Special users: SAS administrator (sasadm) and SAS

service account (sasevs)

Using https with SAS EV

40

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

sasevs@saspw is a member

sasadm@saspw is a member

41

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

42

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Setting SAS EV role permissions

43

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EV Users and Roles

Metadata group SAS EV Role

“SAS Environment Manager Super Users” “Super User Role”

“SAS Environment Manager App Server Tier Users” ”SAS App Tier Role”

“SAS Environment Manager Guests” “Guest Role”

44

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

agent.properties file (portion):SAS service account

45

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Securing the SAS Environment Manager

SSL can be used to encrypt/authenticate the connections to

SAS EV in two places:

The administrative (and other) users logging into the

web interface

The SAS EV agents connecting to the SAS EV server

46

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS Environment Manager

Overview

SAS-Specific Functions

Basic Exercises

Controlling Access

Extra

47

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

47

Where does SAS EV FIT today and the future?

48

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SUPPORTING BUSINESS SERVICE MANAGEMENTsas environment manager

49

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Fit EV AND APM

9.4 M0 (available Q3 via Demos & Downloads)

EV APM plug-in to monitor APM jobs

9.4 M1 – Beginning of EV / APM integration including:

Generalization of common measures - shift, datetime,

elapsed time

Common formats, autocalls area

Consolidated datamart

APM reports surfaced via EV interface

50

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Fit FUTURES

EV Datamarts available to be consumed by VA and ITRM

for:

performance “interval” data

Events/Alerts “event” data

server/service/application “availability” data

Log gathering REST webapp service

51

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Sas environment manager

ROADMAP

9.4 lifecycle goals:

Add functionality to help SAS administrators in troubleshooting problems

and begin replacing SASMC functionality

Environment Snapshot

Security visualization & lineage

User manager

Enable other development groups to use the EV infrastructure to create

administrative components that can be surfaced in the EV interface, in

other solution interfaces, and stand-alone.

Plug-ins can be available as experimental on Demos & Downloads

then production on maintenance boundary

Support for clustering, GRID, LASR

52

Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Takk for meg!