Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal...

18
Supporting our SAS® Solutions Eirik B. Bråtveit, ConocoPhillips Geir Å. Tengesdal, SAS Institute

Transcript of Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal...

Page 1: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Supporting our SAS® Solutions

Eirik B. Bråtveit, ConocoPhillips

Geir Å. Tengesdal, SAS Institute

Page 2: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

What to support?

1000+ LSF batch jobs

160+ LSF batch flows

SAS Servers Production: 2 AIX, 7 Windows

Test: 1 AIX, 7 Windows

Development: 1 AIX, 7 Windows

SAS portal Main SAS 9.2 portal with 1500+ users

2 SAS 9.3 FM portals with 30+ users each

Datasources Internal and external

90+ input data sources (databases, ftp, excel, flat files…)

Developers

2

Page 3: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Admin toolbox requirements

One stop shopping

Stable SAS IntrNet on AIX production batch server

Simple http web server on AIX

Web reports on the fly

LSF trigging of flows on demand

Simple batch environment UNIX Cron jobs for batch data collection on Unix

Windows AT jobs for batch data collection on Windows

Main web server on dedicated Linux server Perl scripts for trigging data collection

MySql on Linux for web data storage

Java script for web presentation part

High availability Depends only on two unix servers, AIX and RedHat

Easy to use and configure

Fast – keep it simple

Easy to modify

3

Page 4: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

System overview

Monitoring

System status handling

Daily reports and analyses

Tools / Utilities

Change management

Documentation

4

Page 5: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

System overview Server configuration diagrams

Accessible from Administration front page

Administration configuration

Stored on Sharepoint

5

Page 6: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

Monitoring Servers

SAS Servers

Database connections

Web servers

Services SAS services

Web services

Scheduling services (LSF)

Processes Ports …

Disk usage

File / table updates SAS tables

PDF, Excel reports etc

URL / Web availability

6

Page 7: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

System status handling Status

OK

Warnings (not critical)

Errors (critical)

Alarms

Web page monitor

Mail service

AlarmPoint interface for callout

Proactive

Detect possible upcoming problems and correct before an incident happen

Immediate notification if an incident already happen

7

Page 8: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

Daily reports and analyses Batch job log report

Flow runtime analyses

Job runtime analyses

Table locking conflicts for overlapping jobs

And more

8

Page 9: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

Tools / Utilities Search facility (jobs, flows, servers …)

SAS Metadata

Scheduler metadata (LSF)

SAS & LSF execution

Git (source and config files)

Copy SAS data

From production to dev/test

From dev to test

Promotion of SAS .spk to production environment

Automatic creation of production backup of elements in new .spk

LSF Scheduling Web interface

Submit flows from web interface in a controlled environment

Check status of LSF flows from web interface

9

Page 10: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

Change management Promotion requests added in Sharepoint

Service Now

Incident tickets / change requests

Change management system for approval

Production promotions

Backup before changes

Implement changes

Git versioning for documenting SAS production changes

DR Server syncronization of configuration files on local file systems

Other changes (Password, configuration, hot fixes, SAS Installation)

10

Page 11: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Toolbox content

Documentation FAQ on Sharepoint

Incident reports for major incidents

Git

11

Page 12: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Administration front page

12

Page 13: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

First to do in the morning!

13

Page 14: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Reports

14

Page 15: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Services

15

Page 16: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Links

16

Page 17: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Questions?

17

Page 18: Supporting our SAS solutions FANSBrukersamlingStavanger22 · 2016-03-11 · Main SAS 9.2 portal with 1500+ users 2 SAS 9.3 FM portals with 30+ users each Datasources Internal and

Thank you for your attention

18

Thanks to Børge Lund