PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the...

18
0 FTS PUBLIC Copyright 2013 FUJITSU PRIMERGY HPC Gateway Gateway to HPC Simplicity ISC13, Leipzig

Transcript of PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the...

Page 1: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

0 FTS PUBLIC Copyright 2013 FUJITSU

PRIMERGY HPC Gateway

Gateway to HPC Simplicity

ISC13, Leipzig

Page 2: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

1 FTS PUBLIC

Take advantage from a complete HPC offering

Copyright 2013 FUJITSU

FEFS

Gateway Cent OS

HPC Cluster Suite

Cluster Management & Operation

Sizing,

design

Proof of

concept

Integration into

customer environment

Certified system

and production

environment

Complete assembly,

pre-installation and

quality assurance

Ready to

Operate

at delivery

PRIMERGY Server, Workstation

ETERNUS Storage

ISV and Research

Partnerships

Open Petascale Libraries Network

PreDiCT Initiative

Consulting and Integration Services

Ready-to-Go

Page 3: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

2 FTS PUBLIC

Make IT Dynamic – Business Efficiency for HPC Solutions

Fujitsu HCS – the total solution approach

Copyright 2013 FUJITSU

HPC Cluster Suite Value Add / Differentiation by Fujitsu

Deployment (based on Fujitsu SVIM and Fujitsu

CDM)

• Integrates ServerView supplied drivers to the CDM

repository

Cluster Management

• Node configuration

• Monitoring and Alerting

Comprehensive software coverage

• Flexible choice of Workload Manager

• Libraries, Compilers

• Support for Parallel File Systems

HPC Gateway - Integrated intuitive interface

FEFS - optional Parallel File System

Single file namespace across all nodes

Increases Storage performance

Required in large or high load I/O configurations

Fujitsu Exabyte File System – FJJ developed (Lustre based)

Provides simplicity in using the HPC Cluster and Application

Use resources more effectively

Broaden HPC and process reuse

Share and exchange data more widely

Optimal system configuration based on application needs,

immediate system readiness and faster deployment

Simplifies HPC usage and management for both current

and potential users of HPC (“out-of-the-box” operation)

Page 4: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

3 FTS PUBLIC

The Fujitsu HPC Cluster Suite (HCS)

Comprehensive software stack

for managing Fujitsu

PRIMERGY HPC clusters

Easy-to-use cluster management

Popular workload managers

General HPC Open Source Software

Highly scalable parallel file system

Graphical end-user interface for

simplified usage

Alliance with leading ISVs

Fully validated HPC solution

Copyright 2013 FUJITSU

Application programs

Workload manager

Operating System

GPGPU and XEON Phi

software support

Cluster deployment and management

Automated installation and configuration

Administrator interface Operation and monitoring

Cluster checker User environment

management

Management of cluster resources Manage serial and parallel jobs Fair share usage between users

Parallel Middleware

Scientific Libraries

Parallel File System

Compilers, performance and profiling tools

Graphical end-user interface

Fujitsu PRIMERGY HPC Clusters

Fujitsu HPC Cluster Suite

RedHat Linux CentOS

OS Drivers

Page 5: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

4 FTS PUBLIC

Targets of HPC Simplicity

Copyright 2013 FUJITSU

Obtain better value

from HPC investments.

Find and apply HPC

knowledge in new ways.

Page 6: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

5 FTS PUBLIC

End-User Context

Copyright 2013 FUJITSU

Process aware Traceable history

Organise activity Service approach

Network neutral

Exploitable information

Focused expertise Data exchange

Driving the need for a complete and simplified HPC environment

Page 7: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

6 FTS PUBLIC

Delivering HPC Simplicity – Bringing Answers

Copyright 2013 FUJITSU

Integral Application Expertise.

Intuitive cluster desktop Tuned application processes Easy application on-boarding

Page 8: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

7 FTS PUBLIC

PRIMERGY HPC Gateway introduction

User interface component of the FUJITSU

Software HPC Cluster Suite

Intuitive web environment incorporating

application workflows, direct simulation

monitoring, data access and collaboration

Delivers value in simplifying HPC end-

use and integrating application expertise,

to tune business processes and better

manage projects

Copyright 2013 FUJITSU

Central user environment in FUJITSU Software HPC Cluster Suite

Page 9: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

8 FTS PUBLIC

PRIMERGY HPC Gateway introduction

Copyright 2013 FUJITSU

Central user environment in FUJITSU Software HPC Cluster Suite

“ The simplicity of web access, the

expertise from agile application

workflows and clarity of active reporting

to tune your business processes and

better manage project outcomes.

Page 10: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

9 FTS PUBLIC

Gateway Application Catalogue

Copyright 2013 FUJITSU

Access key applications from main verticals

Cornerstone of HPC solutions

Application process expertise captured

with designed-in workflows

Solution extended with self

application on-boarding

Page 11: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

10 FTS PUBLIC

Gateway to your cluster

Copyright 2013 FUJITSU

PRIMERGY HPC Gateway

Application

Catalogue

Information

Centre

Dynamic Framework

Fro

nt-e

nd

Bac

k-en

d

Integral expertise with domain focus

Process execution and monitoring

System and application reporting

Single sign-on to whole HPC

environment

Global orchestration and dataflow

Native security layer

H P C c l u s t e r

Page 12: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

11 FTS PUBLIC

CAE

Gateway

Life Sciences

Gateway

Environment

Gateway

Integral application methods – More reliability, lower risk , shorter time-to-value

Experiment setup and management, project reporting

Web access to all methods and information

Gateway

front-end

Workflow orchestration from single cluster to global data centres

Native security layer, single sign-on, encrypted data

Cloud infrastructure, service-based abstraction

Gateway

back-end

Building out Gateway solutions

Intel XEON and XEON Phi clusters

HPC software stack

PRIMERGY

HPC Portfolio

Page 13: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

12 FTS PUBLIC

Lifecycle advantages of HPC simplicity A

ggre

gate

pro

duct

ivity

Each uses makes

own job scripts

Low team consistency,

frequent errors and

misplaced work

Stabilised throughput, but

aggregate group efficiency

capped by weak sharing

and lack of traceability

Solution lifecycle

HPC as usual

Shorter time to

enter production

Higher efficiency

achieved earlier,

shorter learning curve

Learn from established

expertise, apply HPC

in new project areas HPC Simplicity

Benefits continue grow after initial system deployment

Page 14: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

13 FTS PUBLIC

Running workflows / simplified use of HPC resources

Just add parameters and run

applications

Monitor run status

View execution status results

Monitor execution status

View execution results

Enter variables and run

Page 15: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

14 FTS PUBLIC

Review results and project usage

View data from any mount location (temp space,

project space, archive space)

Move data between locations or upload/download

to/from an external location

Copyright 2013 FUJITSU

Report usage by Project, application, user

Filter and search consolidated accounts

Export data for external analysis and report creation

Page 16: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

15 FTS PUBLIC

Automated Application Workflows (advanced)

Standardised best-practice methods Encode business processes as structured automated workflows

Higher transfer reliability Implicit dataflow, optimized for large data volume

Focus on research and analysis

Eliminate low-level actions, increase user productivity,

Faster decisions

Programmed post-processing, filtering and reporting

Usable with minimal learning

Shareable optimal methods

Scalability transparent to user

Copyright 2013 FUJITSU

Page 17: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

16 FTS PUBLIC

Your Gateway to HPC Simplicity

Copyright 2013 FUJITSU

Access expertise in application

methods without the IT pain

Direct visibility on processes and

experiments

Traceability for assured and secure

operations

Scalable and Agile resources

usable from single view

Page 18: PRIMERGY HPC Gateway - Fujitsu · PRIMERGY HPC Gateway introduction User interface component of the FUJITSU Software HPC Cluster Suite Intuitive web environment incorporating application

17 FTS PUBLIC