Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights...

19
1 © 2014 University of São Paulo All rights reserved. HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

Transcript of Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights...

Page 1: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

1 © 2014 University of São Paulo All rights reserved.

HPC in the USP Cloud Adriano Arantes Paterlini

University of Sao Paulo

Page 2: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

2 © 2014 University of São Paulo All rights reserved.

Agenda

University of Sao Paulo

IT structure @ University

USP Cloud

Cloud HPC Models

GPU Cards

Future plans for the cloud

Page 3: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

3 © 2014 University of São Paulo All rights reserved.

University of Sao Paulo

11 campuses 30 sq mi

93,295 students

5,860 professors

16,839 employees

Well known LATAM University

1st University in LATAM by rankings

30% over all Brazil research

Largest Private Cloud in LATAM

Page 4: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

4 © 2014 University of São Paulo All rights reserved.

IT structure @ University

Private Cloud • Customs Systems • Development

IT Department - CIO

• Service Desk • Communication

General Administration Coordination

Summit leadership and IT organization

Service Division System Division Telecom Division Datacenter Division

Vice Dean – Vice President

Dean – President

• Data Networks • Telco Systems

Page 5: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

5 © 2014 University of São Paulo All rights reserved.

USP Cloud

Too much manifestations.

Too hard strikes.

Old servers.

Old datacenters.

New

approaches

were required.

Page 6: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

6 © 2014 University of São Paulo All rights reserved.

Cloud Computing

Infrastructure as a Service (IaaS)

Private Cloud

Cloud USP

Compute and Network

Study Service Model Deployment

Model Service Offering

Started Jun/12

USP Cloud

Page 7: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

7 © 2014 University of São Paulo All rights reserved.

Cloud HPC Models

IaaS

Cluster

HPCaaS

Page 8: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

8 © 2014 University of São Paulo All rights reserved.

Cloud HPC Models

IaaS

Self Service

Autonomy

User dedicated

User own management

Page 9: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

9 © 2014 University of São Paulo All rights reserved.

Cloud HPC Models

Cluster

Traditional

Centralized Management

Better resource use

Better user support

Page 10: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

10 © 2014 University of São Paulo All rights reserved.

Cloud HPC Models

Cluster

Aguia Cluster

– 50 VM nodes

– 500 vCPUs

– 6000 GB RAM

Page 11: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

11 © 2014 University of São Paulo All rights reserved.

Cloud HPC Models

HPCaaS

User Friendly

Service Integration

Workload diversity

Best resource use

Page 12: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

12 © 2014 University of São Paulo All rights reserved.

nvidia TESLA K20X Anchored on Trust & Throughput

Cards 128 Core 2688

Memory 6GB Single 3.95 Tflops Double 1.31 Tflops

Page 13: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

13 © 2014 University of São Paulo All rights reserved.

nvidia GRID K2 Targeting Agility and Efficiency

Cloud Computing

Cards 128 Core 3072

Memory 8GB DDR5 vGPU 16

Page 14: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

14 © 2014 University of São Paulo All rights reserved.

HYPERVISOR XENSERVER

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

VM

vCPU

MEM

vGPU

nvidia GRID K2 Design

Page 15: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

15 © 2014 University of São Paulo All rights reserved.

nvidia GRID K2 Catalog Provide virtual

machines with vGPU support

Page 16: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

16 © 2014 University of São Paulo All rights reserved.

nvidia GRID K2

Page 17: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

17 © 2014 University of São Paulo All rights reserved.

vGPU Delivery to clients

Portal Citrix Cloud Portal Business Manager 2.3.x

Orchestrator Citrix CloudPlatform 4.4

Hypervisor Citrix XenServer 6.2 SP1

nvidia GRID K2 Targeting Agility and Efficiency

Page 18: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

18 © 2014 University of São Paulo All rights reserved.

vGPU Support

Cloud Sao Paulo

Community Cloud

HPC Support Born

Cloud USP

VPC Support

PRESENT

Future plans for the cloud

IPv6 Support

Page 19: Adriano Arantes Paterlini HPC in the USP Cloud · © 2014 University of São Paulo All rights reserved. 1 HPC in the USP Cloud Adriano Arantes Paterlini University of Sao Paulo

19 © 2014 University of São Paulo All rights reserved.

Adriano Arantes Paterlini

[email protected] Nuvem USP [email protected]

LCCA [email protected]