Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng,...

9
Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity Institute University of California, San Diego http://www.lifemapper.org

TAGS:

Transcript of Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng,...

Page 1: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier

ByAimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady

University of Kansas Biodiversity InstituteUniversity of California, San Diego

http://www.lifemapper.org

Page 2: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Lifemapper

• Data– Climate Data– Species Archive• Input: points • Output: potential habitat maps

• Tools– LmSDM: Species Distribution Modeling– LmRAD: Range and Diversity

GBIF

Page 3: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Lifemapper Tiers

Web Tier Client TierManagement Tier

Pipeline

Data updaterJob generator

Job trackerMetadata manager

Lm Web siteREST Web Services

Job submissionData request

Result request

Desktop clientBrowser client

Experiment management,

Result visualization, exploration, analysis

Compute Tier

Virtual clusters request Jobs

Species Distribution Modeling

Range and DiversityAnalysis

Data Tier

Species Sensors

Result archives

Models

Page 4: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Virtual Biodiversity ExpeditionStep 1: Species Distribution Modeling

Species Occurrence Data

Landsat Data

Potential Habitat

1

2

3

3

4

5

Page 5: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Adding a PRAGMA Compute Tier

LM Compute

LM Management

LM Data

LM Compute

Page 6: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

DEMO

Page 7: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Preparation

Web Tier Client TierManagement Tier

Pipeline

Data updaterJob generator

Job trackerMetadata manager

Lm Web siteREST Web Services

Job submissionData request

Result request

Desktop clientBrowser client

Experiment management,

Result visualization, exploration, analysis

Compute Tier

Virtual clusters request Jobs

Species Distribution Modeling

Range and DiversityAnalysis

Data Tier

Species Sensors

Result archives

Models

Page 8: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Execution

• Specialization– Resources request subset of available jobs– Based on data, users, computation type

• Scaling– Management - Increased job speed– Compute – increased data replication

Page 9: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Lifemapper funded by:

U.S. National Science Foundation

NSF EPSCoR 0553722

NSF EPSCoR 0919443

EHR/DRL 0918590

BIO/DBI 0851290

OCI/CI-TEAM 0753336

http://[email protected]

http://www.lifemapper.org/

GNAT Reference Manual - GNU Project · iv 2.134 Pragma Post Class ::::: 69 2.135 Pragma Rename Pragma ::::: 70 2.136 Pragma Pre ::::: 70

GNAT Reference Manual - GNU Project · iv 2.134 Pragma Post Class ::::: 69 2.135 Pragma Rename Pragma ::::: 70 2.136 Pragma Pre ::::: 70

Nikos Papadopoulos - ims.forth.gr

Nikos Papadopoulos - ims.forth.gr

Folleto Grupo Pragma

Folleto Grupo Pragma

3. · 2020-05-27 · At the PRAGMA 32 Workshop, there was a celebration of PRAGMA’s first 15 years. The workshop also marked the transition in leadership. Philip Papadopoulos, a

3. · 2020-05-27 · At the PRAGMA 32 Workshop, there was a celebration of PRAGMA’s first 15 years. The workshop also marked the transition in leadership. Philip Papadopoulos, a

Pragma-BasedApproachForMappingDSPFunctions ...kth.diva-portal.org/smash/get/diva2:810975/FULLTEXT01.pdf · Pragma-BasedApproachForMappingDSPFunctions OnACoarseGrainedReconfigurableArchitecture

Pragma-BasedApproachForMappingDSPFunctions ...kth.diva-portal.org/smash/get/diva2:810975/FULLTEXT01.pdf · Pragma-BasedApproachForMappingDSPFunctions OnACoarseGrainedReconfigurableArchitecture

Pragma FortressSSH 5.0

Pragma FortressSSH 5.0

Virtualizing Lifemapper Software Infrastructure for Biodiversity Expedition · 2015-09-23 · Virtualizing Lifemapper Software Infrastructure for Biodiversity Expedition Nadya Williams

Virtualizing Lifemapper Software Infrastructure for Biodiversity Expedition · 2015-09-23 · Virtualizing Lifemapper Software Infrastructure for Biodiversity Expedition Nadya Williams

Loop Optimizations in LLVM: The Good, The Bad, and The Ugly#pragma _CRI unroll #pragma _CRI fusion #pragma _CRI nofission #pragma _CRI blockingsize #pragma _CRI interchange #pragma

Loop Optimizations in LLVM: The Good, The Bad, and The Ugly#pragma _CRI unroll #pragma _CRI fusion #pragma _CRI nofission #pragma _CRI blockingsize #pragma _CRI interchange #pragma

Historia Pragma Consultores

Historia Pragma Consultores

Dr. Andrew Papadopoulos

Dr. Andrew Papadopoulos

Manual identidad PRAGMA

Manual identidad PRAGMA

Pragma Academy Brochure

Pragma Academy Brochure

Pragma Corporate Finance Pragma Presentation_Eng.pdf · Pragma Corporate Finance . PRAGMA Table of Contents 2 ... pulp and paper chemicals, water treatment chemicals, cement grinding

Pragma Corporate Finance Pragma Presentation_Eng.pdf · Pragma Corporate Finance . PRAGMA Table of Contents 2 ... pulp and paper chemicals, water treatment chemicals, cement grinding

Pragma Report

Pragma Report

Pragma 07 low

Pragma 07 low

Company Profile Pragma Africa - Pragma Latam · The Pragma Way 4 The Pragma Group Pragma Holdings acts as an investment vehicle for the group and provides strategic and operational

Company Profile Pragma Africa - Pragma Latam · The Pragma Way 4 The Pragma Group Pragma Holdings acts as an investment vehicle for the group and provides strategic and operational

GNAT Reference Manual - GNU Projectgcc.gnu.org/onlinedocs/gcc-7.2.0/gnat_rm.pdfiv 2.134 Pragma PrefixException Messages ::::: 67 2.135 Pragma Pre Class ::::: 68 2.136 Pragma Priority

GNAT Reference Manual - GNU Projectgcc.gnu.org/onlinedocs/gcc-7.2.0/gnat_rm.pdfiv 2.134 Pragma PrefixException Messages ::::: 67 2.135 Pragma Pre Class ::::: 68 2.136 Pragma Priority

OpenMP - IPSltodi.est.ips.pt/aabreu/openMP.pdf · #pragma omp sections [clause ...] newline {#pragma omp section newline structured_block #pragma omp section newline structured_block}

OpenMP - IPSltodi.est.ips.pt/aabreu/openMP.pdf · #pragma omp sections [clause ...] newline {#pragma omp section newline structured_block #pragma omp section newline structured_block}

Global Lake Ecological Observatory Network - GLEON: Catalyzing Global Team Science based on PRAGMA Peter Arzberger Tim Kratz, Fang-Pang Lin Philip Papadopoulos,

Global Lake Ecological Observatory Network - GLEON: Catalyzing Global Team Science based on PRAGMA Peter Arzberger Tim Kratz, Fang-Pang Lin Philip Papadopoulos,

Savas Papadopoulos Resumeteacherfinder.gr/resumes/savas-papadopoulos-notes-1.pdf · 1 Savas Papadopoulos – Resume A research scientific position combining, computing, publications,

Savas Papadopoulos Resumeteacherfinder.gr/resumes/savas-papadopoulos-notes-1.pdf · 1 Savas Papadopoulos – Resume A research scientific position combining, computing, publications,