Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng,...

9
Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity Institute University of California, San Diego http://www.lifemapper.org

Transcript of Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng,...

Page 1: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier

ByAimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady

University of Kansas Biodiversity InstituteUniversity of California, San Diego

http://www.lifemapper.org

Page 2: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Lifemapper

• Data– Climate Data– Species Archive• Input: points • Output: potential habitat maps

• Tools– LmSDM: Species Distribution Modeling– LmRAD: Range and Diversity

GBIF

Page 3: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Lifemapper Tiers

Web Tier Client TierManagement Tier

Pipeline

Data updaterJob generator

Job trackerMetadata manager

Lm Web siteREST Web Services

Job submissionData request

Result request

Desktop clientBrowser client

Experiment management,

Result visualization, exploration, analysis

Compute Tier

Virtual clusters request Jobs

Species Distribution Modeling

Range and DiversityAnalysis

Data Tier

Species Sensors

Result archives

Models

Page 4: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Virtual Biodiversity ExpeditionStep 1: Species Distribution Modeling

Species Occurrence Data

Landsat Data

Potential Habitat

1

2

3

3

4

5

Page 5: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Adding a PRAGMA Compute Tier

LM Compute

LM Management

LM Data

LM Compute

Page 6: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

DEMO

Page 7: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Preparation

Web Tier Client TierManagement Tier

Pipeline

Data updaterJob generator

Job trackerMetadata manager

Lm Web siteREST Web Services

Job submissionData request

Result request

Desktop clientBrowser client

Experiment management,

Result visualization, exploration, analysis

Compute Tier

Virtual clusters request Jobs

Species Distribution Modeling

Range and DiversityAnalysis

Data Tier

Species Sensors

Result archives

Models

Page 8: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Execution

• Specialization– Resources request subset of available jobs– Based on data, users, computation type

• Scaling– Management - Increased job speed– Compute – increased data replication

Page 9: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity.

Lifemapper funded by:

U.S. National Science Foundation

NSF EPSCoR 0553722

NSF EPSCoR 0919443

EHR/DRL 0918590

BIO/DBI 0851290

OCI/CI-TEAM 0753336

http://[email protected]