Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

23
© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. Science-as-a-Service on AWS Go Far With Less Ravi K Madduri, Argonne National Laboratory and University of Chicago November 13, 2013

description

Science-as-a-Service on AWS

Transcript of Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

Page 1: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Science-as-a-Service on AWS

Go Far With Less

Ravi K Madduri, Argonne National Laboratory and University of Chicago

November 13, 2013

Page 2: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 3: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 4: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

1Computation Institute, University of Chicago, Chicago, IL, USA. 2Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL, USA. 3 Section Genetic Medicine, University of Chicago, Chicago, IL.

Challenges in Next-Gen Sequencing Analysis

!

!

!

!

!

!

!

High Performance, Reusable Consensus

Calling Pipeline

!

!

!

"

"

"

! "

!

"

"

Parallel Workflows on Globus Genomics

!

!

!

!

!

!

!

Page 5: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 6: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 7: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 8: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 9: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 10: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 11: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 12: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

No.

Historie

s

Executio

n Time

(s)

No. Per

Hour

On-demand

Cost ($2.10)

Spot Cost

($0.50)

1.5B 570 6 $35 $9

1B 445 8 $27 $7

0.5B 283 12 $18 $5

0.25B 170 21 $10 $2

Page 13: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 14: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 15: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 16: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 17: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 18: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 19: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

>10,000 registered users; >150 daily24 PB moved; >1B files

10x (or better) performance vs. scp99.9% availability

Entirely hosted on Amazon

Page 20: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

Figure 1: Globus Genomics spot instance usage in hours/day and cost in $/day for October 2013.

Page 21: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 22: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast
Page 23: Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

Our research is supported by:

U.S. DEPARTMENT OF

ENERGY

23