Landslide Modelling With LCG Tools
Transcript of Landslide Modelling With LCG Tools
-
8/13/2019 Landslide Modelling With LCG Tools
1/24
Landslide modelling
with LCG toolsMichael Wallace - Research Assistant, Particle Physics,University of Bristol
-
8/13/2019 Landslide Modelling With LCG Tools
2/24
Overview
Landslides and landslide simulation
Landslide data management issues
How WLCG tools and resources can help
Overview of proposed architecture
-
8/13/2019 Landslide Modelling With LCG Tools
3/24
Impact of landslides
-
8/13/2019 Landslide Modelling With LCG Tools
4/24
Economic impact
!"!#
!"#
#
#!
%&'()* +(,()- ./0,*12
!"#$ &'( $" )*+),&(# *+& -""
.//0 1 .//2 3) 4,+" (5(+$
31-( 45'66'1& %+78
Developing countriesmore vulnerable
Less resources fordisaster recovery
Accumulated risk dueto poorly planneddevelopment schemes
-
8/13/2019 Landslide Modelling With LCG Tools
5/24
!"!#
!"#
#
#!
%&'()* +(,()- ./0,*12
!"#$ &'( $" )*+),&(# *+& -""
.//0 1 .//2 3) 4,+" (5(+$
31-( 45 16 789:
Economic impact
Developing countriesmore vulnerable
Less resources fordisaster recovery
Accumulated risk dueto poorly planneddevelopment schemes
-
8/13/2019 Landslide Modelling With LCG Tools
6/24
Disaster planning
Landslide risk of a slope for a given storm
Size and runout of a landslide
Economic impact of a landslide
Things that are useful to know:
courtesy of Dr Liz Holco
mbe
-
8/13/2019 Landslide Modelling With LCG Tools
7/24
Landslide modelling
Bristol University has world leading
landslide modellers
chasm -> Landslide risk, hazard, size
questa -> Economic impact
Used by the World Bank for planning
development schemes in developingcountries
-
8/13/2019 Landslide Modelling With LCG Tools
8/24
Data management
Analysing different scenarios across 100s of
slopes results in many simulations and a
long overall runtime
10s of TB generated per year for a typical
usage scenario
No facilities for managing this data
-
8/13/2019 Landslide Modelling With LCG Tools
9/24
Current simulation
workflow
!" $%&'(
)*'+",-
.'/-0 /12'1//*+
3/,2*(45'&(- +&'/1&/+
$,&(- 2,6/*17/1"
8'+(+"/* 4-(11/*+
9'6'- /12'1//*+
:14%" 0("(
;(-'0("/0 '14%" 0("(
!'7%-(/1/?"+
-
8/13/2019 Landslide Modelling With LCG Tools
10/24
Current simulation
workflow
!" $%&'(
)*'+",-
.'/-0 /12'1//*+
3/,2*(45'&(- +&'/1&/+
$,&(- 2,6/*17/1"
8'+(+"/* 4-(11/*+
9'6'- /12'1//*+
:14%" 0("(
;(-'0("/0 '14%" 0("(
!'7%-(/1/?"+
-
8/13/2019 Landslide Modelling With LCG Tools
11/24
Improved simulation
workflow
!"#$% '"()*+,)+- ./(/% )+'/+))*0 1/0$0-)* 2%$++)*0
345678 9/+$*:;)"'*$2
-
8/13/2019 Landslide Modelling With LCG Tools
12/24
Improved simulation
workflow
!"#$% '"()*+,)+- ./(/% )+'/+))*0 1/0$0-)* 2%$++)*0
345678 9/+$*:;)"'*$2
-
8/13/2019 Landslide Modelling With LCG Tools
13/24
What is CouchDB?
Top-level Apache project
Document-oriented database
Data stored as JSON documents, indexed
by UID
Views allow indexing by any document field
-
8/13/2019 Landslide Modelling With LCG Tools
14/24
Why CouchDB?
Multi-master replication out of the box
Geo-indexing out of the box
Runs on phones, laptops, servers & clusters
Provides application logic and can serve
client-side code
Browser + CouchDB = Web application
-
8/13/2019 Landslide Modelling With LCG Tools
15/24
Why not CouchDB?
Greater storage requirements than a
typical RDBMS for most data
Uncertainty over write speeds - need to
test how many writes per second we can
scale to
-
8/13/2019 Landslide Modelling With LCG Tools
16/24
-
8/13/2019 Landslide Modelling With LCG Tools
17/24
Task request
Specifies software release and input files
Specifies variable parameters:
Stochastic parameters
Investment scenarios
Rainfall scenarios
-
8/13/2019 Landslide Modelling With LCG Tools
18/24
Job definition
Specifies software release and input files
Specific parameters generated by task
sentinel
For stochastic jobs:
Seed for generation of stochastic
parameters
-
8/13/2019 Landslide Modelling With LCG Tools
19/24
What is a job?
We submit a job wrapper
~400 lines of python
Downloads job definition
Downloads executable and inputs
Runs executable
Parses and uploads output files
-
8/13/2019 Landslide Modelling With LCG Tools
20/24
Executables
Geographical sciences tag a release in SVN
We automatically check out the release,build it and commit it to a new releases DB
Regression tests are run
Release is replicated to the production DB
-
8/13/2019 Landslide Modelling With LCG Tools
21/24
-
8/13/2019 Landslide Modelling With LCG Tools
22/24
-
8/13/2019 Landslide Modelling With LCG Tools
23/24
In conclusion...
We are applying WLGC tools, resources
and concepts to landslide modelling
This allows us to develop an integratedsystem to provide better informed disaster
planning and reduced economic impact
Planning to have a product deployed with
engineers in the Organisation of EasternCaribbean States by 2012
-
8/13/2019 Landslide Modelling With LCG Tools
24/24
One more thing...
Please support our VO!
vo.landslides.mossaic.org