C/CATT-BRAMS description for EELA-2 Grid School

Claudio Baeza RetamalRodrigo Delgado UrzúaCMM/DIM, Universidad de ChileChile

The BRAMS TeamCPTEC / INPEBrazil

Agenda

Introduction HPC for enviromental sciences @

CMM SAEMC Project What is C/CATT-BRAMS? Software Requirements Grid Requirements The GEL

Introduction: who we are Center for Mathematical Modeling (CMM) is a

center for research on applied mathematics Born at Department of Mathematical

Engineering It belongs to Faculty of Science Physics and

Mathematics of University of Chile In mathematics, Universidad de Chile is

ranked 67th preceded only by the best from USA, Europe, 2 from China, 1 from Israel, 1 from Australia, 1 from Canada.

U. de Chile + U. de Concepción = near 50% of Chilean Mathematics

• 32 researchers (24 U. de Chile, 8 U. de Concepción.)

• 4 CNRS researchers, as CMM is a CNRS’s UMI• 28 researcher engineers & scientist• 90 visitors: average 1month each• 15 postdocs (mainly Europe, Latin America)• 500+ published ISI papers from 2000-

• 40 Ph.D. students• 14 Ph.D. theses• 70 Mathematical Engineering students• 10 Engineering theses (Master level) • 3500 undergraduate students (top 1% in the

country)

Strengths of the team: CMM’s numbers 2008

Goal at CMM:

To establish meaningful and productive relationships between advanced mathematics and all endeavors of modern society

Fundamental Research

Optimization

Probability

Nonlinear Analysis

Discrete Math.

Math. Mechanics

Num. Analysis

Industry

Mining

Telecom.

Forestry

Environment

Education

Energy

Fishing

Biotechnology

•LBMG•ESML•LM4•GeoM

•Forest•Econ•RR•SS•Education

Laboratories: bridge connecting basic and industrial research

HPC for Environmental Sciences @ CMM: ESML

…Earth System Modeling tools and more particularly to provide a functional and validated basis on atmospheric chemistry and climate research...

Collaboration with DMC (Chile), SMHI (Sweden), CPTEC (Brazil), NOAA (USA), INRIA/ENPC (France), among others.

7

HPC for Environmental Sciences @ CMM: ESML

Emissions : mobile and stationary

Adaptation (Porting) + Evaluation + Validation of models: MATCH, RCA MM5, WRF (CATT/CCATT)-BRAMS Polyphemus (POLAIR)

8

SAEMC Goals

SAEMC (http://saemc.cmm.uchile.cl) project main goals: To provide accurate regional emissions and climate change

scenarios for South America, with emphasis on the impacts of and on mega-cities.

To establish the basis for operational chemical weather forecast for South American mega-cities.

To strengthen and expand an active research and capacity building network in the Americas functional to Earth System Modeling.

Multi-national partners: AR, BR, CL, CO, PE, US Strong emphasis on training human resources capable of making

contributions in scientific and technical fields.

9

SAEMC + HPC

WP1: Mobile and Stationary emissions scenarios estimate and evaluation

WP2: Dynamical down-scaling of climate change scenarios

WP3: Pilot implementation of chemical weather forecast network and tools for South American mega-cities

WP4: Prospective characterization of aerosols in and downwind from South American mega-cities

WP5: High Performance and Grid Computing for operational chemical weather forecast Researchers: Eugenio S.

Almeida (CPTEC, Brazil), Claudio Baeza (CMM, Chile) , Rodrigo Delgado (CMM, Chile), Luiz Flavio Rodrigues (CPTEC,Brazil)

10

What is C/CATT-BRAMS?

Chemestry

CoupledAtmosphericTracer andTransport

Brazilian developments toRegionalAtmosphericModelingSystem

What is C/CATT-BRAMS?

BRAMS: multipurpose, numerical prediction model designed to simulate atmospheric circulations spanning in scale from hemispheric scales down to large eddy simulations (LES) of the planetary boundary layer.

What is C/CATT-BRAMS?

C/CATT-BRAMS explores the BRAMS tracer transport capability of using slots for scalars. The in-line model transport follows the Eulerian approach, solving the mass conservation equation for carbon monoxide (CO) and particulate material PM2.5

What is C/CATT-BRAMS?

Software requirements C/C++ and Fortran compilers

Gnu C Compiler Compiler (gcc/g++) / GNU Fortran Compilers (gfortan)

Portland Group compiler suite 6 or later Intel C/C++ and Fortran compiler 9 or later

For Intel 64 compatible CPUs, we recommend Intel compiler set. BRAMS MPI implementation on IA64 systems has been tested but is not suitable for production environments.

Software requirements Regular libraries:

HDF 4.2r0 or higher (not compatible with HDF 5)

zLib 1.1.4 or higherjpeg-6bsZip 1.2 or higher

Model Workflow

Grid requirements Control of Job Failures Manage data and metadata Manage checkpoint Accounting Monitoring To keep a “know-how” along to

databases on grid

Know-how from EELA1

In EELA1 we adopted the strategy of to introduce system calls in source code for interact with the GRID.

These system calls execute scripts (in Perl, Python, shell) or binary program (that uses gLite APIs) for connect the applications with Grid elements.

Finally, we introduce the GEL concept

The Grid Enabling Layer (GEL) A. S. Cofiño, M. Carrillo, C. Baeza, et al. “GRID distributed

computation of nested climate simulations”, Geophysical Research Abstract, European Geosciences Union, Vol.9, 10351, 2007

V. Fernández-Quiruelas, J. Fernández, C. Baeza, et al. “Climate modeling on the GRID”, Third Conference of EELA Project, 2007

V. Fernández-Quiruelas, J. Fernández, A. Cofiño, C. Baeza, et al, “Complex Workflow Management of the CAM Global Climate Model on the GRID”, International Conference on Computational Science 2008 (ICCS 2008), Kraków, Poland

V. Fernández-Quiruelas, J. Fernández, C. Baeza, A. S. Cofiño, J. M. Gutirrez. “Workflow management in the GRID, for sensitivity studies of global climate simulations”, Earth Science Informatics, Springer, Journal no. 12145

How to “gridify” our applications

The main idea is to use the GEL layer for “gridify” the C/CATT-BRAMS application

In EELA1 we use AMGA as metadata server, however, in the grid C/CATT-BRAMS applications, due to performance reasons, we prefer to develop another interface for metadata information, the amount of files is very big.

The interface will be based on AMGA, but do not simulate a file system, simply, will use SQL instruction directly and protocols for synchronization and coordination, for example, a two phase commit.

Thanks!Obrigado!Gracias!