2003 uMeteo-K Jai-Ho Oh Pukyong National University, Busan, Korea APAN for Meteorological Studies...

2003 uMeteo-K2003 uMeteo-K

Jai-Ho Oh

Pukyong National University, Busan, Korea

APAN for Meteorological StudiesAPAN for Meteorological Studies

August 27, 2003

- 2 - 2003 uMeteo-K2003 uMeteo-K

Main GoalsMain Goals

Establishment of uMeteo-K, ubiquitous Korea meteorological research cooperation system


Examples of Weather Information

Water ResourcesWater Resources

EnvironmentEnvironment

Wild FireWild Fire

Metorological Metorological

DisasterDisaster

Industreal AreaIndustreal Area

Health…Health…


uMeteo-KuMeteo-KGRIDGRID

TestbedTestbed

KMA GridKMA Grid

Super EnsembleSeasonal/Climate

Super EnsembleSeasonal/Climate

Risk managementNational response

Risk managementNational response

Applied MeteorologyAgro,Energy,Fishery,

Applied MeteorologyAgro,Energy,Fishery,

Model DevelopmentNext G./K-model

Model DevelopmentNext G./K-model

Impact AssessmentEnv. Impact/Feedback

Impact AssessmentEnv. Impact/Feedback

Meteorological industryMet info/Instruments

Meteorological industryMet info/Instruments

APCN-GridAPCN-Grid

UniversityGrid

PrivateGrid

ProjectGrid

NGISGrid

InstituteGrid

Inter-OfficeGrid

CAgMCAgMGridGrid

Core AgMet StationKoflux/RS reference

Core AgMet StationKoflux/RS reference

Network Hub for RCC Network Hub for RCC

Public serviceUser req./Detailed

Public serviceUser req./Detailed

Global Environment Flux, Aerosol, GHG

Global Environment Flux, Aerosol, GHG


About uMeteo-KAbout uMeteo-K

The concept of virtual lab. for interdisciplinary meteorological researches

- Parallelized numerical weather prediction modeling (Computational Grid)- Cooperation meteorological research system (Access Grid)- Virtual server for large meteorological data (Data Grid)

Grid technology is essential to accomplishment


Climate Prediction Climate Prediction


Changes in solar input Changes in the atmosphere:Composition, chemical reactionrates and circulation

Changes in the hydrological cycle

H2O, N2, O2, CO2, O3 etcTerrestrial

radiation

Precipitation and evaporation

Windstress

Heat exchange

Air-icecoupling

Sea ice

Atmosphere Air-biomassCoupling(e.g. N C )Snow

Ecosystem changes

smoke

Biomass

Changes in farming practice

Land-biomass coupling(e.g. carbon)

Changes in the land surface :Continental distribution, vegetation,Land-use, ecosystems

Land

Ocean

Mixed layer processes

Deep Ocean

Shelf processes

Aerosols &CO2 etc

Riversand lakes

Human influences


27km 9km 3kmClimate Information by 2010

Climate Information by 2003

Required Climate Information by 2010Required Climate Information by 2010


• Earth Simulator• Massively parallel super-computer based on NEC SX-5 architecture.

– 640 computational nodes.640 computational nodes.– 8 vector-processors in each of nodes.8 vector-processors in each of nodes.– Peak performance of 1CPU : 8GFLOPSPeak performance of 1CPU : 8GFLOPS– Total peak performanceTotal peak performance ：　：　 8x8x640 = 40TFLOPS8x8x640 = 40TFLOPS


Development of a High-Resolution Atmospheric Global Model on the Earth Simulator for Climate study

10km or less in horizontal, 100 levels in vertical10km or less in horizontal, 100 levels in vertical

NNonhydrostaticonhydrostatic IC ICosahedralosahedral A Atmospherictmospheric MModelodel (NICAM) (NICAM)


Integration of Human and Computational Resources

Daejeon

Kwangju Pusan

Chuncheon

Incheon

Suwon

ChonanChongju

Jeonju

Chang-won

Ulsan

Pohang

Seoul

Daegu

Cheju

• Computers

• Supercomputers• Experimental Facilities

• High Speed Networks

• Databases• Mass Storage•

Visualization

Environment

• Access Grid System

• Brain pool


AG in uMeteo-KAG in uMeteo-K

Setup uMeteo-K AG with PIG + Room Node basis

(ICSYM/PKNU, CES/SNU, NCAM/KMA)

- Linkage in uMeteo-K with KOREN network system

- Establishment of a duplex video conference system with PIG & Polycom - Establishment of computing environment among uMeteo-K’s PIG

(AG toolkit 1.2 version)

- Establishment of PIG + PIG based independent Room Node system

(NCAM/KMA)


uMeteo-K AG configurationuMeteo-K AG configuration

KAISTKAIST

CNUCNU

KMAKMA

KJISTKJISTPKNU(부경대 )

PKNU(부경대 )

KISTIKISTI

AG

Multicast

Unicast

Unicast

Quick Bridge

Quick Bridge

ANL

KMA

PKNU

KISTIKISTI

KJISTKJISTCNUCNU

KAISTKAIST

KMAKMASNU


Samples of uMeteo-K AG operationSamples of uMeteo-K AG operation

< Korea AG-Group Quick bridge server test – Participants; PKNU, SNU, KISTI, KJIST, CNU, KAIST, KMA on July 8, 2003 >


< uMeteo-K monthly meeting using VRVS PKNU(Busan)-SNU(Seoul)-KMA(Seoul)-USA(Washington D.C), June 3, 2003>


• uMeteo-K computational grid testbed

(Two clusters utilized and each cluster has 4 nodes)

< A node’s specification>

CPU Pentium 4 1.8 Ghz

RAM 1G SDRAM

HDD EIDE 40G

VGA No

Network Internal : 10/100 Fast Ethernet

Exteral : Koren

uMeteo-K CG Testbed uMeteo-K CG Testbed


NAS storage sever

NAS storage sever

10/100 switch hub

Monitoring system

UPS

4 nodes ( single CPU ) cluster

Electrometer KOREN 10/100 Ethernet

4 nodes ( single CPU ) cluster

uMeteo-K CG Testbed ConfigurationuMeteo-K CG Testbed Configuration


• Linux : paran 7.0 (kernel version 2.4.18)

• Globus 2.4

• PG fortran 3.2 (Portland Group)

• MPICH-G2 1.2.5 for parallel job running– MPICH-G2 with PG fortran

• NCAR Graphics for graphic display

• NIS, NFS

uMeteo-K CG Testbed S/WuMeteo-K CG Testbed S/W


• Independent simple CA has installed at each master node.

• A group of slave nodes is controlled by each master node’s PBS

scheduler

CA-A

Master A

CA-B

Master B

slaves slaves

PBSPBS

Globus linkage between testbed clustersGlobus linkage between testbed clusters


subject : /O=uMeteoK/OU=PKNU/OU=pknu.ac.kr/CN=pknuCA2215/CN=proxyissuer : /O=uMeteoK/OU=PKNU/OU=pknu.ac.kr/CN=pknuCA2215identity : /O=uMeteoK/OU=PKNU/OU=pknu.ac.kr/CN=pknuCA2215type : full legacy globus proxystrength : 512 bitspath : /tmp/x509up_u535timeleft : 10:53:37

subject : /O=uMeteoK/OU=pknu.ac.kr/CN=pknuGB1/CN=proxyissuer : /O=uMeteoK/OU=pknu.ac.kr/CN=pknuGB1identity : /O=uMeteoK/OU=pknu.ac.kr/CN=pknuGB1type : full legacy globus proxystrength : 512 bitspath : /tmp/x509up_u533timeleft : 10:01:23

- CA-A : pknuGB01.pknu.ac.kr

- CA-B : pknuGB05.pknu.ac.kr

CA information of each clusterCA information of each cluster


Monitoring system on CG testbed

Before integration

Integration


Globus script file for Parallel MM5 run (mm5.rsl)

+( &(resourceManagerContact="pknuGB01") (count=4) (label="subjob 0") (environment=(GLOBUS_DUROC_SUBJOB_INDEX 0) (LD_LIBRARY_PATH /usr/local/globus/lib/)) (directory="/spring/KISTI/MM5/Run") (executable="/spring/KISTI/MM5/Run/mm5.mpp"))( &(resourceManagerContact="pknuGB05") (count=4) (label="subjob 4") (environment=(GLOBUS_DUROC_SUBJOB_INDEX 1) (LD_LIBRARY_PATH /usr/local/globus/lib/)) (directory="/summer/KISTI/MM5/Run") (executable="/summer/KISTI/MM5/Run/mm5.mpp"))


Parallel MM5 Benchmarks with GLOBUS

Average job waiting time (including CA) : 25 sec

The required time for 3600 sec (1 hour) model integration

The required time for 86400 sec (1 day) model integration

MPICH 35 sec

MPICH-G2 42 sec

MPICH 10 min 38 sec

MPICH-G2 12 min 47 sec

Single CPU 67 min 12 sec


JMA

SNU KISTI

Supercom

PKNU

Forecast output

Data input

Forecast output

Forecast output

NASA

KMA

Model output

Model output

Data input

Data input

COLA

NCEP

uMeteo-K Data Grid

uMeteo-K Data Grid ConfigurationuMeteo-K Data Grid Configuration

2003 uMeteo-K2003 uMeteo-K

Thank you for your attention!Thank you for your attention!

2003 uMeteo-K Jai-Ho Oh Pukyong National University, Busan, Korea APAN for Meteorological Studies...

Documents

Transcript of 2003 uMeteo-K Jai-Ho Oh Pukyong National University, Busan, Korea APAN for Meteorological Studies...