WMO Information System : WIS and a Pilot Project from...
Transcript of WMO Information System : WIS and a Pilot Project from...
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Meteorology eMeteorology e--Science Effort in KoreaScience Effort in Korea
WMO Information WMO Information SystemSystem : WIS: WIS
and and a Pilot Project from CAgM
Dec. 13, 2006
Dong-Il Lee & Byong-Lyol Lee
Korea Meteorological AdministrationKorea Meteorological Administration
Status & Perspectives
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
• Implementation Strategies– Metadata/Ontology– Web service/Grid service
• Current Implementations for WIS– CAgM/WIS– WIS/KMA
Key ContentsKey Contents
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
GEO Initiatives & Cyber Infrastructure
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
WIS implementationsWIS implementations(CAgM/WIS)(CAgM/WIS)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
WIS/GISC infrastructure(WMO Information System)SIMDAT(EU)SIMDAT(EU)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
CAgM MetaData Management
Prototypes of Extended WMO Metadata Core Profile Keywords
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMAHierarchy of weather elements RDF/OWL presentation
WAMIS
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Prototype of Ontology using extended Keywords
WAMIS
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Web & Workflow
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
• Dedicated (Virtual) DCPC/GISC to Agro-
/Applied Meteorology– To take care of non-conventional and extra-
disciplinary data/products(flux, vegetation, soil, forestry, water cycle, etc.)
– To establish a bridge toward GEOSS in information sharing
• Resource sharing technolgy– Servers for NWPs, application models, GIS tools, etc.– Computing GRID is being tested
Requirements from CAgMRequirements from CAgM
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
ImplementationsImplementations(WIS/KMA)(WIS/KMA)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
KMA Efforts to OPENDAP with Grid (I)
agent
SAM File Pool
datasetdataset
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
KMA Efforts for WIS (II)
dataset
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
SIMDATPortal
AMBER
MM5
① Invoke Cluster Resources
By WorkFlow Model
② Call script to reportMeteo modeling
Storage
③ Save resultTo Report File(server side)
Meta catalog
VMCnode
View ReportsOGSA-DAIService
KMA Efforts for WIS (III)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
agentSAN
CTL,IDX for Grib
MetadataExtractor
SIMDATData Repository
UNIDARTMetadataTimeseries/GTS
Ensemble /GDPSWAMIS
VMCNODE(GISC)
WEBPortal
Computing Service
WAMIS Workflow
GrADS Visualization Service
FTP PUSH Service
WorkflowEngineComputing
Resource
KMA Efforts for WIS (IV)
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Future KMA Efforts for WIS
GISC
DCPC
GDS & LASGDS & LASOPENDAP
Agent metadatametadata
metadata
Legacy dataset
Legacy dataset
GISC
Integrated PORTAL
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
DCPC
Synchronize#1
MySQLDB
MySQLDB
② New Service
③ Find New Services
④ Figure outNew Servicesinformation
① Scheduling for synchronize
periodically
⑥ Insert (update) recordsFor new services ⑤ Return
New serviceinformation
Implemented GISC Functions (1)
Portal GISC
DCPC Config XML Metadata
1. Synchronize between GISC and DCPC for new service
UNIDART UNIDART
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
2. Synchronize between GISC and DCPC for new metadata
DCPC
Synchronize#1
MySQLDB
MySQLDB
Portal GISC
DCPC Config XML Metadata
② New Metadata with new Service ID
③ Search FragmentOn metadata Directory
With Service ID ④ Read MetadataMatched with
Fragment
① Scheduling for synchronize
periodically
⑥ Insert (update) recordsFor new metadata contents
⑤ Return New Metadata
Implemented GISC Functions [2]
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Wee
Service
3. Harvesting using Wee Service - OAI
DCPC
MySQLDB
MySQLDB
Portal GISC
XML Metadata
② Make/Send Harvesting msg
③ Search FragmentWith Service ID
Save in DB④ Read Fragment
Metadata
① Scheduling for synchronize
periodically
⑥ Insert (update) recordsFor Fragment contents
⑤ Return Fragment Metadata
Implemented GISC Functions [3]
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Staging Directoryof Portal
Staging Directoryof Portal
OGSA-DAI
② Call OGSA-DAIWith Service class info
And Retrieve condition values
③ Make RequestXML Data
⑤ Return Data
① Request DataUsing conditionsdefined By client
①-1 Save Timestamp IDOn Hashmap List
⑥ SendStatus / Data
⑦ ReturnRequest Status /
Return Data
⑧ If Status is Completed, then
save Data returned by OGSA-DAI
④ Retrieve / MakeXML Data
Portal GISC
Data RepositoryActivity
Storage ForMeteo Data
4. Data Requesting OGSA-DAI service: Instant XML Result Service
Implemented GISC Functions [4]
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
5. Data Requesting using OGSA-DAI service: PUSH Service
OGSA-DAI
② Call OGSA-DAIWith Service class info
And Retrieve condition values
Data Transfer Service
③ Make RequestXML Data
⑤ CallbackStatus
① Request Enb/GDPS DataUsing conditionsdefined By client
①-1 Save Timestamp IDOn Hashmap List
⑥ SendStatus
StorageFor
Meteo Data
TargetFTP Server
⑦ ReturnRequest Status
④-1 Transferring XML fileto target FTP Server
④ RetrieveXML Data
Portal GISC
Implemented GISC Functions [5]
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
6. WAMIS Service Execution using WorkFlow GUI component
AMBER
MM5
① Invoke Cluster Resources
By WorkFlow Model
② Call script to reportMeteo modeling
Report File
③ Save resultTo Report File(server side)
Connect to serverBy samba service
Portal
Implemented GISC Functions – WAMIS
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
<KMA UNIDART>
OGSA-DAI WSRF
Globus Toolkit
Tomcat
ORACLE MetaDB
210.107.255.14
210.107.255.100
DB
<UNIDART Portal>
OC4J Server
<ECMWF SIMDAT Portal>PortalVMCDataRepositoryMySQL
<KMA Climate DB>
MySQL(SYKO60)
FilePool(GTS, Grib)
<KMA SIMDAT & Portal>
Portal
VMC
DataRepository(using UNIDART)
MySQL
<KMA WAMIS NODE>
MM5 operation
Grid model output Tool
<DWD UNIDART>
OGSA-DAI WSRF
Globus Toolkit
Tomcat
DMZ
Demonstration site
KMA DMZ
DWD
ECMWF
AMBER on Windows
Demo – System Architecture
11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA
Thank you!Thank you!