Members and Chapters Władysław Majewski ISOC Poland, president.
Himawari ‐ 8 Operational Data Processing and Access Leon Majewski 25 August 2015.
17
Himawari‐8 Operational Data Processing and Access Leon Majewski 25 August 2015
-
Upload
claude-underwood -
Category
Documents
-
view
219 -
download
2
Transcript of Himawari ‐ 8 Operational Data Processing and Access Leon Majewski 25 August 2015.
Himawari‐8 Operational Data Processing and Access
Leon Majewski
25 August 2015
Data Ingest and Reception
• Multiple access methods and processing chains
– HimawariCloud• NHMS access: operational since July 2015
– HimawariConnect• ABOM access: Due September 2015• 100 Mbit link to JMA (Tokyo)
– HimawariCast• Melbourne: Due August 2015• Darwin: Due September 2015
HimawariCloud
HimawariConnect
HimawariCast
Himawari-8
Hope
JMA
Data Ingest and Reception
• Multiple access methods and processing chains
– HimawariCloud• NHMS access: operational since July 2015
– HimawariConnect• ABOM access: Due September 2015• 100 Mbit link to JMA (Tokyo)
– HimawariCast• Melbourne: Due August 2015• Darwin: Due September 2015
• Approximate HimawariCloud data availability timeline
1 2 3 4 5 6 7 8 9 10 ABOM image generation ABOM product generation
Data Ingest and Reception
Observation Processing Available for download
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
0 1 2 3 4 5 6 7 8 9
Real time processing: Observations
• HSF data is converted to netCDF4
– Metadata: CF, ACDD
– Native projection (+proj=geos)
– Application of calibration coefficients• Scaled radiance (bands 1-6)• Bidirectional reflectance factor (bands 1-6)• Brightness temperature (bands 7-16)
• Generation of solar geometry
Real time processing: Imagery
• Generation of imagery from netCDF4
– GEOTIFF and JPEG with colour scale applied
– Native projection
– Simple latitude/longitude grid (+proj=latlong)
• Geospatial Data Abstraction Library
– Open source toolkit for geospatial data manipulation
– Image translation (crop, format) & re-projection
Real time processing: Products
• GEOCAT framework (NOAA & University of Wisconsin)
– Cloud mask & properties (Heidinger & Pavolonis)
– Fog & Low cloud (Pavolonis)
– Volcanic Ash (Pavolonis)
– Atmospheric Motion Vectors (Daniels & Le Marshall)
– Sea Surface Temperature (Griffin & Majewski)
• External processing systems (post-GEOCAT)
– Solar Radiation (MINES-ParisTech & Grant)
Data access: Observations
• Operational (Government, commercial & non-commercial)
– netCDF: Registered user service
– Service Level Agreement
• Research use: National Compute Infrastructure
– Delayed availability (< 24 hours)
– HSF: 30 days online, archive to MDSS
– netCDF: online, copy on MDSS• Working with NCI to achieve efficient access
Data access: Products
• Operational (Government, commercial & non-commercial)
• Research use: National Compute Infrastructure RDSI
– Delayed availability (< 24 hours)
– netCDF: online, copy on MDSS
– Released as determined to be "valid"
a) Consistent with NOAA output
b) Routine validation metrics available
– Updates are expected as improvements are made
Validation
• Observations
– JMA GSICS web page
– JMA Navigation web page
• Products
– Cloud properties: CloudSat, heritage products
– AMV: Radiosondes, NWP model impact
– Solar radiation: Solar radiation network
– Sea Surface Temperature: drifting buoys
Future Developments
• Meteorological product development
– Overshooting tops
– Convective initiation
– Significant rainfall
– NWP data assimilation• Atmospheric Motion Vectors• Clear Sky Radiances• Cloud properties
• Public viewer release (late September)
Advanced Himawari Imager
• Advanced imagers provide us with a "Big Data" challenge
– Volume• Imagery: 50TB/year• Products: 100 TB/year
– Velocity• 10 minute refresh
– Variety• Band combinations• New Products
AHI Band
Central Wavelength
Spatial Resolution
Bit Depth
MTSAT Central
Wavelength
GOES-R ABI Central Wavelength
[µm] [m] [bits] [µm] [µm]
1 (B) 0.47 1000 11 0.472 (G) 0.51 1000 113 (R) 0.64 500 11 0.68 0.644 0.86 1000 11 0.86
1.375 1.60 2000 11 1.616 2.30 2000 11 2.247 3.90 2000 14 3.70 3.908 6.20 2000 11 6.80 6.179 6.90 2000 11 6.9310 7.30 2000 12 7.3311 8.60 2000 12 8.4012 9.60 2000 12 9.6113 10.40 2000 12 10.80 10.3314 11.20 2000 12 11.2015 12.40 2000 12 12.00 12.3016 13.30 2000 11 13.30
netCDF4 data format
• 20150220005000-P1S-ABOM_OBS_B13-PRJ_GEOS141_2000-HIMAWARI8-AHI.nc
– Date: 20150220005000
– Time coverage: P1S
– Product code: ABOM_OBS_B13
– Projection code: PRJ_GEOS141_2000
– Platform: HIMAWARI8
– Sensor: AHI
netCDF4 data format
• Variable names:
– channel_0001_scaled_radiance• Band 1 scaled radiance
– channel_0003_brf• Band 3 TOA bidirectional reflectance factor
– channel_0013_brightness_temperature• Band 13 TOA brightness temperature
Imagery: VIS, IR, WV, Combinations
