Bunge Corporate | Home · 2018. 12. 18. · Bunge Corporate | Home
Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.
-
Upload
elena-virden -
Category
Documents
-
view
213 -
download
0
Transcript of Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.
![Page 1: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/1.jpg)
Consolidated Internet Farms(NOAA8080)
Bob Bunge
OCIO
![Page 2: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/2.jpg)
Interfacing NOAA Systems
![Page 3: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/3.jpg)
Interfacing NOAA systems II
![Page 4: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/4.jpg)
CIF System Overview
• Three geographically separated similar systems designed to serve data to the public using Internet protocols
• Goal: Provide NWS with an operationally supportable Internet presence
• Designed for 99.9% availability• Deliver raw data, data services, graphics, text,
etc, to all levels and types of customers• LAMP: Linux/Apache/Mysql/PHP
![Page 5: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/5.jpg)
System Overview
• Farms have natively supported up to 1.1 Gb/s of traffic (~8k requests per second), most of which is dynamic (meaning requiring database queries, reading of large netCDF/GRIB2 cubes or both)
• Selected data sets can be pushed out to contracted commercial vendors to leverage a 4 to 10 times increase in capacity (depending on data type)
![Page 6: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/6.jpg)
Architecture
• Each farm is has 14 front end web servers, two web object caches to serve public requests
• Each farm has a five node Mysql cluster• Each farm has about 20 systems dedicated on
the back end to processing, parsing, etc, raw NWS data
• Each farm has two NFS file servers, about 4 Tb total
• XMPP Cluster (2/3 servers) (one farm per year)
![Page 7: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/7.jpg)
System Architecture
![Page 8: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/8.jpg)
Major System Interfaces
• Public Internet (SSMC (2Gb/s)/SRH(1Gb/s)/CRH(140Mb/s)
• SSMC Open Campus, TOC, Regional networks
• NOAAnet, SBN, Sockets
• LDM, rsync, ftp, scp, browser upload via Content Management System
![Page 9: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/9.jpg)
Standards and Formats
• Load balancing: DNS• Incoming data streams: NetCDF, GRIB2,
GRIB2/Cube, WMO, xml, various graphics, radar binary
• Outgoing: HTML, CSS, RESTful, SOAP, XML/XSL, RSS/ATOM, CAP, DWML, OGC, Shp, WFS, zip, XMPP, various graphics
• Up and coming: WMS, XMPP, DM-open• Open Layers mapping displays• Inside: NFS, GFS, SVN, SQL
![Page 10: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/10.jpg)
Dev Schedule and Milestones
• CAWS: Oct• AHPS Phase VI: Nov• 3rd Generation Marine Wx Portal: Winter• High speed file servers: Oct/Nov• Major network realignment: December• 1st consolidated C&A: December/Jan• CAP XMPP/DM-open push test: Winter/Spring?• RIDGE 2: Spring ’10• NextGen Watch/warning maps: Spring ’10?• Completion of WFO migration to CMS: Summer ’10
![Page 11: Consolidated Internet Farms (NOAA8080) Bob Bunge OCIO.](https://reader036.fdocuments.in/reader036/viewer/2022062619/5516a1ef550346f6208b4cbf/html5/thumbnails/11.jpg)
Governance Structure
• 60-1 series of NWSI
• Internet Configuration Control Board– Supported by Web Tactical Team for
usability/science decisions– Online ticketing system used to track trouble
tickets, feature requests, configuration changes
– Docu-wiki used to develop/maintain documentation