GEMINI Indiana University, University of Kentucky.
-
Upload
russell-woods -
Category
Documents
-
view
215 -
download
0
Transcript of GEMINI Indiana University, University of Kentucky.
![Page 1: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/1.jpg)
GEMINI
Indiana University, University of Kentucky
![Page 2: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/2.jpg)
Overview
• Combine U. Kentucky’s INSTOOLS, perfSONAR and Periscope
• Support scalable, high-rate measurement across layers– Including infrastructure
![Page 3: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/3.jpg)
Measurement Points
• Produce measurement data• Send data to a Measurement Store• Send metadata to UNIS• Standard perfSONAR and INSTOOLS MPs• BLiPP (Basic Lightweight Periscope Probes)
– High rate host monitoring– Adjustable frequency
• NetLogger and Calipers for application monitoring– Addressing scalability with in-line analysis and summarization– Example: system call monitoring to determine file transfer
bottleneck
![Page 4: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/4.jpg)
Measurement Store
• Stores Measurement data (I know you didn’t see that coming)
• Supports high-rate data transfers• Publish/Subscribe interface• Multiple tiers with different characteristics– Surge tank near the source– Bottom of rack– Parallel storage for slice-wide data
![Page 5: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/5.jpg)
MAP
• Measurement/Management and/Analysis Presentation Service
• Configuration GUI• Visualize data (from MS)• Visualize topology (obtained from UNIS)
![Page 6: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/6.jpg)
Portal
• “One stop shop” to integrate various MAP services
![Page 7: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/7.jpg)
MC
• Measurement controller/coordinator• Initiates measurement collection• Coordinates measurements• Fetches data from some MPs
![Page 8: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/8.jpg)
UNIS
• Directory service• Topology data– As well as changes
• Service data• Measurement metadata
![Page 9: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/9.jpg)
Cross cutting
• RESTful interface to perfSONAR (Periscope)• GEMINI Event Messaging Service (GEMS)– High rate data with JSON/BSON
![Page 10: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/10.jpg)
Portal Login Windowing Standard Views Prefs
Operator
User
CF Control
FLACK
GUSH
Other…
IM Control
INSTOOLS
UNIS
Other…
MeasurementGraphs/Tables
INSTOOLSPeriscope MAP
Other…
CMS Interface
Drupal
Runtime Interface
-VNC
Archive Interface
Control Framework
Services
Archive
MP1
MP2
MP3
MPn……
CM
SA
Storage
Services…
VM to run
archiveCH
MCC MS
Local/Private Storage
Control And
(Data) Collection
AuthN/Z
UNIS
INSTOOLSGMOC
iRODS- ShellsLab Book
Management and Presentation (MAP)
I&M Services
GENI Resources
![Page 11: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/11.jpg)
![Page 12: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/12.jpg)
![Page 13: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/13.jpg)
GEMINI ArchitectureGEMINI Global Registry (UNIS)
GENI I&MArchive
Portal and MAP
✓✓✓
Event Messaging Service
perfSONAR (REST and SOAP)
MPMeasurement
Points
BLiPP MP
NEW(Openflow, Layer2, Virtual Machine)
Meas. Stores
MA
GENI AuthN/Z
Instrumentize
GENIRACKS
GEMINISLICE
MCMeasurement
Controller /Collector
Network
MS
![Page 14: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/14.jpg)
Status
• Initial merger of INSTOOLS, Periscope and perfSONAR (LAMP)
• MC functionality running together– Some duplicate functionality
• Development workflow• Migration to github• Jira• Collection of “user stories”
![Page 15: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/15.jpg)
Demo Topology
![Page 16: GEMINI Indiana University, University of Kentucky.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e415503460f94b33ab1/html5/thumbnails/16.jpg)
Bottleneck Detection