Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage!...
Transcript of Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage!...
![Page 2: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/2.jpg)
“I need a good place to store / backup / archive my (big) research data, at a reasonable price.”
Public Cloud Archive Mass Store Campus Store
![Page 3: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/3.jpg)
“I need to easily, quickly, & reliably move or mirror portions of my data to other places.”
Research Compu.ng HPC Cluster
Lab Server
Campus Home Filesystem
Desktop Worksta.on
Personal Laptop
XSEDE Resource Public Cloud
![Page 4: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/4.jpg)
“I need to easily and securely share my data with my colleagues at other institutions.”
![Page 5: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/5.jpg)
“I need to get data from a scientific instrument to my analysis server.”
Next Gen Sequencer
Light Sheet Microscope
MRI Advanced Light Source
![Page 6: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/6.jpg)
Challenge: Manage research data as easily as…
…our pictures
…home entertainment …our e-‐mail
![Page 7: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/7.jpg)
What is Globus?
Big data transfer, and sharing… … delivered via SaaS …
… that is simple, secure, and fast… … directly from your own storage
systems
![Page 8: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/8.jpg)
Reliable, secure, high-performance file transfer
• “Fire-and-forget” transfers
• Automatic fault recovery
• Seamless security integration
• Powerful GUI and APIs
Data Source
Data Destination
User initiates transfer request
1
Globus moves and syncs files
2
Globus notifies user
3
![Page 9: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/9.jpg)
Simple, secure sharing off existing storage systems
Data Source
User A selects file(s) to share, selects user or group, and sets permissions
1
Globus tracks shared files; no need to move files to cloud storage!
2
User B logs in to Globus and
accesses shared file
3
• Easily share large data with any user or group
• No cloud storage required
![Page 10: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/10.jpg)
Globus is SaaS
• Web, command line, and REST interfaces • Reduced IT operational costs • New features automatically available • Consolidated support & troubleshooting • Easy to add your laptop, server, cluster,
supercomputer, etc. with Globus Connect
![Page 11: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/11.jpg)
8,000 active endpoints
(in the past year)
![Page 12: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/12.jpg)
Demonstration
![Page 13: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/13.jpg)
Globus Connect Server
• Create endpoint in minutes; no complex GridFTP install • Enable all users with local accounts to transfer files • Native packages: RPMs and DEBs • Also available as part of the Globus Toolkit
Local Storage System (HPC cluster, campus server, …)
Globus Connect Server
MyProxy Online CA
GridFTP Server
Local system users
![Page 14: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/14.jpg)
Our challenge:
Sustainability
We are a non-profit, delivering a production-grade service to the non-profit research community
![Page 15: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/15.jpg)
Globus Provider Subscriptions • Managed Endpoints
– Priority support – Management console – Usage reports – Mass Storage System optimization – Host shared endpoints – Integration support
• Branded Web Site
• Alternate Identity Provider (InCommon is standard)
globus.org/provider-plans
![Page 16: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/16.jpg)
Globus Platform-as-a-Service
Identity, Group, Profile Management Services
…
Sharing Service
Transfer Service
Globus Toolkit
Glo
bus
API
s
Glo
bus
Con
nect
![Page 17: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/17.jpg)
globus genomics
Flexible, scalable, affordable
genomics analysis for all biologists
![Page 18: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/18.jpg)
+ Data management
PaaS
Next-gen sequence analysis SaaS
+ Scalable IaaS
![Page 19: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/19.jpg)
Globus is moving beyond transfer and sharing to data publication and
discovery
![Page 20: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/20.jpg)
Globus Data Publication (coming soon)
• SaaS for publishing large research data • Bring your own storage • Extensible metadata • Publication and curation workflows • Public and restricted collections • Rich discovery model
![Page 21: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/21.jpg)
Argonne Storage System
Univ. of Chicago Argonne IIT UIUC
Exemplar Use Case
3. Assemble Dataset (Transfer Data)
Argonne Curator
2. Describe Submission
Scientist
Shared Endpoint
4. Curate Dataset
1. Publish Data 6. Download
5. Search
![Page 22: Globus Introduction - ccs.uky.eduGlobus tracks shared files; no need to move files to cloud storage! 2 User B logs in to Globus and accesses shared file 3 • Easily share large data](https://reader034.fdocuments.in/reader034/viewer/2022042120/5e9a83114ca49d09a504d8b5/html5/thumbnails/22.jpg)
Thank you to our sponsors!
U . S . D E PA RT M E N T O F
ENERGY