Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve...
-
Upload
michael-warren -
Category
Documents
-
view
216 -
download
0
description
Transcript of Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve...
![Page 1: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/1.jpg)
Accelerating Campus Research with Connective Services for CyberinfrastructureRob GardnerSteve Tuecke
![Page 2: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/2.jpg)
2
A typical campus: distributed departments, distributed researchers, distributed resources
![Page 3: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/3.jpg)
3
Commodification, cloud technologies, and practices
achieving economies of scale drive centralization of resources on campuses, condo clusters, etc.
College-level funding discouraging “closet clusters”
![Page 4: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/4.jpg)
4
Yet, for human and practical reasons there often remains a
distribution of resources on campuses
![Page 5: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/5.jpg)
5
And off-campus too…
E.g. National CI grids, HPC centers, commercial clouds, science clouds …
![Page 6: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/6.jpg)
6
Bridged Campus Cyberinfrastructures
![Page 7: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/7.jpg)
7
Needed: services to make distributed resources transparent to campus users…
…and cost effective for resource providers, wherever those resources are provisioned.
![Page 8: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/8.jpg)
8
CI Connect VisionAccelerate research on campus by
providing connective services for local, cloud and national cyberinfrastructure
![Page 9: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/9.jpg)
9
CI Connect for research projects• OSG Connect is a service for connecting users
and project Groups to the national-scale Open Science Grid
• Provisioned as a service, using the CI Connect platform
![Page 10: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/10.jpg)
10
UChicago UC3
Open Science Grid
Amazon EC2
osgconnect.net
portal
login
stash
![Page 11: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/11.jpg)
11
OSG Connect resources: campus grid, opportunistic OSG, & Amazon cloud in one place – integrated with
identity and research data management services
Scheduling to OSG via flockingto the GlideinWMS service
![Page 12: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/12.jpg)
12
OSG Connect projects
Enabling individual
researchers
![Page 13: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/13.jpg)
13
Knowledge Synthesis Studies enabled by d-HTC
M. Culbertson,UIUC
computing on 19 sites in OSG
![Page 14: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/14.jpg)
14
CI Connect Campuses• An HTCondor-based job submission environment
connecting local campus cluster resources, the OSG, bridged campuses, or optionally Amazon cloud resources
• Offered as a service (PaaS model)• Deployed Duke University as the first branded CI
Connect campus• Deployments in progress for the University of
Chicago• Discussions with University of Michigan
![Page 15: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/15.jpg)
15
Collaboration between Scalable Computing Center at Duke Universityand the Computation Institute at UChicago
http://duke.ci-connect.net
![Page 16: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/16.jpg)
16
Duke Condor Grid
Open Science Grid
UChicago UC3 Grid
duke.ci-connect.net
portal
login
stash
Campus bridge to partner institutionConnection to OSGAccess controlled by Duke SCC
![Page 17: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/17.jpg)
17
UC3
RCC Midway
Beagle
ci-connect.net
portal
login
stash
Will set this up for UChicago Computation and Enrico Fermi Institutes(Tier3 users will migrate to ATLAS Connect)
![Page 18: Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.](https://reader036.fdocuments.in/reader036/viewer/2022062600/5a4d1b6a7f8b9ab0599b2df2/html5/thumbnails/18.jpg)
18
CI Connect Summary• CI Connect offers a way to bring more CPU into users
home environment without deploying IT• Offers a means to share resources on and off campus
with non-physics groups• Integrated Globus for data management• Instances deployed for:
– OSG– Duke Scalable Support Center (Duke Grid)– ATLAS
• Started discussion with U Michigan• Interest from XSEDE campus bridging