Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science...
Transcript of Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science...
![Page 1: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/1.jpg)
Globus Connect Personal
erhtjhtyhy
Changyong Park
HPCAT, X-ray Science Division
Argonne National Laboratory
July 17, 2020
https://app.globus.org
![Page 2: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/2.jpg)
Web service login – https://app.globus.org
2
• Organizational login
• Personal login – Gmail,
ORCID, or a custom
Globus account
• Example is given using
a personal login
![Page 3: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/3.jpg)
File Manger – Collection – Search: aps#data
3
The “aps#data” is an
endpoint at Globus site
that APS administrates
to provide users with
data transfer service.
![Page 4: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/4.jpg)
aps#data needs authentication
4
For the first time
connection, the
authentication will be
requested.
![Page 5: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/5.jpg)
APS Web Portal Authentication with “d” Prefix
5
• Username: dxxxxxx
• Password: <APS password>
• If your APS Beamline User Portalaccess (to login ESAF, GUP, Training, etc.) does not work, reset the APS
web password for username
"<badge number>" following the
link on the portal login page. After
reset, it takes up to 15 minutes for
changes to propagate to the data
management system.
![Page 6: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/6.jpg)
Path to set “/gdata/dm/HPCAT/”
6
Either navigate the folder
trees or directly put in the
Path field.
![Page 7: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/7.jpg)
Navigate to your experiment
7
<BEAMLINE>/<yyyy-run>/s<beamline>-<yyyymmdd>-e<esaf#>-<description>
e.g., 16BMD/2020-2/s16bmd-20200717-e226372-GlobusDemo
• Note the sync folder name on
Globus would be different from
the source folder name on
beamline computer.
![Page 8: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/8.jpg)
Prepare to sync the data to a local storage
8
Here, you will need to
install “Globus Connect
Personal” on your local
machine (pc or laptop), if
this is the first-time
connection.
Click “Search”
This opens the sync panel.
![Page 9: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/9.jpg)
Install Globus Connect Personal
9
Click this button and
follow the instruction.
This name will
appear on your
Globus Endpoint.
![Page 10: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/10.jpg)
Endpoint Administrated by You
10
Your endpoint is
administrated by you.
![Page 11: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/11.jpg)
Start to sync to local folder
11
Find this from File Manger - Collection
Navigate on your local machine
• The transfer and sync is one-way.
• You do not have a “write”
permission in aps#data endpoint.
• You can only transfer and sync the
data from aps#data to your local
storage.
![Page 12: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/12.jpg)
Tips at the beamline
Understand the data transfer and sync is one-way (source to target).
Two options (ask your local contact to setup):
– Upload the data all at once after completing the experiment
– Real time data upload and sync
During the real time upload and sync, creation of new folders and files, and
modification of the existing ones at source will be synced real-time (with some
latency depending on internet traffic).
Deletion of exiting ones, however, cannot be synced and may mess up the folder
trees at Globus endpoint. Use real-time sync with a caution.
12
![Page 13: Globus Connect Personal · Globus Connect Personal erhtjhtyhy Changyong Park HPCAT, X-ray Science Division Argonne National Laboratory July 17, 2020](https://reader034.fdocuments.in/reader034/viewer/2022052104/603fbd78c202a916c5680c9d/html5/thumbnails/13.jpg)
Useful Links
Globus online general description (https://app.globus.org/)
A step-by-step instruction on data transfer (https://www.aps.anl.gov/Imaging/Data-Transfer)
A user guide on DCS site (https://dcs-aps.wsu.edu/planning-for-experiments/globus-data-
managment/)
13