XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf ·...
Transcript of XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf ·...
![Page 1: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/1.jpg)
May 3, 2017
XSEDE New User Tutorial
Jay AlamedaNational Center for Supercomputing Applications
![Page 2: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/2.jpg)
XSEDE Training Survey
• Pleasecompleteashorton-linesurveyaboutthismoduleathttp://bit.ly/xsedejackson.Wevalueyourfeedback,andwilluseyourfeedbacktohelpimproveourtrainingofferings.
• Slidesfromthisworkshopareavailableathttp://hpcuniversity.org/trainingMaterials/238/
![Page 3: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/3.jpg)
Nowwhat?
Yeah!IgotanXSEDE
allocation!
![Page 4: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/4.jpg)
Learning Outcomes
Aftercompletingthistutorial, youwillbeableto:• UsetheXSEDEUserPortal• AccessyourXSEDEresources• Managefiles• Runjobs• Gethelp
![Page 5: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/5.jpg)
XSEDE User Portal (XUP)
• URL:portal.xsede.org• Singlepoint-of-entrytoinformationaboutXSEDEservicesandutilitiesforusingthem
• AnyonecancreateanXUPuseraccountandaccessnon-projectfeatures
• OnlyXSEDEallocationprojectmemberscanaccessprojectfeatures
![Page 6: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/6.jpg)
Using the XUP
• CreateandlogintoyourXUPAccount• UseXSEDEresourcesresponsibly• GetaddedtoyourXSEDEproject• NavigateyourpersonalMyXSEDEwebpage• NavigatetheinformationintheXUP
![Page 7: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/7.jpg)
Create and login to your XUP account
1. FromtheXUPhomepage,clickCREATEACCOUNT
2. CompletetheUserAccountForm
3. Verifyyouraccountrequest
4. Selectyourusernameandpassword
5. LogintotheXUP
portal.xsede.org
Click the CREATE ACCOUNT link to access the XUP User Account Form
![Page 8: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/8.jpg)
Other Sign In Options
Choose your institutions’sidentity provider
![Page 9: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/9.jpg)
Example: Logging in with Illinois credentials
![Page 10: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/10.jpg)
Link your campus identity and portal identity
![Page 11: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/11.jpg)
Login to the portal to link identities
![Page 12: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/12.jpg)
And inspect your new linked identity, via user profile
![Page 13: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/13.jpg)
XSEDE Acceptable Use Policy
• MustaccepttheUserResponsibilitiesFormaftercreatingyourXUPaccountandagainatthebeginningofeachallocationyoureceive.– Availableontheportal– Documentation,UsagePolicy-
https://portal.xsede.org/web/xup/usage-policy
• Chooseastrongpasswordandprotectit.• CloseSSHterminalsandlogoutoftheUserPortalwhenyou
arefinishedwithyoursession.• ReportSuspiciousActivity:email [email protected] orcall1-
866-907-2383immediately,regardlessofthetimeofday.
XSEDECybersecurityTutorialhttps://portal.xsede.org/web/xup/online-training
![Page 14: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/14.jpg)
Get Added to Your XSEDE project
• PIsautomaticallyhavefullaccesstotheirproject’saccount.
• ThePIisresponsibleformanagingusersontheiraccount.
• AskthePI,ortheirallocationmanager,toaddyourXUPusernametotheproject.
![Page 15: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/15.jpg)
Your My XSEDE webpage(1)Welcome to the XUP• Quick access to
commonly used features.
(2)Latest updates• Latest information
specific to your user account.
(3)My Resources and
Allocations• Summary of the active
projects for which you are either a PI or member.
(1)
(2)
(3)
![Page 16: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/16.jpg)
Update your XUP User Profile
MY XSEDEàProfile
- View and or change your user information (organization, address). - Make sure your email address is correct. XSEDE staff will use it to
communicate with you regarding your allocation.
![Page 17: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/17.jpg)
Navigating the XUP
• MyXSEDE• Resources• Documentation• Allocations
• Training• Help• About
![Page 18: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/18.jpg)
View the XSEDE Systems Monitor• Resources->SystemsMonitor- ProvidestechnicalandstatusinformationforallofXSEDE'sresources.- TheSTATUScolumnindicateswhetherthesystemisupordown.Ifdown,canclickonstatustofindwhenthemachineisexpectedtocomebackup.
![Page 19: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/19.jpg)
Accessing XSEDE ResourcesAuthentication Methods1. Password
• XUP credentials• Site-password• One-time password
2. Key-based
Single Sign-On• Enables logging in once to
access all of your allocated resources
Connection Methods1. GSI-OpenSSH2. OpenSSH
![Page 20: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/20.jpg)
XSEDE SSO Login HubAnSSOenabledconnectionpointtoXSEDEresources
Ø SSHtologin.xsede.org usingyourXUPcredentials with2FactorAuthentication
ØMoveamongresourcesusinggsisshcommand
![Page 21: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/21.jpg)
Set up 2 Factor Authentication
• AfterloggingintotheXSEDEUserPortal,selectyourprofile
![Page 22: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/22.jpg)
Adding 2 Factor Authentication
• EnrollinDuo
![Page 23: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/23.jpg)
What is Duo?
• NotethatDUO2FactorAuthenticationisrequiredforaccesstotheXSEDESingleSignonHub– Selectenroll
![Page 24: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/24.jpg)
Duo Enrollment:
• Toverifyyouridentityinyourcurrentsession,youwillneedtoenteryourXSEDEUserPortalpassword
![Page 25: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/25.jpg)
Setup Duo
• Starttheprocessofsettingup2factorauthentication
![Page 26: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/26.jpg)
Choose the device for 2 Factor Auth
• MobilePhoneisrecommended– Tablet,LandlinealsoOK(thoughnotpreferred)
![Page 27: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/27.jpg)
Connect Duo to your phone
• Addphonenumber– Continue
![Page 28: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/28.jpg)
Verifying phone number ownership
• Duocallsyourphone• EntercodefromDuocalltoyourphone
![Page 29: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/29.jpg)
Download Duo app (if desired)
• Setauthenticationmethod(push,text,call)– Andcontinuetologin
![Page 30: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/30.jpg)
Choose authentication method
• Duopush(toapp)• Callphone• Textpasscode
![Page 31: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/31.jpg)
Success!
• Indicationofsuccessfulsetup
![Page 32: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/32.jpg)
Following along with today’s tutorial:
• Verifythateveryonehasanssh clientontheirlaptop!
• Forssh toXSEDESSOloginhub(today!)ssh –lusername login.xsede.orgusername onhandout
• AndfromtheregotoyourXSEDEresource,forexample:gsissh comet.sdsc.edu
![Page 33: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/33.jpg)
2 factor authentication
![Page 34: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/34.jpg)
Managing your XSEDE files
1. Wheretostorefiles– Homedirectory– Scratchdirectory– Archivalstorage
2. Howtomovefiles– Commandlineusingglobus-url-copy,uberftp,scp,orsftp
– Globus Online
![Page 35: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/35.jpg)
XSEDE File Systems• Homedirectory
– Locationspecifiedintheenvironmentvariable$HOME.– Usetostoreprojectfilesyouwanttokeeplongtermsuchassourcecode,
scripts,andinputdatasets.– Notbackedupregularlyandnotpurged.– Quotastypicallysettolimitamountofdiskspaceavailable.
• Scratchdirectory– Locationspecifiedinenvironmentvariablevariesamongresourcesbutwill
includethetermSCRATCH,e.g.$SCRATCH_DIR.– Usetotemporarilystorefilesproducedduringapplicationruns.– Notbackedupandroutinelypurged.– Noquotas.Availablespacedependsoncumulativeusebyallusers.
• Archivalstorage– Mustrequestthroughallocationprocess
![Page 36: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/36.jpg)
Your XSEDE Compute Environment
• YourdefaultXSEDEcomputeenvironmentprovidesaccesstothecompilers,directories,andsoftwareyouwillneedtoefficientlyuseyourXSEDEresources.• Environment:Anareaofacomputer'smemoryusedbytheoperating
systemandsomeprogramstostorecertainvariablestowhichtheyneedfrequentaccess
• CustomizeenvironmentusingModulesXSEDECustomizingEnvironmentTutorial
https://portal.xsede.org/web/xup/online-training
![Page 37: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/37.jpg)
Modules Package• Acommandlineinterfaceusedtoconfiguretheshellforan
application.Twocomponents:1. Modulefiles - containconfigurationinformation2. Modulecommand- interpretsmodulefiles
• Pre-writtenmodulefiles availableforcompilers,mpiimplementations
• Pre-writtenmodulefiles availableforcommonsoftware,e.g.NAMD,GAMESS
![Page 38: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/38.jpg)
Module CommandsModule command Description
moduleavail [path...] Listallmodulefiles availableonthesystem.
modulelist Listthemodulefiles currentlyloadedintheshellenvironment.
modulehelp modulefile Printhelpinformationforthemodulefile specifiedintheargument.
moduledisplay modulefile Displaythechangesmadetotheenvironmentwhenthespecifiedmodulefile isloaded.
moduleload modulefile Interpretthecommandscontainedwithinthespecifiedmodulefile.
moduleswitch modulefile1 modulefile2 Removetheenvironmentchangesmadebymodulefile1 andmakethechangesspecifiedinmodulefile2.
moduleunload modulefile Removetheenvironmentchangesmadebymodulefile.
![Page 39: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/39.jpg)
Module Commands Example% module listCurrently Loaded Modulefiles:
1) torque/2.3.13_psc 4) icc/14.0.0 7) globus/5.2.2
2) mpt/2.04 5) imkl/10.3.3 8) xdusage/1.0-r7
3) ifort/14.0.0 6) psc_path/1.0
% module avail gcc------------------------- /usr/local/opt/modulefiles --------------------------
gcc/4.3.5 gcc/4.4.6 gcc/4.5.3 gcc/4.6.0 gcc/4.7.2 gcc/4.8.0 gcc/4.8.1% module load gcc/4.8.1% module listCurrently Loaded Modulefiles:
1) torque/2.3.13_psc 5) imkl/10.3.3 9) mpfr/3.1.0
2) mpt/2.04 6) psc_path/1.0 10) gmp/5.0.5
3) ifort/14.0.0 7) globus/5.2.2 11) mpc/0.8.2
4) icc/14.0.0 8) xdusage/1.0-r7 12) gcc/4.8.1% module unload gcc% module listCurrently Loaded Modulefiles:
1) torque/2.3.13_psc 4) icc/14.0.0 7) globus/5.2.2
2) mpt/2.04 5) imkl/10.3.3 8) xdusage/1.0-r7
3) ifort/14.0.0 6) psc_path/1.0
![Page 40: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/40.jpg)
Moving Files - Globus• Afast,reliable,andsecurefiletransferservicegearedtothebigdataneedsoftheresearchcommunity.
• Movesterabytesofdatainthousandsoffiles• Automaticfaultrecovery• Easytouse• Noclientsoftwareinstallation• Consolidatedsupportandtroubleshooting• Supportsfiletransfertoanymachine• Accountsarefree- https://www.globus.org/
![Page 41: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/41.jpg)
Globus Dashboard
![Page 42: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/42.jpg)
Login to use Globus Web App
![Page 43: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/43.jpg)
Use XSEDE Identity Provider
![Page 44: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/44.jpg)
Sign in with XSEDE credentials
![Page 45: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/45.jpg)
Globus Online File Transfer
![Page 46: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/46.jpg)
Choosing a file to move…
![Page 47: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/47.jpg)
RunningJobsOverview
Compute Nodes
Home Scratch
File System
JobData
Data
Researcher
Login
Login Nodes
Command Line
Use for tasks such as fileediting, code compilation,
data backup, and job submission.
Read/write data from compute nodes to Scratch directory.
Store project filesSuch as sourcecode, scripts, andinput data sets toHome directory.
Run jobs by submitting your batch script to the compute nodes using the "qsub" command.
When you connect to a resource, you are on a login node shared by many users.
Your job is submitted to a queue and will wait in line until nodes are available. Queues are managed by a job scheduler that allows jobs to run efficiently.
BatchScript
Commands for code execution, copy input files to scratch,…Specify number/type of nodes,length of run, output directory, …
![Page 48: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/48.jpg)
Login Nodes
• WhenyoulogintoanXSEDEresource,youconnecttoaloginnode.
• Useloginnodesforbasictaskssuchasfileediting,codecompilation,databackup,andjobsubmission.
• Donotruncomputejobsontheloginnodes.
Where do I run compute jobs?
![Page 49: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/49.jpg)
Running Compute Jobs
• Jobsarerunonthecomputenodesbysubmittingabatchscriptonaloginnode
• Alljobsareplacedinabatchqueueaftertheyaresubmitted.
• AllXSEDEcomputeresourcesuseabatchscheduler forrunningjobs.
• ResourceUserGuidesontheXUPhavedetailsonyoursystem’sscheduler.
![Page 50: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/50.jpg)
Batch Scripts
• Batchscriptsincludeschedulerspecificdirectives,comments,andexecutablecommands,e.g.:• Numberandtypeofnodesneeded• Timeneededtorunthejob• Wheretowriteoutputfiles
• Scriptcommandsaresystemspecific– seetheresource’sUserGuideontheXUPfordetails
![Page 51: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/51.jpg)
Batch Script for PSC’s Blacklight
1. #!/bin/csh
2. #PBS -l ncpus=16
3. #ncpus must be a multiple of 16
4. #PBS -l walltime=5:00
5. #PBS -j oe
6. #PBS -q batch
7. set echo
8. ja
9. #move to my $SCRATCH directory
10. cd $SCRATCH
11. #copy executable to $SCRATCH
12. cp $HOME/mympi
13. #run my executable
14. mpirun -np $PBS_NCPUS ./mympi
15. ja -chlst
Blacklight uses the Portable Batch System (PBS) scheduler. Lines 2,4,5, and 6 are PBS directives.
![Page 52: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/52.jpg)
Submitting Batch Scripts• Commandsaremachinespecific,butfollowgeneralprinciples
• WithPBSbatchscripts,usethe qsub commandqsub myscript.job
• CanalsospecifyPBSdirectivesascommand-lineoptions:qsub -l ncpus=16 -l walltime=5:00 -j oe -q batch myscript.job
• Command-linedirectivesoverridedirectivesinyourscripts.
![Page 53: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/53.jpg)
More PBS commands
• qstat - displaysthestatusofbatchjobs.
• qdel – deletesaqueuedjoborkillsarunningjob.
• Seetheqsub manpage formore
-a givesthestatusofalljobsonthesystem.
qstat-n listsnodesallocatedtoarunningjobinadditiontobasicinformation.
qstat-fPBS_JOBID givesdetailedinformationonaparticularjob.
-q providessummaryinformationonallthequeues.
![Page 54: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/54.jpg)
Example Batch Command
• Afterjob29898runs:user1shouldgetfileamber.job.o29898withoutput/errors(logfile)
qsub amber.job
qstat –a
Job ID Username Queue Jobname SessID NDS Tasks Memory Time S Time
------- -------- ------ -------- ------ ---- ----- ------ ----- - -----
29668 user1 batch job2 21909 1 256 -- 08:00 R 02:28
29894 user2 batch run128 -- 1 128 -- 02:30 Q --
29895 user3 batch STDIN 15921 1 1 -- 01:00 R 00:10
29896 user2 batch jobL 21988 1 2048 -- 01:00 R 00:09
29897 user4 batch STDIN 22367 1 2 -- 00:30 R 00:06
29898 user1 batch amber 25188 1 1 -- 01:10 R 00:00
qdel 29668
![Page 55: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/55.jpg)
Job Scheduling
• AllXSEDEcomputeresourcesuseabatchscheduler forrunningjobs.
• Alljobsareplacedinabatchqueueaftertheyaresubmitted.
• ResourceUserGuidesontheXUPhavedetailsonyoursystem’sscheduler.
![Page 56: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/56.jpg)
Batch Schedulers
• Attempttobalancequeuewaittimesofcompetingjobswithefficientsystemutilization.– Jobprioritizationinfluencedbynumberofcoresandwallclocktimerequested
– FIFOqueueswithfairusemechanismstokeepasingleuserfromdominatingthequeue
– Backfillingunusednodeswithsmallerjobs• Willnotstartjobsiftheywillnotfinishbeforescheduledsystemmaintenance.
![Page 57: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/57.jpg)
Common problems encountered when running jobs:
• Invalidnumberofcoreswererequested
• JobrunsoutofCPUtime• Filescan’tbefound• Inadequatesoftwarepermissions
![Page 58: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/58.jpg)
Improving job turnaround
• Requestaccuratewalltime• Useflexiblewalltime• Packyourjob
– Runningmanysmalljobsplacesagreatburdenontheschedulerandisalsoinconvenientforyou.
– Packmanyexecutionsintoasinglejob,whichyouthensubmittoPBSwithasingleqsub command.
![Page 59: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/59.jpg)
Requesting flexible walltime
Example:Yourjobrequests64coresandawalltimebetween2and4hours.Ifthereisa64coreslotavailablefor3hours,yourjobcouldruninthisslot.However,ifyourjobhadrequestedafixedwalltime of4hoursitwouldnotrununtilthelargertimeslotbecomesavailable.
-l walltime_min=HH:MM:SS -l walltime_max=HH:MM:SS
![Page 60: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/60.jpg)
Packing Serial JobsRuneachprogramexecutioninthebackgroundandplaceawaitcommandaftereachexecution.
#!/bin/csh
#PBS -l ncpus=96
#PBS -l walltime=5:00
#PBS -q batch
dplace -c 0 ./myserial1 < serial1.dat &
dplace -c 32 ./myserial2 < serial2.dat &
dplace -c 64 ./myserial3 < serial3.dat &
wait
![Page 61: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/61.jpg)
Packing OpenMP Jobs
TopackOpenMP executables,replacethedplace commandwiththeomplace command.SamplejobtopackOpenMPexecutables:
omplace -nt 32 -c 0 ./myopenmp1 < myopenmp1.dat &
omplace -nt 32 -c 32 ./myopenmp2 < myopenmp2.dat &
omplace -nt 32 -c 64 ./myopenmp3 < myopenmp3.dat &
omplace -nt 32 -c 96 ./myopenmp4 < myopenmp4.dat &
wait
![Page 62: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/62.jpg)
Managing Your Environment: Modules
• Allows you to manipulate your environment.• ‘module list’ shows currently loaded modules.• ‘module avail’ shows available modules.• ‘module show’ <name> describes module.
% module load gcc/3.1.1 % which gcc/usr/local/gcc/3.1.1/linux/bin/gcc
% module switch gcc/3.1.1 gcc/3.2.0 % which gcc/usr/local/gcc/3.2.0/linux/bin/gcc
% module unload gcc% which gccgcc not found
http://modules.sourceforge.net/
![Page 63: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/63.jpg)
For the following exercise (same steps as before):• Checktoseeifconnectionisstilllive,ifnot:• Forssh toXSEDESSOloginhub(today!)
ssh –lusername login.xsede.orgusername onhandout
• AndfromtheregotoyourXSEDEresource,forexample:gsissh comet.sdsc.edu
![Page 64: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/64.jpg)
SDSC comet Cluster & Modules
• Defaultenvironmentintelcompilers,mvapich2MPIimplementation
• Wewillswapintelcompilerswithgnucompilersmoduleswapintelgnuwhichgcc
• Andthenwe’llloadtheopenMPI librarymoduleloadopenmpi_ibwhichmpicc
![Page 65: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/65.jpg)
Module demo on comet
![Page 66: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/66.jpg)
Using modules in your job script
• First,source/usr/share/Modules/init/shell-namemoduleloadmodule-name• Checkon-linedocumentation
![Page 67: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/67.jpg)
Exercise
• Makesureyouareoncomet.sdsc.edu• Runtheshallowwatermodelcodeprovided• Noinputfileneeded• Copybatchscriptfrommyhomedirectory:
cp ~ux400689/shallow-slurm.sb.
![Page 68: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/68.jpg)
Job script
![Page 69: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/69.jpg)
Exercise:• Submitthejob(sbatch --res=JSUResDay2shallow-slurm.sb)
• Monitorthejob(squeue –uusername)• Makesureyouhavetheoutputfilesatjobcompletion
moreshallow*out(forthiscase,yourswillbedifferent!)
-bash-4.1$ lscalc.c decs.h eclipse.inc Makefile shallow-batch.sh tstep.f90calc.o diag.c init.c shallow shallow-slurm.sb tstep.ocopy.c diag.o init.o shallow.582135.comet-03-56.out time.cworker.ccopy.o dump.c main.c shallow.591445.comet-04-66.out time.oworker.oCVS dump.o main.o shallow.591474.comet-04-66.out tstep.c-bash-4.1$
![Page 70: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/70.jpg)
Output files: need to show successful completion
![Page 71: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/71.jpg)
• portal.xsede.orgà HelpSubmitticket
• portal.xsede.orgàMyXSEDEà Tickets– Submitticket– Viewpasttickets(bothopenandclosed)
• [email protected] orcall1-866-907-2383,atanyhour(24/7)
Need help? Reporting and Tracking Issues
![Page 72: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/72.jpg)
More “helpful” resourcesxsede.orgàUserServices• Resources availableateachServiceProvider
• UserGuidesdescribingmemory,numberofCPUs,filesystems,etc.
• Storagefacilities• Software(ComprehensiveSearch)
• Training:portal.xsede.orgà Training• CourseCalendar• On-linetraining
• Getface-to-facehelpfromXSEDEexpertsatyourinstitution;contactyourlocalCampusChampions.
• ExtendedCollaborativeSupport(formerlyknownasAdvancedUserSupport(AUSS))
![Page 73: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/73.jpg)
XSEDE Training Survey
• Pleasecompleteashorton-linesurveyaboutthismoduleathttp://bit.ly/xsedejackson. Wevalueyourfeedback,andwilluseyourfeedbacktohelpimproveourtrainingofferings.
• Slidesfromthisworkshopareavailableathttp://hpcuniversity.org/trainingMaterials/238/
![Page 74: XSEDE New User Tutorial - hpcuniversity.orghpcuniversity.org/media/.../49/...JSU_day2-1.pdf · XSEDE Acceptable Use Policy • Must accept the User Responsibilities Form after creating](https://reader034.fdocuments.in/reader034/viewer/2022051920/600cd0ab89d4cf38fe365c4c/html5/thumbnails/74.jpg)
May 3, 2017
Thanks for listening and welcome toXSEDE!