Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we...
-
Upload
lorin-dalton -
Category
Documents
-
view
216 -
download
1
Transcript of Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we...
![Page 1: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/1.jpg)
![Page 2: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/2.jpg)
Part 9:MyProxy
![Page 3: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/3.jpg)
Pragmatics
• This presentation and lab ends the GRIDS Center agenda
• Q: When do we convene again tomorrow?
![Page 4: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/4.jpg)
And repeating our thanks to
• Warren Anderson• … who, among his many other talents, could recognize the
make and model of my fountain pen from across the table
• LIGO Support Staff• Especially Bonnie Wooley
• National Science Foundation• So long, and thanks for all the fish
• Y’all
![Page 5: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/5.jpg)
Evaluations Reminder
• Ple–e–e–ease give us your feedback• How do we make this more useful to you?• Would it be useful to make this a regular event
with the LSC community?
![Page 6: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/6.jpg)
Part 9: MyProxy
• Bonus §: Other Workflow Managers
• A: MyProxy Concepts
• B: MyProxy Commands
• C: Laboratory: MyProxy
![Page 7: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/7.jpg)
Bonus §: Workflow Management
• GridANT
• Pegasus
![Page 8: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/8.jpg)
Ant
• http://ant.apache.org/• JAVA-based build engine
• Similar turf to make, but cross-platform
• Build targets are defined in XML files
• Tasks are not restricted to code generation jobs• In other words, it’s also a simple workflow
manager
![Page 9: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/9.jpg)
GridAnt
www-unix.globus.org/cog/projects/gridant/• Simple client-side workflow manager
• Part of GT3
• Includes GSI authentication for file transfer and job execution components
![Page 10: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/10.jpg)
GridAnt Capabilities
• Setup the grid environment
• Authenticate users to the grid
• Copy files between grid resources
• Delete files on a grid resource
• Execute tasks on the grid
• Query resources and status of tasks on the grid
• Checkpoint the current state of grid tasks
![Page 11: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/11.jpg)
Pegasus
• http://pegasus.isi.edu• “Planning for Execution on the Grid”
• Developed as part of GriPhyN
• Defines workflow on an abstract level
• Generates concrete workflow (i.e. DAGMan files)
![Page 12: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/12.jpg)
Pegasus and LIGO
• Chimera Virtual Data System • www.gryphyn.org/chimera
• Info from Chimera helps define an abstract workflow• Pegasus
• … transforms it into a concrete workflow and • … submits it to DAGMan
• The concrete workflow is optimized for virtual data• Reusing data components that have already been materialized• … as determined by querying the RLS
![Page 13: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/13.jpg)
A: MyProxy Concepts
![Page 14: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/14.jpg)
MyProxy
• Developed at NCSA
• A MyProxy repository is also maintained by NCSA at myproxy.ncsa.uiuc.edu.
• To be distributed with Globus Toolkit 4
• Excellent documentation at http://grid.ncsa.uiuc.edu/myproxy
![Page 15: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/15.jpg)
Note! Proxy ≠ Proxy!
In this section, we’re talking about a different kind of proxy than before.
• grid-proxy-init deals with local certificate proxies.
• myproxy-init deals with proxies stored in a remote repository.
![Page 16: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/16.jpg)
Why use MyProxy?
• Using MyProxy, you don’t need to store a copy of your Grid credentials on every machine you use to access the Grid.
• You can use MyProxy to delegate credentials to a grid portal.
• You can allow trusted servers to renew your proxy credential.
![Page 17: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/17.jpg)
![Page 18: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/18.jpg)
Credential Renewal
• Q: What happens if my credential goes away in the middle of a big job?• A: “Undefined” disasters
• MyProxy lets you extend the lifetime of a stored credential
• Condor-G can automatically renew your about-to-expire credential if you’ve set things up properly
![Page 19: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/19.jpg)
B: MyProxy Commands
![Page 20: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/20.jpg)
MyProxy Commands
• myproxy-init: store (or renew) proxy• myproxy-get-delegation: retrieve proxy• myproxy-info: query stored credentials• myproxy-destroy: remove credential• myproxy-change-pass-phrase: change
password encrypting private key
![Page 21: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/21.jpg)
The Pride of Urbana
"Good afternoon, gentlemen. I am a HAL 9000 computer. I became operational at the H.A.L. Assembly Plant in Urbana, Illinois on the 12th of January, 1992.
![Page 22: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/22.jpg)
Lab 9: MyProxy
![Page 23: Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649f2f5503460f94c48b06/html5/thumbnails/23.jpg)
Lab 9: MyProxy
• In this lab, you’ll:• Store a credential in a MyProxy repository• Retrieve it from the repository• Destroy it (intentionally)• Renew it• Renew it automatically with Condor-G