NUG 2004Grid File Yanker Demo

Shreyas CholiaMass Storage Group, NERSC

06/24/2004

Grid File Yanker

• Allows users to browse and transfer files, across filesystems served by GridFTP servers, directly from their web browser.

• Includes a reliable file transfer mechanism, that attempts to restart failed transfer jobs.

• Provides a convenient interface for submitting and monitoring background file transfer jobs.

GFY Components

• GFY Server: Java Servlet that runs as a SOAP Service. Users can invoke this via– The GFY Client Applet

– Command line tools

– Their own SOAP clients that can call the GFY Server API

GFY Components (cont.)

• GFY Client: This is a Java applet that can run on any web browser that supports Java 1.4.2 (or higher). – The applet provides a convenient GUI filesystem

interface to access GridFTP servers and transfer files between them.

– Users do not have to carry Grid credentials on their client machines. The Applet supplies a username / password combination to the GFY Server which uses this to grab Grid credentials from a MyProxy server.

GFY Screen Shot

How it Works …

• GFY Client provides username/password combination to GFY Server

• GFY Server uses combination to acquire a Grid Proxy Credential from a MyProxy Server, and returns a session identifier to the Client.

• GFY Client makes SOAP request to GFY Server to perform Filesystem operation / File Transfer

using the session identifier.

How it Works … (cont.)

• GFY Server talks to desired GridFTP server(s) with the acquired credential and either – performs the filesystem operation, or

– spawns off a background transfer thread to manage the reliable third party transfer between two GridFTP servers.

• Client can query the server for the state of current transfer jobs

How it works …

Upcoming Features

• Recursive directory copy• Multiple File Transfer / Bulk File operations• Integration with NERSC Portal, including

common login and credential sharing• Command line tools to submit transfer jobs to

GFY service

Acknowledgements

• The GFY was made possible, thanks to the contributions of:– Matt Andrews (NERSC)– Nancy Johnston (NERSC)– Nancy Meyer (NERSC)– Steve Chan (NERSC)– Adam Megacz (XWT Foundation)

Additional Information

• FSG Homepage: http://www.nersc.gov/nusers/resources/HPSS

• GFY Information:• Contact:

– Shreyas Cholia (Mass Storage Group)

• Email: scholia@lbl.gov

• Phone: (510) 486-6552