Grid Programming on Grid Programming on Taiwan Unigrid PlatformTaiwan Unigrid Platform

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

Introduction (1)Introduction (1)The purpose of grid computing is

to integrate various resources within a large network environment.

The purpose of the UniGrid project is to build a platform for academic research using grid-related technologies in Taiwan.

Introduction (2)Introduction (2)8 institutes join to

develop the system◦國網中心◦清華大學資工系◦中研院資科所◦東華大學資工系◦東海大學資科系◦中華大學資工系◦興國管理學院電子商務學系◦靜宜大學資訊管理系

Introduction (3)Introduction (3)

台灣大學電機系 台灣大學資工系 台灣師大資工系 淡江大學資工系 德明技術學院資科系 交通大學資工系 新竹教育大學資工所 逢甲大學資工系 台中教育大學資科系 國家高速網路與計算中心中群

修平技術學院資管系

彰化師大資工系 中正大學資工系 成功大學電機系 成功大學資工系 台南大學數位學習科技系 長榮大學資管系 立德管理學院資管系 中山大學電機系 義守大學資工系 高雄大學資工系 台東大學資訊管理學系

Over 20 institutes provides their resource and join the Unigrid platform

Introduction (4)Introduction (4)All institutes that participate in

the UniGrid project contribute some resources.

These resources can be used in collaboration for large scale applications.

Introduction (5)Introduction (5)

Portal DemoPortal Demohttp://www.unigrid.org.tw/

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

LoginLoginConnect to http://www.unigrid.org.tw/Choose the Workflow Submition tab to

login

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Data Storage SystemData Storage System Press the Data Storage button

◦ Your computer required to have java runtime environment (jre) installed

Choose trust to any prompt window

Data Storage SystemData Storage System

Your data storage spaceYour local diskUpload file

Download file

When upload, always use 01_iisgridxx_IISAS series

Data Storage SystemData Storage System

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Structure of a workflowStructure of a workflow

sequentialexecution

parallelexecution

Workflow

Create WorkflowCreate WorkflowTo execute program, first thing is

to create the workflowThen create the StageThen create the Job and fill in

proper job descriptionNow we are ready for workflow

submission

Edit WorkflowEdit WorkflowChoose EditWorkflow in the left hand siteFill in the workflow name your like and press

send

Create StageCreate Stage A new workflow with the specified name will appear in

the bottom of all existing workflows Press the edit this flow, a new text field will appear

to create new stage with the specified stage name

Create jobCreate jobPress add new job of the specified stage to

fill in the job description

Job Description-1Job Description-1 Scheduler:

◦ Using default ”Condor” JOB name :

◦ The name of this job Job Profile :

◦ This profile determined which machine will be allocated, you can try None, CPU_Bound, or Memory_Bound

Run Type :◦ Choose this wisely according to which kind of your

program is Binary Filename :

◦ The filename of your program Argument :

◦ The arguments required by your program

Job Description-2Job Description-2 Data Filename:

◦ The input file name if required Note that the specified binary and data file must

exist on date storage system before press the submission button

Output filename : ◦ If your program generate output files, specify the

output file name tell the grid system to transfer the output file back to date storage system while job complete.

Number of processors : ◦ Required number of processors

Machine Select: ◦ Select machine manually by specify the cluster

name and required number of processors

Job Description-3Job Description-3SRB Directory :

◦ It tells the grid where the Binary file and data file located

◦ Choose it always while execute your program

Note that if you upload your program/date in a specified folder, please also add the relative path to the binary/date filename textfield◦ EX. You build xxx directory in storage

system and put in the file test.exe,then you must fill in the binary filename as ./xxx/test.exe and check the SRB directory checkbox

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Submit WorkflowSubmit Workflow Select the function Workflow Find out the workflow by the workflow name then

press the submit

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Check Job StatusCheck Job Status Choose function Job Status You can see all the submitted workflows as a tree structure

in the JobStatus page by ascending order of submit time. The detailed job result will show on the right side.

Job Result DescriptionJob Result Description Job name

◦ The same as you specified in workflow Job ID

◦ A unique ID for each job Executable name

◦ The program name specified in binary filename field of workflow

Job Start/Finish Time◦ The time that this job actually start execution and end

execution Machine List

◦ List the cluster name and number of processor used in this cluster

Job Result◦ The screen output of the program

Job Log◦ Used for debug, don’t care

Any Question?Any Question?