CSF4, SGE and Gfarm Integration Zhaohui Ding [email protected] [email protected] Jilin...

34
CSF4, SGE and CSF4, SGE and Gfarm Integration Gfarm Integration Zhaohui Ding Zhaohui Ding [email protected] [email protected] [email protected] [email protected] Jilin University Jilin University

Transcript of CSF4, SGE and Gfarm Integration Zhaohui Ding [email protected] [email protected] Jilin...

Page 1: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

CSF4, SGE and Gfarm CSF4, SGE and Gfarm IntegrationIntegration

Zhaohui DingZhaohui [email protected]@email.jlu.edu.cn

[email protected]@sdsc.eduJilin UniversityJilin University

Page 2: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

22

AgendaAgenda

CSF4CSF4

CSF4 integrate with SGE(Done at SDSC)CSF4 integrate with SGE(Done at SDSC)

CSF4 integrate with Gfarm(Done at CSF4 integrate with Gfarm(Done at SDSC)SDSC)

CSF4 other new functionalities(Done at CSF4 other new functionalities(Done at SDSC)SDSC)

Page 3: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

33

CSF4CSF4

What is CSFWhat is CSF

CSF4 Functionalities & ServicesCSF4 Functionalities & Services

CSF4 ArchitectureCSF4 Architecture

Page 4: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

44

CSF4 – What is CSFCSF4 – What is CSF

What is CSFWhat is CSF Full name: Full name: CCommunity ommunity SScheduler cheduler FFrameworkramework CSF is a meta-scheduler working at grid level contribuCSF is a meta-scheduler working at grid level contribu

ted by Platform (a CA software company/LSF) ted by Platform (a CA software company/LSF) The first version of CSF, CSF3, was developed based The first version of CSF, CSF3, was developed based

on GT3-OGSI on GT3-OGSI CSF4 is the GT4-WSRF compliant version of CSF witCSF4 is the GT4-WSRF compliant version of CSF wit

h providing the same functionalities with CSF3h providing the same functionalities with CSF3 CSF is an open source project and can be accessed aCSF is an open source project and can be accessed a

t t http://sourceforge.nethttp://sourceforge.net (the cvs mainline code is csf4) (the cvs mainline code is csf4) The development team of CSF4 is from Jilin UniversitThe development team of CSF4 is from Jilin Universit

y, PRCy, PRC

Page 5: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

55

CSF4 – What is CSF (CSF4 – What is CSF (contcont.).)CSF4 is a CSF4 is a

contribution contribution to GT4to GT4

Page 6: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

66

What is CSF (What is CSF (contcont.).)

Meta-scheduler vs Local Resource MangerMeta-scheduler vs Local Resource MangerIn a Grid-computing environment, there is a common reIn a Grid-computing environment, there is a common re

quirement for users to query, negotiate access and mquirement for users to query, negotiate access and manage resources existing within different administrativanage resources existing within different administrative domains at Grid level. The meta-scheduler is designe domains at Grid level. The meta-scheduler is designed to perform such global wide policies. ed to perform such global wide policies.

Typically different Resource Management soft wares (RTypically different Resource Management soft wares (RMs) like LSF, PBS, and Sun Grid Engine are responsiMs) like LSF, PBS, and Sun Grid Engine are responsible for load balancing and resource sharing within eacble for load balancing and resource sharing within each local administrative domain. h local administrative domain.

Page 7: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

77

What is CSF (What is CSF (contcont.).)

A typical deployment for Meta-Scheduler and RMs. A typical deployment for Meta-Scheduler and RMs.

Page 8: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

88

CSF4 – FunctionalitiesCSF4 – Functionalities

Functionalities provided by CSF4Functionalities provided by CSF4 Submit, control and monitor jobs at a grid level. Submit, control and monitor jobs at a grid level. Create and manage advanced reservations at the grid Create and manage advanced reservations at the grid

level. (only support LSF now)level. (only support LSF now) Send job and advanced reservation operations to locaSend job and advanced reservation operations to loca

l resource managers. l resource managers. A plug in scheduler interface so that site and user speA plug in scheduler interface so that site and user spe

cific scheduling policies can be implemented regardlecific scheduling policies can be implemented regardless of the underlying resource manager. ss of the underlying resource manager.

Create queues of jobs, each with separately define-abCreate queues of jobs, each with separately define-able scheduling policies. le scheduling policies.

Page 9: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

99

CSF4 – Services (CSF4 – Services (contcont.).)

CSF4 will start the following services in GT4 containerCSF4 will start the following services in GT4 container

- Services available for grid users:- Services available for grid users: JobServiceJobService

csf-job-create, csf-job-start, csf-job-submit, csf-job-create, csf-job-start, csf-job-submit,

csf-job-status, csf-job-stop, csf-job-resume, …,csf-job-status, csf-job-stop, csf-job-resume, …, ReservationServiceReservationService

csf-rsv-create, csf-rsv-status, csf-rsv-cancelcsf-rsv-create, csf-rsv-status, csf-rsv-cancel

csf-job-submit, …csf-job-submit, … QueuingServiceQueuingService

csf-queue-create, csf-queue-conf, csf-queue-datacsf-queue-create, csf-queue-conf, csf-queue-data

Page 10: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1010

CSF4 – Services (CSF4 – Services (contcont.).)

Services for internal use only:Services for internal use only: ResourceManagerFactoryServiceResourceManagerFactoryService

Used by Job Service to Start a job via RM AdapterUsed by Job Service to Start a job via RM Adapter

(Configuration needed for LSF Adapters)(Configuration needed for LSF Adapters) ResourceManagerLsfServiceResourceManagerLsfService

Used by Job Service to start a job in LSF via LSF RM AdapterUsed by Job Service to start a job in LSF via LSF RM Adapter ResourceManagerGramService (new service)ResourceManagerGramService (new service)

Used by Job Service to start a job in Gatekeeper via Java Cog Used by Job Service to start a job in Gatekeeper via Java Cog Kit.Kit.

They are not supposed to be used by the user directly, They are not supposed to be used by the user directly, and there is no user client provided. and there is no user client provided.

Page 11: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1111

CSF4 – Schedule plugin & scheduliCSF4 – Schedule plugin & scheduling policiesng policies

Scheduling polices are defined in a queue Scheduling polices are defined in a queue Each policy is implemented inside a scheduling Each policy is implemented inside a scheduling plugin moduleplugin moduleA queue can load multiple plugin modulesA queue can load multiple plugin modulesFCFS pluginFCFS plugin is mandatory for all the queues and is mandatory for all the queues and is always loaded by CSFis always loaded by CSFThrottle pluginThrottle plugin is an optional plugin provided by is an optional plugin provided by CSF to constraint the number of jobs lunched in CSF to constraint the number of jobs lunched in one scheduling cycleone scheduling cycleUsers can write their own plugins to realize custUsers can write their own plugins to realize customized scheduling policies omized scheduling policies

Page 12: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1212

CSF4 – ArchitectureCSF4 – Architecture

Page 13: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1313

CSF4 – Architecture (CSF4 – Architecture (cont.cont.))TermsTerms

RM Gram AdapterRM Gram AdapterServices to submit jobs to resource manager via GRAM Services to submit jobs to resource manager via GRAM

protocol. (LSF/PBS/Condor/SGE)protocol. (LSF/PBS/Condor/SGE)

Specific RM AdapterSpecific RM AdapterMetaScheduler sends job/reservation requests to RM. EMetaScheduler sends job/reservation requests to RM. E

very resource manager needs to implement its own Rvery resource manager needs to implement its own RM Adapter. Now only LSF Adapter is available. M Adapter. Now only LSF Adapter is available.

RM LSF Adapter is able to talk with remote LSF clusters.RM LSF Adapter is able to talk with remote LSF clusters.

Support more functionalities: advance reservation, complex jSupport more functionalities: advance reservation, complex job control.ob control.

Page 14: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1414

CSF4 Integrate with SGECSF4 Integrate with SGEfor SGE6for SGE6

Before Globus Toolkit 4 released, the scheming docuBefore Globus Toolkit 4 released, the scheming documents said GT4 wouldn't offer scheduler adapter for ments said GT4 wouldn't offer scheduler adapter for SGE, so CSF4 didn't support SGE, either.SGE, so CSF4 didn't support SGE, either.

A third-part adapter developed by London e-Science A third-part adapter developed by London e-Science Centre, Gridwise Technologies and MCNC is releaseCentre, Gridwise Technologies and MCNC is releasedd. The adapter only supports SGE6.0.. The adapter only supports SGE6.0.

With extendable architecture, CSF4 can support SGE With extendable architecture, CSF4 can support SGE easily. easily.

Page 15: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1515

CSF4 Integrate with SGE CSF4 Integrate with SGE for SGE5.3for SGE5.3

Now SGE5.3 can only integrate with GT2.x.Now SGE5.3 can only integrate with GT2.x.Most clusters in SDSC is using GT2 and SGE Most clusters in SDSC is using GT2 and SGE 5.3. GT2 is still popular.5.3. GT2 is still popular.CSF4 Supports GT2 gatekeeper is significant.CSF4 Supports GT2 gatekeeper is significant.How to support GT2?How to support GT2?Java CoG Kit: Java CoG Kit: The Java Commodity Grid Kit The Java Commodity Grid Kit provides convenient access to Grid middlewarprovides convenient access to Grid middleware through the Java frameworke through the Java framework. It supports GT2.. It supports GT2.

Page 16: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1616

CSF4 Integrate with SGE CSF4 Integrate with SGE for SGE5.3(Cont.)for SGE5.3(Cont.)

ResourceManagerGramService (new service)ResourceManagerGramService (new service) Used by Job Service to start a job in Gatekeeper viUsed by Job Service to start a job in Gatekeeper vi

a Java Cog Kit.a Java Cog Kit. Config gatekeeper at resourcemanager-config.xmlConfig gatekeeper at resourcemanager-config.xml

for example:for example:<cluster><cluster><name> gatekeeper32 </name><name> gatekeeper32 </name><type> GRAM </type><type> GRAM </type><host> rocks-32.sdsc.edu/jobmanager-fork </host><host> rocks-32.sdsc.edu/jobmanager-fork </host><port> 2119</port><port> 2119</port><version>2.4</version><version>2.4</version></cluster></cluster>

Page 17: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1717

CSF4 integrate with GfarmCSF4 integrate with Gfarm

Gfarm SecurityGfarm Security Share Secure KeyShare Secure Key

GSI AuthenticationGSI Authentication User certificate User certificate DelegateDelegate Proxy certificateProxy certificate

Page 18: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1818

CSF4 integrate with CSF4 integrate with Gfarm(Cont.)Gfarm(Cont.)

Introduce four termsIntroduce four termsTwo kinds of proxyTwo kinds of proxy Full proxy : Generally, is Full proxy : Generally, is a proxy that has been created by a proxy that has been created by

grid-proxy-init or a proxy created from such a proxy by full grid-proxy-init or a proxy created from such a proxy by full delegation mechanisms.delegation mechanisms.

Limited proxy : is a proxy that is created from a full Proxy Limited proxy : is a proxy that is created from a full Proxy when it delegated with the limited delegation mechanism. when it delegated with the limited delegation mechanism. The first time a proxy is created by the limited delegation The first time a proxy is created by the limited delegation mechanism a level 1 Limited Proxy is created. Any mechanism a level 1 Limited Proxy is created. Any subsequent delegation (limited or full) of a level N Limited subsequent delegation (limited or full) of a level N Limited Proxy creates a level N+1 limited proxy. Proxy creates a level N+1 limited proxy.

Page 19: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

1919

CSF4 integrate with Gfarm(ConCSF4 integrate with Gfarm(Cont.)t.)

Two Kinds of DelegationTwo Kinds of Delegation Full delegation : Full delegation of a Full Proxy Full delegation : Full delegation of a Full Proxy

results in a Full Proxy on the remote side. Full results in a Full Proxy on the remote side. Full delegation of a level N Limited Proxy results in a delegation of a level N Limited Proxy results in a level N+1 Limited Proxy level N+1 Limited Proxy

Limited delegation : Limited Delegation of a Full Limited delegation : Limited Delegation of a Full Proxy results in a level 1 Limited Proxy. Limited Proxy results in a level 1 Limited Proxy. Limited delegation of a level N Limited Proxy results in a delegation of a level N Limited Proxy results in a level N+1 Limited Proxy.level N+1 Limited Proxy.

Page 20: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2020

CSF4 integrate with Gfarm(ConCSF4 integrate with Gfarm(Cont.)t.)

Three Server authentication flagsThree Server authentication flags Default, In this mode a Full Proxy or a level 1 Limited Proxy wDefault, In this mode a Full Proxy or a level 1 Limited Proxy w

ill be accepted for authentication. (e.g. Gfarm1.1) ill be accepted for authentication. (e.g. Gfarm1.1) (middle) (middle)

GSS_C_GLOBUS_LIMITED_PROXY_FLAG, With this flag GSS_C_GLOBUS_LIMITED_PROXY_FLAG, With this flag only a Full Proxy will be accepted for authentication. This modonly a Full Proxy will be accepted for authentication. This mode should be used by applications that do job start-up (e.g. the gae should be used by applications that do job start-up (e.g. the gatekeeper and ws-gram).tekeeper and ws-gram). (strict) (strict)

GSS_C_GLOBUS_LIMITED_PROXY_MANY_FLAG, With GSS_C_GLOBUS_LIMITED_PROXY_MANY_FLAG, With this flag any Full Proxy or Limited Proxy (of any level) will be this flag any Full Proxy or Limited Proxy (of any level) will be accepted. (e.g. GridFTP, Gfarm1.2)accepted. (e.g. GridFTP, Gfarm1.2)

(loose)(loose)

Page 21: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2121

CSF4 integrate with Gfarm(ConCSF4 integrate with Gfarm(Cont.)t.)

Two factorsTwo factors WS-Gram and Gatekeeper client delegate user certWS-Gram and Gatekeeper client delegate user cert

ificate with limited delegation.ificate with limited delegation. gfsd (Gfarm1.1 file node deamon) only accept 1 legfsd (Gfarm1.1 file node deamon) only accept 1 le

vel limited proxy and full proxyvel limited proxy and full proxy

Two conclusionsTwo conclusions CSF4 must delegate to local scheduler with full delCSF4 must delegate to local scheduler with full del

egationegation CSF4 can’t re-use WS-GRAM and Gatekeeper clieCSF4 can’t re-use WS-GRAM and Gatekeeper clie

nt librarynt library

Page 22: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2222

CSF4 integrate with Gfarm(ConCSF4 integrate with Gfarm(Cont.)t.)

How to Support Full Delegation for WS-GRAMHow to Support Full Delegation for WS-GRAM Delegation Service : Delegation Service : A new componentA new component of GT4, of GT4, this compothis compo

nent provides an interface for delegation of credentials to a nent provides an interface for delegation of credentials to a hosting environment. This enables a single delegated credehosting environment. This enables a single delegated credential to be shared across multiple invocations of services on ntial to be shared across multiple invocations of services on that hosting environmentthat hosting environment

jobcredentialEndpoint: In the Job Description, a new schejobcredentialEndpoint: In the Job Description, a new schema element is supported, an EndpointReference which poinma element is supported, an EndpointReference which points to the deletated credential resource (i.e. DelegationServicts to the deletated credential resource (i.e. DelegationService Resource).e Resource).

Page 23: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2323

CSF4 integrate with Gfarm(ConCSF4 integrate with Gfarm(Cont.)t.)

How to enable WS-GRAM run the job with fulHow to enable WS-GRAM run the job with full delegation? l delegation? CSF4 will access the DelegationFactoryService of CSF4 will access the DelegationFactoryService of

the hosting which the job will be submit to firstly, the hosting which the job will be submit to firstly, get a DelegationService EndpointReference. (With get a DelegationService EndpointReference. (With the EndpointReference, user can retrieve a resourcthe EndpointReference, user can retrieve a resource property that contain a full proxy), CSF add the e property that contain a full proxy), CSF add the EndpointReferce to job description as jobCredentiaEndpointReferce to job description as jobCredentialEndpoint, then the job will be delegate to GRAM lEndpoint, then the job will be delegate to GRAM Server with full delegation.Server with full delegation.

Page 24: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2424

CSF4 integrate with CSF4 integrate with Gfarm(Cont.)Gfarm(Cont.)

Page 25: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2525

CSF4 integrate with CSF4 integrate with Gfarm(Cont.)Gfarm(Cont.)

How to Support Full Delegation for GateKeeperHow to Support Full Delegation for GateKeeper

Java CoG Kit support full delegationJava CoG Kit support full delegation A class org.globus.gram.GramJobA class org.globus.gram.GramJob

which represents a simple gram jobwhich represents a simple gram job The class support full delegation.The class support full delegation.

Page 26: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2626

CSF4 new functionalityCSF4 new functionality One meta-scheduler work with Multiple-site via GRAMOne meta-scheduler work with Multiple-site via GRAM

PBS Gram SGE Gram LSF Gram

PBS Cluster SGE Cluster LSF Cluster

PBS Gram SGE Gram LSF Gram

PBS Cluster SGE Cluster LSF Cluster

PBS Gram SGE Gram LSF Gram

PBS Cluster SGE Cluster LSF Cluster

Page 27: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2727

CSF4 new functionality(Cont.)CSF4 new functionality(Cont.) a new interface to query all clusters availablea new interface to query all clusters available

A new command line A new command line csf-job-RmInfocsf-job-RmInfowill print all clusters information availablewill print all clusters information available

Page 28: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2828

CSF4 – DemoCSF4 – Demoenvironmentenvironment

Set up GT4/CSF4 at rocks-110(frontend)Set up GT4/CSF4 at rocks-110(frontend)

Set up GT2 at rocks-32 clusterSet up GT2 at rocks-32 cluster

Set up SGE6.0u4 at rocks-110 cluster and SGE Set up SGE6.0u4 at rocks-110 cluster and SGE adapteradapter

Set up SGE5.3 at rocks-32 cluster and SGE Set up SGE5.3 at rocks-32 cluster and SGE adapteradapter

Set up Gfarm1.2 at rocks-32 and rocks-110 Set up Gfarm1.2 at rocks-32 and rocks-110 clustersclusters

Page 29: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

2929

CSF4 – DemoCSF4 – Demo

Configuration for CSF Resource Manager Configuration for CSF Resource Manager (resourcemanager-config.xml)(resourcemanager-config.xml)<cluster><cluster><name> gatekeeper32 </name><name> gatekeeper32 </name><type> GRAM </type><type> GRAM </type><host> rocks-32.sdsc.edu/jobmanager-fork </host><host> rocks-32.sdsc.edu/jobmanager-fork </host><port> 2119</port><port> 2119</port><version>2.4</version><version>2.4</version></cluster></cluster>

<cluster><cluster><name> sge32 </name><name> sge32 </name><type> GRAM </type><type> GRAM </type><host> rocks-32.sdsc.edu/jobmanager-sge </host><host> rocks-32.sdsc.edu/jobmanager-sge </host><port> 2119</port><port> 2119</port><version>2.4</version><version>2.4</version></cluster></cluster>

Page 30: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

3030

CSF4 – Demo (Job Execution)CSF4 – Demo (Job Execution)

Demo 1 – Query Clusters availableDemo 1 – Query Clusters available

Demo 2 – Ran a job in local SGE6.0Demo 2 – Ran a job in local SGE6.0

Demo 3 – Run a job (need full delegation) Demo 3 – Run a job (need full delegation) in remote GT2 gatekeeper with different in remote GT2 gatekeeper with different delegationdelegation

Demo 4 – Run a Gfarm job in remote Demo 4 – Run a Gfarm job in remote SGE5.3SGE5.3

Page 31: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

3131

CSF4 – Related workCSF4 – Related work

Condor-G Condor-G Condor-G integrate Condor project and Condor-G integrate Condor project and

Globus project.Globus project. USE GRAM protocol, only support Globus USE GRAM protocol, only support Globus

Toolkit 2.x Toolkit 2.x

Page 32: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

3232

CSF4 – Related workCSF4 – Related workMoab Grid Scheduler (SILVER)Moab Grid Scheduler (SILVER)

Page 33: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

3333

CSF4 – Our Future PlansCSF4 – Our Future Plans

A new policy plug-in to Support work flowA new policy plug-in to Support work flow

We’re considering to integrate CSF with INFORMNET(We’re considering to integrate CSF with INFORMNET(http://grid-http://grid-develdevel..sdscsdsc..eduedu//informnetinformnet//))

A new policy plug-in to schedule Gfarm job in CSF4A new policy plug-in to schedule Gfarm job in CSF4

Data aware plug-inData aware plug-in

Make grid level & cluster level data-aware scheduling work Make grid level & cluster level data-aware scheduling work

together efficientlytogether efficiently

Page 34: CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

3434

Seeking for Collaboration Seeking for Collaboration OpportunitiesOpportunities

Q/AQ/A

ThanksThanks