National Institute of Advanced Industrial Science and Technology Recent activities on building a...

National Institute of Advanced Industrial Science and Technology

Recent activities on building a production Grid in the Asia Pacific Region

- PRAGMA routine-basis experiments –- APGrid PMA and the IGTF -

Yoshio Tanaka ([email protected])Yoshio Tanaka ([email protected])APGrid PMA, ChairAPGrid PMA, Chair

PRAGMAPRAGMAGrid Technology Research Center, Grid Technology Research Center, AIST,AIST, Japan Japan


PRAGMA routine-basis experiments

All slides in this part are by courtesy ofMason Katz and Cindy Zheng (SDSC/PRAGMA)

Cindy Zheng, PRAGMA9, 10/21/2005

PRAGMA Grid TestbedPRAGMA Grid Testbed

AIST, Japan

CNIC, China

KISTI, Korea

ASCC, Taiwan

NCHC, Taiwan

UoHyd, India

MU, Australia BII, Singapore

KU, Thailand

USM, Malaysia

NCSA, USA

SDSC, USA

CICESE, Mexico

UNAM, Mexico

UChile, Chile

TITECH, Japan

UMC, USA

UZurich, Switzerland

GUCAS, China

http://pragma-goc.rocksclusters.org


Application vs. Infrastructure Middleware


PRAGMA Grid resources http://pragma-goc.rocksclusters.org/pragma-doc/resources.html


Why Routine-basis Experiments?

• Resources group Missions and goals– Improve interoperability of Grid middleware– Improve usability and productivity of global grid

• PRAGMA from March, 2002 to May, 2004– Computation resources

10 countries/regions, 26 institutions, 27 clusters, 889 CPUs

– Technologies (Ninf-G, Nimrod, SCE, Gfarm, etc.)– Collaboration projects (Gamess, EOL, etc.)– Grid is still hard to use, especially global grid

• How to make a global grid easy to use?– More organized testbed operation– Full-scale and integrated testing/research– Long daily application runs– Find problems, develop/research/test solutions

Cindy Zheng, GGF13, 3/14/05


Routine-basis Experiments

• Initiated in May 2004 PRAGMA6 workshop• Testbed

– Voluntary contribution (8 -> 17)– Computational resources first– Production grid is the goal

• Applications– QM/MD, TDDFT, mpiBlast-g2, Savannah,– iGAP over Gfarm– Ocean science, Geoscience (proposed)

• Learn requirements/issues• Research/implement solutions• Improve application/middleware/infrastructure inte

grations• Collaboration, coordination, consensus

Cindy Zheng, GGF13, 3/14/05


QMMDhttp://pragma-goc.rocksclusters.org/applications/qmmd/qmmd_requirement.html

• Quantum mechanics application• Ninf-G based• Driver: Hiroshi Takemiya (AIST)• Ready on 12 sites:

– AIST: Yoshio Tanaka, Yusuke Tanimura – ASCC: Hurng-Chun Lee, Mike Chiang– CNIC: Kai Nan, Kevin Dong– KISTI: Jysoo Lee, Jae-Hyuck Kwak– KU: Somsak Sriprayoonsakul, Sugree Phatanapherom – NCHC: Weicheng Huang, Chien-Lin Huang– NCSA: Radha Nandkumar, Tom Roney– SDSC: Mason Katz, Cindy Zheng– TITECH: Satoshi Matsuoka, Hitoshi Aoki – UNAM: Jose Luis Gordillo Ruiz, Eduardo Murrieta Leon– UoHyd: Arun Agarwal, Rajeev Wankar, Neelakanta Reddy– USM(hawk): Habibah Wahab, Suhaini Ahmad


Lessons Learned http://pragma-goc.rocksclusters.org/tddft/Lessons.htm

• Information sharing• Trust and access (Naregi-CA, Gridsphere)• Grid software installation (Rocks)• Resource requirements (NCSA script, INCA)• User/application environment (Gfarm)• Job submission (Portal/service/middleware)• System/job monitoring (SCMSWeb)• Network monitoring (APAN, NLANR)• Resource/job accounting (NTU)• Fault tolerance (Ninf-G, Nimrod)• Collaborations


Introduction of APGrid PMAand

International Grid Trust Federation

Background

Many Asia-Pacific countries are going to have stronMany Asia-Pacific countries are going to have strong motivation for international collaboration with the g motivation for international collaboration with the outside of Asia Pacific.outside of Asia Pacific.

LCG, OSC, TeraGrid, etc…PRAGMA & TeraGrid, UK-eScience, EGEE, etc.

Key issue for the collaboration is CA operationKey issue for the collaboration is CA operationMost Certificate Authorities in Asia-Pacific countries were experimental-level

No CP/CPSNot strictly operated

Background (cont’d)

Problems of authentication federationsProblems of authentication federationsAll CAs should keep the same level of operation.

How the CA is securely operated?Use HSM? Dedicated CA room?

…All CAs should have no conflict in policy

How the CA identifies end entities?Use face-to-face meeting? Telephone? etc.

…Policy Management Authority (PMA) is a coordinatiPolicy Management Authority (PMA) is a coordination body of CA policies and operations.on body of CA policies and operations.

Policy Management Authority (PMA)

Currently, there are three regional PMAsCurrently, there are three regional PMAsEUGrid PMA (established May 2004)

Former: EUDG WP6 CA Coordination Group (started in 2002)

TAG PMA (going to be established)One of the founding members: DOEGrid PMA (started in 2002)

APGrid PMA (established June 2004)Unofficially started in 2003

Each regional PMA is responsible forEach regional PMA is responsible forcoordination of CA policy within the regioncoordination of CA policy with the other regional PMAs

History of PMAs

GGF7@Tokyo, March 2003GGF7@Tokyo, March 2003First meeting with EU, DOE, and AP membersAgreed with working on forming the Grid PMA.

develop minimum requirementsdevelop GridPMA charter

Continuous discussions between AP, EU, and TAG PMA for IContinuous discussions between AP, EU, and TAG PMA for International Grid Trust Federation.nternational Grid Trust Federation.

GGF12 and EUGrid PMA meeting@Brussels, September 2004GGF13@Seoul, March 2005EUGridPMA meeting@Tallinn, May 2005GGF14@ChicagoGGF15@Boston

We (AP, EU, TAG PMAs) have agreed with trust with each otWe (AP, EU, TAG PMAs) have agreed with trust with each other for the federation.her for the federation.

APGrid PMA: Asia Pacific Grid PMA

General Policy Management Authority in Asia PacificGeneral Policy Management Authority in Asia PacificNot specific for ApGrid, Not specific for PRAGMA…

Launched on June 1Launched on June 1stst, 2004, 2004

Defines minimum CA requirementsDefines minimum CA requirements

APGrid PMA approved that we accept two levels of CA:APGrid PMA approved that we accept two levels of CA:Experimental-level CA

Alternative of the Globus CACan be trusted within A-P communities

Production-level CAStrict management is necessaryExpected to be trusted by international communities

APGridPMA: Status (Members and CAs)Affiliation Name Production CA Experimental CA

AIST / Japan Yoshio Tanaka in operation will close

ASCC / Taiwan Eric Yen in operation none

KISTI / Korea Jae-Hyuck Kwak in operation in operation

CAS / China Kai Nan Under review in operation

IHEP / China Gonxing Sun in operation none

APAC/Australia David Bannon Under review in operation

NAREGI/Japan Shinji Shimojo In operation in operation

NCHC / Taiwan Julian Yu-Chung Chen Under review in operation

SDSC / USA Mason Katz planning planning

NECTEC / Thailand Sornthep Vannarat Planning In operation

NGO / Singapore Jon Lau Planning none

KEK / Japan Takashi Sasaki Planning none

HKU / HongKong Chen Lin, Elaine no plan in operation

U of Hyd / India Arun Agarwal no plan in operation

USM / Malaysia Boon Yaik no plan in operation

Osaka U / Japan Susumu Date no plan in operation

APGridPMA: Activities (cont’d)

Defines and approves documents such as charter and the Defines and approves documents such as charter and the minimum CA requirementsminimum CA requirementsAccreditation of CAsAccreditation of CAs

6 accredited CAsAIST, IHEP, KISTI, NAREGI, ASGCC

in operation

APAC, KEKgoing to be in operation

AuditAuditAudit checklist was drafted based on WebTrust criteria and the minimum CA requirementAIST, ASGCC, IHEP, CNIC have been audited by the other CAs.

APGridPMA: Activities

Regular (monthly) VTC.Regular (monthly) VTC.Brief status reports of each CAIn-depth report of a CADecisions

Examination for accreditation of a CAApproval of charter, minimum CA requirements, etc.

Open discussions(physical) face-to-face meeting once per year.(physical) face-to-face meeting once per year.

1st face-to-face meeting was in Dec. 2005, Beijing.Discussions by emailsDiscussions by emailsDiscussions with the other PMAsDiscussions with the other PMAs

Status and challenges

International Grid Trust Federation (IGTF) has been officially approved at the GGInternational Grid Trust Federation (IGTF) has been officially approved at the GGF15, Boston, October 2005.F15, Boston, October 2005.

Three PMAs are the founders of the IGTFThree PMAs agreed with trust with each other.Three PMAs agreed with trust with each other.

e.g. CAs accredited by APGrid PMA can be trusted by EUGrid PMA and TAGPMA.Information (CA certificate, policy file, etc.) of Asia Pacific CAs accredited by APGrid PMA has been included a CA distribution package released by EUGrid PMA.

First APGridPMA Face-to-Face Meeting Beijing – Nov 2005 - 20

David Groep – [email protected]

Distribution of CA information

Periodic, monthly, distribution of all trust anchors Common for the entire IGTF Includes all trust anchors for all

profilesclassic, SLCS, experimental*, …

Does not distinguished between accrediting PMAs

Wide variety of formats RedHat Package Management

(RPM) systemincluding a ‘meta’ package with dependencies per profile

‘tar’ archives per CA, ordered per profile

Installation bundle suitable for ‘./configure && make install’

New formats (like JKS) on request Chairs can update the common

back-end repository

Summary of the APGrid PMA and the IGTF

CACACACA

CACACACA

EUGrid PMA

CACA

CACA

CACACACA

CACA

CACA

APGrid PMA

CACA

CACA

CACA

CACA

TAG PMA

Regional PMA is responsible for coordination of security policies within the region

Three PMAs compose IGTF

National Institute of Advanced Industrial Science and Technology Recent activities on building a...

Documents

Transcript of National Institute of Advanced Industrial Science and Technology Recent activities on building a...