Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28...

37
Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006

Transcript of Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28...

Page 1: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

UpdateProgress Since PRAGMA 9

Bringing the Grid to Coastal ZonesTownsville

PRAGMA 1026 – 28 March 2006

Page 2: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Cyclone Larry

Tropical cyclone Larry is seen striking the coast of Australia in this

satellite image.

Page 3: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Cyclone Larry - Innisfall

Pictures from Bernard Pailthorpe

Page 4: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Tropical Cyclone Wati

Page 5: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.
Page 6: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

PRAGMA 9

Page 7: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

SC05 PRAGMA at work…

Page 8: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

At NCHC and NCSA Booths

Page 9: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

PRIME, PRIUS and PRAGMA

Page 10: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Annual Reports

•Prepare for SCxy•Highlight Accomplishments•Promote PRIME and PRIUS•Describe Working Group Progress•Summarize Individual Institution Contributions•Give Additional Information, e.g. Publications, Sponsors

Page 11: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Multigrid Interoperations Initiative

• SC05 (November 2005)– APAC– K*Grid/KISTI– NAREGI/Titech– Business Grid/AIST– PRAGMA (UCSD, NCHC)– EGEE– OSG– DEISA– UK NGS– TeraGrid

• GGF Feb 06 (Greece) (Feb 2006)– APAC– K*Grid/KISTI– NAREGI/Titech– AIST– PRAGMA– EGEE– OSG– DEISA– NCHC– ChinaGrid – Others

• Working Groups– Authorization and Identify Management – Resources Information Schema and Services– Job Submission, Audit, Tracking– Data Movement and Management– Testbed for Production Interoperation

Initial Drivers: Charlie Catlett, Satohsi Matsuoka

Page 12: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

PRAGMA-TeraGrid-AIST Interoperation• Goal

– Test interoperation by running a “simple” physics application across PRAGMA Testbed and TeraGrid

• TDDFT was first application run on PRAGMA testbed to work out its interoperability issues

• Assumptions– As few as possible!– Teragrid Endpoint must run the Teragrid software stack

• Modified only to allow for interoperation

– PRAGMA Endpoints already running their site-local policies and stacks

• This is an “engineering” exercise– What is feasible, what are the best practices– To inform policy, not to make it

Page 13: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Timeline11/17/05 - 01/20/06 High-level discussions and commitment to the Multi-Grid

Interoperation experiment

01/20/06 - 01/26/06 Select and agree on the first application

01/26/06 - 02/03/06 Each grid allocates resources and designates technical support/contact and application drivers

01/27/06 - 01/31/06 Application drivers prepare and publish application requirements

02/03/06 - 02/04/06 Application drivers apply for user accounts on each grid

01/31/06 - 02/04/06 each site setup user accounts

01/31/06 - 02/08/06 each site implements the application requirements

02/01/06 - 02/08/06 Application drivers test user account access on each site

02/01/06 - 02/08/06 Application drivers deploy then test the application on each site

02/09/06 - 02/09/06 Application drivers start the application run**** (Interoperation)

02/09/06 - Start discussion and deployment of grid monitoring software - SCMSWeb, for cross grid monitoring

More than 200 emails to accomplish the above

Page 14: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Multi-Grid Interoperation Testbed

Page 15: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

People – TeraGrid – PRAGMA – AIST Interoperation

• Important people– Cindy Zheng – PRAGMA/UCSD– JP Navarro, Dane Skow – Teragrid/ANL– Yusuke Tanimura, Yoshio Tanaka – AIST– Somsak Sriprayoonsakul – Kasetsart U.

(Thailand)– (Charlie Catlett, Philip Papadopoulos, Peter Arzberger, Fang-Pang Lin)

Page 16: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

PRAGMA Proposal to NSFOverview and Approach

Process to Promote Routine Use Team Science

Application-Driven CollaborationsApplications Middleware

Routine Use Lab/TestbedTesting Applications

Building Grid and GOC

Multiway DisseminationKey Middleware

Workshops and Organization

Information Exchange

Planning and Review

New Collaborations

New Members

Expand Users

Expand Impact

Products

Improved middlewareBroader Use

New CollaborationsTransfer Tech.

StandardsPublications

New KnowledgeData AccessEducation

Page 17: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Key New Component of the Renewal

• Expand our impact to new application areas– GEO and Geosciences

• Increase emphasis on data in our routine use laboratory – GEO and Geosciences and others

• Harness the potential of lambda grids– Telescience and Tile Display Walls

• Work with productions grids to achieve interoperations– Grid Interoperations Now (GIN)

• Broaden involvement of middleware developments from outside the Pacific Rim– U Amsterdam; UK National e-science Center, U

Zurich

Page 18: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

CCGrid - Singapore16 – 19 May 2006

• Abramson D, Lynch A, Takemiya H, Tanimura Y, Date S, Nakamura H, Jeong K, Hwang S, Zhu J, Lu ZH, Amoreira C, Baldridge K, Lee H, Wang C, Shih HL, Molina T, Li, W, Arzberger P. Deploying Scientific Application on the PRAGMA Grid Testbed: Ways, Means and Lessons. CCgrid 2006

• Lee B-S, Tang M, Zhang J, Soon OY, Zheng C, Arzberger P. Analysis of Jobs on a Multi-Organizational Grid Test-bed. CCGrid 2006.

• Huang W, Huang C-L, Wu, C-H., The Development of a Computational Grid Portal. Accepted CCGrid 2006.

• Zheng C, Abramson D, Arzberger P, Ayuub S, Enticott C, Garic S, Katz M, Kwak J, Papadopoulos P, Phatanapherom S, Sriprayoonsakul S, Tanaka Y, Tanimura Y, Tatebe O, Uthayopas P. The PRAGMA Testbed: Building a Multi-Application International Grid CCGrid 2006.

Page 19: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Articles On• Infrastructure in

Australia

• India’s Grid Initiative

• Cyber Science Initiative in Japan

• CI in Korea

• Taiwan CI for Knowledge Innovation

• Brazil

• South Africa

• PRAGMA

http://www.ctwatch.org/quarterly/articles/2006/02

Guest Editor: Radha Nandkumar

Page 20: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

PRIME: Leveraged Training•Computer Network Information Center (CNIC), Chinese Academy of Sciences•Cybermedia Center (CMC), Osaka University, Japan•Monash University, Australia•National Center for High-performance Computing (NCHC), Taiwan

Page 21: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Pacific Rim UniverSitiesOsaka University

• First Student to San Diego– Kohei Ichikawa – Demo at this meeting– Joint Paper at BioGrid meeting in Singapore

• Website soon

• Interest in other site

• Susumu Date

Page 22: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

South Asia International Joint Research and Training Program in High-

Permformance Computing Application and Networking Technology

• Involved institutions from South Asia

• Discussed grid technology

• http://www.nchc.org.tw/event/2005/1128/

Page 23: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Some Members and Participants

http://pragma-goc.rocksclusters.org/pragma-doc/org.html; Resource Group Album: Total 85 Pictures – and another album

Page 24: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

http://www.sdsc.edu/~jennifer/PRAGMA-Website/pragma2005.html

Page 25: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

http://www.pragma.cn

Page 26: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

California Institute for Telecommunication and Information Technology (Calit2)

• PRAGMA 7: Larry Smarr stated that space would be available for PRAGMA visitors

• Visitors from AIST, KISTI, Osaka

• Letter of Intent: UCSD (via Calit2) and Grid Technology Research Center (AIST) 20 March 2006

Page 27: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Promotions

• Putchong Uthayopas– Appointed head of the ThaiGrid Project

• Osamu Tatebe– Associate Professor, U Tsukuba

• Raul Haza Izquierdo– Telematics Director, CICESE

Page 28: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Working Groups: Organize PRAGMA Efforts

• Resources– Mason Katz, SDSC– Yoshio Tanaka, AIST

• Biological Sciences– Karpjoo Jeong, Konkuk

U/KISTI

• Telescience– Shinji Shimojo, Osaka– Fang-Pang Lin, NCHC

• Data Computing– Osamu Tatebe, AIST

Page 29: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Picture from PRAGMA 9

Page 30: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

News Flash 4:44 PM PTS 28 Feb 06

• Dear friends,

• I'm happy to inform you that MIMOS (Malaysia) has joined our testbed and finished preparation all in one breath!

• The site contacts are Jing Yuan Luke and Wan Mohd Hikam Kauthary bin Hassan. Also, in collaboration with (USM) Habibah Wahab, they are getting ready and will deploy and run a grid application in our testbed soon.

• For more info about MIMOS and its testbed resources, see http://pragma-goc.rocksclusters.org/pragma-doc/org.html

• http://pragma-goc.rocksclusters.org/pragma-doc/resources.html• http://pragma-goc.rocksclusters.org/pragma-grid-status/work.html

• Welcome, MIMOS friends, to our testbed! Thank you for the super fast job you have done!

• Cindy

Page 31: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Agenda for Steering Committee

• Role of PRAGMA in the Grid Interoperations Now (GIN) activity

• Application of Potential New Members• Dates for PRAGMA 11

– Osaka, Japan: Osaka University– 15 – 17 October 2006

• Dates for PRAGMA 12– Bangkok, Thailand, NECTEC and ThaiGrid

• Expansion of Steering Committee

Page 32: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Institutions Applying for Membership

• Institute of High Performance Computing (iHPC) Terrance Hung

• Centro de Investigacion Cientifica y de Educacion Superior de Ensenada (CICESE) Raul Hazas Izquierdo

• Malaysian Institute of Microelectronic Systems (MIMOS) Mashkuri Yaacob

Page 33: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Members Present and Testbed Participants

• AIST• APAC, AARNET,

Grangenet, Monash University, QPSF

• ASCC• CNIC• Jilin University• Kasetsart U (ThaiGrid)• KISTI, Seoul National

University• NGO Singapore,

Nanyang Techical University

• NCHC

• NCSA• NECTEC• Osaka University• Pacific Northwest

Gigapop• Titech, APAN• UCSD• USM• UoH• CICESE• MIMOS• U Zurich

Page 34: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Observers Represented• HCMC University of Technology: Tuan Anh Nguyen• Waikato University: Tony McGregor• SUNY Binghamton: Ken Chiu• NEC: Takuto Okuno• NARA Institute of Science and Technology: Kazutoshi

Fujikawa• King Mongkuts University of Technology Thonburi:

Tiranee Achalukul • TeraGrid (ANL): JP Navarone • Globus Team (ANL): Bill Allcock• IRNC (USC): John Silvester• IRNC (Florida International): Heidi Alvarez, Kuldeep

Kumar• Planet Lab (Princeton): Marc Fiuczynski• James Cook University: Ian Atkinson• AIMS: Stuart Kininmonth

Page 35: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Challenges• Resources: How can we incorporate data

into the routine use laboratory?• Telescience: How do we take advantage

of Tile Display Walls for collaboration?• PRAGMA: How do we broaden our impact

with production grids?• Applications: Can we make progress on a

geosciences / GEO working group?• PRAGMA: How can we engage more

students and create more exchanges?• PRAGMA Web sites: Can we provide a

short summary in each language?

Page 36: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Demonstration of OptIPuter

Technology and Partnership: KISTI and EVL

Via Jason Leigh, 22 Feb 2006

Page 37: Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Welcome to PRAGMA 10

And the Second CREON GLEON Joint Workshop