LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

22
LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich) ISRAGRID Eddie Aronovich TAU, IUCC Oct 2008

Transcript of LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

Page 1: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

ISRAGRID

Eddie AronovichTAU, IUCCOct 2008

Page 2: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Agenda Short intro to Grid and Clouds NGI (EGI) Zisapel Committee ISRAGRID EGEE

Page 3: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

E-science Need for more:

Processing power Storage Share research facilities

E-science: “computationally intensive science that is carried out in highly distributed network environments, or science that uses immense data sets that require grid computing;”

Page 4: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Global challenges with high societal impact

Big Science and the role of “empowered” citizens

Data deluge… born digital material… virtual-labs

Cross-disciplinarity

Spread of skills and competences

Mário Campolargo, EGEE 08

Page 5: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Scientific facilities

. . . . . .

.

Linking at the speed of the light

Sharing computers, instruments and applications

Sharing and federating scientific data

Mário Campolargo, EGEE 08

Page 6: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

When does it Grid?

Coordinates Distributed Resources

Using standard, open, general-purpose protocols

Deliver non-trivial qualities of serviceFoster, Kesselman/The grid: Blue Print for a new Computing infrastructure

Page 7: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Key Cloud Services Attributes

Off-Site, Thirds-party provider Access via Internet Minimal/no IT skills required to “implement” Provisioning = self-service requesting; near real-time

deployment; dynamic & fine-grained scaling Fine-grained usage-based pricing model UI - browser and successors Web services APIs as System Interface Shared resources/common versions

Source: IDC, Sep 2008

Page 8: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

eIRG, Lisbon, 12 October 2007 8

European Grid Initiative• Need to prepare permanent, common Grid infrastructure• Ensure the long-term sustainability of the European e-

Infrastructure independent of short project funding cycles• Coordinate the integration and interaction between

National Grid Infrastructures (NGIs)• Operate the production Grid infrastructure on a European

level for a wide range of scientific disciplines

Page 9: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Vision of EGI Formation of National Grid Initiatives (NGIs) which unite

efforts within each country, providing a single point of contact for coordinated efforts and reducing the management and organisational overhead of international cooperation around Grid computing.

These national bodies will be complemented by a second structure, European Grid Initiative (EGI) coordinating issues on a European scale, including operations management, policy, standards and middleware testing.

Such a structure addresses the key issue of long-term sustainability of the European Grid Infrastructure, ensuring the availability of Grid services to researchers from all backgrounds and disciplines as we move further into the 21st century.

From EGI Paper, Version 3.2, August 2006:“Towards a European Infrastructure for e-Science”

Page 10: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

EGEE08 Istanbul, Turkey www.eu-egi.eu 10

Grids in Europewww.eu-egi.eu

Each NGI … should be a recognized national body with a single point-of-contact … should mobilize national funding and resources… should ensure the operation of a national

e-Infrastructure… should support user communities… should contribute and adhere to intl. standards

and policies

Prof. Dieter KRANZLMUELLER , EGEE 08

Page 11: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

ISRAGRID committee Forum for National R&D Infrastructure (TELEM)

appointed Yehuda Zisapel on Jan 2007 to examine Grid infrastructure for Israel.

Members: David Horn (TAU), Julian Satran (IBM), Doron Havatzelet (MOD), Assaf Maron (BMC), Eliezer Rabinovici (HUJI), Yossi Matias (TAU, Google), Shuki Glaitman (AXC), co-ordinator: Avi Shavit.

Final report handled on July 2007.

National Research Infrastructure approved the recommendations to establish the ISRAGRID!

Page 12: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

General recommendations Gain knowledge and train professional

for the industry.

increase compute resources and improve their utilization for the benefit of the community

Establish inter-organizational Grid in Israel

Supply infrastructure for the Israeli academia and hi-tech

Page 13: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Modus Operandi The network would be used for R&D and will be

based on the existing NREN.

Users will finance the establishment and operation of the GRID operation.

All the research entities will be invited to participate.

The network will be available with secure access.

Each partner will finance his own resources (to be shared) and connectivity to the NREN.

Page 14: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Network benefits Accessibility to vast amount of resources that were

not accessible otherwise.

Lowering processing cost by sharing resources

Improve resources utilization by balancing between computation demands and (idle) resource availability.

Parallel process in order to shorten the computing time.

Establish user communities (VO) in Israel

Page 15: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

ISRAGRID Administration ISRAGRID administration will be located in IUCC (local NREN)

Skilled personnel will be hired to provide the needed services for all the users

ISRAGRID is the Israeli official grid representative in international organizations.

Establish and maintain VOs for all the users in Israel.

Helping users to establish new sites and share resources

Maintain the core services and grid related security.

Each site in the ISRAGRID will contribute some resources for the benefit of all.

Page 16: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Estimated budget

1200000; 45%

873000; 33%

284000; 11%

125000; 5%

80000; 3% 80000; 3%

Communication Personnel Equipment Administration Conferences

Page 17: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Services to be given Virtual Organization

management

Information services

Certificate Authority (EUGridPMA, IGTF)

Monitoring

CERT

Co-Ordination with other projects

Page 18: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Additional recommendations

Academic teaching – The Planning and Budgeting Committee (PBC) Encourage Grid training in all institutes that acquire

degrees in computer science or engineering have Grid research.

Each University that will give 3 weekly hours course will get additional 100K NIS

The training will be done thru “Gilda” node that will be maintained by the administration.

Academic research – National Science Fund (NSF) Allocate 3-5 grants in domains related to grid

computing (incl. parallel processing, game theory, queuing theory, internet etc.) as long as they have clear association with the field.

The grants application should be submitted according to the regular procedures of NSF and pass the needed academic committees.

Page 19: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

EGEE & ISRAGRID Initial operation will be based on EGEE

EGEE will help with introduction and training in the first year

Current users are from Physics and BioMed community

Page 20: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

How this Orchestra Plays? ReplicaCatalogue

Logging &Book-keeping

ResourceBroker

StorageElement

ComputingElement

Information Service

Job Status

DataSets info

Author.&Authen.

Job S

ub

mit E

vent

Job Q

uery Jo

b St

atus

Input “sandbox”

Input “sandbox” + Broker Info

Output “sandbox”

Output “sandbox”

Pu

blish

SE & CE info

“User interface”

Page 21: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

EGEE

Page 22: LinkSceem – ISRAGRID – Eddie Aronovich ( Eddie Aronovich TAU, IUCC Oct 2008.

LinkSceem – ISRAGRID – Eddie Aronovich (http://www.cs.tau.ac.il/research/eddie.aronovich)

Summary ISRAGRID is the Israeli National Grid

Initiative (NGI) and the official representative of IL.

Main interest: Create communities for R&D that will allow resource and information sharing

ISRAGRID services for Grid and cloud computing incl. info serv., comm, security, traning, etc.

ISRAGRID is open to any entity interested in grid or clouds

You are

welcome !