Thierry PRIOL Scientific Coordinator INRIA coregrid [email protected]

25
Managed by CoreGRID: European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies Thierry PRIOL Scientific Coordinator INRIA http://www.coregrid.net [email protected] Bruno Le Dantec Administrative & Financial Coordinator ERCIM http://www.coregrid.net [email protected] Evangelos Markatos FORTH-ICS http://dcs.ics.forth.gr [email protected] Based on a talk prepared by:

description

CoreGRID: European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies. Evangelos Markatos FORTH-ICS http://dcs.ics.forth.gr [email protected] Based on a talk prepared by:. Bruno Le Dantec - PowerPoint PPT Presentation

Transcript of Thierry PRIOL Scientific Coordinator INRIA coregrid [email protected]

Page 1: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

Managed by

CoreGRID: European Research Network on Foundations, Software Infrastructures and

Applications for large scale distributed, GRID and Peer-to-Peer Technologies

Thierry PRIOLScientific Coordinator

INRIAhttp://www.coregrid.net

[email protected]

Bruno Le DantecAdministrative & Financial Coordinator

ERCIMhttp://[email protected]

Evangelos MarkatosFORTH-ICS

http://[email protected]

Based on a talk prepared by:

Page 2: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

DCS Lab

• Distributed Computing Systems Lab – People

• 4 faculty and researchers• 5 staff members (M.S.) • 10 graduate students • 5 undergraduate students

– Research Areas • Security • GRIDs and P2P systems• Network Monitoring

Page 3: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Mission StatementDriving Force: Study planet-wide distributed systems

– to understand the forces that drive their day-to-day operation– as well as the dimensions that sustain their long-term evolution

It is probably the first time in the history of Comp. Science that we have build something so complex that it deserves to be studied on its own

Example Questions: – Why do they work at all? – How do they break? – What kind of traffic is that which flows through the “veins” of such

systems? – What holds these systems together? – How do they respond to various types of attacks? – Under what circumstances would they collapse? – How can we make them more robust? – How can we trust them? – How can we be safe in them?

Page 4: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Internet Epidemics

Cyberattacks– Worms, viruses, backdoors

Background: – CodeRED Worm infected 350,000 computers in

24 hours – The Sapphire/Slammer worm infected 70,000

computers in 30 minutes

Research areas: – Detection and mitigation of cyber-attacks

Page 5: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

GRID Computing

Large Scale Distributed Computing

Research Areas:– Scalability to millions (billions?) of end nodes– Monitoring and Measurements

Page 6: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Network Monitoring

Research Questions:– How can we develop Scalable Monitoring Systems?

• For 10-40-100 Gbps?

– What kind of traffic flows in the Internet today?– How can we use it to detect performance bottlenecks?– How can we use it to detect security compromises?

Page 7: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Network Monitoring – AchievementsSuccessful Completion of SCAMPI

– EU-funded project to develop a 10Gbps passive monitoring systemProject Coordination of the follow-up LOBSTER project

– LOBSTER: Large Scale Monitoring of Broadband Internet Infrastructure• A European network of monitors

Secured Funding– SCAMPI, LOBSTER EU projects

Enstablished Collaborations– NRNs: National Research Networks

• CESNET, UNINETT (100 monitoring nodes in 2008)– TERENA

• The Association of European NRNs Invited to give Keynote talk

– At 4th Concertation Meeting of IST-FP6 Communication and Network Technologies projects and associated clusters, Brussels, Belgium, March 2005.

Page 8: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Peer-to-Peer Systems

Research Areas:– Scalability in p2p systems

• Caching, prefetching, reduction of duplicate messages, etc.

– Reliability• How can we develop reliable p2p systems out of unreliable

components?

– Security• Attackers exploit peers into communicating with a single victim

computer • How can we detect and mitigate such attacks?

Page 9: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

CoreGRID objectives

• To build a European-wide research center– To avoid fragmentation of Grid research activities in Europe– Create the European “Grid Lighthouse” and be seen as such

worldwide – To achieve integration and sustainability

• To build solid foundations for GRID and P2P technologies

– Both on a methodological basis and a technological basis– Support medium and long term research activities

• Achieve and promote scientific and technological excellence within & beyond the Grid research community

• Gather and disseminate European research• A think-tank for spin-off projects

– EC funded, bilateral projects, international cooperations, …

Page 10: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

CoreGRID Membership

42 partners from 18 Countries (1 from S. America)

CoreGRID researchers– Sep 2004: 118 researchers– Aug 2005: 145 researchers– 7 researchers left the Network,

34 new ones were included

CoreGRID PhD students– Sep 2004: 163 PhD students– Aug 2005: 169 PhD students– 22 left the Network, 28 new

ones were included

U. Cyprus

INRIACNRS

ERCIM

CETICUCL

CNR-ISTIINFNU. CalabriaU. LecceU. Pisa

CLPP-BAS

Delft U.Vrije U.

EPFLUASF

FhGFZJUSTUTTU. MuensterUNI DOU. PassauZIB

ICS-FORTH

ICRAL-CCLRCU. BelfastU. CambridgeU. CardiffU. ManchesterU. NewcastleU. Wesminster

KTHSICS

SZTAKI

VTT

U. CoimbraUPC

Masaryk U.

U. Chile

PSCCYFRONET

Page 11: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Vision:

• Build an Integrated Research CenterIntegrated Research Center – on GRID and P2P systems

• A IRC consists of Research Institutes Research Institutes – on specific topics such as – Data management, Programming Models – Scheduling, Monitoring– Architecture, etc.

• A RI consists of Research LabsResearch Labs– 2-10 researchers from different organizations

• closely working on the same subject

Page 12: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Operating the Network

• Administrative & Financial Management– ERCIM

• Bruno Le Dantec (Administrative & Financial Coordinator)

• Celine Bitoune (Assistant to the AFC)

• Scientific & Technical Management– INRIA

• Thierry Priol (Scientific Coordinator)• Päivi Palosaari (Assistant to the SCO)

Page 13: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

A brief description of ERCIM

ERCIM is a consortium of leading research institutions from 18 Europeancountriescommitted to information technology and applied mathematics.

Page 14: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Organizational map

ExecutiveCommittee

Scientific Advisory Board Industrial Advisory BoardSpecific Task Forces

- NPTF: New Participants

Integration Monitoring CommitteeChair: R. Perrott (U. Belfast)

Head of the“Collaboration Gateway”

Administrative &Financial Co-ordinator

Scientific Co-ordinator

MembersGeneral

Assembly

Head of the“Integrated Activities”

Head of the“Spreading Excellence”

Heads of CoreGRIDInstitutes

Chair:D. Laforenza(CNR-ISTI)

Page 15: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Scientific Advisory Board (SAB)

Objectives:

– Deliberate on science-related matters of the Network

– Annual external assessment of the scientific quality of the work

– Provide guidance to the strategic orientations

– Formulate recommendations to the Executive Committee

on content, planning and execution of the Joint Programme of Activities

Three senior Network scientists and three external advisors + SCO

Internal members:

• Jarek Nabrzyzki (PSNC - Poland)

• Henri Bal (Vrije U. - The Netherlands)

• Uwe Schwiegelshohn (Dortmund U. - Germany)External members:

• Dennis Gannon (Indiana U. - USA)

• Michel Cosnard (Nice U. - France)

• Sato Sekiguchi (AIST - Japan)

Page 16: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Industrial Advisory Board

First IAB meeting: June 15, 2005, at UPC, Barcelona

Report written by Monica Marinucci-Lopez, Oracle, CoreGRID IAB secretary

Page 17: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

A set of well identified research challenges

Knowledge & Data ManagementKnowledge & Data Management– Handling information/data that are required/produced by a wide range

of diverse processing power

Programming ModelProgramming Model– Making the programming of Grid infrastructures as simple and

transparent as possible

System ArchitectureSystem Architecture– Designing the next generation Grid middleware

Grid Information, Resource and Monitoring ServicesGrid Information, Resource and Monitoring Services– Scalable information service to implement a service view of the Grid

Resource Management & SchedulingResource Management & Scheduling– Scheduling jobs/applications/tasks/computation within a Grid

environment

Systems, Tools and EnvironmentsSystems, Tools and Environments– Integrating various middleware, tools and applications for problem

solving

Page 18: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

CoreGRID Integration WorkshopIntegration Workshop 2005

• Summarized the integration work of Year 1• 28-30 November in Pisa• 124 attendees: All partners, SAB and IAB.

• 50 reviewed presentations, incl. 46 cooperation papers:– 23 full (20 min)– 27 short (10 min)

• 179 authors• 2 keynote speeches (SAB and IAB)• 2 general discussions (Trust & Security, Panel)

• Preliminary Proceedings: both printed and electronic versions

• Selected papers Book by Springer-Verlag (early 2006)

Page 19: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Durable mobility of researchers

• Internal mobility is essential for integration and to ensure stronger co-operation among partners, promote career development and mobility

• 2 activities :– Fellowship ProgrammeFellowship Programme - Young researchers hosted by

two institutes for two distinct periods ~ 600 kۥ CALL 1, JANUARY 2005 (12 applications and 3 candidates

selected)• CALL 2, MAY 2005 (28 applications and 4 candidates selected)• CALL 3, DECEMBER 2005 (5 positions offered)

– Research Exchange ProgrammeResearch Exchange Programme - Researcher or student from 1 member to another, two weeks to six months~ 480 k€

Page 20: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Public Website

www.coregrid.net• Internal and External Communication

• Regularly updated• Visitors counted since mid April 05

– Apr 14: 90,508 visits – May 31: 123,000 visits– Aug 26: 227,701 visits– Dec 2: 337,631 visits

• Visibility: score of 8/10 in the Google PageRank

36% from non-european countries

% of Visits per Country

netw orks

17%

United States

11%

Educational

Institution9%

France

9%

Commercial

6%

United Kingdom

6%

Germany

5%

Brazil

5%

Chile

5%

Netherlands

5%

Colombia

4%

Hong Kong

4%

Thailand

3%

China

2%

Norw ay

2%

Portugal

2%

Canada

2%

Czech Republic

2%

Italy

2%

Turkey

2%

Autres

13%

Page 21: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

« CoreGRID Publications »

• joint scientific publications – Authors from two or more labs– Tech Reports – Conferences – Journals

Page 22: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

CoreGRID Springer series

CoreGRID negotiated a series of books with Springer

1. Vol 1: Component Models and Systems for Grid Applications (2005)

2. Vol 2: Future Generation Grids (2005)

3. Vol 3: Proceedings on the 1st CoreGRID Workshop on Knowledge and Data Management in Grids (to appear)

4. Vol 4: Proceedings on the CoreGRID Integration Workshop 2005 (to appear)

Page 23: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Training & Education activities

• Training and Education Website

• Annual CoreGRID Summer SchoolsSummer Schools

• In 2005 :

– EPFL, Lausanne, Switzerland, 5-9 September

– Targeted to young computer science PhD students

– 40 participants (fully booked)

Page 24: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Our work in CoreGRID

• Architecture– Large Scale Systems

• Monitoring – Use passive monitoring to infer performance

of individual connections• Security

– Threat Models for GRID systems – Cyberattacks

• Exploit p2p and GRID protocols to attack a victim

– HoneyLab• How to use the GRID as a distributed Honeypot

Page 25: Thierry PRIOL Scientific Coordinator INRIA coregrid Thierry.Priol@inria.fr

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

[email protected]

Conclusion

CoreGRID started in September 1st, 2004– A very active project that has completed completed

successfully its first yearsuccessfully its first year– Involvement of the main European Key playersmain European Key players

in Grid computing (both institutions and researchers)

– The only one Network of Excellence in Gridonly one Network of Excellence in Grid funded by the EU