Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2

Center Overview

Lennart JohnssonDirector

Cullen Distinguished Professor of Computer Science, Mathematics and Electrical and

Computer Engineering

Lennart Johnsson

TLC2 Review

August 27, 2004

Outline

• General overview• Demographics• Outreach• External funding• Infrastructure in support of Research

and Education• Research

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 Mission

to foster and support collaborativeinterdisciplinary research, education and training

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 Scope• Research, education and training in

– Computational Science and Engineering– Computer Science and Information Technology

• Current initiatives and centers of excellence– Advanced Computing Research Laboratory (ACRL)– Center for Technology Literacy (CTL)– Houston Luis Stokes Alliance for Minority Participation

(H-LSAMP)– Houston Area Technology Advancement Center (HATAC)– Institute for Digital Informatics and Analysis (IDIA)– Institute for Molecular Design (IMD)– Texas Institute for Measurement, Evaluation and

Statistics (TIMES)

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Scope• Provide an infrastructure enabling and supporting

research and education requiring significant computational, storage, networking and visualization resources– Significant computing, storage, networking and

visualization resources– State-of-the-art communication tools and electronic

classrooms– Provide expertise in computing and information

technology tools development and use (web, data base, HPCN)

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Scope• Provide an infrastructure enabling and supporting

research and education requiring significant computational, storage, networking and visualization resources– Assistance in proposal preparation and research

award management– Development of funding opportunities– Assistance with arrangements of workshops,

symposia, conferences, and external relations– Promotional efforts (web, flyers, posters, …)

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Scope

• Seed new research initiatives• Support innovation in education and training• Facilitate the formation of new centers and institutes

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 Organization

Arthur VailasVP Research/Intellectual

Property Mgmt.

Lennart JohnssonDirector

Rosalinda MendezAssociate Director

Robert HoneymanTLC2 Business Admin

Jennifer PattenFinancial Coordinator

Angela WilliamsProposal Specialist II

Financial/Business Admin

VacantProposal Specialist I

Peter RosalesApplications

Dev3

VacantMarketing/Promo/

Copy Editor

Extenal Relations

VacantManager TLC2Info Systems

Info Technology

Elaine MeskarGarcia

Admin. Asst.

SupportsDirector

OverseesMarketingandBusinessOperations

Liason forIT

Also supportsEducational andOutreach Efforts for theoverall Center andrealted centers,programs and institutes.

Will support overallcenter or director;duties and reportingto be determined bydirector

VacantAssociate Director

Development

Faculty AdvisoryCouncil

CultivatesIndustryPartnerships/Sponsors

Liason forGovernmentPartnerships

GeneralProgram andProposalDevelopment

Helps inOutreach Efforts

IndustrialAdvisory Group

Josten MaApplications

Dev 4James Dela

CerdaOffice Assistant

Judy CoxLAN

Administrator

VacantMicrosystems

Analyst 2

Joseph GhobrialOperating Systems

Programmer 2

Janell PursooProgram

Coordinator

VacantWeb

Developer 3

VacantWeb

Developer 3

VacantExecutiveSecretary

Erik Enquist/Jason Holland

OperatingSystems

Programmer 3

VacantApplicationsDeveloper 2

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2

• Formed in 1999 as a transformation of TCCIS, the Texas Center for Computational and Information Sciences

• February 2002 inaugurated office, classroom and visualization facility made possible through a ~$3.6M NASA grant.

• 2002 – 2003. – Hired 7 financial staff, net 4– Hired 7.5 technical staff net 6– Hired 3 admin assistants, net 1– Hired 3 support staff, net 2 full-time

• 2002/2003 Tier-1 funding to establish a data storage capability• 2003 Access Grid node procurement• 2003/2004 base funding used to establish computer room and a

computational resource• 2004/2005 upgrade of network infrastructure

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Personnel by category

2004 TLC2 Personnel by Category(961 total)

8%

14%

18%56%

4%

Undergraduate Students546

Graduate Students170

130Scientists/Researchers/PostDoc

Faculty74

Staff41

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 Faculty Members with TLC2 Funding - by Department*

Psychology10

23%

Computer Science11

27%

Mathematics5

12%Chemistry4

9%

Physics3

7%Biology & Biochemistry

25%

Electrical & Computer Engineering2

5%

Information Logistics Technology1

2%

English1

2%Geosciences1

2%

Mechanical Engineering1

2%

Political Science1

2%

Chemical Engineering1

2%

*cumulative for FY00 - FY04

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 Faculty Members with TLC2 Funding - by College*

College of Liberal Arts and Social Sciences

1228%

Cullen College of Engineering4

9%

College of Technology1

2%

College of Natural Sciences and Mathematics

2661%

*cumulative for FY00 - FY04

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 personnel ethnicity

TLC2 2004

23%

25%

23%27%

2%

Hispanic

Asian

Caucasian

Black/African American

Other

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 Personnel - Gender

TLC2 Gender 2004

52%

48% MaleFemale

Lennart Johnsson

TLC2 Review

August 27, 2004OutreachNumber of Events Organized, Hosted, or Supported by TLC2 Core Staff

-by Year

43

1

4

4

41

2

2

1

3

2

3

4

0

2

4

6

8

10

12

14

16

18

20

2002 2003 2004

Num

ber o

f Eve

nts

WorkshopSymposiumSpecial EventSeminarOutreachLectureConference

Lennart Johnsson

TLC2 Review

August 27, 2004OutreachParticipants by Place of Origin for TLC2 Organized Events - Cummulative

United States23454%

International378%

University of Houston71

16%

Houston Metropolitan Area93

21%

State of Texas6

1%

National Center for Macromolecular Imaging WorkshopFirst Houston High Field NMR SymposiumRobotics and Computer Vision NSF PI WorkshopFirst Half Second NIH WorkshopWorkshop on OpenMP Applications and Tools

Events Organized by TLC2 Core Staff

Lennart Johnsson

TLC2 Review

August 27, 2004OutreachLocation of Events Organized, Hosted or Supported by TLC2 Core Staff

- Cummulative

United States2

5%

State of Texas5

13%

University of Houston31

82%

13th Annual Earth Science Field Day - Refugio, TXFennessey Ranch Wildlife Photography Workshop - Refugio, TXECNS 5th Annual Conference - Houston, TX14th Annual Earth Science Field Day - Refugio, TXFennessey Ranch Wildlife Photography Work Weekend - Refugio, TX

Robotics and Computer Vision NSF PI Workshop - Las Vegas, NVSupercomputing 2003 Conference - Phoenix, AZ

Lennart Johnsson

TLC2 Review

August 27, 2004OutreachEvent Participants by Occupation for Events Organized, Hosted, or Supported

by TLC2 Core Staff - Cummulative

University Affiliated129958%

K-12 Educators944%

K-12 Students86338%

University Affiliated - Includes University Professors, Researchers, Post-docs, University Administration, Graduate & Undergraduate Students.

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 Expertise • Data Base expertise

– TIMES (supporting awards of $21M)– H-LSAMP (supporting awards of $8.6M)

• Web site expertise– 16 Lab/group web sites developed or under development– 2 Workshops/conference web sites developed– 1 Instructional web sites under development

• Back-up service for CS department• HPCN expertise

– 50 - 60 Course setups each year– About 10 Workshop and conference setups each year– Configuration and management of ~280 nodes/~600 processors– Configuration and management of 40 TB storage network

Lennart Johnsson

TLC2 Review

August 27, 2004Other systems maintained by TLC2 staff

• Advanced Computing Research Laboratory– 61 node Itanium2 cluster (currently largely used by

TLC2)– 17 node Opteron cluster (available to TLC2)

• Garbey group– 33 node AMD cluster

• Classroom computers (~50)• AV systems• AG node• Office computers (~20)• Printers and large format plotter

Lennart Johnsson

TLC2 Review

August 27, 2004

Web Development and Training

• 18 Web portals and websites completed or in various stages of completion in addition to the TLC2 main web site two of which for conference management

• Web content management – March 12th Workshop – 20

participants– March 25th Workshop – 8

participants• H-LSAMP

– June 24th – 11 participants– August 20th – 15

participants

Distribution by Department

Chemistry6%

CS49%

Engineering6%

Others16%

Physics6%

Psychology11%

Technology6%

Lennart Johnsson

TLC2 Review

August 27, 2004

Award dataTotal Amount of Awards Received and Expenditures for Awards with TLC2 Credit

FY 99 - FY 03

$0

$2,000,000

$4,000,000

$6,000,000

$8,000,000

$10,000,000

$12,000,000

$14,000,000

$16,000,000

$18,000,000

$20,000,000

FY 99 - FY 01 FY 02 FY 03

Annual Awards

Annual Expenditures

Grand Total Awards: $30,559,803 Grand Total Expenditures: $18,572,228

Lennart Johnsson

TLC2 Review

August 27, 2004

Award by UH EntityTotal Awards with TLC2 Credit - by Center

FY 99 - FY 03

$0

$2,000,000

$4,000,000

$6,000,000

$8,000,000

$10,000,000

$12,000,000

$14,000,000

$16,000,000

$18,000,000

FY 99 FY 00 FY 01 FY 02 FY 03

Independent Faculty: $4,708,824

Member Centers: $25,850,979

Grand Total Awards: $30,559,803

Lennart Johnsson

TLC2 Review

August 27, 2004

Award by SourceAwards with TLC2 Credit by Type FY 02 - FY 03

$6,817,581

$14,626,964$1,820,706

$2,309,134

$1,258,393

$771,825

$-

$2,000,000

$4,000,000

$6,000,000

$8,000,000

$10,000,000

$12,000,000

$14,000,000

$16,000,000

$18,000,000

FY02 FY03

Local/OtherStateFederal

Total Funding: $27,604,603

Lennart Johnsson

TLC2 Review

August 27, 2004Award by SourceTypes of Federal Funding - FY 03

Other Federal $895,975

6%

NSF$1,499,684

10%

Dept. of Energy $706,527

5%

NIH/Dept. of Education $11,524,778

79%

Lennart Johnsson

TLC2 Review

August 27, 2004Awards by Source and UH EntityCumulative Awards by Center FY02-FY03 for Awards

with TLC2 Credit

Independent FacultyState

$10,055 0%

Independent Faculty Federal $1,947,015

7%

Member Centers Local/Other $1,953,164

7%

Member Centers State $4,119,785

15%

Independent FacultyLocal/Other

$77,054 0%

Member Centers Federal $19,497,530

71%

Cumulative Award Expenditures by Center FY02-FY03

Member Centers

$14,576,029 88%

Independent Faculty

$1,990,393 12%

Grand Total Awards: $27,604,603 Grand Total Expenditures: $16,566,422

Lennart Johnsson

TLC2 Review

August 27, 2004

Proposal dataDollar Value of Member Center and Independent Faculty

Proposals Submitted in FY 03 with TLC2 Credit

Independent Faculty $16,536,586

40% Member Centers $24,326,093

60%

Lennart Johnsson

TLC2 Review

August 27, 2004Number of Proposals by

DepartmentNumber and Values of Proposals Submitted in

FY03 with TLC2 Credit - By Department

Psychology6

7%$13,488,238

Physics2

2%$807,800

Chemistry5

6%$1,527,704

Geosciences14

17%$5,807,842

Math2

2%$296,000

Electrical Engineering1

1%$328,730

Computer Science53

65%$18,606,365

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Research SupportDollar Amounts of TLC2 Support in FY03-FY04 - by Member Centers and Independent Faculty

$210,000

$305,000

$390,000

$154,115

$36,000

$65,787

$20,000

$52,122

$0

$100,000

$200,000

$300,000

$400,000

$500,000

$600,000

$700,000

Member Centers Independent Faculty

FY 04 Seed Funding

FY 04 Innovation Awards

FY03 Seed Funding

FY 03 Innovation Awards

Total Awarded: $1,233,024

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Innovative Research Support

Dollar Amounts of TLC2 Innovative Research Awards in FY03 and FY04 - by Department

$173,294

$3,954$17,666

$122,621

$50,000

$87,088

$60,377

$22,000

$20,000

$79,787

$0

$20,000

$40,000

$60,000

$80,000

$100,000

$120,000

$140,000

$160,000

$180,000

$200,000

ComputerScience

ElecEngr Math Chemistry Physics ChemEngr Bio/Biochem

FY04

FY 03

Funding was provided to support research in areas including bioinformatics, medical imaging, computing, computational analysis, and digital informatics.

Total Awarded: $636,787

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 ExpendituresTLC2 FY04 Expenditures (Preliminary)

Room 200/232$7,6930.35%

Office$35,9511.63%

AV$96,3794.36%

Dark Fiber$230,00010.41%

Viz Lab$34,6171.57%

Awards$173,911

7.87%Admin Staff

$127,7805.79%

Tech Staff$367,25416.63%

Events/External Relations Staff$61,0512.76%

Financial Staff$180,673

8.18%M&O

$439,13619.88%

Room 576/586$454,17020.56%

Total Expenditures: $2,208,615

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Budget FY05TLC2 - FY 05 Estimated Budget

Visualization and Imagery$450,000

19%

Events/External Relations Staff$87,777

4%

Viz Lab$15,000

1%

Lab Build Out$50,000

2%

Office$50,000

2%

Rooms 576/586$34,000

1%

Rooms 200/232$135,000

6%

M&O$373,266

16%

Administrative Staff$130,975

6%

Technical Staff$476,435

21%

Financial Staff$192,690

8%

Awards$325,000

14%

Lennart Johnsson

TLC2 Review

August 27, 2004Infrastructure

• Communication• Electronic Classrooms• Computing – Research and education

– Visualization– Storage– Computing– Networking

• Usage• User training

Lennart Johnsson

TLC2 Review

August 27, 2004

Communication Facilities• AG node from InSorS

– Used regularly for HiPCATmeetings

– 50% domestic, 50% international

• AV Facilities– Video conference capabilities in rooms PGH-200,

PGH-218, and PGH-232– Ability to direct SGI output to PGH-200, PGH-218

and PGH-232 in addition to displays in PGH-216– 10 Keck Center for Computational Biology

Seminars Spring 2004

Lennart Johnsson

TLC2 Review

August 27, 2004Classrooms – PGH 200

48 seats with- 15” flat panel displays- 1.4 GHz AMD Athlon PCs- individual teacher –

student interaction facilitiesDual boot Linux Windows XP serverAV for video conferencingDual projection capabilityStreaming video from visualization laboratory

Lennart Johnsson

TLC2 Review

August 27, 2004Classrooms – PGH 232126 seats withVideo conference facilitiesStereographic projection capabilitiesPower/Network port at every desk

Lennart Johnsson

TLC2 Review

August 27, 2004Classroom UsageTLC2 Classrooms

0

5

10

15

20

25

30

35

Year 2002 Year 2003 Year 2004

Year

ly C

lass

room

Tot

als

PGH200PGH232

Lennart Johnsson

TLC2 Review

August 27, 2004Classroom Usage by Dept

Computer Science, 67, 88.2%

Math, 7, 9.2%

English, 1, 1.3% Pharmacy, 1, 1.3%

Computer ScienceMathEnglishPharmacy

Biology, 1, 1.5%

Computer Science, 67, 98.5%

Computer ScienceBiology

PGH-200PGH-232

Lennart Johnsson

TLC2 Review

August 27, 2004

Research Computing

Lennart Johnsson

TLC2 Review

August 27, 2004

SGI Reality Center 3300W3 Channel Stereo Screen 12.6’ x 23.9’VHS Video up to 1600 x 1200 @ 60 Hz per channel3D stereoscopic capability

ImmersaDesk R2 4’ x 5’ movable screen 3D Stereoscopiccapability

Visualization Laboratory

Software Packages• VMD 1.8.2• OpenInventor 4.0• Amira 3.1• MPT 1.9

Compiler Suites• GCC 3.3• MIPSpro 7.4

Performance Libraries• SGI Scientific Library 1.4.1.3

Monitoring/Management Software• Ganglia Cluster Monitor

SGI Onyx 3400 16 500 MHz R-14000 Processors8 GB Main Memory4 IR3 PipelinesRuns on IRIX

Lennart Johnsson

TLC2 Review

August 27, 2004Distributed Storage NetworkProvide NFS based filesystems to SGI, Solaris and Linux clients in Chemistry, Geosciences, Computer Science, and TLC2. RedHat 9.0

Lennart Johnsson

TLC2 Review

August 27, 2004

1.6 TFlops Linux Cluster

Second most powerful computer in a Texas Educational InstitutionRanked 102 among the worlds 500 most powerful computersAcquired as part of an Intel/HP/TLC2 partnership

152 Itanium2 nodesdual 1.3 GHz/3MB processor nodes4 GB per node

Myrinet, 152 host ports, 304 spine portsGigE for System Area Networking, 4:1 oversubscriptionManagement network

Lennart Johnsson

TLC2 Review

August 27, 2004

Research Computing• 16-way SMP (Gelato donation)

– HP Integrity, Itanium2• Three 4-way SMPs (part of a 20-node cluster)

– AMD Opteron 1.6 GHz, 16GB– Infiniband– Rocks 3.2.0 (based on Redhat Enterprise Linux 3) – Compilers: GCC 3.2, Pathscale (just ordered)– Performance Libraries: GOTO Performance

libraries, AMD Core Math Libraries, FFTW– Filesystem: NFS based home directories– Monitoring/Mangement Software: Ganglia Cluster

Monitor, Parallel Distributed Shell, Web based PBS queue viewer

Run At t ent ionFault

Remot eSP Pr esent

St andby PowerPower

hp Integrity rx8620

Lennart Johnsson

TLC2 Review

August 27, 2004

TLC2 InfrastructureProduction Webservers• Fedora Core 1 x86_64• Zope 2.6.1 content management system• Apache 2.0.50• Second server will be placed in Times for redundancy

Development Webserver• Fedora Core 1 i386• Zope 2.6.1 content management system• Apache 2.0.50

TLC2 Email Servers• RedHat Linux 9.0• Sendmail Email server• Clamav Virus Software for virus protection• Spamassassin for spam filtering• Backup server setup for redundancy

Lennart Johnsson

TLC2 Review

August 27, 2004TLC2 Computing, Storage and

Visualization Facilities

Lennart Johnsson

TLC2 Review

August 27, 2004ACRL Itanium2 Cluster UsagePercentage of Node Use

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Jan-

03

Feb-

03

Mar

-03

Apr

-03

May

-03

Jun-

03

Jul-0

3

Aug

-03

Sep

-03

Oct

-03

Nov

-03

Dec

-03

Jan-

04

Feb-

04

Mar

-04

Apr

-04

May

-04

Jun-

04

Jul-0

4

IMD Engineering CS IDIA ACRL Physics Baylor CS Courses Math Others

Lennart Johnsson

TLC2 Review

August 27, 2004ACRL Itanium2 Cluster Usage

Accumulated Node Usage: January 2003 - July 2004

AQM

Baylor

IMD

CS

CS Courses

Engineering

Other

ACRL

IDIA

MATH

NASA

Physics

Staff

Vendors

Lennart Johnsson

TLC2 Review

August 27, 2004

Cluster Training

May 14, 2004

The TLC2 Cluster Workshop was a general introduction to cluster environments which included details regarding cluster use, popular cluster administration tools, job scheduling and a Rocks demo installation.

32 Attendees from:• UH Computer Science, Physics, Math, Biology, Biochemistry, Electrical Engineering• Baylor College of Medicine• Rice University• Texas A&M Computer Science

Next Workshop scheduled September 17, 2004

Lennart Johnsson

TLC2 Review

August 27, 2004

High-Performance Networking

Lennart Johnsson

TLC2 Review

August 27, 2004

Background • The Texas GigaPoP established through a $1M NSF High-

Performance Network Connections grant awarded to Rice (Kennedy), Baylor (Chiu) and UH (Johnsson) in 1996. This grant was awarded in the first round of such grants. Texas A&M received funding to join a year later.

• The Texas GigaPoP established in 1997 as the third or fourth in the country enabling leading-edge research depending on high-performance networking.

• A leased 622 Mbps service purchased between UH and TMC/Rice and a 155 Mbps service purchased to the vBNS (very high-performance Backbone Network Service)

Lennart Johnsson

TLC2 Review

August 27, 2004

Background – Selected Research at UH• Participation in the development of the first Grid demonstration

and test-bed (3,600 computers on five continents) at SC97 based on what is now the defacto standard for Grid middleware, the Globus software

• As Globus project partner, sharing of the Global Information Infrastructure Next Generation Award in 1998 presented by Vice President Al Gore

• Federal funding to UH as national project partner during the next several years amounting to about $5M for Johnsson and collaborators alone

• Lack of upgraded network infrastructure has prevented participation in national projects of the type enabled by the Texas GigaPoP (now known as the South East Texas GigaPOP) and associated connectivity in 1997 – 2000.

Lennart Johnsson

TLC2 Review

August 27, 2004

Current Network Upgrade Needs

• Improved capacity between TMC-Rice-UH for research projects that can attract federal funding in CS and the Sciences

• Improved capacity to Internet2 to participate in national projects developing national and global information infrastructures or tools for the construction thereof

• Connectivity to the National Lambda Rail

Lennart Johnsson

TLC2 Review

August 27, 2004

High-Performance Backbones

0

5

10

15

20

2000 2001 2002 2003 2004

Number of Backbones WorldwideOperating at Various Gbps Rates by Year

12.55102040

Lennart Johnsson

TLC2 Review

August 27, 2004

Houston Research and Education Network Upgrade plans

• Houston Dark Fiber Rings– Inter-campus ring: TMC-Rice-UH– NLR ring: TMC-Rice-UH-AT&T-WilTel

• Ring characteristics– 12 strands– TrueWave RS Non-Zero Dispersion Fiber (tested at

1.6 Tbps with 40 Gbps channels over 400 km)– 455 fibermiles– 20 yr IRU, $79,200 plus $3,000/yr and construction

costs at four access points estimated at $100k

Lennart Johnsson

TLC2 Review

August 27, 2004

Intercampus Ring: TMC-Rice-UH

Lennart Johnsson

TLC2 Review

August 27, 2004

NLR Ring: TMC-Rice-UH-AT&T-WilTel

Lennart Johnsson

TLC2 Review

August 27, 2004

• Interested parties– South East Texas GigaPoP– LEARN– NLR– TMC, Rice, UH – Research Projects

Houston Research and Education Network Upgrade plans

Lennart Johnsson

TLC2 Review

August 27, 2004

NLR – Southern Route Preferred AlternativeWiltel Fiber in the West -- AT&T Fiber in the Southeast

Denver

Seattle

Sunnyvale

LA

San Diego

Chicago Pitts

Wash DC

Raleigh

Jacksonville

Atlanta

KC

Baton Rouge

El Paso -Las Cruces

Phoenix

Pensacola

Dallas

San Ant. Houston

Albuq. Tulsa

New YorkClev

Lennart Johnsson

TLC2 Review

August 27, 2004

Collaborations Needing the Infrastructure

• HiPCAT• TIGRE• THEGrid• US Alice project (LCG)• Houston BioGrid• GCC and Keck• VGrADS• And many more projects ….

Lennart Johnsson

TLC2 Review

August 27, 2004

High Performance Computing Across Texas (HiPCAT) — http://www.hipcat.net

Lennart Johnsson

TLC2 Review

August 27, 2004

HiPCAT MissionHiPCAT was founded by Rice University, Texas A&M University, Texas Tech University, University of Houston and University of Texas at Austin to serve as a forum for its members to share expertise and experiences in large-scale computation.

Member institutions provide its scientists, educators and students with advanced technologies and carries out research and development projects of common interest.

Areas of excellence at HiPCAT institutions that require advanced computing technologies in collaborative settings for simulation, analysis, and knowledge discovery include research in oil exploration and recovery, environmental modeling, biomedicine and drug discovery, materials science and engineering, nanotechnologies, and spacecraft design.

Lennart Johnsson

TLC2 Review

August 27, 2004TIGRE

Texas Internet Grid for Research and Education• TIGRE will enhance the capabilities available to Texas

researchers in academia, government, and industry by integrating compute resources, data collections and instruments thereby increasing their competitiveness for national and international science and engineering research opportunities.

• Areas of research that require dramatically increased computational and data sharing capabilities of critical interest to Texas are – biomedicine, – energy and the environment, – materials science, – agriculture, and – information technology.

Lennart Johnsson

TLC2 Review

August 27, 2004

THEGrid

• Several Universities– UT, UH, Rice, TTU, TAMU, UTA, UTB, UTEP, SMU, UTD,

etc• Many different research facilities used

– Fermi National Accelerator Laboratory– CERN, Switzerland, DESY, Germany, and KEK, Japan– Jefferson Lab– Brookhaven National Lab– SLAC, CA and Cornell– Natural sources and underground labs

• Sizable community, variety of experiments and needs• Very large data sets now! Even larger ones coming!!

Lennart Johnsson

TLC2 Review

August 27, 2004

• World’s Highest Energy proton-anti-proton collider – Ecm=1.96 TeV (=6.3x10-7J/p 13M Joules on 10-6m2)Equivalent to the kinetic energy of a 20t truck at a speed 80 mi/hr

Chicago

Tevatron p

p CDF

Dzero

Currently generating data at over a petabyte per year

DØ and CDF at Fermilab Tevatron

Lennart Johnsson

TLC2 Review

August 27, 2004LHC DATA

This is reduced by online computers that filter out a few hundred “good” events per sec.

The accelerator generates 40 million particle collisions (events) every second at the centre of each of the four experiments’ detectors

Which are recorded on disk and magnetic tapeat 100-1,000 MegaBytes/sec ~15 PetaBytes per year

Lennart Johnsson

TLC2 Review

August 27, 2004RAL

IN2P3

BNL

FZK

CNAF

USC

PIC ICEPP

FNAL

NIKHEFKrakow

Taipei

CIEMAT

TRIUMF

RomeCSCS

Legnaro

UB

IFCA

IC

MSU

Prague

Budapest

Cambridge

Processing M SI2000**

Disk PetaBytes

Mass Storage

PetaBytes

CERN 20 5 20

Major data handling centres

(Tier 1)45 20 18

Other large centres (Tier 2) 40 12 5

Totals 105 37 43

** Current fast processor ~1K SI2000

Current estimates of Computing Resources needed at Major LHC Centres

First full year of data - 2008 Data distribution~70 Gbits/sec

Lennart Johnsson

TLC2 Review

August 27, 2004

LHC Computing Grid (LCG)

Lennart Johnsson

TLC2 Review

August 27, 2004LCGNetworking

• Key element for LHC computing strategy

• Aiming at sustained 500 MB/s by end 2004 – requiring 10 Gb/s networks to some Tier-1 centres based on existing facilities

5.44 Gb/s

1.1 TB in 30 min.

6.25 Gb/s20 April 04

Lennart Johnsson

TLC2 Review

August 27, 2004

HEP Major Links: BW Roadmap in Gbps; Shown at ICHEP2002HEP Major Links: BW Roadmap in Gbps; Shown at ICHEP2002

Year Production Experimental Remarks 2001 0.155 0.622-2.5 SONET/SDH 2002 0.622 2.5 SONET/SDH

DWDM; GigE Integ. 2003 2.5 10 DWDM; 1 + 10 GigE

Integration 2005 10 2-4 X 10 Switch;

Provisioning 2007 2-4 X 10 ~10 X 10;

40 Gbps 1st Gen. Grids

2009 ~10 X 10 or 1-2 X 40

~5 X 40 or ~20-50 X 10

40 Gbps Switching

2011 ~5 X 40 or ~20 X 10

~25 X 40 or ~100 X 10

2nd Gen Grids Terabit Networks

2013 ~Terabit ~MultiTerabit ~Fill One Fiber

Lennart Johnsson

TLC2 Review

August 27, 2004

Summary: Storage and Bandwidth NeedsDiscipline Size of Archives Growth rate of Archives Bandwidth needs

Life Sciences

Mammography 50 – 100 PB 25 – 60 PB/yr ~ 10 Gbps

Microscopy 100+ PB 50 – 100 PB/yr 1 – 10 Gbps

Other imaging 200+ PB 100+ PB/yr 10 – 100 Gbps

Major medical center 100 – 1,000PB ~100 Gbps

Earth Sciences

Weather 1 – 10 Gbps

Climate 100+ PB 50 – 100 PB/yr 10 – 100 Gbps

Environment ~ 10 Gbps

High-Energy Physics 100+ PB 20 – 50 PB/yr 10 – 100 Gbps

Astronomy 100+ PB 20 – 50 PB/yr 10 – 100 Gbps

Telemedicine, Telescience 1 - 10 Gbps

Collaboration 1 Gbps

Remote steering 10 Gbps

Remote Visualization 10 Gbps

Computation 100 – 1,000 Gbps

Lennart Johnsson

TLC2 Review

August 27, 2004

Global Lambda Integrated FacilityPredicted Bandwidth for Scheduled

Experiments, December 2004

www.glif.is Visualization courtesy of Bob Patterson, NCSA.

Lennart Johnsson

TLC2 Review

August 27, 2004

Global Lambda Integrated Facility 2Q2004

DWDM SURFnet

10 Gbit/s

SURFnet10 Gbit/s

SURFnet

10 Gbit/s

IEEAF10 Gbit/s

DwingelooASTRON/JIVE

PragueCzechLight

2.5 Gbit/s

NSF10

Gbit/s

LondonUKLight

StockholmNorthernLight

2.5 Gbit/s

New YorkMANLAN

10 Gbit/s

10Gbit/s

10 Gbit/s

2x10 Gbit/s

IEEAF10 Gbit/s

2x10 Gbit/s

10 Gbit/s

2.5 Gbit/s

2.5 Gbit/s

TokyoAPAN

GenevaCERN

Chicago Amsterdam

SydneyAARnet

10 Gbit/s

10 Gbit/s 10 Gbit/s

Seattle

Los Angeles

TokyoWIDE

Lennart Johnsson

TLC2 Review

August 27, 2004Houston BioGrid

500 Å

JEOL3000-FEGLiquid He stageNSF support

No. of Particles Needed for 3-D Reconstruction

B = 100 Å2

8.5 Å 4.5 Å

6,000 5,000,000

Resolution

B = 50 Å2 3,000 150,0008.5 Å Structure of the

HSV-1 Capsid

Lennart Johnsson

TLC2 Review

August 27, 2004Houston BioGrid

Lennart Johnsson

TLC2 Review

August 27, 2004Houston BioGrid

http://www.csm.ornl.gov/ghpn/report4.pdf

Proteomics

Lennart Johnsson

TLC2 Review

August 27, 2004SimDB

Lennart Johnsson

TLC2 Review

August 27, 2004VGrADS

Lennart Johnsson

TLC2 Review

August 27, 2004

Summary

• TLC2 has successfully established – A state-of-the-art visualization, computing,

storage and networking infrastructure in support of competitive research and education (preliminary data indicates external funding of about $45M in the FY02- FY04 period by 43 faculty)

– Effective support for proposal and award management

– Effective outreach