University Digital Art Driven Innovation with Industry

New Models for Art & Industry CollaborationUCLA Arrowhead Conference Center

Lake Arrowhead, CANovember 17, 2002

Dr. Larry Smarr

Director, California Institute for Telecommunications and Information Technologies

Harry E. Gruber Professor,

Dept. of Computer Science and Engineering

Jacobs School of Engineering, UCSD

Lessons Learned from Fifteen Years of Art Driven Innovation with Industry

• Three Classes of Industrial Partners– Near-Art (Render Houses, Movie Production, Gaming)– Infrastructure (Computers, Telecom, Software)– End Consumers (Biochem, Manufacturing, Medical)

• World Class Facilities– Bleeding Edge– Multi-Function (VR, Rendering, Audio, Displays, Mixing)

• Renaissance Teams– Permanent Academic Professionals– Art, Computer Science, Content Equal Members– Lots of Graduate Students

• Showtime!– Demos at World Conferences (Siggraph, Supercomputing, iGrid)– Large Scale Projects– Use of New Tech to Create New Visual Metaphors on New Content

Computing and Graphics Has Enabled Artists to Create Extended Reality

http://access.ncsa.uiuc.edu/http://movies.warnerbros.com/twister

www.jurassicpark.comwww.cinemenium.com/perfectstorm/

1987

1993

1996

2000

Stefen Fangmeier Computer GraphicsFrom NCSA to ILM

SIGGRAPH 89Science by Satellite

“Using satellite technology…demo ofWhat It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations.”

― Al Gore, SenatorChair, US Senate Subcommittee on Science, Technology and Space

“What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers.”

― Larry Smarr, DirectorNational Center for Supercomputing Applications, UIUC

ATT & Sun

Source: Maxine Brown

http://sunsite.lanet.lv/ftp/sun-info/sunflash/1989/Aug/08.21.89.tele.video

“It’s the real start of humans being able to immerse themselves inside the brains of computers―seeing what the computers are seeing.”― Larry Smarr, Director,

National Center for Supercomputing Applications, UIUC

“See things you’ve never seen before.”― Tom DeFanti, Director, Electronic Visualization Laboratory, UIC

“Virtual prototyping of new products, from small to large.”― Rick Stevens, Director, Math and Computer

Science Division, Argonne National Lab

“Next year―SuperVROOM…Get rid of the Machine Farm and put gigabit networks in place to talk to computers at remote sites―a whole new level of interaction and communication.”― Maxine Brown, Associate Director,

Electronic Visualization Laboratory, UIC

SIGGRAPH 94VROOM: Virtual Reality Room

Post-Euclidean Walkabout George Francis, NCSA, UIUCwww.math.uiuc.edu/~gfrancis/

General MotorsResearch

UIC www.evl.uic.edu/EVL/VROOM/HTML/OTHER/HomePage.html

Source: Maxine Brown

Supercomputing 95I-WAY: Information Wide Area Year

UIC

The Barriers: Time And DistanceThe Barrier-Shattering Prototype: I-WAY

I-Way Featured:• Networked Visualization Application Demonstrations• OC-3 (155Mbps) Backbone• Large-Scale Immersive Displays• I-Soft Programming Environment

http://archive.ncsa.uiuc.edu/General/Training/SC95/GII.HPCC.html

CitySpace

Cellular Semiotics

SIGGRAPH ’96 Cosmic VoyageFirst Scientific Data Driven IMAX Sequence

Colliding Galaxies (Smithsonian IMAX)-Donna Cox, Bob Patterson, NCSA-From “Cosmic Voyage”-Nominated for Academy Award 1997

• Star Render Algorithm From PIXAR• Virtual Director in CAVE• 1000 Hour SDSC Supercomputer Run to Generate Data• Tens of Thousands of Hours of NCSA SGI Time to Render Data• Cross-Country Transfer to IMAX Film of Massive Amounts of Data

Sponsored by Motorola for the Smithsonian

Cyberfest ’97--Gesture and Body Movement Control Real Time Performance Art

“Machine Child” Performed at

Celebration of HAL’s BirthUniversity of Illinois

Robin Bargar, Insook Choi, Juhan Sonin, NCSA

and UIUC Music Dept.

Special Guests:Roger Ebert, Harry Lange,

& Arthur C. Clarke

Alliance 1997: Collaborative Video Productionvia Tele-Immersion and Virtual Director

Donna Cox, Bob Patterson, Stuart Levy, Glen Whelesswww.ncsa.uiuc.edu/People/cox/

Alliance Project Linking CAVE, Immersadesk, Power Wall, and Workstation

UIC

Corporations Use the Grid ForVirtual Prototyping

Real Time Linked Virtual Reality and Audio-Video Between NCSA, Peoria, Houston, and Germany

Fall 1997

Caterpillar, NCSAUniversity of Illinois at Urbana-Champaign

• Fifteen Countries/Locations Proposing 28 Demonstrations: Canada, CERN, France, Germany, Greece, Italy, Japan, The Netherlands, Singapore, Spain, Sweden, Taiwan, United Kingdom, United States

• Applications Demonstrated: Art, Bioinformatics, Chemistry, Cosmology, Cultural Heritage, Education, High-Definition Media Streaming, Manufacturing, Medicine, Neuroscience, Physics, Tele-science

• Grid Technologies: Grid Middleware, Data Management/ Replication Grids, Visualization Grids, Computational Grids, Access Grids, Grid Portal

iGrid 2002 September 24-26, 2002, Amsterdam, The Netherlands

www.startap.net/igrid2002UIC

Sponsors: HP, IBM, Cisco, Philips, Level (3), Glimmerglass, etc.

California Has Initiated Four New Institutes for Science and Innovation

UCSBUCLA

California NanoSystems Institute

UCSF UCB

California Institute for Bioengineering, Biotechnology,

and Quantitative Biomedical Research

UCI

UCSD

California Institute for Telecommunications and Information Technology

Center for Information Technology Research

in the Interest of Society

UCSC

UCDUCM

www.ucop.edu/california-institutes

New Media Arts--an Application Driver of Cal-(IT)2 From the Beginning

www.calit2.net

220 UC San Diego & UC Irvine FacultyWorking in Multidisciplinary Teams

With Students, Industry, and the Community

The State’s $100 M Creates Unique Buildings, Equipment, and Laboratories

Two New Cal-(IT)2 Buildings Are Beginning Construction

• Will Create New Laboratory Facilities– Clean Rooms for Nanotech and BioMEMS– Computer Arts Virtual Reality– Wireless and Optical Networking– Interdisciplinary Teams

Bioengineering

UC San Diego

UC Irvine

May 31, 2002$100 Million for New Buildings

From the State

• 3D Fabrication and Scanning• Digital Cinema Production• Haptic Interface Development

• Immersive Visualization• Spatialized Audio• Tele-Performance• Motion Capture

• Exhibition Gallery• 200 Seat, Tele-presence Auditorium• 2000 sq. ft. Black Box Experimental Performance Space

Labs For Advanced Arts Production And Research

Major Opportunity/ChallengeDesign of Cal-(IT)2 Building Facilities

Over Fifty Industrial Sponsors From a Broad Range of Industries

Akamai Technologies Inc.AMCCAmpersand VenturesArch VenturesThe Boeing CompanyBroadcom CorporationCAIMIS, Inc.Conexant Systems, Inc.Connexion by BoeingCox CommunicationsDiamondhead VenturesDupontEmulex Corporation

Network SystemsEnosys MarketsEnterprise PartnersEntropia, Inc.Ericsson ESRIExtreme NetworksGlobal Photon SystemsGravitonIBM

ComputersCommunications

SoftwareSensors

BiomedicalStartups

Venture Capital

Newport CorporationOracleOrincon IndustriesPanoram TechnologiesPrintronixQUALCOMMQuantumThe R.W. Johnson Pharmaceutical Research InstituteSAICSamueli, Henry (Broadcom)SciFrame, Inc.Seagate Storage ProductsSGISilicon WaveSonySTMicroelectronics, Inc.Sun MicrosystemsTeraBurst NetworksTexas InstrumentsTime DomainUCSD HealthcareThe Unwired FundWebEx

IdeaEdge VenturesThe Irvine CompanyIntersil CorporationIrvine Sensors CorporationJMI, Inc.Leap Wireless InternationalLink, William J. (Versant Ventures)Litton Industries, Inc.MedExpert InternationalMerckMicrosoft CorporationMission VenturesNCR

$140 Million in Industrial Matching

Cal-(IT)2 Industrial Partners are Supporting Academic Research and Education

• In the Last Six Months– Hosted Over 25 Seminars or Lectures

– Hosted or Co-Sponsored Over Ten Workshops/Conferences

• Funding a Dozen Faculty Research Projects

• Supported 20 Summer Undergraduate Fellows

• Funds Over 42 Graduate Fellowships

• Hosts Distinguished Visitors

• Provides Equipment for Living Labs

• Created a Half Dozen Chaired Professorships

Cal-(IT)2 New Media ArtsIs Well Underway

• UCSD/UCI Computer Gaming Initiative– Laboratory for Game Culture & Technology – CSE 190 Computer Gaming Course

• Computing As Social Space• Planning for New Building Facilities • Humans Interacting with Virtual Realities

Internet Linked PianosSmoke and Mirrors

CSE 190

UC San Diego UC Irvine

Interacting Virtual SpacesSheldon Brown’s “Mi Casa Es Tu Casa”

Human-Robot InteractionsSimon Penny’s Petit Mal

And Under Development:Bedlam--a Multi-modal, Networked Robotic, Telematic Performance

Between Irvine and Montreal

www-art.cfa.cmu.edu/Penny/works/petitmal/petitcode.html

Why Optical NetworksAre Emerging as the 21st Century Driver

Scientific American, January 2001

Metro Optically Linked Visualization Wallswith Industrial Partners Set Stage for Federal Grant

• Driven by SensorNets Data– Real Time Seismic– Environmental Monitoring – Distributed Collaboration– Emergency Response

• Linked UCSD and SDSU– Dedication March 4, 2002

Linking Control Rooms

Cox, Panoram,SAIC, SGI, IBM,

TeraBurst NetworksSD Telecom Council

UCSD SDSU44 Miles of Cox Fiber

½ Mile

The UCSD OptIPuter Deployment

SIO

SDSC

CRCA

Phys. Sci -Keck

SOM

JSOE Preuss

6th College

Phase I, Fall 02

Phase II, 2003

SDSCAnnex

To Other OptIPuter Sites

Collocation point

Node M

The OptIPuter Will Radically Alter Remote Interaction with Large Data Objects

Earth Sciences

SDSC

Arts

Chemistry

Medicine

Engineering

High School

UndergradCollege

Phase I, Fall 02

Phase II, 2003

SDSCAnnex

To Other OptIPuter Sites

Collocation point

Collocation

NSF ITR Award $13.5 Million With Six Campuses

PI—Larry Smarr

CENIC and CISI Plan to Create a Dark FiberExperimental and Research Network

Figure 2: SoCal Optical Research and Experimental Network

The SoCal Component

From Telephone Conference Calls to Access Grid International Video Meetings

Access Grid Lead-ArgonneNSF STARTAP Lead-UIC’s Elec. Vis. Lab

Can We Modify This TechnologyTo Create Global Performance Spaces?

www.manovich.net/cinema_future/www.manovich.net/cinema_future/toc.htmtoc.htm

Soft CinemaThe Future Of Cinema, Television & Computer Multimedia

• "Algorithmic Cinema" – Software Controls Both

– The Layout Of The Screen

– The Sequences Of Media Elements Which Appear In These Frames

• "Database Cinema" – The Media Elements Are Selected From A Large Database

– Construct a Potentially Unlimited Number Of Different Narrative Films

• "Macro-Cinema" – How Moving Images May Look When The Net Will Mature,

– Unlimited Bandwidth & Very High Resolution Displays

• "Multimedia Cinema" – Video, 2D Animation, Motion Graphics, 3D Scenes, Diagrams, Etc.

The Emergent Cyber-Civilizations

• Shared Virtual Worlds– Persistent and Growing Cyber Constructions

• Interacting Avatars – Hiro is approaching the Street. It is the Broadway, the

Champs Elysees of the Metaverse... It does not really exist. But right now, millions of people are walking up and down it.-- Neal Stephenson’s Snowcrash

• Artificial Intelligence “Gods”– Lord of the Rings—the Movie

– Computing Actions of Large Groups of Cyber Entities– What Will Be Possible When This is Real Time?

– William Gibson Metaphysics– Neuromancer, Count Zero, Mona Lisa Overdrive– AIs Interacting with Humans and Each Other

www.everquest.com