“UC San Diego’sIntegrated Digital Infrastructure Initiative”

Briefing to the Representative AssemblyUC San Diego Senate

University of California, San DiegoOctober 27, 2015

Dr. Larry SmarrDirector, California Institute for Telecommunications and Information Technology

Harry E. Gruber Professor, Dept. of Computer Science and Engineering

Jacobs School of Engineering, UCSDhttp://lsmarr.calit2.net

What is UC San Diego’s Integrated Digital Infrastructure (IDI) Initiative?

• 5 Partnering Units:

• A Process to Support UCSD Strategic Plan With an Integrated Digital Infrastructure– Digital Technology Resource Advisory (“Concierge”) Service to Assess Technology, Identify the

Right Mix of Services to Meet Faculty and Research Staff Needs, Assist with Integration– Coordination Across Units to Ensure Research Needs are Met Efficiently and Effectively– Transformational Projects and Digital Research Platforms to Enhance Research and Education– Supporting a Research Data Library and Critical High Performance Cyberinfrastructure

Administrative Computing & Telecommunications (ACT)

IDI Will Transition to New CIO Office July 1, 2016Margaret Leinen, Chair; Larry Smarr, Co-Chair - CIO Search Committee

IDI Supporting UCSD’s Strategic Plan

• Transformational Projects & big data instructional support give our students hands-on experience with new technology and industry-standard tools (Goal 1)

• Collaboration & communications technology, including high-speed networking & electronic lab notebooks, improves interaction & reduces barriers to participation and makes cross-campus & multidisciplinary research practical (Goals 2 & 3)

• High-performance computing & networking supports big data research for economic & social improvement, allows us to deploy science for the public good faster (Goal 4)

• Digital Research Platforms that serve multiple researchers reduce excess spending, focus technology and research growth, and ensure good stewardship of public funds (Goal 5)

IDI Timeline:Leading Up to Beginning IDI Funding

• March 2009 – Report of the UCSD Research Cyberinfrastructure Design Team

• April 2010 – Report of the Cyberinfrastructure Planning and Operations Committee (CIPOC)

• 2010-2013 – Research Cyberinfrastructure Builds Out: Colocation, Condo Computing (TSCC), High-Speed

Networking, Research Data Curation• FY13/14

– Chancellor Asks, “Where is my Big Data Cyberinfrastructure?”• March 2014

– Powering the University of the Future: UC San Diego’s Integrated Digital Infrastructure• August 2014

– Integrated Digital Infrastructure (IDI): IDI Support for Projects Driving the UCSD Strategic Plan Goals For Year One (2014-15) - Key Transformational Projects

IDI Budget• Financial Support From UCSD Administration

– FY14/15– IDI Staff $500,000– IDI Projects $800,000

– FY15/16 – IDI Staff $623,000– IDI Projects $877,000

– Transitioning RCI for SDSC Colo/Condo and Library Research Data Curation Program Support Not Included Above

IDI Timeline:IDI Funding of Transformational Projects and Digital Research Platforms

• September 2014-July 2015 – IDI Funds and Executes 22+ Transformational Projects

• May 2015 – IDI Showcases Held

• June 2015 – IDI Call for Proposals: Transformational Projects and Digital Research Platforms

• July 2015-June 2016 – IDI Funds and Executes 14+ Digital Research Platforms

• July 2016 – IDI Transitions to New CIO Office

Additional IDI projects use significant IDI Concierge/Tech staff time, but are not funded, per se

Data Research Library:Curation, Annotation, Publishing of Researcher Generated Datasets

IDI Provided $185,610 (FY14/15)+$650,000 (FY15/16) to UCSD Library for 2,000TB of Specialized Disk Storage

Examples of IDI Support for Transformational ProjectsFY14/15

• Kim Albizati, Lecturer in Chemistry– Deploying electronic lab notebooks in upper-division Chemistry classes, preparing students for private-sector

work and making notebook management, editing and grading easier for students and instructors.

• Mark Ellisman, Distinguished Professor of Neurosciences and Bioengineering– Providing a Big Data PC to terminate a dedicated 40Gbps optical lightpath for moving of tens of terabytes of data

from the National Center for Microscopy and Imaging Research (Biomedical Sciences Building) to SDSC.

• Jules Jaffe, Research Oceanographer with Scripps Institution of Oceanography– Equipping labs with large 3D displays/storage/compute devices and equipping Scripps Pier with 10Gbps optical

fiber connectivity; a FY15/16 follow-on will provide multiple 10Gbps optical fiber to underwater microscopes and to multiple SIO faculty labs and to Birch Aquarium, creating real-time display of underwater microorganisms.

• Falko Kuester, Associate Professor of Structural Engineering– Equipping and staffing a student 3-D printing lab that builds drones, which were tested successfully during a

field trip, and the data is now being processed.

• Thomas Levy, Distinguished Professor of Anthropology– Developing new interfaces to UCSD’s Research Data Library to curate new archaeological data sets concerning

the evolution of societies in the southern Levant from the Neolithic to Islamic periods.

IDI Showcase Speakers

IDI Showcase Speakers

IDI Showcase Speakers

Some Current FY15/16 IDI Digital Research Platforms

• Setting up a Student-Centered Virtual Reality Lab

• Creating a High-Performance Storage, Management and Computation Platform for Heterogeneous, Multilingual Social Media Data to enable Social Science Research

• Developing High-Performance SDSC Storage to Serve Both Microbiome & Particle Physics Researchers

• Establishing a Real-time Drone Data Testbed in Collaboration with Campus Emergency Services

• Creating a New Pattern Recognition Lab with Multi-Vendor Brain-Inspired Processors

• Plus Ten Others…

A UCSD Integrated Digital Infrastructure Project for Big Data Requirements of Rob Knight’s Lab – PRP Does This on a Sub-National Scale

FIONA12 Cores/GPU128 GB RAM3.5 TB SSD48TB Disk

10Gbps NIC

Knight Lab

10Gbps

Gordon

Prism@UCSD

Data Oasis7.5PB,

200GB/s

Knight 1024 ClusterIn SDSC Co-Lo

CHERuB100Gbps

Emperor & Other Vis Tools

64Mpixel Data Analysis Wall

120Gbps

40Gbps

The Pacific Research Platform Creates a Regional End-to-End Science-Driven “Big Data Freeway System”

NSF CC*DNI Grant$5M 10/2015-10/2020

PI: Larry Smarr, UC San Diego Calit2Co-Pis:• Camille Crittenden, UC Berkeley CITRIS, • Tom DeFanti, UC San Diego Calit2, • Philip Papadopoulos, UC San Diego SDSC, • Frank Wuerthwein, UC San Diego Physics

and SDSC