Digital Asset Management Systems

DigitalWell Digital Asset Management Systems

& Applications

Jim DeRoest, Director Streaming Media

Technologies

DigitalWell Digital Asset Management Systems

& Applications

Jim DeRoest, Director Streaming Media

Technologies

www.digitalwell.org

Who We Are – Streaming Media, Video & TV TechnologiesWho We Are – Streaming Media, Video & TV Technologies

• Campus– Institutional repository/Asset Management – Digitalwell Project– Streaming – Distance education, eLearning

• Television – UWTV, uw2.tv, ResearchChannel– Cable & Satellite broadcast 17.1million homes– +2500hrs modem to SD to HD on-demand programming– Live multicast internationally to 30mbps DV

• Radio – KEXP– Analog and Digital broadcast– Streaming audio to 1.4mbps – On demand broadcast & playlist archive

• Video/Audio Research– iHDTV – desktop to uncompressed HD over the Internet

• Campus– Institutional repository/Asset Management – Digitalwell Project– Streaming – Distance education, eLearning

• Television – UWTV, uw2.tv, ResearchChannel– Cable & Satellite broadcast 17.1million homes– +2500hrs modem to SD to HD on-demand programming– Live multicast internationally to 30mbps DV

• Radio – KEXP– Analog and Digital broadcast– Streaming audio to 1.4mbps – On demand broadcast & playlist archive

• Video/Audio Research– iHDTV – desktop to uncompressed HD over the Internet

MissionMission• Exploit Next Generation Network Bandwidth

• High Quality, Low Latency Interactive Systems• Deliver Realism - Quality & Latency Matter

– Health Sciences, Biology, Performance Arts

• System Integration & Automation – End to End• Television, Radio, Internet Technologies

• Middleware Standards• Intellectual Property, Discovery, Metadata

• Research & Outreach• National/International Consortia, K20

• Digital Media Asset Management• On Demand Access, DLib Interoperation, Preservation

• Exploit Next Generation Network Bandwidth• High Quality, Low Latency Interactive Systems• Deliver Realism - Quality & Latency Matter

– Health Sciences, Biology, Performance Arts

• System Integration & Automation – End to End• Television, Radio, Internet Technologies

• Middleware Standards• Intellectual Property, Discovery, Metadata

• Research & Outreach• National/International Consortia, K20

• Digital Media Asset Management• On Demand Access, DLib Interoperation, Preservation

Broadcast, Streaming, On-Demand

www.researchchannel.orgwww.uwtv.orgwww.kexp.org

ResearchChannel

Nationwide 7x24 Hour Television Channel on Cable and Satellite

International Retransmission

Research Consortia

ResearchChannel

Nationwide 7x24 Hour Television Channel on Cable and Satellite

International Retransmission

Research Consortia

ResearchChannel ParticipantsResearchChannel Participants

• Research Universities: Duke UniversityGeorge Mason UniversityJohns Hopkins UniversityMassachusetts Institute of TechnologyNational University of SingaporeOregon State UniversityPenn State UniversityRice UniversityRutgers, The State University of New JerseyStanford UniversityTufts UniversityUniversidad de Puerto RicoUniversitat Politècnica de CatalunyaUniversity of Alaska FairbanksUniversity of ChicagoUniversity of HawaiiUniversity of HoustonUniversity of Maryland - College ParkUniversity of PennsylvaniaUniversity of Southern CaliforniaUniversity of VirginiaUniversity of WashingtonUniversity of Wisconsin-MadisonVirginia TechYale University

• Research Organizations:

Howard Hughes Medical InstituteInternet2National Academies

National Academy of EngineeringNational Academy of Sciences

National Institute of Standards and TechnologyNational Institutes of Health

National Institute of Nursing ResearchNational Library of Medicine

National Science & Technology Medals FoundationNational Science FoundationNational Sea Grant College ProgramPacific Northwest GigapopStanford Hospital & ClinicsWisconsin Public Television

• Corporate Research Centers: Corporation for Education Network Initiatives in CaliforniaIBM CorporationJohnson & JohnsonMicrosoft ResearchSony Electronics Inc.Vulcan Inc.

• RC Global InitiativeAustraliaBrazilChileChinaFinlandKoreaNetherlandsPortugalSpain

Broadcast Subscribers Broadcast Subscribers

• 9.0 million - Dish Network

• 8.1 million - Individual cable systems

• 9.0 million - Dish Network

• 8.1 million - Individual cable systems

• 17.1 million - Total• 17.1 million - Total

International On-Demand & MulticastInternational On-Demand & Multicast

KEXP Listener: “Filipino listeners have a limited music resource. Your online audio streams are able to satisfy hungry listeners such as myself. Thank god for the internet!”

Regional distribution outside U.S.Regional distribution outside U.S.

* Webtrends: October 2002 - 2003. U.S. is 75% of Total, this shows remaining 25%

NetherlandsGermany

Japan

UK

France

Austria

Switzerland

IsraelItaly

Brazil

Sweden

Belgium

Finland

Taiwan

AU

Singapore

Hong Kong

Canada

Saudi Arabia

CollaboratorsCollaborators

• Research & Standards Development• Educational Outreach• Content Sharing• Network Test Beds

• Research & Standards Development• Educational Outreach• Content Sharing• Network Test Beds

DigitalWell: Digital Asset ManagementDigitalWell: Digital Asset Management

• Project focus – Broadcast-”Intercast” integration.– Automation – End to End

• capture, describe, deliver

– High quality, Realism• Commodity, Standard def, High def• Next generation networks

– Asset agnostic• Doc, pic, audio, video, data blobs

– Middleware• Metadata, DRM/IPMP, API

– Scalable/Pluggable Architecture• Evolve with Technology

– Federated DAMS Interoperation– Storage/Preservation

• Project focus – Broadcast-”Intercast” integration.– Automation – End to End

• capture, describe, deliver

– High quality, Realism• Commodity, Standard def, High def• Next generation networks

– Asset agnostic• Doc, pic, audio, video, data blobs

– Middleware• Metadata, DRM/IPMP, API

– Scalable/Pluggable Architecture• Evolve with Technology

– Federated DAMS Interoperation– Storage/Preservation

OAI

DigitalWell Architecture

AccessAPIs

Drivers

Storage Pool Abstraction

DatabasesDB2, SQLServer

Servers

Windows, UnixFile systems

HSM HPSS, ADSM

DataTransport/Streams

Federation

BroadcastAutomation

WS API DW AdminAPI

Metadata Abstraction

MetadataServices

Broadcast, Dlib, eLearning

WebISO, Shibboleth, PKI

Stream State Manager

SRB

Authorization-Authentication-Access Control

LDAP

Request Director

OAI

InternetStreaming Service

InternetMulticast ServiceDV, MPEG2, WM

Satellite & Cable

InternationalRetransmission

Web Broadcast Schedule Program Library

Video On Demand

DigitalWellEnd to End AutomationEnvironment

Broadcast

TrafficSystem Metadata

Digital Asset Repository

VoD Metadata

Synchronization

Video Capture

Single Pass Tape Dub & EncodingMPEG2 SD HDWM, Real, QT

InstantiationInstantiation

• Dub time automation– Single pass ingest

• Virage/Flipfactory• 15mbps MPEG2 master• Format transcoding• Keyframe, metadata

creation

• Queued for review• Archive & publish

– Scheduling• Protrack/Digitalwell• Metadata synchronization

• Automated monitoring• Ingest to delivery

• Dub time automation– Single pass ingest

• Virage/Flipfactory• 15mbps MPEG2 master• Format transcoding• Keyframe, metadata

creation

• Queued for review• Archive & publish

– Scheduling• Protrack/Digitalwell• Metadata synchronization

• Automated monitoring• Ingest to delivery

Automated Encoding ProcessAutomated Encoding Process

MiddlewareMiddleware

• Metadata– Dublin Core, MPEG7, Custom– OAI, possibly METS– WS API– Collection Directory – LoC/AMIA MIC

• Access Controls– Web ISO (Pubcookie), – Institutional Groups– Collection and Asset level ACLs– Shibboleth under development

• Preservation– OAIS?

• Metadata– Dublin Core, MPEG7, Custom– OAI, possibly METS– WS API– Collection Directory – LoC/AMIA MIC

• Access Controls– Web ISO (Pubcookie), – Institutional Groups– Collection and Asset level ACLs– Shibboleth under development

• Preservation– OAIS?

Broadcast Scheduling IntegrationBroadcast Scheduling Integration

• Broadcast Traffic & Web Integration– Program metadata store (DigitalWell)– Broadcast schedule (ProTrack, Louth)– Daily extract ProTrack list metadata– Synchronize metadata (ProTrack,

DigitalWell) • Tape number and program name

– Dynamic generation of ResearchChannel Web• Broadcast schedule• VoD library

• Broadcast Traffic & Web Integration– Program metadata store (DigitalWell)– Broadcast schedule (ProTrack, Louth)– Daily extract ProTrack list metadata– Synchronize metadata (ProTrack,

DigitalWell) • Tape number and program name

– Dynamic generation of ResearchChannel Web• Broadcast schedule• VoD library

Delivery – Little Video … Big VideoDelivery – Little Video … Big Video

• Clustered Load Sharing Server Architecture– WM9, Real10, Quicktime, Shoutcast, VideoCharger,

VideoLAN• Little Video – Smartphones, PDAs,

– Path 1, WM, Shoutcast– Audio/Video streaming, VoD

• Middle Video – Desktop– Modem, DSL, Broadband environments– Audio: 32kbps to 1.4mbps Uncompressed– Video: 56kbps to 5.6mbps SD, 19.2mbps HD– DVTS DV 30mbps– Unicast and Multicast

• Big Video– Studio Quality SDI delivery 250mbps (SD, HDCAM)– Uncompressed HD 1.5mbps

• VoD Demo APAN 2004• International VC Demo SC’04

http://www.researchchannel.org/projects

Interactive High Definition Video SC’04Network Routes

Internet SDTV to DesktopInternet SDTV to Desktop

• Servers, Players, Codecs– VidoeLan, IBM Videocharger– ffmpeg, Elecard– MPEG2 @ 5.6mbps

• Content stored and streamed from UW DigitalWell architecture

• All UWTV, ResearchChannel programming available – over 2000 hrs.

• UWTV, ResearchChannel SD multicast at 2mbps

• Servers, Players, Codecs– VidoeLan, IBM Videocharger– ffmpeg, Elecard– MPEG2 @ 5.6mbps


• All UWTV, ResearchChannel programming available – over 2000 hrs.

• UWTV, ResearchChannel SD multicast at 2mbps

Internet HDTV to DesktopInternet HDTV to Desktop

• Servers, Players, Codecs– VidoeLan, IBM

Videocharger, MS WM9– ffmpeg, Elecard– 1080i MPEG2 @

19.2mbps– 720p WM9 @ 5mbps


• Developing HDTV card integration for component out display to HD plasmas, projectors, LCDs

• Servers, Players, Codecs– VidoeLan, IBM

Videocharger, MS WM9– ffmpeg, Elecard– 1080i MPEG2 @

19.2mbps– 720p WM9 @ 5mbps


• Developing HDTV card integration for component out display to HD plasmas, projectors, LCDs

Storage ManagementStorage Management

• Pluggable Hierarchical Infrastructure– Hardware – NAS/SAN/Robotic Tape

• 30 TB NAS – Isilon IQ• 2 TB SAN staging – EMC Symetrix• STK robotic tape silos – 9840, 9940

– Software – Mass Store System• HPSS, TSM

– Disaster recovery - offsite copies• Content Sharing

– Mirroring/Synchronization – Peer to Peer

• Federated/Disparate Digital Repositories

• SRB OAI

• Pluggable Hierarchical Infrastructure– Hardware – NAS/SAN/Robotic Tape

• 30 TB NAS – Isilon IQ• 2 TB SAN staging – EMC Symetrix• STK robotic tape silos – 9840, 9940

– Software – Mass Store System• HPSS, TSM

– Disaster recovery - offsite copies• Content Sharing

– Mirroring/Synchronization – Peer to Peer

• Federated/Disparate Digital Repositories

• SRB OAI

Open Federated ArchivesOpen Federated Archives

NSDL UW CDL

Media Repositories

Targeted Media Portals

DigitalWell Other DAMS, DLS

SRB/OAI

DigitalWell Institutional R1 DigitalWell Institutional R1

• Institutional Repository Services• Broadcast Migration

– KEXP, UWTV, ResearchChannel– Two Previous Broadcast DW

Implementations

• Production 1QTR 2005

• Institutional Repository Services• Broadcast Migration

– KEXP, UWTV, ResearchChannel– Two Previous Broadcast DW

Implementations

• Production 1QTR 2005

DigitalWell R1DigitalWell R1

• What’s New …– Enhanced Content Upload

• Batch Collection Ingest: Assets and XML Metadata– Validation Assets to Metadata– Recoverable Upload

– Metadata Profiles• DWLite – File System Metadata, Limited

Search• Extended Dublin Core – Search• PBCore – Broadcast Support• Advanced Custom Fields

• What’s New …– Enhanced Content Upload

• Batch Collection Ingest: Assets and XML Metadata– Validation Assets to Metadata– Recoverable Upload

– Metadata Profiles• DWLite – File System Metadata, Limited

Search• Extended Dublin Core – Search• PBCore – Broadcast Support• Advanced Custom Fields


• What’s New …– WS API

• Interface Development, Teaching Tools

– System Admin Tool• User Account Management• Automated Account Creation/Expiration• User Quotas• Collection Management

– Selectable per Asset Delivery Option• Stream only, Download or Both

• What’s New …– WS API

• Interface Development, Teaching Tools

– System Admin Tool• User Account Management• Automated Account Creation/Expiration• User Quotas• Collection Management

– Selectable per Asset Delivery Option• Stream only, Download or Both


• New Non-broadcast Collections– Health Sciences – MRI imaging– School of Music – 15k hrs Ethnomusicology– College of Forestry – Sat images old growth– Experimental Education – SD video to K12– iEARN – International student video collab

http://www.iearn.org

– PETTT VideoTraces – Collab video toolhttp://epts.washington.edu/pettt/projects/videotraces.html

Sharing PBS Programming Over the Internet between 8 stationsSharing PBS Programming Over the Internet between 8 stations

Microsoft ResearchMicrosoft Research

MURL Goals:

•Increase awareness among researchers everywhere about the recent advances in the availability of streaming video technologies

•Provide access anywhere, at any time, to the rich, distinctive seminars of the partner institutions

•Investigate the potential of streaming video and collaborative technologies to change, and improve, the delivery of information and education

•Explore the social and communication issues that may arise from increasing the audience for seminars that are traditionally targeted to smaller, face-to-face groups

DigitalWell - What’s next…DigitalWell - What’s next…• Content Sharing/Synchronization

– SRB prototype with AARNET• Advanced Search

– CRIM MADIS MPEG7 Video Object Search• Encoding

– Closed Caption, Transcripts– User Initiated Batch Transcoding

• Network and Storage Scaling– Bandwidth > 1.5gbps per stream– Cost

• 1Hr Broadcast HD ~9GB• 1Hr HDCAM/SDI ~120GB• 1Hr Studio HD ~670GB

• Video Conferencing– Low Latency HD and Plasma Resolution

• Tarari HPC hardware• SDI Firewire• Capture Card

– Access Grid and Video Presence integration

• Content Sharing/Synchronization– SRB prototype with AARNET

• Advanced Search– CRIM MADIS MPEG7 Video Object Search

• Encoding– Closed Caption, Transcripts– User Initiated Batch Transcoding

• Network and Storage Scaling– Bandwidth > 1.5gbps per stream– Cost

• 1Hr Broadcast HD ~9GB• 1Hr HDCAM/SDI ~120GB• 1Hr Studio HD ~670GB

• Video Conferencing– Low Latency HD and Plasma Resolution

• Tarari HPC hardware• SDI Firewire• Capture Card

– Access Grid and Video Presence integration

? Questions [email protected]

[email protected]

Digital Asset Management Systems

Documents

Transcript of Digital Asset Management Systems