Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

29
BRIDGING ON-PREMISE AND CLOUD DEPLOYMENTS FOR BROADCAST IT Moving the worlds data at maximum speed

description

Today’s complex media workflows increasingly involve end-to-end, customized and automated operations, often with a combination of both cloud and on-premise storage. They require the integration of multiple geographically dispersed teams and processes, and the ability to publish to multiple screens and platforms. This presentation explores how infrastructure-agnostic technologies can enable these new workflows by allowing large digital content to be ingested, accessed and distributed at maximum speed and with full security - regardless of storage type or network distance.

Transcript of Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

Page 1: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

BRIDGING ON-PREMISE AND CLOUD DEPLOYMENTS FOR BROADCAST ITMoving the worlds data at maximum speed

Page 2: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

2

PRESENTER AND AGENDA

PRESENTERs

Michelle MunsonPresident and [email protected]

Andrea Di MuzioSr. Solutions [email protected]

• Industry Trends

• Big Data Challenges

• Solutions

• Use Cases

• Q & A

AGENDA

Page 3: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

3

ASPERA’S MISSION

Creating next-generation transport technologies

that move the world’s digital assets at maximum speed,

regardless of file size, transfer distance and network conditions.

Page 4: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

ASPERA PRODUCT PORTFOLIO

High-speed transfersfor web, desktop and mobile

High-speed file transfer servers for on premise, private, public, and hybrid cloud deployments

File sharing, collaboration and exchange applications

Transfer management, monitoring and automation

Scalable, multi-directional, multi-node synchronization

TRANSFER CLIENTS

WEB APPLICATIONS

MANAGEMENT & AUTOMATION

SYNCHRONIZATION

TRANSFER SERVERS

Innovative, patented, highly efficient bulk data transport technology, unique and core to all Aspera products

FASP™ TRANSPORT

4

Page 5: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

5

TRENDS

Big Data Explosion• 90% of data today file-based or unstructured• Mix of file sizes—but larger and larger files the norm

Diversity of IP Networks—Media, Bandwidth Rates, and Conditions• Variable bandwidth rates (slow to super-fast)• Bandwidth rates increasing—costs decreasing• Network media remains diverse (terrestrial, satellite, wireless) • Conditions vary—all networks prone to degradation over distance

Global Workflows—moving Big Data over WANs• Teams are geographically dispersed• Over distance, network conditions degrade• Contemporary TCP acceleration solutions not designed for big data transfer and replication

Cloud Computing Grows Up• Amazon Web Services (AWS) S3 cloud storage – 2010: 262 billion objects, 2012: 905 billion objects• More choices: Microsoft Azure, OpenStack, HP Cloud• No longer a niche – Netflix (transcoding), MTV (global video distribution), BGI (genomic sequencing)

Page 6: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

6

CHALLENGES WITH TCP AND ALTERNATIVE TECHNOLOGIES

Distance degrades conditions on all networks• Latency (or Round Trip Times) increase• Packet losses increase• Fast networks just as prone to degradation

TCP performance degrades with distance• Throughput bottleneck becomes more severe with

increased latency and packet loss

TCP does not scale with bandwidth• TCP designed for low bandwidth• Adding more bandwidth does not improve throughput

Alternative Technologies• TCP-based - Network latency and packet loss must be low • Modified TCP - Improves on TCP performance but insufficient for fast networks• UDP traffic blasters - Inefficient and waste bandwidth• Data caching - Inappropriate for many large file transfer workflows• Data compression - Time consuming and impractical for certain file types• CDNs & co-lo build outs - High overhead and expensive to scale

Page 7: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

7

BIG DATA CLOUD STORAGE CHALLENGE

Page 8: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

8

STANDARD SOLUTION – MULTI-PART UPLOAD

Page 9: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

9

FASP™: HIGH-PERFORMANCE TRANSPORT

Maximum transfer speed• Optimal end-to-end throughput efficiency• Transfer performance scales with bandwidth independent of

transfer distance and resilient to packet loss

Congestion Avoidance and Policy Control• Automatic, full utilization of available bandwidth• On-the-fly prioritization and bandwidth allocation

Uncompromising security and reliability• Secure, user/endpoint authentication • AES-128 cryptography in transit and at-rest

Low Overhead• Less than 0.1% overhead on 30% packet loss• High performance with large files or large sets of small files

Resulting in• Transfers up to thousands of times faster than FTP• Precise and predictable transfer times• Extreme scalability (concurrency and throughput)

Page 10: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

FASP 3 – UNIVERSAL HIGH-SPEED DATA TRANSPORT

CLOUD

HYBRID ON PREMISE

fasp 3DISTANCE INDEPENDENT

INFRASTRUCTURE AGNOSTICLocate your big data anywhere and move

it seamlessly with high-speed, secure transfers

FILE SIZE INDEPENDENTMaximum transfer speed, optimal

bandwidth utilization and maximum I/O throughput on any storage platform regardless of

number or size of files

ALL PARADIGMS & DEPLOYMENT MODELSTransfer, replicate or synchronize your data in

all types of scenarios: one-to-one, hub and spoke, unidirectional and multi-directional

10

Page 11: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

11

ASPERA ON DEMAND HIGH SPEED DATA INGESTWITH DIRECT-TO-CLOUD

Cloud

Page 12: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

ASPERA ON DEMANDAVAILABLE ON AMAZON WEB SERVICES AND WINDOWS AZURE

Transfer Servers – fasp servers as VM images for high speed transfer with cloud storage.• Direct integration with Amazon S3 and Windows Azure BLOB object storage for line speed ingest and

distribution• Offers unlimited scale out with additional transfer server instances.• Flexible Storage Options – Choose between local, Elastic block or Cloud storage (e.g. S3 / Azure

Blob)• Fast, robust and secure - Automatic resume, encryption, encryption-at rest, private multi-tenant

storage roots, and dynamic bandwidth control.• Fully interoperable with all Aspera clients.• Base transfer server, or Web-enabled application platform with support for Connect browser plug-in

for SDK integration with 3rd party cloud applications.

Web Applications – Add-ons to the base Transfer Server (AWS Only)• Aspera Shares –Multi-node file ingest and sharing, provides access to content across any location (on

cloud, other clouds, or on-premise) with powerful security and access model• Aspera faspex – Global Person-to-person file delivery, collaboration, exchange and distribution• Perfect for Hybrid deployments: Easily Publish, Store, or Receive content on-premise or on cloud

storage

Optional Clients • Optional add-ons to extend the content ingestion and distribution to mobile devices and email

clients• Supports Faspex iOS Client, Outlook Plug-in, Cargo Automatic Downloader, and Mobile Uploader

Licensing and Availability• Tiered usage (up to 1PB a month) based on GB transferred; No bandwidth caps, no user counts,

no limit on number of “servers” (or “instances”) one can run• Month-to-month pay as you go, or annual and multi-year terms• Available now: http://cloud.asperasoft.com

12

Page 13: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

13

ORCHESTRATOR OVERVIEW

Applications and Use Cases• Advanced contribution and automation• High volume processing and transformation• Ad ingest and insertion for video-on-demand• End-to-end content preparation and distribution

Features and Benefits• Intuitive Web based graphical workflow designer • Real time monitoring of active workflows• Open architecture for full customization• Unattended and interactive workflows, with ad hoc and recurring

(scheduled) execution• Extensive and growing library of plug-ins for 3rd party product integration• Highly scalable in support of the most demanding file-based workflows – on

promise, on cloud, or hybrid • Integration with the Aspera high-speed file transfer environment and

Aspera Console for reporting

Web-based application and SDK for creating and managing automated workflows, from simple file forwarding, to complex process orchestration.

Page 14: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

OPEN PLATFORM 3RD PARTY LIBRARYFREE TO ORCHESTRATOR USERS

Transcoding

Video Quality Control

MediaInfo

Database / Stores Antivirus

Ad Insertion & Media Management Email

Image ManipulationWatermarking

Encryption File Transfer

ImageMagik

Media Management IT Management

FTP/SFTP SCP

Page 15: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

15

fasp

Node

Node

fasp

THE SOLUTION

• Data migration from one region to another or from one provider to another

• Transfer database or application logs from one region to another for DR or Business Continuity

US West

Node

US East

fasp

USE CASE: INTRA-CLOUD TRANSFERSACROSS SAME OR DIFFERENT CLOUD INFRASTRUCTURE

Page 16: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

16

faspShares

NodeNode

DMZ

fasp

Datacenter, Emeryville, CA

Client, NY, NY

THE SOLUTION

• Shares Web app transparently communicates with Aspera server Nodes and displays content in a single user interface

• User browses authorized content across multiple shares

• Independent high-speed data transfers to/from Datacenter, AWS S3, and Windows Azure BLOB, transparent to user

USE CASE: INGEST AND SHARINGHYBRID ACROSS PUBLIC & PRIVATE CLOUDS

Page 17: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

USE CASE: PERSON-TO-PERSONHYBRID ACROSS PUBLIC & PRIVATE CLOUDS

Remote Storage

On Premise orOn Cloud

HTTP – multipar

t

fasp

faspexPerson-to-

Person

fasp

Connect Browser Plug-in

1. Login to faspex On Demand

2. Remote browsing of remote storage (cloud or on premise)

3. fasp high-speed upload to FoD and S3

4. faspex notification to recipient

5. fasp high-speed download Direct-from-S3

13

4

Ireland

Connect Browser Plug-in

2 5AWS

S3

Browser, San Diego Browser, London

17

Datacenter, NY

Page 18: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

CUSTOMER EXAMPLE: CLOUD-BASED ENCODING

HTTP – multipartfasp

Parallel Transcoding 14 EC2 instances: 3 min

`

Herndon, VA

THE SOLUTION

1. Video Broadcast Capture2. High-speed upload of content directly into AWS S33. Transfer completion triggers parallel transcoding in the

cloud and device-specific videos are saved to S34. Using AWS CloudFront, content is delivered to viewers’

devices

1

2

3

4

18

Connect Server

running on EC2

Aspera Connect browser plug-in

Ultimate Fighting Championship® (UFC®) is the world’s leading promoter of mixed martial arts (MMA), with programming broadcast to half a billion homes throughout 150 countries. Challenge: Transferring high-resolution video content from venue to host site in the cloud for scale-out transcoding

Page 19: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

DEMO AT ASPERA STAND K09: END-TO-END WORKFLOWINGEST, TRANSFER, DISTRIBUTE AND ARCHIVE GLOBALLY, IN MINUTES

INGEST TRANSFORM DISTRIBUTE ARCHIVE

Media Company

BLOB

S3 Glacier

Aspera Node

DMZ

3

AUTOMATE

Transcoding Service

Aspera Orchestrator

Faspex On Demand

Aspera Node

Media Customer

Aspera Console

THE SOLUTION

1. Content is transferred and ingested to an on-premise Aspera server

2. Aspera high-speed transfer Direct-to-S3 with Aspera On Demand

3. Multiple parallel transcoding jobs, with output stored back to S3

4. Faspex packages are created, sent and downloaded by the customer

5. Media files are archived to Azure BLOB or AWS S3 / Glacier6. Entire process is MINUTES, works GLOBALLY, and is SECURE

1

2

4 5

Page 20: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

20

HYBRID WORKFLOW - COMBINES ON-PREM AND ON CLOUD

1. Ingest original content to on-premise Aspera Server (and trigger workflow)

2. Run MediaInfo plug-in to extract video details

3. Notify Operator of ingestion availability and present options for transcoding on-premise, on-cloud, and archive

a) Transcode in the cloud (Zencoder.com or other)

b) Transcode on premise (ffmpeg or other)

4. Transcode and publish files to faspex (S3-S3 transfer) or on-premise to S3 transfer

5. Received files are downloaded by faspex client (Cargo or Connect)

6. Archive original video to alternate cloud for long-term storage

Page 21: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

21

STEP 1: INGEST AND TRIGGER WORKFLOW

1 GB high-speed transfer globally in under 30 seconds

Ingest original content to on-premise Aspera Server (triggers start of workflow)

Page 22: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

22

STEP 2: EXTRACT VIDEO DETAILS USING MEDIAINFO

Ingested content is stored on-premise – ingest directory is monitored by Orchestrator, video details are automatically extracted using MediaInfo Plug-in

Page 23: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

23

STEP 3: SELECT ON-PREMISE OR ON-CLOUD TRANSCODING

Select option for transcoding on-premise, on-cloud (operator or programmatic)1. Transcode in the cloud (Zencoder.com or other)2. Transcode on premise (ffmpeg or other)

Select option for post-transcode archive

1. On-cloud (Azure or AWS S3 / Glacier)

2. On-Premise

Page 24: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

24

STEP 4: TRANSCODE AND PUBLISH FILES TO FASPEX

Transcode job completes, and output files are published to recipient using faspex APIs (running on-premise or on-cloud)

Page 25: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

25

STEP 5: GLOBAL DISTRIBUTION TO CLIENT IN MINUTES

Received files are downloaded by faspex client at high-speed with encryption in transit and at-rest: 1 GB in 41 seconds (Cargo automatic download or user-initiated with Connect browser plug-in)

Page 26: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

26

STEP 6: ARCHIVE TO AZURE

Page 27: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

USE CASE: AUTOMATED END-TO-END WORKFLOWACROSS HYBRID ACROSS PUBLIC & PRIVATE CLOUDS

INGEST TRANSFORM DISTRIBUTE ARCHIVE

Media Company

BLOB

S3 Glacier

Aspera Node

DMZ

3

AUTOMATE

Transcoding Service

Aspera Orchestrator

Faspex On Demand

Aspera Node

Media Customer

Aspera Console

THE SOLUTION

1. Content is transferred and ingested to an on-premise Aspera server

2. Aspera high-speed transfer Direct-to-S3 with Aspera On Demand

3. Multiple parallel transcoding jobs, with output stored back to S3

4. Faspex packages are created, sent and downloaded by the customer

5. Media files are archived to Azure BLOB or AWS S3 / Glacier

1

2

4 5

Page 28: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

28

LEARN MORE AT CLOUD.ASPERASOFT.COM

Page 29: Aspera - Bridging On Premise and Cloud Deployments for Broadcast IT

THANK YOU FOR JOINING!

Michelle MunsonAspera President and CEO

FOR MORE INFORMATION ON ANY ASPERA PRODUCT, PLEASE CONTACT:

[email protected]

Andrea Di MuzioAspera Sr. Solutions Architect