Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13...

23
© Copyright Khronos Group, 2012 - Page 1 Call for Participation to the Chinese Mobile Industry Beijing, March 2012 Neil Trevett President, The Khronos Group Vice President Mobile Content, NVIDIA

Transcript of Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13...

Page 1: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 1

Call for Participation to the Chinese Mobile Industry

Beijing, March 2012

Neil Trevett President, The Khronos Group

Vice President Mobile Content, NVIDIA

Page 2: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 2

Urgent Mobile Market Opportunity!

China - Explosive domestic mobile

market growth - Intends to increase leadership

in global mobile markets

Khronos - Defining open global mobile

technology standards - Driving mobile

device capabilities

OPPORTUNITY FOR CHINA TO DRIVE DIRECTION OF GLOBAL MOBILE TECHNOLOGY

Page 3: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 3

Khronos Connects Software to Silicon

APIs enable software developers to turn silicon

functionality into rich end user experiences

Embedded and Mobile 3D

Advanced Audio

Parallel Computing

Camera, Images and Streaming Media

Khronos creates OPEN STANDARD APIs for advanced hardware acceleration

Graphics, video, audio, compute, visual and sensor processing

15 ACTIVE APIs

Page 4: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 4

Why are Khronos Standards Key? • Khronos APIs define core mobile device functionality

- Low-level “Foundation” functionality needed on every platform

• Khronos standards have strong industry momentum

- Shipping on billions of devices

- Shipping on multiple OS

• They are FREE

- No royalties

Khronos standards drive mobile market growth by expanding device capabilities

Tianyu

HTC ZTE

Page 5: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 5

Khronos History

2000 2003 2004 2005 2006 2008 2009 2011

Embedded and Mobile 3D

Advanced Audio

Parallel Computing

Camera, Images and Streaming Media

3D Digital Asset Exchange format

Vector 2D

Cross platform desktop 3D

Plugin-free 3D Web Content

Web Compute

Hardware accelerated vision functions

OpenVL

Unified Sensor and Input Processing

Over 100 Members 15 Active Standards

Surface Management

Page 7: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 7

Board of Promoters

Over 100 members – any company worldwide is welcome to join

Khronos has 30% Asian

Membership

Page 8: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 8

Board of Promoters

Over 100 members – any company worldwide is welcome to join

Apple

The Khronos Board of Directors has made Chinese industry participation a priority and committed

significant financial and staffing resources!

Page 9: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 9

Khronos and China • Participation in Khronos standardization

will help Chinese companies to compete

in the global mobile market

• Avoid costs and market confusion caused

by fragmentation

• Khronos needs Chinese company

participation to help grow market

opportunities for all

• Key Chinese companies:

- Silicon vendors

- Mobile OEMs

- Mobile carriers Khronos hosts first DevU in

China at PC Expo Beijing and meeting with Mayor of Tianjin

October 2004

China Mobile Terminal Industry Development Forum Shanghai

November 2005

Mobile Entertainment World Shanghai November 2007

DevU Beijing – Tsinghua University Dec 2010

Outreach to Chinese Industry Beijing and Shanghai

March 2012

Khronos Group are Gold Sponsors of the China Game

Developer Conference on July 25-27, 2012 in Shanghai

Khronos China

Outreach

Page 10: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 10

The Value of Khronos Participation

Gather Industry Requirements for future

silicon acceleration

Draft Specifications Confidential to

Khronos members

Publicly Release Specifications and Conformance Tests

Companies Release Products

Have a voice in how key standards

evolve to suit your business

needs

Develop products in

parallel with spec drafting

for faster time to market

See an early window into the

future of the industry technology

roadmap before products are developed

Products are aligned with global market needs and trends

The Khronos standardization process is proven to RAPIDLY generate industry consensus on future hardware acceleration functionality to EFFICIENTLY create new market opportunities

Members can ship products faster than

non-members

Page 11: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 11

Khronos Working Group Process

Working Groups (WGs) One working group per API

Promoter Members - Participation and vote in WGs - Board seat for strategy, budget and spec ratification

Contributor Members - Participation and vote in WGs

Academic Members - Participation in WGs

Ratified Specifications

Conformance Tests and Adopters Program

SDKs, Sample, Ref Cards and Man Pages

Adopters Build conformant implementation and products

Developers Develop applications using the APIs

$$$ $

$

Members

Wider Industry

Page 12: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 12

Khronos Cooperative Model

Khronos Specification Conformance Tests

Khronos standards have significant value - 100s of

man years invested by industry leading experts

Khronos creates open, royalty-free API standards

Khronos Members agree not to assert IP claims against other Members or Adopters

for CONFORMANT IMPLEMENTATIONS

• Solid legal framework for industry cooperation • ‘By the industry for the industry’ • Open to any company to join

• How does Khronos make money? • It doesn't! • Khronos fees cover costs of

creating, deploying and promoting specs and tests

Page 13: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 13

Khronos Conformance Process

• Implementers of Khronos specifications are not covered under the Khronos

IP framework unless their products are submitted and pass conformance!

• Khronos administers an Adopters Program for each API

- Adopters program provides full test access and trademark license for small fee

Company executes Adopters

Agreement and pays fee (usually

US$10K for unlimited products)

Port and execute tests on products to generate test

results

Upload test results to Khronos private

web-site. Peer Review by

members/Adopters

Successful Review of results enables products to use

Khronos trademarks and to be listed on Khronos website

Company implementing Khronos spec

wishes to use the trademark

Example: “We implemented OpenGL ES”

Full use of logo and

trademark

Full use of logo and

trademark with small disclaimer

Restricted use trademark (not

logo) with disclaimer language

Adopter Benefit

Page 14: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 14

Khronos API Ecosystem Evolution

New API technology first

evolves on high-end platforms

Mobile is the new platform for

apps innovation. Mobile

APIs unlock hardware and

conserve battery life

Apps embrace mobility’s

unique strengths and need

complex, interoperating APIs

with rich sensory inputs

e.g. Augmented Reality

Diverse platforms – mobile, TV,

embedded – means HTML5 will

become increasingly important

as a universal app platform

DESKTOP

MOBILE

INTEROP, VISION AND SENSORS

WEB

Page 15: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 15

10 Years of OpenGL ES! • OpenGL for embedded and mobile devices

- Eliminates redundant and legacy features

- Adds extensions to make it mobile-friendly

• The dominant 3D API for mobile devices

- Widely adopted for STB, DTV, automotive,…

- Hundreds and hundreds of millions shipped

• Runs high-end content and engines

- UE3, Unity, Unigine, Rage

Page 16: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 16

Augmented Reality – the Next Big Thing

Camera video stream sent to the compositor

3D Augmentation Rendering

3D augmentations composited with video stream

Camera Tracking

Camera images used to track the

camera’s location and

orientation

Camera-to-scene transform locks the 3D rendering to the real world

Page 17: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 17

Augmented Reality Functionality

Camera Processing

3D Rendering and Video Composition

Audio Rendering

Application on CPU

Positional and GPS Sensor Data

Computer Vision and Tracking

Position

and Tracking

Semantics

Control Camera, Preprocess and generate

video streams

Video TAP to CPU

Synchronization and sensor

fusion

Video stream to GPU

Positional Sensors

Camera EGLStream

Much more flexibility than just “overlay augmentations

over background”

OpenVL

Page 18: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 18

Android Native API Adoption

OpenGL ES OpenGL ES 2.0

Shipping - Android 2.2

OpenSL ES OpenSL ES 1.0

Shipping – Android 2.3

OpenMAX AL OpenMAX AL 1.0

Shipping - Android 4.0

EGL EGL 1.4

Shipping under SDK

OpenCL Not yet adopted

StreamInput Working group will ship spec in 2012

OpenVL Working group will ship spec in 2012

Page 19: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 19

Extended Native APIs on Android • Native APIs can be shipped as NDK extensions before Google Adoption

- Do not break/change existing Google APIs

• Khronos APIs have strong momentum in the silicon community

- Evangelize Google to adopt into standard platform

• Extended APIs can be used by:

- Bundled apps, Market apps with API selection

- Multiple APKs behind single multi-APK SKU

Standard Android SDK

and NDK

Extended NDK for

Key use cases

Evangelize Google and ISVs to

adopt enabling APIs

E.g. video, camera, imaging,

sensor and composition APIs

Page 20: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 20

HTML5 – Cross OS App Platform • Increasing diversity of devices

creates a demand for a true cross OS

programming platform

• BUT need more than “more HTML”

Rich Experiential Processing Multi-core CPUs

Rich 2D and 3D GPU GPU Computing

Multiple HD cameras Image and vision processing

Video encode/decode Audio encode/decode

Inertial and positional sensors

How can the Browser rapidly assimilate such diverse functionality?

Traditional Web-content

Page 21: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 21

Leveraging Native API Investment into HTML5 • HTML5 evolving into cross-platform programming platform

- Gradually exposing complete system capabilities

• Opportunity to synergize Web and native APIs development

- Leverage native API investments, reduce developer learning cycles

• Khronos and W3C creating close liaison

Native APIs shipping or working group underway

JavaScript API shipping or working group underway

WebVL? Vision

Processing

WebAudio Advanced JavaScript

Audio

WebMAX? Camera

control and video

processing

Possible future JavaScript APIs

Device and Sensor APIs

Device Orientation

Working Groups

Native

JavaScript

OpenVL

Canvas

Page 22: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 22

Khronos Members

Enhancing Educator Efforts

KITE Educators

Students

Industry Best Practices

Khronos-related courseware and exams

Skilled Employees

Khronos does not teach courses … … Khronos assists Educators in teaching Khronos APIs

Courseware For Review

Page 23: Call for Participation to the Chinese Mobile Industry · © Copyright Khronos Group, 2012 - Page 13 Khronos Conformance Process •Implementers of Khronos specifications are not covered

© Copyright Khronos Group, 2012 - Page 23

In Summary • The Khronos standardization process has defined mobile hardware

acceleration and helped create multi-billion dollar markets

• Aligning the Chinese and global mobile markets will further expand market

opportunities and avoid fragmentation for the benefit of all

• Chinese companies will benefit significantly from Khronos participation and

standards development will reflect Chinese industry requirements

• Khronos has identified Chinese industry participation as a priority

Connecting Software to Silicon