10th Anniversary Update - Khronos Group · • ... WebGL HTML5 JavaScript CSS ... Provided Download...
-
Upload
truongxuyen -
Category
Documents
-
view
228 -
download
1
Transcript of 10th Anniversary Update - Khronos Group · • ... WebGL HTML5 JavaScript CSS ... Provided Download...
© Copyright Khronos Group, 2010 - Page 1
10th Anniversary Update
Neil TrevettVice President Mobile Content, NVIDIA
President, The Khronos GroupTokyo, December 2010
© Copyright Khronos Group, 2010 - Page 2
Welcome!
• In its first 10 years Khronos has created standards that are now shipping in
100‟s of millions of devices
• Today we will give you update on Khronos and our news over the last year
- Hwanyong Lee, CTO Huone – OpenVG Overview
- Erik Noreke, OpenSL ES Chair – OpenSL ES and OpenMAX IL Overview
• … hear from Japanese members using and shipping Khronos APIs
- Takumi, Hi, Imagination, DMP
• … and discuss about how we will start out the next 10 years
© Copyright Khronos Group, 2010 - Page 3
Khronos Vision
“The best way to predict the future is to invent it.”Alan Kay
Billions of devices increasinggraphics, compute, video,
imaging and audio capabilities
Market growth driven by rich
user experiences
Developers creating user experiences need efficient silicon accelerator access
Standard APIs define silicon capabilities
and provide reliable developer access
© Copyright Khronos Group, 2010 - Page 4
Modern Mobile Silicon Functionality
• Rich end-user experiences
need significant processing
- Parallel Computing
- GPU Computing
- 3D Graphics
- 2D Graphics
- Camera control
- Image processing
- Video encode
- Video decode
- Audio encode
- Audio decode
• All this silicon needs
to be programmed
© Copyright Khronos Group, 2010 - Page 5
The Critical Role of APIs
Khronos APIs are low-level – just above raw silicon - to create the
“foundation” functionality needed on every platform
APIs enable software developers to turn
silicon functionality intorich end user experiences
© Copyright Khronos Group, 2010 - Page 6
Khronos - Forum for Industry Cooperation
Open International MembershipAny company is welcome to join to suggest working groups and technology directions
Open StandardsPublicly available onweb-site to be used
by anyone
Royalty FreeNo per-device royalty
to ship APIimplementations
Industry CooperationHundreds of man years invested by industry experts to create state-of-the APIs
Opportunity to compete to create chips, software and systems that deliver amazing end user experiences in international markets
International Market Growth= ¥ $ € !
© Copyright Khronos Group, 2010 - Page 7
Board of Promoters
Over 100 members – any company worldwide is welcome to join
Apple
© Copyright Khronos Group, 2010 - Page 8
Khronos Family of Standards
Embedded 3DCross platform
desktop 3D
3D Digital Asset Exchange format
Advanced Audio Vector 2D
Context, Sync and Surface Management
Mobile OSAbstraction
Au
tho
rin
g a
nd
a
cce
ssib
ilit
yA
pp
lica
tio
n
Acce
lera
tio
n
Parallel Computing
Plugin-free 3D Web Content
Streaming MediaSafety Critical 3D
Syste
m
Inte
gra
tio
n
Window SystemAcceleration
A coordinated ecosystem of compute, graphics and media
standards and APIs
Video, Audio andImage Acceleration
Codec Creation
© Copyright Khronos Group, 2010 - Page 9
Major Releases This Year at Khronos
Nov09
WebGL 1.0 Provisional
Specification Released
OpenCL 1.1Specification
Released
Jun10OpenGL 4.0
Released
Mar10
OpenGL 4.1Released
Jul10
© Copyright Khronos Group, 2010 - Page 10
OpenGL for Each Hardware Generation
Geometry Shaders
1.X
Fixed Function
2.X
Vertex and Fragment Shaders
3.X
Tessellation and Compute
4.X
„Surfacerealism‟
„Shape realism‟
© Copyright Khronos Group, 2010 - Page 11
© Copyright Khronos Group, 2010 - Page 12
© Copyright Khronos Group, 2010 - Page 13
Accelerating OpenGL Innovation
• OpenGL increasing pace of innovation
- Six new spec versions in two years
- Actual implementations following specifications closely
• OpenGL 4.1 and GLSL 4.10 specifications available June 2010
- Support for the latest generation of programmable hardware
• OpenGL 4.1 is now superset of DX11 functionality
DirectX 10.1
2004 2006 2008
OpenGL 2.0 OpenGL 2.1 OpenGL 3.0
OpenGL 3.1
2009
DirectX 9.0c DirectX 10.0 DirectX 11
20102005 2007
OpenGL 3.2
OpenGL 3.3+
OpenGL 4.0
2011
OpenGL 4.1
SIGGRAPH2010
© Copyright Khronos Group, 2010 - Page 14
Processor Parallelism
CPUsMultiple cores driving performance increases
GPUsIncreasingly general purpose data-parallel
computing
Graphics APIs and Shading
Languages
Multi-processor
programming – e.g. OpenMP
EmergingIntersection
HeterogeneousComputing
OpenCL is a programming framework for heterogeneous compute resources
© Copyright Khronos Group, 2010 - Page 15
Anatomy of OpenCL
• Language Specification
- C-based cross-platform programming interface
- Subset of ISO C99 with language extensions - familiar to developers
- Defined numerical accuracy - IEEE 754 rounding with specified maximum error
- Online or offline compilation and build of compute kernel executables
- Rich set of built-in functions
• Platform Layer API
- A hardware abstraction layer over diverse computational resources
- Query, select and initialize compute devices
- Create compute contexts and work-queues
• Runtime API
- Execute compute kernels
- Manage scheduling, compute, and memory resources
© Copyright Khronos Group, 2010 - Page 16
OpenCL Timeline
• Six months from proposal to released OpenCL 1.0 specification
- Due to a strong initial proposal and a shared commercial incentive
• Multiple conformant implementations shipping
- For CPUs and GPUs on multiple OS
• 18 month cadence between OpenCL 1.0 and OpenCL 1.1
- Many new API and language features – responding to developer feedback
- Backwards compatibility protect software investment
Apple proposes OpenCL working group and contributes draft specification to Khronos
Khronos publicly releases OpenCL 1.0 as royalty-free specification
Khronos releases OpenCL 1.0 conformance tests to ensure high-quality implementations
Jun08
Dec08
May09
2H09
Multiple conformant implementations ship across diverse OS and platforms
Jun10
OpenCL 1.1 Specification released and first implementations ship
© Copyright Khronos Group, 2010 - Page 17
OpenCL Desktop Implementations
• http://www.amd.com/us/products/technologies/stream-
technology/opencl/Pages/opencl.aspx
• http://software.intel.com/en-us/articles/intel-opencl-sdk/
• http://www.nvidia.com/object/cuda_opencl_new.html
© Copyright Khronos Group, 2010 - Page 18
OpenCL Courses
• http://maps.google.com/maps/ms?ie=UTF8&oe=UTF8&msa=0&msid=11
0337952595184289080.000491695f76aaf121c0d
© Copyright Khronos Group, 2010 - Page 19
Mobile Application Portability
CompositingUser Interfaces
Games and Game EnginesGames and
Game EnginesGames and Game Engines
Flash PlayersFlash PlayersFlash and SVG
Players
TV and Video StacksTV and Video
StacksTV and Video Stacks
Applications are portable toKhronos-enabled platforms
OS resource abstraction
Browsers
Silicon and platform
independent graphics, media
and compute acceleration
© Copyright Khronos Group, 2010 - Page 20
Driving API Adoption into Device Platforms
Plug-in
Native support
SurfaceFlinger
EGL and OpenSL ES now supported in Android 2.3 NDK
© Copyright Khronos Group, 2010 - Page 21
EGL Becoming an Interoperability Hub
Buffers, textures and video streams flow efficiently
between any combination of client APIs
Inter-API Synchronization events enable efficient
resource sharing
EGL Interoperability Conformance Tests being
created to ensure that client APIs can cleanly communicate
Enabling the Khronos individual APIs to interoperate as a
coherent ecosystem
© Copyright Khronos Group, 2010 - Page 22
Mobile Visual ComputingCompute, graphics and AV APIs
interoperate through EGL
Visual Computing Ecosystem
Desktop Visual ComputingOpenGL and OpenCL have direct
interoperability. OpenCL objects can be created from OpenGL Textures, Buffer
Objects and Renderbuffers
© Copyright Khronos Group, 2010 - Page 23
WebGL – 3D on the Web – No Plug-in!
• Historic opportunity to bring accelerated 3D graphics to web
- WebGL defines JavaScript binding to OpenGL ES 2.0
• Leveraging HTML 5 and uses <canvas> element
- Enables a 3D context for the canvas
• Very different dynamic to VRML
- Browser vendors want 3D this time
- No plug-in
Availability of OpenGL ES 2.0 on almost every
web-capable device
JavaScriptbinding to
OpenGL ES 2.0Increasing JavaScript performance.HTML 5 Canvas Tag
© Copyright Khronos Group, 2010 - Page 24
WebGL Implementation Update
• Working group launched March 2009
- Mozilla, Apple, Google and Opera
working with OpenGL GPU vendors
- Provisional spec – November 2009
- Implementations in public daily builds
- WebGL 1.0 expected spring 2011
- WebGL on Windows uses Google Angle
to create ES2 over DX9
• WebGL JS middleware already
- GLGE, SpiderGL, X3DOM, EnergizeGL,
SceneJS, O3D, CopperLicht, CubicVR
• WebGL Extension Registry Online
- http://www.khronos.org/registry/webgl
/doc/spec/extensions/
ContentJavaScript, HTML, CSS, ...
WebGL HTML5
JavaScript CSS
BrowserProvided
OSProvided
DownloadFrom Web
Plug-in
Production support expected in 1Q11
OpenGL ES 2.0OpenGL
DX9/Angle
© Copyright Khronos Group, 2010 - Page 25
WebGL Compositing
• WebGL is HTML - fully participates in canvas/browser compositing
- Overlay and underlay HTML content - including SVG
- Easy to make HUDs or user interfaces
• WebGL TexImage2D accepts
- Raw buffer
- HTML image element
- HTML video element (takes current frame)
- HTML canvas element
E.g. draw text to 2D canvas, use as bump-map texture in WebGL
then composite 3D model over HTML text
© Copyright Khronos Group, 2010 - Page 26
OpenGL Ecosystem
Leading-edge functionality developed first on desktop
OpenGL ES 2.0 on desktop as subset of OpenGL 4.1 for mobile
content flexibility – including native support for WebGL
WebGL will drive new-generation security into
OpenGL family
Mobile functionality subset that is deployed on billions of devices
Pervasive OpenGL ES 2.0 availability enables Browser vendors to build 3D
directly into HTML5
© Copyright Khronos Group, 2010 - Page 27
Starting the Next 10 Years
• New working groups for ray-tracing and computer vision?
• EGL extensions for rich graphics/video interop?
• 3D Convergence - does OpenGL ES become an OpenGL profile over time?
• Need EGL and OpenMAX IL on desktop – increased application portability?
• OpenVG Express – for bring essential OpenVG onto every GPU?
• Bringing vector graphics to OpenGL / OpenGL ES?
• W3C liaison for web-based augmented reality?
© Copyright Khronos Group, 2010 - Page 28
Khronos Member Speakers
• Hwanyong Lee, CTO, HUONE
- OpenVG – Khronos Overview
• Erik Noreke, OpenSL ES Work Group Chairperson
- OpenSL ES and OpenMAX – Khronos Overview
• Tommy Asano, Executive Director, Advanced Technologies, TAKUMI
- Graphics IP core enabling Khronos API for embedded solutions
• Shige Matsue, President, Imagination Tech KK
- OpenGL ES, OpenVG, OpenCL - Bringing All Khronos APIs Together
• Tomotaka Watanabe, Marketing Manager, HI Corp
- Middleware product development using Khronos APIs
• Tatsuo Yamamoto, CEO, DMP
- Khronos API training programs