Software Testing: Test Management Iain McCowatt [email protected] @imccowatt imccowatt.
Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson,...
Transcript of Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson,...
![Page 1: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/1.jpg)
Lecturer Athanasios Nikolaidis
![Page 2: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/2.jpg)
Computer Graphics: Graphics primitives 2D viewing and clipping 2D and 3D transformations Curves and surfaces Rendering and ray tracing Illumination models Shading models Texture mapping Computer animation
![Page 3: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/3.jpg)
Multimedia Applications: Coding of audio-visual objects (MPEG-4) Multimedia content description interface
(MPEG-7) Multimedia information retrieval Multimedia framework (MPEG-21) Digital rights management
![Page 4: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/4.jpg)
Peter Shirley, Steve Marschner, Fundamentals of Computer Graphics, CRC Press, 2009.
Shalini Govil-Pai, Principles of Computer Graphics: Theory and Practice Using OpenGL and Maya®, Springer, 2004.
David Salomon, Curves and Surfaces for Computer Graphics, Springer, 2006.
Iain E.G. Richardson, H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia, Wiley, 2003.
Introduction to MPEG 7: Multimedia Content Description Interface, edited by B.S. Manjunath, Philippe Salembier and Thomas Sikora, Wiley, 2002.
The MPEG-21 Book, edited by Ian S. Burnett, Fernando Pereira, Rik Van de Walle and Rob Koenen, Wiley, 2006.
![Page 5: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/5.jpg)
Synthetic images (images created using computers)
Digital “illustration of life”
![Page 6: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/6.jpg)
Pixar’s first film, (“Luxo Jr.”, 1986)
![Page 7: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/7.jpg)
Creation of an image
![Page 8: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/8.jpg)
Movies Games Simulation CAD-CAM Architecture Virtual Reality Visualization Medical Imaging
![Page 9: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/9.jpg)
![Page 10: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/10.jpg)
![Page 11: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/11.jpg)
![Page 12: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/12.jpg)
![Page 13: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/13.jpg)
![Page 14: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/14.jpg)
![Page 15: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/15.jpg)
![Page 16: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/16.jpg)
![Page 17: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/17.jpg)
![Page 18: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/18.jpg)
![Page 19: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/19.jpg)
Parallel to the history of computers: Pen plotters Simple displays using A/D converters
![Page 20: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/20.jpg)
Wireframe graphics: Drawing only lines
Sketchpad A PhD at MIT (Ivan Sutherland, 1963) Predecessor to GUI, OOP
![Page 21: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/21.jpg)
Raster graphics: Image as an array of picture elements (pixels) contained
in the frame buffer Not just lines anymore: filled shapes
![Page 22: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/22.jpg)
Realistic graphics
smooth shading environment mapping bump mapping
![Page 23: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/23.jpg)
OpenGL (API by SGI) Computer-generated full length movies (Toy Story)
Hardware with more features (texture mapping, blending, stencil buffers, etc.)
![Page 24: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/24.jpg)
Photorealism Graphics cards for PCs (NVIDIA, ATI, etc.) with GPUs Game boxes and players determine market directions Software used on industrial level (Maya, Lightwave, etc.) Programmable pipelines
![Page 25: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/25.jpg)
![Page 26: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/26.jpg)
OpenGL (SGI) Direct3D (Microsoft) RenderMan Interface Specification (Pixar)
![Page 27: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/27.jpg)
Modeling: mathematical representation of objects
Rendering: turning models into images Animation: the above plus movement
(change in time)
![Page 28: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/28.jpg)
The programmer’s point of view: Specify geometric objects Describe their properties Define how they should be viewed Move either camera or objects around for
animation
![Page 29: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/29.jpg)
The process of converting a set of 3D primitives to a corresponding set of 2D pixels to be displayed as output (using graphics hardware)
![Page 30: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/30.jpg)
It is not efficient to render whole curves and surfaces directly
![Page 31: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/31.jpg)
Basic geometric objects handled by graphics hardware. Can be points, line segments, circles, polygons, etc.
(most usual: triangles). More complex objects can be constructed based on
primitives.
![Page 32: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/32.jpg)
![Page 33: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/33.jpg)
![Page 34: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/34.jpg)
RGB Color Texture Pattern
![Page 35: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/35.jpg)
Ambient: same at every point on the surface Diffuse: scattered light independent of
angle (rough)
Specular: dependent on angle (shiny)
![Page 36: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/36.jpg)
Most common are point sources
![Page 37: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/37.jpg)
Rotation Translation Scaling
![Page 38: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/38.jpg)
An object can be viewed from different angles:
![Page 39: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/39.jpg)
Reproduce the effect of taking a photograph
![Page 40: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/40.jpg)
Objects farther away are smaller in size Lines from each point on the image are drawn through
the center of the camera lens (the center of projection (COP)).
![Page 41: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/41.jpg)
Camera positioning just results in more transformations on the objects: Transformations that position the object relative to the
camera Handled in the transformation process in the pipeline
up COP eye
![Page 42: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/42.jpg)
What is visible on the screen?
![Page 43: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/43.jpg)
If we draw objects directly, our screen will be a “mess”. Remove hidden surfaces.
![Page 44: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/44.jpg)
Transforms pixel values in world coordinates to pixel values in screen coordinates
![Page 45: Lecturer Athanasios Nikolaidisteachers.cm.ihu.gr/nikolaid/CGMA_Intro.pdf · Iain E.G. Richardson, H.264 and MPEG -4 Video Compression: Video Coding for Next -generation Multimedia,](https://reader034.fdocuments.in/reader034/viewer/2022042812/5faac27045b96e6c43225d67/html5/thumbnails/45.jpg)
Delicate 3D models Perspective Hidden surface removal Shading (lighting & reflection) Shadow Detailed textures and normals