Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera...
Transcript of Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera...
![Page 1: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/1.jpg)
Success Story of the Open-Source Camera Stack:
The Nokia N9 Case
Embedded Linux ConferenceEurope - 2011
Laurent [email protected]
![Page 2: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/2.jpg)
Source: http://en.wikipedia.org/wiki/Nokia_N900
![Page 3: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/3.jpg)
Application
Middleware
Adaptation
![Page 4: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/4.jpg)
Chip Vendor
Device Maker
AdaptationLayer
![Page 5: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/5.jpg)
Development
Management
![Page 6: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/6.jpg)
Source: http://xkcd.com/844/
![Page 7: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/7.jpg)
Code
Slides
![Page 8: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/8.jpg)
![Page 9: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/9.jpg)
![Page 10: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/10.jpg)
LensSensors
N900 Camera Stack
GStreamer
Hardware
Flash
ISP
V4L2
omap3camd
N900 Camera Skype
User
Kernel
OSS
OSS Non-Free
![Page 11: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/11.jpg)
Source: http://www.magiclens.co.uk/View/249/Jenga
![Page 12: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/12.jpg)
Source: http://en.wikipedia.org/wiki/Rube_goldberg
![Page 13: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/13.jpg)
Source: http://www.themobilefanatics.com/nokia-n9-gone-in-60-seconds/
![Page 14: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/14.jpg)
![Page 15: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/15.jpg)
Source: http://www.vincentjamespia.com/2010/08/365-project-day-242-tower-falls.html
![Page 16: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/16.jpg)
LensSensor
N9 Camera Stack
GStreamer
Hardware
FlashISP
Media Controller / V4L2
libv4l
libomap3camd
N9 Camera (Skype?)
Libraries
Kernel
AppsOSS
![Page 17: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/17.jpg)
![Page 18: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/18.jpg)
vs.
![Page 19: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/19.jpg)
RisksAPI
RisksCode
...
![Page 20: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/20.jpg)
Media devices increasingly handle multiple related functions. Many USB cameras include microphones, video capture hardware can also output video, or SoC camera interfaces also perform memory-to-memory operations similar to video codecs.
Independent functions, even when implemented in the same hardware, can be modelled as separate devices. A USB camera with a microphone will be presented to userspace applications as V4L2 and ALSA capture devices. The devices' relationships (when using a webcam, end-users shouldn't have to manually select the associated USB microphone), while not made available directly to applications by the drivers, can usually be retrieved from sysfs.
With more and more advanced SoC devices being introduced, the current approach will not scale. Device topologies are getting increasingly complex and can't always be represented by a tree structure. Hardware blocks are shared between different functions, creating dependencies between seemingly unrelated devices.
Kernel abstraction APIs such as V4L2 and ALSA provide means for applications to access hardware parameters. As newer hardware expose an increasingly high number of those parameters, drivers need to guess what applications really require based on limited information, thereby implementing policies that belong to userspace.
The media controller API aims at solving those problems.
censored
![Page 21: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/21.jpg)
Community
![Page 22: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/22.jpg)
![Page 23: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/23.jpg)
![Page 24: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/24.jpg)
Source: http://gordonandthewhale.com/
![Page 25: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/25.jpg)
Community QA Process
![Page 26: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/26.jpg)
Subdev userspace API ● Control Framework ● CMA ● CREATE_BUFS ● Community ● Subdev Interface ● Buffers Sharing ● Media controller ● GstPhotography ● videobuf2 ● camerabin2 ● Events API
![Page 27: Success Story of the Open- Source Camera Stack: The ...Success Story of the Open-Source Camera Stack: The Nokia N9 Case Embedded Linux Conference Europe - 2011 Laurent Pinchart laurent.pinchart@ideasonboard.com](https://reader033.fdocuments.in/reader033/viewer/2022051808/600bba3ac685d47f16696535/html5/thumbnails/27.jpg)
? !