The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can...
Transcript of The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can...
![Page 1: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/1.jpg)
The GNOME Audio Story
Arun Raghavan
![Page 2: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/2.jpg)
Who am I?
![Page 3: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/3.jpg)
twitter: @louiswu
irc: Ford_Prefect
![Page 4: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/4.jpg)
PulseAudio
GStreamer
Other misc.
![Page 5: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/5.jpg)
How hard can audio be?
![Page 6: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/6.jpg)
🔉 Read samples, play them out
🎤 Record samples, do stuff
![Page 7: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/7.jpg)
Samples?
![Page 8: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/8.jpg)
![Page 9: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/9.jpg)
![Page 10: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/10.jpg)
Start from the lowest layer
![Page 11: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/11.jpg)
ALSA
![Page 12: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/12.jpg)
Advanced Linux Sound Architecture
![Page 13: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/13.jpg)
Kernel infrastructure
Userspace library
Plugin system
![Page 14: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/14.jpg)
“Restricted” subset
Talk to the hardware
![Page 15: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/15.jpg)
PulseAudio
![Page 16: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/16.jpg)
Sound server
Why do we need one?
![Page 17: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/17.jpg)
Applications just wanna
play or capture
![Page 18: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/18.jpg)
![Page 19: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/19.jpg)
Mixing
Conversion
Volumes
![Page 20: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/20.jpg)
Routing
Filters
![Page 21: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/21.jpg)
Power
Hardware
![Page 22: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/22.jpg)
Simple API
Async API
![Page 23: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/23.jpg)
libcanberra
![Page 24: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/24.jpg)
Event sound library
![Page 25: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/25.jpg)
Phone ring
Button press
New message
![Page 26: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/26.jpg)
GTK+ bindings
Easily attach an event to a widget
![Page 27: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/27.jpg)
Sounds cached if possible
![Page 28: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/28.jpg)
GStreamer
![Page 29: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/29.jpg)
Swiss-army mulitimedia knife
![Page 30: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/30.jpg)
Encode/decode
Containers
![Page 31: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/31.jpg)
Audio and video
Disk, network, …
![Page 32: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/32.jpg)
Everything that Nirbheek
spoke about yesterday
![Page 33: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/33.jpg)
BUT WHAT DO I USE?
![Page 34: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/34.jpg)
ALSA
![Page 35: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/35.jpg)
Practically never
![Page 36: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/36.jpg)
PulseAudio
![Page 37: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/37.jpg)
Working with samples
Fine-grained control
![Page 38: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/38.jpg)
libcanberra
![Page 39: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/39.jpg)
Event sounds
GSound in the future
'nuff said
![Page 40: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/40.jpg)
GStreamer
![Page 41: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/41.jpg)
Encoded audio
Custom pipeline
![Page 42: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/42.jpg)
JACK
![Page 43: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/43.jpg)
What's that?
Pro-audio use cases
![Page 44: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/44.jpg)
Future work
![Page 45: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/45.jpg)
Container support
Filters and effects
![Page 46: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/46.jpg)
UI interactions
Low latency
![Page 47: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/47.jpg)
Easier policy
Compressed audio
![Page 48: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/48.jpg)
Questions?
![Page 49: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?](https://reader034.fdocuments.in/reader034/viewer/2022043009/5f9c5358e471795dc550c41b/html5/thumbnails/49.jpg)
Thank you!
♥