The X170 protocol as a vehicle for 3D sound control
description
Transcript of The X170 protocol as a vehicle for 3D sound control
The X170 protocol as a vehicle for 3D sound control
Presented by Shane Haw Supervisor: Professor Richard FossEmail: [email protected]
1. A Brief Overview of my Research.2. Object Orientated Approach3. System Design4. Demonstration5. Future Work6. Questions
Brief Overview• 3D Sound Control or Sound Localization• Combination of 3 technologies:– HCI (Human Computer Interaction) : A
capturing of 3D coordinates– Computer Graphics: A displaying of 3D
coordinates– Real-time Multimedia: converting the
distances between coordinates to volumes
Object Oriented Approach
• Cyclic Approach:– Use Case Diagram– Requirements Specification– Textual Scenarios– Noun Derivations– Class Diagram / Object Model– Sequence Diagrams
System Design
• Technologies used:– HCI: The Microsoft Kinect with the Microsoft
Kinect SDK (beta).– Computer Graphics: Google Sketchup with its
Ruby API– Real-time Multimedia: AES-X170 Protocol
Overall Structure
Audio Networking• The AES-X170 Protocol is a control protocol– Allows the accessing and setting of remote
parameters, which allows the volume levels of channels to be set.
– The volume parameters within the evaluation box are found at the crosspoints between the 1st and 2nd Bus.
Audio Networking
Audio Networking
Audio Networking
Computer Graphics• Google Sketchup provides the means of
displaying the 3D coordinates• A simple, click and drag approach to
building models• Google Sketchup provides a Ruby API• Plugin Folder• Scripts can then be interacted with
through the use of tcp sockets
Computer Graphics
Human Computer Interaction• Microsoft Kinect• The SDK released on the 24th of June 2011• Provides skeletal tracking– Provides the 3 dimensional coordinates of several
preset skeletal joints
Human Computer Interaction
Demonstration
Future Work• The ability to edit portions of old saves• Gesture recognition for track selection rather
than GUI interface• The adding of further speakers and some
effects such as reverberation for better sound localization
Questions ?