Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in...
Transcript of Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in...
![Page 1: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/1.jpg)
![Page 2: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/2.jpg)
Granular Synthesis in Next-Generation Games
Game Developer's ConferenceMarch 2006
San Jose
Leonard J. PaulVancouver Film SchoolGame Audio Instructor
lpaul {at} vfs.com604-685-5808 x4035
![Page 3: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/3.jpg)
Grain Production
0 ms 250 ms 500 ms
200 ms 205 ms 210 ms
Envelope
200 ms 205 ms 210 ms
x
=
Original Waveform
10ms Segment
Envelope function
Grain output
Source Granular Grain
![Page 4: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/4.jpg)
Granular Synthesis Flowchart
ENVOSC
OSC
Amp1/dur
Grain envelope
Grain Waveform
Grain Voice 1
Freq
Grain Voice n
...
Multi-channel Output
![Page 5: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/5.jpg)
Granular Density Spectrogram
![Page 6: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/6.jpg)
Granular Parameters1) Selection order (forwards/reverse or freeze)2) Pitch shift (playback rate)3) Amplitude range4) Spatialization / panning (static/dynamic)5) Grain duration6) Grain density (number of grains/second or number of grain voices)7) Envelope (ASR shape, attack/release slope or windowing function)8) DSP effect (reverb, filtering etc.)9) Feedback amount (for granular delay lines)
Source
![Page 7: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/7.jpg)
Grain Segmentation
0 sec 2.5 secs
1 2 3 4 5 6 7 8 9
Nuts ! It's com - pany pro - pa - gan - da
Split into natural length sizes similar to syllables to improve granulation
Source No Segmentation With Segmentation
![Page 8: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/8.jpg)
Dialogue
Independent control over pitch and tempo
Segmentation
Phase vocoder
Examples
Source Pitch and tempo variations
![Page 9: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/9.jpg)
Sound Effects
Delay-line granulation effect
Synthesis techniques
Scraping, skidding and sliding
Ambiances
Examples
Source
![Page 10: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/10.jpg)
Crowd Engines
Granular cross-fading / morphing
Crowd intensities
Chaining between chunks
Reduction of identifiable loop elements
Examples
![Page 11: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/11.jpg)
Car Engines
Segmentation
Layering
RPM bands
Pitch-shifting
Examples
Source
![Page 12: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/12.jpg)
Music
Techniques and aesthetics
Real-time vs. pre-rendered
Grain quantization
Software tools
Examples
The Corporation Granular Impulse
![Page 13: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/13.jpg)
Granular Effects
Techniques
Delay-line granulation
Granular reverb
Examples
![Page 14: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/14.jpg)
Granular Surround
History of use of diffusion in performance
Grain speaker assignment
Trajectories
Examples
![Page 15: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/15.jpg)
GranularParticle Effects ControlParameters
Particle PhysicsParameters:
vel, pos, etc..
Granular Synthesis
![Page 16: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/16.jpg)
Granular Software
![Page 17: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/17.jpg)
CloudGenerator for Mac
Curtis Roads & John Alexander 1996
![Page 18: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/18.jpg)
Granular Footsteps in Java
Chirag Mehta
![Page 19: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/19.jpg)
Natural Wavelet Grain Segmentation in Java
Reynald Hoskinson
![Page 20: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/20.jpg)
Synthesis Toolkit
Perry R. Cook&
Gary P. Scavone
![Page 21: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/21.jpg)
AudioMulch
Ross Bencina
![Page 22: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/22.jpg)
Max/MSP Granular Synthesis
![Page 23: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/23.jpg)
Pure Data Granular Synthesis
![Page 24: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/24.jpg)
Implementation
Prototyping
Integration into game audio tools and libraries
Pure Data demos and prototyping techniques
Source code examples
![Page 25: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/25.jpg)
Granular Software
AudioMulchFruity LoopsAbleton LiveKTGranulator VST PluginPropellerhead's ReasonCloudGeneratorGranular Footfall SynthesisNatural Wavelet SegmentationSynthesis Toolkit (STK)Max/MSPPure Data
http://audiomulch.com/http://www.flstudio.com/http://www.ableton.com/http://www.koen.smartelectronix.com/http://www.propellerheads.se/ftp://ftp.create.ucsb.edu/pub/CloudGeneratorhttp://chir.ag/493/FootFallDriver.htmlhttp://www.cs.ubc.ca/~reynald/naturalgrains.htmlhttp://ccrma.stanford.edu/software/stk/http://www.cycling74.com/http://www-crca.ucsd.edu/~msp/software.html
![Page 26: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/26.jpg)
Granular Source Code
Nick Fell's Grantab for Pure DataRoss Bencina's Implementation of Granular SynthesisFrank Barknecht's Pure Data Port of SyncGrain SyncGrain SndObj Library by Victor LazzariniAmber
http://www.gla.ac.uk/music/studio/spiclem.html
http://www.audiomulch.com/~rossb/
http://footils.org/cms/pms/
http://music.nuim.ie/musictec/SndObj/main.html
http://www.euph0r1a.net/projects/?handler=amber
![Page 27: Granular Synthesis in Next-Generation - Video Game Audio · 2019-10-16 · Granular Synthesis in Next-Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul](https://reader030.fdocuments.in/reader030/viewer/2022040204/5eba615d9a760f4c5944c6d0/html5/thumbnails/27.jpg)
Questions?
lpaul {at} vfs.com
http://www.VideoGameAudio.com