Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music...

25
Meinard Müller, Frank Zalkow Overview International Audio Laboratories Erlangen [email protected], [email protected] Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks

Transcript of Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music...

Page 1: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Meinard Müller, Frank Zalkow

Overview

International Audio Laboratories [email protected], [email protected]

Tutorial T1Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks

Page 2: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Meinard Müller

Mathematics (Diplom/Master) Computer Science (PhD) Information Retrieval (Habilitation)

Since 2012: Professor for Semantic Audio Processing

ISMIR Board Member since 2010 (currently President-Elect) IEEE Audio and Acoustic Signal Processing TC (2010 - 2016) Member of Senior Editorial Board, IEEE Signal Processing Magazine

Page 3: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Frank Zalkow

Musicology/Music Informatics (Bachelor) Music Informatics (Master)

Since 08/2016: PhD student in MIR(supervisor: Meinard Müller)

Improving Music Retrieval with Machine Learning Cross-Connections between Musicology and Computer Science Choir Singing

Page 4: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Frank Zalkow Christof Weiß Michael Krause Sebastian Rosenzweig Hendrik Schreiber

Group Members

Patricio López-Serrano Christian Dittmar Stefan Balke Thomas Prätzlich Jonathan Driedger Harald Grohganz Nanzhu Jiang ...

Former PhD Students

Page 5: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

International Audio Laboratories Erlangen

Page 6: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

International Audio Laboratories Erlangen

Audio

Page 7: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

International Audio Laboratories Erlangen

Audio

Audio Coding

Music ProcessingPsychoacoustics

3D Audio

Virtual Reality

Page 8: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

FMP Notebooks

Introductions of MIR scenarios

Textbook-like explanations and algorithms

Python code examples

Numerous illustrations and sound examples

https://www.audiolabs-erlangen.de/FMP

Page 9: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Schedule9:00 – 9:20 Overview9:20 – 9:55 Music Representations and Retrieval9:55 – 10:30 Audio Structure Analysis

10:30 – 11:00 Coffee Break

11:00 – 11:30 Tempo and Beat Tracking11:30 – 12:00 Audio Decomposition12:00 – 12:30 Further Topics & Conclusions

https://www.audiolabs-erlangen.de/resources/MIR/2019_TutorialFMP_ISMIR/Slides:

https://www.audiolabs-erlangen.de/FMPFMP Notebooks:

Page 10: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk Outline

https://www.audiolabs-erlangen.de/FMP

Page 11: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk Outline

https://www.audiolabs-erlangen.de/FMP

Basics + 8 Chapters

Page 12: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk Outline

Basics + 8 Chapters Tempo and Beat Tracking

https://www.audiolabs-erlangen.de/FMP

Page 13: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Tempo and Beat Tracking

Page 14: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

Page 15: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

Explanations

MathematicsTheory

Page 16: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

Page 17: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

Music Example

Audio

Links

Annotations

Page 18: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

Page 19: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

AlgorithmsPython Code

Functions

Page 20: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

Page 21: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk OutlineTempo and Beat Tracking

Visualization

Results

Evaluation

Sonification

Page 22: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk Outline

https://www.audiolabs-erlangen.de/FMP

Page 23: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Talk Outline

https://www.audiolabs-erlangen.de/FMP

Research

Teaching Understanding

BaselinesProgramming

Multimedia

Page 24: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Book: Fundamentals of Music Processing

Meinard MüllerFundamentals of Music ProcessingAudio, Analysis, Algorithms, Applications483 p., 249 illus., hardcoverISBN: 978-3-319-21944-8Springer, 2015

Accompanying website: www.music-processing.de

Page 25: Tutorial T1 Fundamentals of Music Processing: An ... · Tutorial T1 Fundamentals of Music Processing: An Introduction using Python and Jupyter Notebooks . Meinard Müller Mathematics

Book: Fundamentals of Music Processing

Meinard MüllerFundamentals of Music ProcessingAudio, Analysis, Algorithms, Applications483 p., 249 illus., hardcoverISBN: 978-3-319-21944-8Springer, 2015

Accompanying website: www.music-processing.de