1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original...
Transcript of 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original...
![Page 1: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/1.jpg)
![Page 2: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/2.jpg)
1) Introducing Kara1k, a Karaoke dataset for music research
2) Long-term project for creating new tasks and improving
state-of-the-art
3) Experiments with the Kara1k dataset showing new results
Outline
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
![Page 3: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/3.jpg)
![Page 4: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/4.jpg)
![Page 5: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/5.jpg)
● Cover song
● An alternative version, performance, or recording of a previously published musical piece
● Input: Cover song (audio file), database of original songs;
● Output: Located original song
Focus No.1: Cover Song Identification
Queen Queen + George Michael
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
![Page 6: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/6.jpg)
![Page 7: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/7.jpg)
● For both areas, the future research has major problems
● Stalled state-of-the-art (CSI: 2009 Serra et al.)● It is NOT a problem of techniques, rather of datasets
– Not enough datasets to foster the research– Datasets do not have sufficient metadata or features
● Datasets with > 1000 songs=> not enough features (MillionSongDataset)=> YouTube quality (AudioSet)
– Audio copyright problems● Unable to form new tasks / new questions (e.g. how the
cover song differs from original) – no datasets for that
Motivation
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
![Page 8: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/8.jpg)
● Cover Song Identification
● The task would benefit greatly from sub-problems
– Finding a cover song only with a different singer / players, but the same musical setup (tempo, harmony)
● We need a large-enough dataset with many features, not breaching copyright law along the way
● Singing voice analysis
● We need dataset with detailed metadata (e.g. 5 gender classes)
● We need separate tracks (singer, background)● Versatility (gender, language, type of singing, ...)
Goals – let‘s make it better
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
![Page 9: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/9.jpg)
KaraFun application by Recisio
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
![Page 10: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/10.jpg)
![Page 12: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/12.jpg)
![Page 13: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/13.jpg)
![Page 14: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/14.jpg)
![Page 15: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/15.jpg)
![Page 16: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/16.jpg)
![Page 17: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/17.jpg)
![Page 18: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/18.jpg)
Special value of Kara1k
● For Singing voice analysis
● 1000 x KaraFun songs do provide metadata such as
– Language(s)– Genre(s)– Gender(s)– Backing vocals flag– Duet flag– Explicit language annotation– Others (Year of recording, ISRC, …)
● All songs: Vocal track / Instrumental track / Mix track
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
![Page 19: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/19.jpg)
![Page 20: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/20.jpg)
![Page 21: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/21.jpg)
![Page 22: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/22.jpg)
![Page 23: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/23.jpg)
![Page 24: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/24.jpg)
![Page 25: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/25.jpg)
Conclusion
http://www.yannbayle.fr/karamir
● We have created a new dataset, Kara1k
● Cover Song Identification, Singing voice analysis, and more
● Freely distributable, easy to use
● Opening doors for new challenges (KaraMIR project)
● Unmatched variety of features and metadata
● New sub-tasks for CSI, new tasks for Singing voice analysis
● New partnership with a company
● Paving the way – first experiments
● Comparing new features for CSI, 89% precision
● MFCC not robust against background music for Gender classification
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
![Page 26: 1)Introducing Kara1k, a Karaoke dataset for music research ...€¦ · Output: Located original song Focus No.1: Cover Song Identification Queen Queen + George Michael Bayle et al.](https://reader033.fdocuments.in/reader033/viewer/2022060610/60613220daabe33e2238cc63/html5/thumbnails/26.jpg)
Thank you for your attention
Bayle et al. Kara1k: A karaoke dataset for cover song identification and singing voice analysis
… please come to see a poster with Demo