Brian Isaacson, AICP Planning Director, Program Management Metropolitan District.
Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory...
-
Upload
corey-carroll -
Category
Documents
-
view
215 -
download
0
Transcript of Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory...
![Page 1: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/1.jpg)
Content Visualization in a Content Visualization in a Digital Music LibraryDigital Music Library
Eric J. IsaacsonEric J. Isaacson
Assoc. Prof. of Music TheoryAssoc. Prof. of Music Theory
Indiana University School of MusicIndiana University School of Music
This material is based upon work supported by the National Science Foundation under Grant No. 9909068. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the presenters and do not necessarily reflect the views of the National Science Foundation.
3rd International Workshop on Information Visualization Interfaces for Retrieval and Analysis (IVIRA), 31 May 2003 (Houston)
![Page 2: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/2.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
22
Importance of Vis. in MusicImportance of Vis. in Music
““Freezes” otherwise ephemeral content by Freezes” otherwise ephemeral content by mapping temporal onto a spatial domainmapping temporal onto a spatial domain
Supports recall, reproductionSupports recall, reproduction Can depict structures/featuresCan depict structures/features
Hidden and surfaceHidden and surface Large and small scaleLarge and small scale HierarchiesHierarchies
Enables communicationEnables communication
![Page 3: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/3.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
33
Quick History of Western Quick History of Western NotationNotation
Origins are >1000 years old (heightened Origins are >1000 years old (heightened neumes)neumes)
Began as memory aidBegan as memory aid Rhythmic notation develops ca. 1300Rhythmic notation develops ca. 1300 ““Modern” music notation reaches present Modern” music notation reaches present
form ca. 1600form ca. 1600
![Page 4: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/4.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
44
Notation as VisualizationNotation as Visualization
Useful for random accessUseful for random access Provides concise guide for how music Provides concise guide for how music
soundssounds Trained musicians can read “structural” Trained musicians can read “structural”
features in notation (but only indirectly)features in notation (but only indirectly)
![Page 5: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/5.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
55
Variations2: Indiana Univ. Variations2: Indiana Univ. Digital Music LibraryDigital Music Library
ContentContent Digital Audio/VideoDigital Audio/Video Scanned score imagesScanned score images Symbolically encoded score filesSymbolically encoded score files
Software forSoftware for Enhanced search for musicEnhanced search for music Player/viewers for (synchronized) playbackPlayer/viewers for (synchronized) playback Notation display, editingNotation display, editing Library catalogingLibrary cataloging Learning, study, teachingLearning, study, teaching
![Page 6: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/6.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
66
Potential Visual SearchPotential Visual Search
![Page 7: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/7.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
77
Content Vis. in Variations2Content Vis. in Variations2
Primary focus is on user-created, user-Primary focus is on user-created, user-manipulated techniquesmanipulated techniques
Driven by curriculum, disciplineDriven by curriculum, discipline
![Page 8: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/8.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
88
Visualization in Variation2Visualization in Variation2
Stage 1: Score imagesStage 1: Score images Bookmarks add minimal visualizationBookmarks add minimal visualization
![Page 9: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/9.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
99
Visualization in Variations2Visualization in Variations2
Stage 2: TimelinerStage 2: Timeliner Diagrams large-scale structureDiagrams large-scale structure Initially tied to recording onlyInitially tied to recording only
![Page 10: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/10.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1010
Visualization in Variations2Visualization in Variations2
Stage3: Annotation toolsStage3: Annotation tools Drawing, text, smart-labelsDrawing, text, smart-labels Designed for showing Designed for showing
![Page 11: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/11.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1111
Visualization in Variations2Visualization in Variations2
Stage 4: Encoded scoresStage 4: Encoded scores Display of selected partsDisplay of selected parts ColorColor AnnotationAnnotation Analytic notationAnalytic notation
![Page 12: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/12.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1212
Other Views (Audio)Other Views (Audio)
Spectrograms (auto)Spectrograms (auto) Self-similarity graphs (auto, with Self-similarity graphs (auto, with
parameters)parameters)
![Page 13: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/13.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1313
Other Views (Symbolic)Other Views (Symbolic)
Lerdahl & Jackendoff tree diagrams (user)Lerdahl & Jackendoff tree diagrams (user)
![Page 14: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/14.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1414
Other ViewsOther Views
Line graphsLine graphs Pitches in Bartók, Pitches in Bartók, Music for Strings, Perc. and Music for Strings, Perc. and
CelesteCeleste, I (Brinkman & Mesiti 1991), I (Brinkman & Mesiti 1991)
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
![Page 15: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/15.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1515
Other ViewsOther Views
Harmonic regions (“keyscape”) in Bach, C Harmonic regions (“keyscape”) in Bach, C Major Prelude (Craig Sapp)Major Prelude (Craig Sapp)
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
![Page 16: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/16.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1616
Other ViewsOther Views
Timelines, “pattern repetition”Timelines, “pattern repetition” http://turbulence.org/Works/song/index.htmlhttp://turbulence.org/Works/song/index.html
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
![Page 17: Content Visualization in a Digital Music Library Eric J. Isaacson Assoc. Prof. of Music Theory Indiana University School of Music This material is based.](https://reader035.fdocuments.in/reader035/viewer/2022062716/56649dd25503460f94ac8974/html5/thumbnails/17.jpg)
IVIRA 2003IVIRA 2003 Isaacson, Content Visualization in a Digital MusiIsaacson, Content Visualization in a Digital Music Libraryc Library
1717