Department of Computational Perception - FWF Project L112-N04

Department of

Computational Perception

Home – Mission – Teaching – People – Research – Media – Impressum

Operational Models of Music Similarity for Music Information Retrieval

Project Title: Operational Models of Music Similarity for Music Information Retrieval

Sponsor: Austrian National Science Fund (Fonds zur Förderung der wissenschaftlichen Forschung, FWF), Project Number: L112-N04

Duration: 42 months (February 2005 – July 2008)

In cooperation with: Austrian Research Institute for Artificial Intelligence (ÖFAI), Vienna – Machine Learning, Data Mining, and Intelligent Music Processing Group

Persons involved:

Peter Knees
Tim Pohle
Klaus Seyerlehner
Markus Schedl
Gerhard Widmer

Abstract

The rapidly growing amount of music available in digital form via internet or digital libraries calls for entirely new computer-based methods for analysing, describing, distributing, and presenting music. The currently emerging research and application field known as Music Information Retrieval (MIR) is a direct response to that need. Over the past years, our research group has accumulated substantial expertise in intelligent music processing. The goal of this project is to develop our know-how and methods further along three specific lines, to the point where they can be used as a basis for commercially relevant application projects. In particular, the research goals are - to develop computational models and metrics of music (audio) similarity that permit the computer to effectively `understand' which pieces of music may be considered similar by human listeners; - to develop new ways of using such similarity metrics to automatically structure large digital music collections according to musical criteria, into richly structured `music spaces'; - and to develop new methods for visualising such music spaces and permitting users to explore and browse through music collections structured in this way. The result of this will be a set of methods that can be used as a basis for computer systems that provide a rich variety of intelligent music services, such as content-based music collection organisation, search and retrieval of music files, automatic playlist generation, music recommendation -- services for which there is and will be a great demand in the rapidly developing era of digital music.

Publications

Exploring Music Collections in Virtual Landscapes
P. Knees, M. Schedl, T. Pohle, and G. Widmer.

IEEE MultiMedia, vol. 14, no. 3, pp. 46-54, 2007.

>>

"Reinventing The Wheel": A Novel Approach to Music Player Interfaces
T. Pohle, P. Knees, M. Schedl, E. Pampalk, and G. Widmer.
IEEE Transactions on Multimedia, vol. 9, no. 3, pp. 567-575, 2007.

>>

Musikalisch intelligente Computer: Anwendungen in der klassischen und populären Musik
G. Widmer.
Informatik Spektrum 28(5), pp. 363-368, 2005.

>>

Accessing Music Collections via Representative Cluster Prototypes in a Hierarchical Organization Scheme
M. Dopler, M. Schedl, T. Pohle, and P. Knees.
Proceedings of the 9th International Conference on Music Information Retrieval (ISMIR'08),
Philadelphia, PA, USA, September 14-18, 2008.

>>

Frame-level Audio Similarity - A Codebook Approach
K. Seyerlehner, G. Widmer, and P. Knees
Proceedings of the 11th International Conference on Digital Audio Effects (DAFx-08),

Espoo, Finland, September 1-4, 2008.

>>

A Deeper Look into Web-based Classification of Music Artists
P. Knees, M. Schedl, and T. Pohle.
Proceedings of the 2nd Workshop on Learning the Semantics of Audio Signals (LSAS 2008),
Paris, France, June 21st, 2008.

>>

A Document-centered Approach to a Natural Language Music Search Engine
P. Knees, T. Pohle, M. Schedl, D. Schnitzer, and K. Seyerlehner.
Proceedings of the 30th European Conference on Information Retrieval (ECIR'08),

Glasgow, Scotland, UK, March 30-April 3, 2008.
© Springer-Verlag, Published in the Lecture Notes in Computer Science (LNCS) series.

>>

Towards an Automatically Generated Music Information System via Web Content Mining
M. Schedl, P. Knees, T. Pohle, and G. Widmer.
Proceedings of the 30th European Conference on Information Retrieval (ECIR'08),

Glasgow, Scotland, UK, March 30-April 3, 2008.
© Springer-Verlag, Published in the Lecture Notes in Computer Science (LNCS) series.

>>

One-Touch Access to Music on Mobile Devices

D. Schnitzer, T. Pohle, P. Knees, and G. Widmer.

Proceedings of the 6th International Conference on Mobile and Ubiquitous Multimedia (MUM 2007),

Oulu, Finland, December 12-14, 2007. (Best Student Paper Award)

>>

Browsing the Web Using Stacked Three-Dimensional Sunbursts to Visualize Term Co-Occurrences and Multimedia Content
M. Schedl, P. Knees, G. Widmer, K. Seyerlehner, and T. Pohle.
Proceedings of the IEEE Visualization 2007 (Vis'07),

Sacramento, California, USA, October 2007.

>>

Automatic Music Detection in Television Productions
K. Seyerlehner, T. Pohle, M. Schedl, and G. Widmer.
Proceedings of the 10th International Conference on Digital Audio Effects (DAFx-07),

Bordeaux, France, September 2007.

>>

From Rhythm Patterns to Perceived Tempo
K. Seyerlehner, G. Widmer, D. Schnitzer.

Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR'07),

Vienna, Austria, September 23-27, 2007.

>>

Meaningfully Browsing Music Services
T. Pohle, P. Knees, M. Schedl, and G. Widmer.

Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR'07),

Vienna, Austria, September 23-27, 2007.

>>

Web-based Detection of Music Band Members and Line-Up
M. Schedl, G. Widmer, T. Pohle, and K. Seyerlehner.

Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR'07),

Vienna, Austria, September 23-27, 2007.

>>

Search & Select - Intuitively Retrieving Music from Large Collections
P. Knees.

Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR'07),

Vienna, Austria, September 23-27, 2007.

>>

A Music Search Engine Built upon Audio-based and Web-based Similarity Measures
P. Knees, T. Pohle, M. Schedl, and G. Widmer.

Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'07),

Amsterdam, the Netherlands, July 23-27, 2007.

>>

Searching for Music using Natural Language Queries and Relevance Feedback
P. Knees and G. Widmer.

Proceedings of the 5th International Workshop on Adaptive Multimedia Retrieval (AMR'07),

Paris, France, July 5-6, 2007.

>>

Automatically Detecting Members and Instrumentation of Music Bands via Web Content Mining
M. Schedl and G. Widmer.

Proceedings of the 5th International Workshop on Adaptive Multimedia Retrieval (AMR'07),

Paris, France, July 5-6, 2007.

>>

Building an Interactive Next-Generation Artist Recommender Based on Automatically Derived High-Level Concepts
T. Pohle, P. Knees, M. Schedl, and G. Widmer.
Proceedings of the 5th International Workshop on Content Based Multimedia Indexing (CBMI'07),
Bordeaux, France, June 25-27, 2007.

>>

The CoMIRVA Toolkit for Visualizing Music-Related Data
M. Schedl, P. Knees, K. Seyerlehner, and T. Pohle.
Proceedings of the 9th Eurographics/IEEE VGTC Symposium on Visualization (EuroVis'07),

Norrköping, Sweden, May 23-25 2007.

>>

Automatically Describing Music on a Map
P. Knees, T. Pohle, M. Schedl, and G. Widmer.
Proceedings of the 1st Workshop on Learning the Semantics of Audio Signals (LSAS 2006),
Athens, Greece, December 6th, 2006.

>>

Automatically Adapting the Structure of Audio Similarity Spaces
T. Pohle, P. Knees, M. Schedl, and G. Widmer.
Proceedings of the 1st Workshop on Learning the Semantics of Audio Signals (LSAS 2006),
Athens, Greece, December 6th, 2006.

>>

Investigating Web-Based Approaches to Revealing Prototypical Music Artists in Genre Taxonomies
M. Schedl, P. Knees, and G. Widmer.
Proceedings of the 1st IEEE International Conference on Digital Information Management (ICDIM'06),
Bangalore, India, December 6-8, 2006.

>>

Combining Audio-based Similarity with Web-based Data to Accelerate Automatic Music Playlist Generation
P. Knees, T. Pohle, M. Schedl, and G. Widmer.

Proceedings of the 8th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR'06),

Santa Barbara, California, USA, October 26-27, 2006.

>>

An Innovative Three-Dimensional User Interface for Exploring Music Collections Enriched with Meta-Information from the Web
P. Knees, M. Schedl, T. Pohle, and G. Widmer.

Proceedings of the 14th ACM International Conference on Multimedia (MM'06),

Santa Barbara, California, USA, October 23-27, 2006.

>>

Independent Component Analysis for Music Similarity Computation
T. Pohle, M. Schedl, P. Knees, and G. Widmer.
Proceedings of the 7th International Conference on Music Information Retrieval (ISMIR'06),
Victoria, Canada, October 8-12, 2006.

>>

Assigning and Visualizing Music Genres by Web-based Co-Occurrence Analysis
M. Schedl, T. Pohle, P. Knees, and G. Widmer.
Proceedings of the 7th International Conference on Music Information Retrieval (ISMIR'06),
Victoria, Canada, October 8-12, 2006.

>>

Towards Automatic Retrieval of Album Covers
M. Schedl, P. Knees, T. Pohle, and G. Widmer.
Proceedings of the 28th European Conference on Information Retrieval (ECIR'06),
London, UK, April 10-12, 2006.

>>

Interactive Poster: Using CoMIRVA for Visualizing Similarities Between Music Artists
M. Schedl, P. Knees, and G. Widmer.
Proceedings of the IEEE Visualization 2005 (Vis'05),
Minneapolis, Minnesota, October 2005.

>>

Improving Prototypical Artist Detection by Penalizing Exorbitant Popularity
M. Schedl, P. Knees, and G. Widmer.
Proceedings of the 3rd International Symposium on Computer Music Modeling and Retrieval (CMMR'05),
Pisa, Italy, September 2005.

>>

Discovering and Visualizing Prototypical Artists by Web-based Co-Occurrence Analysis
M. Schedl, P. Knees, and G. Widmer.
Proceedings of the 6th International Conference on Music Information Retrieval (ISMIR'05), pp. 21-28,
London, UK, September 11-15, 2005.

>>

Multiple Lyrics Alignment: Automatic Retrieval of Song Lyrics
P. Knees, M. Schedl, and G. Widmer.
Proceedings of the 6th International Conference on Music Information Retrieval (ISMIR'05), pp. 564-569,
London, UK, September 11-15, 2005.

>>

From Sound to "Sense" via Feature Extraction and Machine Learning: Deriving High-level Descriptors for Characterising Music
G. Widmer, S. Dixon, P. Knees, E. Pampalk, and T. Pohle.
In Sound to Sense:Sense to Sound: A State-of-the-Art (S2S2 2005), Florence, Italy.

>>

Studio Report: The Maching Learning and Intelligent Music Processing Group at the Austrian Research Institute for Artificial Intelligence (OFAI)
G. Widmer, S. Dixon, A. Flexer, W. Goebl, P. Knees, S.T. Madsen, E. Pampalk, T. Pohle, M. Schedl, and A. Tobudic.
Proceedings of the 2005 International Computer Music Conference (ICMC2005),
Barcelona, Spain, September 2005.

>>

A Web-Based Approach to Assessing Artist Similarity using Co-Occurrences
M. Schedl, P. Knees, and G. Widmer.
Proceedings of the 4th International Workshop on Content-Based Multimedia Indexing (CBMI'05),
Riga, Latvia, June 2005.

>>

last edited by pk at 2008-12-17