Department of Computational Perception
Department of
Computational Perception
Johannes Kepler Universit+AOQ-t Linz


Home  –  Mission  –  Teaching  –  People  –  Research  –  Media  –  Impressum


MUSIC RETRIEVAL BEYOND SIMPLE AUDIO SIMILARITY

Project Title: Music Retrieval Beyond Simple Audio Similarity

Sponsor: Austrian National Science Fund (Fonds zur Förderung der wissenschaftlichen Forschung, FWF)

Project Number: L511-N15

Duration: 48 months (May 2008 April 2012)

In cooperation with: Austrian Research Institute for Artificial Intelligence (OFAI), Vienna Intelligent Music Processing and Machine Learning Group

Persons involved:

Gerhard Widmer (Project Leader)
Peter Knees
Tim Pohle
Klaus Seyerlehner
Dominik Schnitzer
Reinhard Sonnleitner
Florian Krebs
Markus Schedl

Abstract

Digital music archives have reached capacities nowadays that require 'intelligent' computational methods to assist the user in finding and retrieving desired music. Responding to these demands, the still growing research field of Music Information Retrieval (MIR) develops techniques to facilitate access to music. The previous FWF project L112 "Operational Models of Music Similarity for Music Information Retrieval" enabled us to deepen our expertise in intelligent music audio processing and assessment of musical similarity, and to develop computational methods that are now finding their way into practical applications. Additionally, we undertook first steps towards extracting relevant (meta-)information on the work of musical artists from the Internet. The goal of this new project is to substantially advance this latter work on Web-based music information retrieval, and to develop robust methods that can be used as a basis for commercially relevant application projects.

In particular, we will carry out research to accomplish 4 main goals:

The outcome of this research will be a set of Web-based methods to derive manifold types of music-related information, independent of commercial search engines. Using these methods, many new services will become possible, such as music information systems that autonomously collect and edit artist related data and discover connections between them, or music search engines that can be queried through meaningful natural language expressions. Existing content-based music services will also benefit from these complementary sources of information.

Publications

Indexing Content-Based Music Similarity Models for Fast Retrieval in Massive Databases

D. Schnitzer

Dissertation, Johannes Kepler University Linz, October 2011.

>>PDFPDF

Content-Based Music Recommender Systems: Beyond simple Frame-Level Audio Similarity

K. Seyerlehner.

Dissertation, Johannes Kepler University Linz, December 2010.

(Received Award of Excellence 2011 by the Austrian Federal Ministry of Science and Research BMWF)

>>PDFPDF

Text-Based Description of Music for Indexing, Retrieval, and Browsing

P. Knees.

Dissertation, Johannes Kepler University Linz, November 2010.

>>PDFPDF

Automatic Characterization of Music for Intuitive Retrieval

T. Pohle.

Dissertation, Johannes Kepler University Linz, 2009.

>>PDFPDF



Effects of Album and Artist Filters in Audio Similarity Computed for Very Large Music Databases
A. Flexer and D. Schnitzer.
Computer Music Journal, 34(3):20–28, 2010.

An Audio-Visual Approach to Web Video Categorization

B. Ionescu, K. Seyerlehner, I. Mironica, C. Vertan, and P. Lambert.

Multimedia Tools and Applications, Special Issue on Multimedia on the Web, May 2012. 


Video Genre Categorization and Representation using Audio-Visual Information
B. Ionescu, K. Seyerlehner, C. Rasche, C. Vertan, and P. Lambert.

SPIE - Journal of Electronic Imaging, 2012. 


A Fast Audio Similarity Retrieval Method for Millions of Music Tracks
D. Schnitzer, A. Flexer and G. Widmer.
Multimedia Tools and Applications, 58(1), 23-40, May 2012.


A Music Information System Automatically Generated via Web Content Mining Techniques
M. Schedl, G. Widmer, P. Knees, T. Pohle.
Information Processing & Management, volume 47, pp. 426-439, 2011


Exploring the Music Similarity Space on the Web
M. Schedl, T. Pohle, P. Knees, and G. Widmer.
ACM Transactions on Information Systems, volume 29, number 3, article 14, 2011


Enlightening the Sun: A User Interface to Explore Music Artists via Multimedia Content

M. Schedl and T. Pohle.

Multimedia Tools and Applications: Special Issue on Semantic and Digital Media Technologies, volume 49, number 1, August 2010.

>>PDFPDF



A Simple and Effective Spectral Feature for Speech Detection in Mixed Audio Signals
R. Sonnleitner, B. Niedermayer, G. Widmer, and J. Schlüter.
In Proceedings of the 15th International Conference on Digital Audio Effects (DAFx-12),
York, UK, September 2012. 
>>PDFPDF

Unsupervised Feature Learning for Speech and Music Detection in Radio Broadcasts
J. Schlüter and R. Sonnleitner.
In Proceedings of the 15th International Conference on Digital Audio Effects (DAFx-12),
York, UK, September 2012. 
>>PDFPDF

Content-based Video Description for Automatic Video Genre Categorization
B. Ionescu, K. Seyerlehner, Ch. Rasche, C. Vertan, and P. Lambert.
In Proceedings of the 18th International Conference on MultiMedia Modelling (MMM2012),
Klagenfurt, Austria, 2012. 

Towards Semantic Music Information Extraction from the Web Using Rule Patterns and Supervised Learning
P. Knees and M. Schedl.
Proceedings of the 2nd Workshop on Music Recommendation and Discovery (WOMRAD 2011) in conjunction with the 5th ACM Conference on Recommender Systems (RecSys 2011),
Chicago, IL, USA, October 23, 2011.
>>PDFPDF

Investigating the Similarity Space of Music Artists on the Micro-Blogosphere
M. Schedl, P. Knees, and S. Böck.
Proceedings of the 12th International Society for Music Information Retrieval Conference (ISMIR 2011),
Miami, FL, USA, October 24-28, 2011.
>>PDFPDF

Using Mutual Proximity to Improve Content-Based Audio Similarity
D. Schnitzer, A. Flexer, M. Schedl, and G. Widmer.
Proceedings of the 12th International Society for Music Information Retrieval Conference (ISMIR 2011),
Miami, FL, USA, October 24-28, 2011.
>>PDFPDF

An Approach to Automatic Music Band Member Detection Based on Supervised Learning
P. Knees.
Proceedings of the 9th International Workshop on Adaptive Multimedia Retrieval (AMR 2011),
Barcelona, Spain, July 18-19, 2011.
>>PDFPDF

Personalization in Multimodal Music Retrieval
M. Schedl and P. Knees.
Proceedings of the 9th International Workshop on Adaptive Multimedia Retrieval (AMR 2011),
Barcelona, Spain, July 18-19, 2011.
>>PDFPDF

Analyzing the Potential of Microblogs for Spatio-Temporal Popularity Estimation of Music Artists.
M. Schedl.
Proceedings of the IJCAI 2011: International Workshop on Social Web Mining,
Barcelona, Spain, July 2011.
>>PDFPDF

Large-Scale Music Exploration in Hierarchically Organized Landscapes Using Prototypicality Information
M. Schedl, C. Höglinger, and P. Knees.
Proceedings of the ACM International Conference on Multimedia Retrieval (ICMR 2011),
Trento, Italy, April 2011.
>>PDFPDF BibTexBibTeX

A Comparison of Human, Automatic and Collaborative Music Genre Classification and User Centric Evaluation of Genre Classification Systems
K. Seyerlehner, G. Widmer, and P. Knees.
Proceedings of the 8th International Workshop on Multimedia Retrieval (AMR 2010),
Linz, Austria.
>>PDFPDF

A High-Level Audio Feature for Music Retrieval and Sorting
T. Pohle, P. Knees, K. Seyerlehner, and G. Widmer.
Proceedings of the 13th International Conference on Digital Audio Effects (DAFx-10),
Graz, Austria, September 2010.

Fusing Block-Level Features for Music Similarity Estimation
K. Seyerlehner, G. Widmer, and T. Pohle.
Proceedings of the 13th International Conference on Digital Audio Effects (DAFx-10),
Graz, Austria, September 2010.

Limitations of interactive music recommendation based on audio content
A. Flexer, M. Gasser, D. Schnitzer.
Proceedings of Audio Mostly 2010,
Pitea, Sweden, September 2010.

Automatic Music Tag Classification based on Block-Level Features
K. Seyerlehner, G. Widmer, M. Schedl, and P. Knees.
Proceedings of the 7th Sound and Music Computing Conference (SMC 2010),
Barcelona, Spain, July 2010.

What's Hot? Estimating Country-Specific Artist Popularity
M. Schedl, T. Pohle, N. Koenigstein, and P. Knees
Proceedings of the 11th International Society for Music Information Retrieval Conference (ISMIR 2010),
Utrecht, the Netherlands, August 2010.

On the Use of Microblogging Posts for Similarity Estimation and Artist Labeling
M. Schedl.
Proceedings of the 11th International Society for Music Information Retrieval Conference (ISMIR 2010),
Utrecht, the Netherlands, August 2010.

Supervised and Unsupervised Web Document Filtering Techniques to Improve Text-Based Music Retrieval
P. Knees, M. Schedl, T. Pohle, K. Seyerlehner, and G. Widmer.
Proceedings of the 11th International Society for Music Information Retrieval Conference (ISMIR 2010),
Utrecht, the Netherlands, August 2010.

Islands of Gaussians: The Self Organizing Map and Gaussian Music Similarity Features
D. Schnitzer, A. Flexer, G. Widmer, and M. Gasser.
Proceedings of the 11th International Society for Music Information Retrieval Conference (ISMIR 2010),
Utrecht, the Netherlands, August 2010.
>>PDFPDF

Combining Features Reduces Hubness in Audio Similarity
A. Flexer, D. Schnitzer, M. Gasser, and T. Pohle.
Proceedings of the 11th International Society for Music Information Retrieval Conference (ISMIR 2010),
Utrecht, the Netherlands, August 2010.
>>PDFPDF

Country of Origin Determination via Web Mining Techniques
M. Schedl, C. Schiketanz, and K. Seyerlehner.
Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2010): 2nd International Workshop on Advances in Music Information Research (AdMIRe 2010),
Singapore, July 2010.

Three Web-based Heuristics to Determine a Person's or Institution's Country of Origin
M. Schedl, K. Seyerlehner, D. Schnitzer, G. Widmer, and C. Schiketanz.
Proceedings of the 33th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2010),
Geneva, Switzerland, July 2010.

Context-based Music Similarity Estimation

M. Schedl and P. Knees.

Proceedings of the 3rd International Workshop on Learning the Semantics of Audio Signals (LSAS 2009),
Graz, Austria, December 2nd, 2009.

>>PDFPDF

On the Limitations of Browsing Top-N Recommender Systems

K. Seyerlehner, A. Flexer, and G. Widmer.

Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys'09),
New York, USA, October 22-25, 2009.

Augmenting Text-Based Music Retrieval with Audio Similarity

P. Knees, T. Pohle, M. Schedl, D. Schnitzer, K. Seyerlehner, and G. Widmer.

Proceedings of the 10th International Society for Music Information Retrieval Conference (ISMIR'09),

Kobe, Japan, October 26-30, 2009.

>>PDFPDF

On Rhythm and General Music Similarity

T. Pohle, D. Schnitzer, M. Schedl, P. Knees, and G. Widmer.

Proceedings of the 10th International Society for Music Information Retrieval Conference (ISMIR'09),

Kobe, Japan, October 26-30, 2009.


Browsing Music Recommendation Networks

K. Seyerlehner, P. Knees, D. Schnitzer, and G. Widmer.

Proceedings of the 10th International Society for Music Information Retrieval Conference (ISMIR'09),

Kobe, Japan, October 26-30, 2009.

>>PDFPDF

A Filter-and-Refine Indexing Method for Fast Similarity Search in Millions of Music Tracks

D. Schnitzer, A. Flexer, and G. Widmer.

Proceedings of the 10th International Society for Music Information Retrieval Conference (ISMIR'09),

Kobe, Japan, October 26-30, 2009.

>>PDFPDF

The ISMIR Cloud: A Decade of ISMIR Conferences at Your Fingertips

Grachten, M., Schedl, M., Pohle, T. and Widmer, G.

Proceedings of the 10th International Society for Music Information Retrieval Conference (ISMIR'09),

Kobe, Japan, October 26-30, 2009.

>>PDFPDF

Informed Selection of Frames for Music Similarity Computation

K. Seyerlehner, T. Pohle, G. Widmer, and D. Schnitzer.

Proceedings of the 12th International Conference on Digital Audio Effects (DAFx-09),
Como, Italy, September 1-4, 2009
>>PDFPDF

Album and Artist Effects for Audio Similarity at the Scale of the Web

A. Flexer and D. Schnitzer.
Proceedings of the 6th Sound and Music Computing Conference (SMC'09),
Porto, Portugal, 2009.
>>PDFPDF

Exploring Music Artists via Descriptive Terms and Multimedia Content

M. Schedl and T. Pohle

Proceedings of the 3rd International Conference on Semantic and Digital Media Technologies (SAMT 2008),

Koblenz, Germany, December 3-5, 2008.

>>PDFPDF

sound/tracks: Real-Time Synaesthetic Sonification of Train Journeys
P. Knees, T. Pohle, and G. Widmer.
Proceedings of the 16th ACM International Conference on Multimedia (MM'08) - Interactive Arts Exhibition,
Vancouver, BC, Canada, October 27-November 1, 2008.

>>PDFPDF PostscriptPS BibTexBibTeX

sound/tracks: Real-Time Synaesthetic Sonification and Visualisation of Passing Landscapes
T. Pohle, P. Knees, and G. Widmer.
Proceedings of the 16th ACM International Conference on Multimedia (MM'08) - Interactive Arts Program,
Vancouver, BC, Canada, October 27-November 1, 2008.

>>PDFPDF PostscriptPS BibTexBibTeX

Oh Oh Oh Whoah! Towards Automatic Topic Detection in Song Lyrics
F. Kleedorfer, P. Knees, and T. Pohle.
Proceedings of the 9th International Conference on Music Information Retrieval (ISMIR'08),
Philadelphia, PA, USA, September 14-18, 2008.

>>PDFPDF

StreamCatcher - Integrated Visualization of Music Clips and Online Audio Streams
M. Gasser, A. Flexer, and G. Widmer.
Proceedings of the 9th International Conference on Music Information Retrieval (ISMIR'08),
Philadelphia, PA, USA, September 14-18, 2008.

>>PDFPDF

Accessing Music Collections via Representative Cluster Prototypes in a Hierarchical Organization Scheme
M. Dopler, M. Schedl, T. Pohle, and P. Knees.
Proceedings of the 9th International Conference on Music Information Retrieval (ISMIR'08),
Philadelphia, PA, USA, September 14-18, 2008.

>>PDFPDF BibTexBibTeX

Frame-level Audio Similarity - A Codebook Approach
K. Seyerlehner, G. Widmer, and P. Knees
Proceedings of the 11th International Conference on Digital Audio Effects (DAFx-08),

Espoo, Finland, September 1-4, 2008.

>>PDFPDF

A Deeper Look into Web-based Classification of Music Artists
P. Knees, M. Schedl, and T. Pohle.
Proceedings of the (LSAS 2008),
Paris, France, June 21st, 2008.

>>PDFPDF PostscriptPS BibTexBibTeX

Investigating Different Term Weighting Functions for Browsing Artist-Related Web Pages by Means of Term Co-Occurrences
M. Schedl and P. Knees.
Proceedings of the (LSAS 2008),
Paris, France, June 21st, 2008.

>>PDFPDF BibTexBibTeX




A Refined Block-Level Feature Set for Classification, Similarity and Tag Prediction

K. Seyerlehner, M. Schedl, P. Knees, and R. Sonnleitner.

Extended Abstract to the Music Information Retrieval Evaluation eXchange (MIREX 2011),

Miami, FL, USA, October 2011.


Using Block-Level Features for Genre Classification, Tag Classification, and Music Similarity Estimation

K. Seyerlehner, M. Schedl, T. Pohle, and P. Knees.

Extended Abstract to the Music Information Retrieval Evaluation eXchange (MIREX 2010),

Utrecht, the Netherlands, August 2010.


Comparing Sounds and the Organisation of their Onsets in Time

T. Pohle and D. Schnitzer.

6th Annual Music Information Retrieval eXchange (MIREX 2009),

Kobe, Japan, October, 2009.

>>PDFPDF



last edited by pk on October 29, 2012