Department of Computational Perception
Department of
Computational Perception
Johannes Kepler Universitšt Linz

Home  –  Mission  –  Teaching  –  People  –  Research  –  Media  –  Awards  –  Impressum

Multimedia Search and Retrieval

344.038, KV, 3h (4.5 ECTS), WS 2013/14

Assist.-Prof. Dr. Markus Schedl
Univ.-Ass. Dr. Peter Knees

Time: Wednesday, 13:45-16:15
Start: Wednesday, Oct. 9, 2013
Location: K 001A

This class will be taught in English.

Class Objectives and Content

Students will learn the basics in multimedia processing and analysis (feature extraction, feature analysis, pattern discovery, information visualization), which are required to understand and build multimedia information systems. We will first cover the four most important types of multimedia data (text, audio/music, image, video) individually, focusing on particularities of each data source and on aspects of feature extraction and data cleaning. After the first set of lectures, students will have acquired a solid knowledge in state-of-the-art feature extraction techniques. Hereafter, methods to analyze the extracted features will be discussed, in particular, methods of data analysis for pattern discovery and visualization. This will be complemented by a practical project in which students will apply the techniques learned.

The main topics covered include:

Practical Exercise

The task to be solved in the practical exercise is to predict the most suitable music soundtrack for a TV commercial, from a list of candidate songs. Given a TV commercial (video), students are required to use a wide range of multimedia features (text, music, image/video), experiment with fusion techniques, and elaborate algorithms to select suitable music from a real-world collection of 5000 songs. This is a challenging task, in which multimodal information sources should be considered, which do not trivially connect to each other.

The practical exercise will be carried out in groups of four. Information related to the task can be found here, more details are given in the first lecture.


last edited by pk on Sep 11, 2013