Department of Computational Perception

TV & RADIO ANALYSIS

Given the gigantic and constantly growing amount of audiovisual material that is archived in digital form, there is a tremendous need in the media industry for methods that automatically extract semantic information from audiovisual data streams. In order to index and effectively search in huge multimedia databases, we need computers that can detect and name all sorts of recognisable sound objects in audio streams. (The image to the right pertains to a real-world application, where TV channels are automatically monitored for the presence of music (in the foreground or background), using a music detection algorithm developed by us (in cooperation with the Austrian Research Institute for Artificial Intelligence, Vienna). Example topics: Music audio fingerprinting Detection of specific musical instruments Automatic detection of commercials in TV and radio Jingle detection and recognition Speech detection and classification (male/female, one/several, ...) Language identification from spoken language Speaker recognition Video genre classification based on analysis of the soundtrack Automatic segmentation of music/audio soundtracks into coherent sections Identifying suited speakers for dubbing (Finden stimmähnlicher SprecherInnen zum Synchronisieren von  fremdsprachigen Filmen; Kontakt: D. Schnitzer, G. Widmer) Contact: Reinhard Sonnleitner, Gerhard Widmer

last edited by pk on May 11, 2012