Department of Computational Perception
Department of
Computational Perception
 Johannes Kepler Universität Linz

Home  –  Mission  –  Teaching  –  People  –  Research  –  Media  –  Awards  –  Impressum

ARTISTIC APPLICATIONS

<< back to overview


We are also interested in applying methods from Artificial Intelligence, Pattern Recognition, Signal Processing, Web Retrieval, etc. to the domains of interactive and digital arts. The following shows some projects currently under development at the department. If you have exciting and creative ideas for applying computational intelligence in an artistic context (for instance, by using new gesture and posture capture devices) do not hesitate to contact us!

sound/tracks

When travelling on a train and looking out of the window, the fleeting impressions of the moving scenery and the composition of the passing objects generate a piece of visual music with its own tempo and rhythm, its own colours and harmonies. The project sound/tracks aims at capturing these visual impressions and translates them into a musical composition in real-time. The view out of the window is captured with a camera and translated into instantaneously played back piano music. The passing scenery can be considered the score of a musical composition which is going to be interpreted based on outside conditions such as weather and lighting, the speed of the train, and the quality of the camera. Thus, every journey will produce a unique composition.

More details, background, and example videos on the sound/tracks project page

Examples for projects:
  • Implementing sound/tracks on iPhone, iPad 2, or Android devices
  • Experimenting with different image-to-music transformations
  • Optical Flow Estimation (offline and online)
  • Object/scenery reconstruction from recorded train journeys
  • Generating sounds from moving objects
  • Real-time music playlist generation based on surroundings
Contact: Peter Knees
sound/tracks - Tunnel near Mallnitz-Obervellach


Weltassoziator

The Weltassoziator is intended as a space that allows observation of machine cognition and association. Aspects of the world's knowledge are projected in the space, interact with each other, and organize autonomously. The presence of the visitor and the visitor's current focus of attention change priorities in concept association and initiate an interaction between visitor and machine. This stimulates a joint association process of human and artificial intelligence and ultimately leads to an intervowen stream of thoughts.

Examples for projects:
  • Capturing body movements
  • Determining a user's center of attention
  • Visualisation of "concept interaction" for large display projection
  • Efficient retrieval and caching of arbitrary multimedia objects from the Web
Contact: Andreas Arzt


last edited by pk on 2012-02-20