generative (& interactive) installation (2012)
As an interactive experience, the TimeTravel Explorations installation consists of surround sound, two video projections, and a visitor feedback device. The audiovisual material - recordings of Chinese instruments and saxophones, and landscape images from Singapore and Norway - has been ‘precomposed’ through an interactive process involving musicians, producing a database with more than 1000 specific associations between short bits of recorded audio and partial clips of video. When running, the TimeTravel Explorations software uses this database to create new combinations in an infinite number of ways. The visitors (the audience) are invited to participate by providing real-time feedback to the system via a simple interface. Their feedback is added to the database as ‘preference weightings’ that continuously influence which new combinations the system generates. Whilst the interactive feedback device is not immediately responsive in a push-button way, the installation is designed as a ‘slow’ interactive process; a user-centered systems design with a real-time feedback loop. It lets the visitor immerse in the experience while exploring the content, and puts her in a mood of quiet reflection. Presented at WOCMAT (30 November - 1 December 2012) in Taiwan.
Below is a YouTube film clip, showing an arbitrary slice of the generative installation. Binaural audio - use headphones to hear the spatialisation of instruments! Caveat: the binaural encoding used is KEMAR, which doesn't take into account the individual variations of your HRTF. Please note that the YouTube film clip is an arbitrary instance of a generative piece. In the installation, a MaxMSP patcher is used to recombine, in a logical way, a large number of audiovisual associations (at the Taiwan installation, 680 audio and video files were used, each with a duration of between 2 and 20 seconds).
TimeTravel Explorations is the continuation of TimeTravel - tune in, a networked audiovisual performance between Norway and Singapore earlier this year between Tromsø’s Nordlys Festival and Nanyang Technological University’s Innovation Centre. The creative team of 15 musicians, programmers and designers was led by PerMagnus Lindborg. Here, we investigated real-time music performance over network, supported by video, through a series of open rehearsals and a final concert on Internet, 31 January -- 2 February 2012.