Real-time tracking of sound parameters in a multimedia system

Modern multimedia performances and presentations offer innovative methods for user interaction, in order to be more appealing to the audience. Following this trend and in collaboration with VIS S.r.l. (an SME in Rome), the Institute of Information Sciences and Technology (ISTI-CNR) has developed a system called Pandora, which controls real-time video effects applied to filmed or synthesized scenes by means of parameters extracted from sound signals. The system can be used both for artistic interactive multimedia performances and also for other non-artistic applications.