An interactive multimedia system for treating autism spectrum disorder

A system for real-time gesture tracking is presented, used in active well-being self-assessment activities and in particular applied to medical coaching and music-therapy. The system is composed of a gestural interface and a computer running own (custom) developed software. During the test sessions a person freely moves his body inside a specifically designed room. The algorithms detect and extrapolate features from the human figure, such us spatial position, arms and legs angles, etc. An operator can link these features to sounds synthesized in real time, following a predefined schema. The augmented interaction with the environment helps to improve the contact with reality in subjects having autism spectrum disorders (ASD). The system has been tested on a set of young subjects and a team of psychologists has analyzed the results of this experimentation. Moreover, we started to work on graphical feedback in order to realize a multichannel system.