RGB-D sensor-based platform for cognitive rehabilitation in Alzheimer disease

The paper presents an digital platform integrating advanced Natural User Interface technologies for multi-domain Cognitive Rehabilitation. The platform is made up of a set-top-box connected to a TV monitor with Internet connection, a commercial RGB-D sensor as interactive device and an optional e-shirt with textile electrodes for clinical signs detection. A novel hand tracking procedure has been implemented improving the interaction between the end-user and the Graphical User Interface designed for specific cognitive domains. For proper interaction, gestures of Alzheimer Disease's patients with mild form are acquired by the active vision sensor in the nominal functioning range, allowing 100% hands detection rate, useful for an error free human-machine interaction.