Cognitive Web Annotation Using Multiple Sensory Channels

This paper illustrates a multimodal system allowing students engaged in web based didactic activities to enrich the web pages with annotations in different formats: textual, audio and video, using different cognitive strategies. The system was designed taking into consideration research results from various disciplines, including cognitive learning theories and particularly the application of metacognition for text comprehension, studies on Human Computer Interaction (HCI) and the use of multi-channel interactions.