A Framework for Designing and Recognizing Sketch-Based Libraries for Pervasive Systems

Sketch-based interfaces enable users to effortless and powerfully communication way to represent concepts and/or commands, in different application domains, on different devices. Developing of a sketch-based interface for recognizing each specific domain is a timeconsuming operation that requires the re-engineering and/or the redesigning of the whole recognition framework. The sketch-based interaction can be exploit in order to have a suitable modality to interact, in pervasive and ubiquitous way, with mobile information systems. Moreover, sketch-based interaction can be particularly profitable if used together with other modalities (such as: speech, gesture, text, and so on). In this paper we propose a general framework to define and to recognize each kind of 2D symbols library, besides the proposed approach allow us to add, by text and speech modalities, an additional semantic meaning to each symbol contained in the built library.