Criteria, Challenges and Opportunities for Gesture Programming Languages

An increasing number of today’s consumer devices such as mobile phones or tablet computers are equipped with various
sensors. The extraction of useful information such as gestures from sensor-generated data based on mainstream imperative languages is a notoriously difficult task. Over the last few years, a number of domain-specific programming languages have been proposed to ease the development of gesture detection. Most of these languages have adopted a declarative approach allowing programmers to describe their gestures rather than having to manually maintain a history of event data and intermediate gesture results. While these declarative languages represent a clear advancement in gesture detection, a number of issues are still unresolved. In this paper we present relevant criteria for gesture detection and provide an initial classification of existing solutions based on these criteria in order to foster a discussion and identify opportunities for future gesture programming languages.
Publication Reference
Hoste, L. and Signer, B.: "Criteria, Challenges and Opportunities for Gesture Programming Languages", Proceedings of EGMI2014, 1st International Workshop on Engineering Gestures for Multimodal Interfaces, Rome, Italy, June, 2014