Thesis proposals for 2013-2014

Mudra - A Unified Multimodal Interaction Framework

Mudra is a unified multimodal interaction framework supporting the integrated processing of low-level data streams as well as high-level semantic inferences. Our solution is based on a central fact base in combination with a declarative rule-based language to derive new facts at different abstraction levels. The architecture of the Mudra framework consists of three layers: At the infrastructure level, we support the incorporation of any arbitrary input modalities, including skeleton tracking via Microsoft’s Xbox Kinect, multi-touch via TUIO and Midas, voice recognition via CMU Sphinx and accelerometer data via SunSPOTs. In the core layer a very efficient inference engine (CLIPS) was substantially extended for the continuous processing of events. The application layer provides flexible handlers for end-user applications or fission frameworks, with the possibility to feed application-level entities back to the core layer.

Multimodal and Multi-Touch Interaction

We are developing multimodal and multi-touch interaction frameworks with a focus on the declarative definition of gestures and interaction patterns and the reusability as well as extensibility of existing gestures. Our solution supports the rapid prototyping and investigation of novel multimodal and multi-touch gestures.

Semantic Web Languages and Technology

Semantic Web technology and languages (like RDF(S) and OWL) is an important area in Web Engineering and for semantic interoperability. WISE is mainly using the results of research done in this domain, but we also contribute to it in the context of different research project.  

Serious Games

The purpose of this research topic is to perform research on development methods for serious games, which are games used for training, advertising, simulation, or education.  

The goal of the development methods is to ease the development of serious games and to allow for a greater involvement of the different stakeholders during the development process. 

We also investigate adaptativity (i.e., dynamic adaptation) for serious games. which has the aim to adapt a serious games to different characteristics of the player as well as to the performance of the player. 

Furthermore, we investigate how non-player characters can be made more relalistic in their behavior and interaction.