Thesis proposals for 2012-2013

MobiCraNT - Second Generation Mobile Cross-media Applications - Scalability, Heterogeneity and Legacy

The MobiCraNT project aims at the development of software engineering principles and patterns for the development of mobile cross-media applications that operate in a heterogenous distributed setting and interact using cross-media technology.

Mudra - A Unified Multimodal Interaction Framework

Mudra is a unified multimodal interaction framework supporting the integrated processing of low-level data streams as well as high-level semantic inferences. Our solution is based on a central fact base in combination with a declarative rule-based language to derive new facts at different abstraction levels. The architecture of the Mudra framework consists of three layers: At the infrastructure level, we support the incorporation of any arbitrary input modalities, including skeleton tracking via Microsoft’s Xbox Kinect, multi-touch via TUIO and Midas, voice recognition via CMU Sphinx and accelerometer data via SunSPOTs. In the core layer a very efficient inference engine (CLIPS) was substantially extended for the continuous processing of events. The application layer provides flexible handlers for end-user applications or fission frameworks, with the possibility to feed application-level entities back to the core layer.

Multimodal and Multi-Touch Interaction

We are developing multimodal and multi-touch interaction frameworks with a focus on the declarative definition of gestures and interaction patterns and the reusability as well as extensibility of existing gestures. Our solution supports the rapid prototyping and investigation of novel multimodal and multi-touch gestures.

Semantic Web Languages and Technology

Semantic Web technology and languages (like RDF(S) and OWL) is an important area in Web Engineering and for semantic interoperability. WISE is mainly using the results of research done in this domain, but we also contribute to it in the context of different research project.