Facilitating Multimodal Mobile Interaction
Type of Thesis:
Master Thesis Today‘s mobile applications typically run on PDAs, follow a client-server division, and rely on traditional user interfaces such as keyboard, stylus or touchscreen. This landscape is changing swiftly. On the one hand, we see the advent of smartphones featuring various sensors, RFID readers and GPS chips, blurring the distinction between clients and servers of information and thus inducing fluid information spaces. On the other hand, we see the rise of new interface modalities such as voice interaction, digital pen and paper, gestures and so on. The MobiCraNT project aims at the development of software engineering principles and patterns for the development of such applications.
In the scope of the MobiCraNT project, novel ways to interact with the content on smartphones will be explored, in particular by making use of multimodal interfaces. Those interfaces might be based on a number of different interaction channels, such as speech, touch, gestures, etc. This project focuses on exploring the different modalities accessible on state-of-the-art smartphones, and in particular the possibilities to mix those different modalities. A Google Maps-based Android application will further be used as a showcase application.
Background Knowledge:
- Java
Technical challenges:
- Catalogue modalities that are currently available on modern smartphones
- Explore meaningful context-dependant modalities combinations
- Develop a Google Maps-based Android application that can be controlled via different modalities
Contact:
Beat Signer
Contact:
Bruno Dumas
Academic Year:
2011-2012