|
|
|
Contact:
Contact information is not available.
|
Projects |
Back to Top |
Publications |
Back to Top |
Multimodal Interactions with an Instrumented Shelf
Rainer Wasinger, Michael Schneider, Jörg Baus, Antonio Krüger
Workshop on Artificial Intelligence in Mobile Systems (AIMS) at UbiComp, 2004, pp. 36-43.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper, we describe the initial implementation of our application demonstrator called ‘ShopAssist’. This application will aid users in product queries within a shopping scenario context. We describe the wide range of input modalities that our application supports such as speech, handwriting, intra and extra gestures, and the mixed modality combinations that promote advanced user interaction with real-world and virtual objects.
REAL: Situated Dialogues in Instrumented Environments
C. Stahl, J. Baus, A. Krüger, D. Heckmann, R. Wasinger, M. Schneider
Workshop on Invisible and Transparent Interfaces at AVI 2004, Gallipoli, Italy, 2004, pp. 10-15.
[pdf]
[BibTeX]
show abstract
We give a survey of the research project REAL, where we investigate how a system can proactively assist its user in solving different tasks in an instrumented environment by sensing implicit interaction and utilising distributed presentation media. First we introduce
the architecture of our instrumented environment, which uses a blackboard to coordinate the components of the environment, such as the sensing and positioning services and interaction devices. A ubiquitous user model provides contextual information on the users
characteristics, actions and locations. The user may access and control their profile via a web interface. In the following, we present two mobile applications to employ the environmental support for situated dialogues, a shopping assistant and a pedestrian navigation system. Both applications allow for multi-modal interaction through a combination of speech, gesture and sensed actions such as motion.
SearchLight - A Lightweight Search Function for Pervasive Environments
Andreas Butz, Michael Schneider, Mira Spassova
Pervasive Computing, Second International Conference
[pdf]
[BibTeX]
show abstract
We present a lightweight search function for physical objects
in instrumented environments. Objects are tagged with optical
markers which are scanned by a steerable camera and
projector unit on the ceiling. The same projector can then
highlight the objects when given the corresponding marker
ID. The process is very robust regarding calibration, and no
3D model of the environment is needed. We discuss the scenario
of finding books in a library or office environment and
several extensions currently under development.