Header And Logo
Site Navigation
Dr.-Ing. Rainer Wasinger
|
|
|
Contact:
Contact information is not available.
This link might be dead
|
Website: http://www.ics.mq.edu.au/~wasinger/.
Projects |
Back to Top |
- COLLATE / m3i 2001-01-01 – 2006-12-31
Publications |
Back to Top |
2008
Three Output Planning Strategies for Use in Context-aware Computing Scenarios
Gerrit Kahl, Rainer Wasinger, Tim Schwartz, and Lübomira Spassova
Proceedings of the AISB 2008 Symposium on Multimodal Output Generation (MOG 2008), April 3 - April 4, 2008, Aberdeen, Scotland, UK
[pdf]
[BibTeX]
show abstract
In everyday life, it is useful for mobile devices like cell phones and PDAs to have an understanding of their user's surrounding context. Presentation output planning is one area where such context can be used to optimally adapt information to a user's current situational context. This paper outlines the architecture of a context-aware output planning module, as well as the design and implementation of three output generation strategies: user-define, symmetric multimodal, and context-based output planning. These strategies are responsible for selecting the best suited modalities (e.g. speech, gesture, text), for presenting information to a user situated in a public environment such as a shopping mall.
A central point of this paper is the identification of context with finite resources to obtain a private and/or public output. We show via a wording demonstrator the extent to which such factors can, with readily available technology, be incorporated into a system. The paper also outlines the set of reactions that a system might take when given context information on the user and the environment.
2007
Adaptive Mobile Guides
Antonio Krüger, Jörg Baus, Dominik Heckmann, Michael Kruppa, Rainer Wasinger
P. Brusilovsky, A. Kobsa, and W. Nejdl (Eds.): The Adaptive Web, LNCS 4321, pp. 521–549, 2007.
Springer-Verlag Berlin Heidelberg
show abstract
In this chapter we discuss various aspects of adaptive mobile
guide applications. After having motivated the need for web based
mobile applications, we will discuss technologies that are needed to enable
adaptive mobile web applications, including not only positioning
technologies but also sensor technologies needed to determine additional
information on the context and situation of usage. We will also address
issues of modeling context and situations before giving an overview on
existing systems coming from three important classes of mobile guides:
museum guides, navigation systems and shopping assistants. The chapter
closes with an extensive discussion of relevant attributes of web based
mobile guides.
Auditory Perceptible Landmarks in Mobile Navigation
Jörg Baus, Rainer Wasinger, Ilhan Aslan, Antonio Krüger, Andreas Maier, Tim Schwartz
Proceedings of IUI 07 (to appear)
[ DOWNLOAD NOTE ]
show abstract
Normally, mobile pedestrian navigation systems use visually
perceptible landmarks to guide their users through
the environment. In this article we introduce concepts
for the use of auditory perceptible landmarks in route
descriptions. Such auditory perceptible landmarks complement
their visual counterparts and also stand to be
beneficial for certain groups like the visually impaired
and the elderly.
2006
The Anthropomorphized Product Shelf: Symmetric Multimodal Interaction with Instrumented Environments
Rainer Wasinger, Wolfgang Wahlster
Chapter in: Emile Aarts and José Luis Encarnação (eds.): True Visions: The Emergence of Ambient Intelligence.
Heidelberg: Springer, 2006, in press (due out Feb.2006), ISBN: 3-540-28972-0.
[BibTeX]
show abstract
Ambient intelligence environments require robust and intuitive interfaces for accessing their embodied functionality. This chapter describes a new paradigm for tangible multimodal interfaces, in which humans can manipulate, and converse with physical objects in their surrounding environment via coordinated speech, handwriting and gesture. We describe the symmetric nature of human environment communication, and extend the scenario by providing our objects with human-like characteristics. This is followed by the results of a usability field study on user acceptance for anthropomorphized objects, conducted within a shopping context.
2005
Product Associated Displays in a Shopping Scenario
Lübomira Spassova, Rainer Wasinger, Jörg Baus, Antonio Krüger
4th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 05), 2005, pp. 210-211.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper, we introduce the concept of Product Associated
Displays – PADs – as a way of providing visual
feedback to users interacting with physical objects in an
instrumented environment. PADs are projected public displays
created at locations that can be intuitively associated
with the objects they show information about. The concept
is illustrated in a shopping scenario.
Integrating Intra and Extra Gestures into a Mobile and Multimodal Shopping Assistant
Rainer Wasinger, Antonio Krüger, Oliver Jacobs
Proc. of the 3rd International Conference on Pervasive Computing (Pervasive), 2005, pp. 297-314.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
Accompanying the rise of mobile and pervasive computing, applications now need to adapt to their surrounding environments and provide users with information in the environment in an easy and natural manner. In this paper we describe a user interface that integrates multimodal input on a handheld device with external gestures performed with real world artifacts. The described approach extends reference resolution based on speech, handwriting and gesture to that of real world objects that users may hold in their hands. We discuss the varied interaction channels available to users that arise from mixing and matching input modalities on the mobile device with actions performed in the environment. We also discuss the underlying components required in handling these extended multimodal interactions and present an implementation of our ideas in a demonstrator called the Mobile ShopAssist. This demonstrator is then used as the basis for a recent usability study that we describe on user interaction within mobile contexts.
Modality Preference - Learning from Users
Rainer Wasinger, Antonio Krüger
Workshop on User Experience Design for Pervasive Computing (Experience) at Pervasive, 2005.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
An important constituent for mobile and ubiquitous computing systems is the interface and the associated human-computer interactions. Mobile contexts have different design requirements to stationary desktop contexts. Although previous work has concentrated on stationary domains and unimodal systems, and more recently on multimodal systems, user evaluation for the use of different modality combinations is limited. In this paper, we outline the qualitative results from a recent usability study. These results form a general guideline in determining which base modalities and modality combinations to use when designing for mobile and ubiquitous environments.
2004
Multimodal Interactions with an Instrumented Shelf
Rainer Wasinger, Michael Schneider, Jörg Baus, Antonio Krüger
Workshop on Artificial Intelligence in Mobile Systems (AIMS) at UbiComp, 2004, pp. 36-43.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper, we describe the initial implementation of our application demonstrator called ‘ShopAssist’. This application will aid users in product queries within a shopping scenario context. We describe the wide range of input modalities that our application supports such as speech, handwriting, intra and extra gestures, and the mixed modality combinations that promote advanced user interaction with real-world and virtual objects.
Multi-modal Interaction with Mobile Navigation Systems
Rainer Wasinger, Antonio Krüger
W. Wahlster (Ed.): Special Journal Issue "Conversational User Interfaces", it - Information Technology 46 (2004) 6, München: Oldenbourg Wissenschaftsverlag (ISSN 1611-2776), 2004, pp. 322-331.
[BibTeX]
show abstract
Navigation systems have seen significant advancements in recent years. They now exist for desktop computers, automobiles, and mobile devices. They are able to adapt to many different situational contexts and now provide a solid foundation for a wide range of location based services. Mobile multi-modal interfaces have seen similar advancements over the past few years as technologies previously designed for powerful mainframe computers are gradually swept into the reach of mobile devices. This paper describes a multi-modal user interface that has been integrated into a pedestrian navigation service called the Personal Navigator, and a closely interleaved shopping assistant called the Mobile ShopAssist. We describe the wide range of input interaction and output presentation that we believe mobile systems should provide and describe the importance for context-aware systems to adapt their user interfaces to the surrounding environment.
REAL: Situated Dialogues in Instrumented Environments
C. Stahl, J. Baus, A. Krüger, D. Heckmann, R. Wasinger, M. Schneider
Workshop on Invisible and Transparent Interfaces at AVI 2004, Gallipoli, Italy, 2004, pp. 10-15.
[pdf]
[BibTeX]
show abstract
We give a survey of the research project REAL, where we investigate how a system can proactively assist its user in solving different tasks in an instrumented environment by sensing implicit interaction and utilising distributed presentation media. First we introduce
the architecture of our instrumented environment, which uses a blackboard to coordinate the components of the environment, such as the sensing and positioning services and interaction devices. A ubiquitous user model provides contextual information on the users
characteristics, actions and locations. The user may access and control their profile via a web interface. In the following, we present two mobile applications to employ the environmental support for situated dialogues, a shopping assistant and a pedestrian navigation system. Both applications allow for multi-modal interaction through a combination of speech, gesture and sensed actions such as motion.
The Connected User Interface: Realizing a Personal Situated Navigation Service
Antonio Krüger, Andreas Butz, Christian Müller, Christoph Stahl, Rainer Wasinger, Karl-Ernst Steinberg, Andreas Dirschl
In Proceedings of the 9th International Conference on Intelligent User Interfaces (IUI 2004), ACM Press, 2004, pp. 161-168.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
Navigation services can be found in different situations and contexts: while using the web with a desktop PC, in cars, and more recently also when being a pedestrian on PDAs. These services are usually well designed for their specific purpose, but fail to work in other situations. In this paper we present an approach that connects a variety of specialized user interfaces to achieve a personal navigation service spanning different situations. We describe the concepts behind the BPN (BMW Personal Navigator), an entirely implemented
system that combines a desktop event and route planner, a car navigation system, and a multi-modal, in- and outdoor pedestrian navigation system for a PDA. Rather than designing for one unified UI, we focus on connecting specialized UIs for desktop, in-car and on-foot use.
Concepts and issues in interfaces for multiple users and multiple devices
Christian Kray, Rainer Wasinger, Gerd Kortuem
Workshop on Multi-User and Ubiquitous User Interfaces (MU3I) at IUI/CADUI, 2004, pp. 7-12.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper, we identify and discuss several groups of issues that arise in the design of interfaces for multiple users interacting with multiple devices. We analyze in what ways these interfaces differ from traditional single-user single-device interfaces, and identify different characteristics of interfaces. We categorize a possible set of device types that may exist in an environment, and then discuss the fundamental issues that have to be addressed when designing multi-user multi-device interfaces. The focus is on user and device management, technical concerns and social concerns, and some of the topics discussed include coordination, assignment, sharing, load-limits, coverage, privacy concerns, and user alienation.
2003
Adapting Spoken and Visual Output for a Pedestrian Navigation System, based on given Situational Statements
Rainer Wasinger, Dominika Oliver, Dominik Heckmann, Bettina Braun, Boris Brandherm, Christoph Stahl
11th GI-Workshop on Adaptivity and User Modeling in Interactive Software Systems (ABIS-2003), Karlsruhe, 2003, pp. 343-346.
[pdf]
[BibTeX]
show abstract
As mobile devices become more and more complex, there is an increasing desire for these devices to adapt to their users. This paper identifies parameters for different input
sources (user, device and environment), and the parameters of media output (speech, graphics, sound and text), that may be modified to tailor user presentation in a pedestrian navigation system. We also provide an initial insight into some of the causal relationships between our input and output parameters, with a specific focus on the effects that speech can contribute to the presentation of media output.
Controlling multiple devices
Rainer Wasinger, Christian Kray, Christoph Endres
Physical Interaction (PI03) Workshop on Real World User Interfaces at MobileHCI, 2003, pp. 60-63.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
Two major differences between ubiquitous computing and a traditional desktop scenario consist of the number of users interacting simultaneously with a system, and the number of devices that they use. This paper focuses on the physical user interfaces problem of how device control is allocated, shared, and released by services and users. Based on a classification of different types of devices, we analyze in which ways a device can be controlled. We then identify several influencing factors in allocating devices, and conclude by sketching out a high-level strategy for the (semi) automatic handling of device allocation.
M3I in a Pedestrian Navigation & Exploration System
Rainer Wasinger, Christoph Stahl, Antonio Krüger
5th International Symposium on Human Computer Interaction with Mobile Devices (Mobile HCI 2003), Udine, Italy, September 8-11, 2003, Springer: Lecture Notes in Computer Science, Vol. 2795, Chittaro, Luca (Ed.), ISBN: 3-540-40821-5, pp. 481-485.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper, we describe a near-complete Pocket PC implementation of a mobile multi-modal interaction (M3I) platform for pedestrian navigation. The platform is designed to easily support indoor and outdoor navigation tasks, and uses several modalities for the presentation and user input. Whereas 2D/3D-graphics and synthesized speech are used to present useful information on routes and places, embedded speech and gesture recognition allow for situated user interaction.
Robust speech interaction in a mobile environment through the use of multiple and different media types
Rainer Wasinger, Christoph Stahl, Antonio Krüger
8th European Conference on Speech Communication and Technology (EUROSPEECH 2003 - INTERSPEECH 2003), Geneva, Switzerland, September 1-4, 2003, ISCA Archive, pp. 1049-1052.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
Mobile and outdoor environments have long been out of
reach for speech engines due to the performance limitations
that were associated with portable devices, and the
difficulties of processing speech in high-noise areas. This
paper outlines an architecture for increasing speech
recognition rates in a mobile pedestrian indoor/outdoor
navigation environment, through the use of a media fusion
knowledge component.
2002
Readapting Multimodal Presentations to Heterogenous User Groups
Antonio Krüger, Michael Kruppa, Christian Müller, Rainer Wasinger
Notes of the AAAI-Workshop on Intelligent and Situation-Aware Media and Presentations, Technical Report WS-02-08, AAAI Press, 2002, pp. 46-54.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
This article exploits the possibilities of mixed presentation modes in a situation where both public and private display screens as well as public and private audio channels can be accessed by the users. This will allow the users to share information with a group, while still being able to receive individual information at the same time. Special strategies are identified that readapt an already running public presentation to the interests of late arriving users. Following these strategies, the generation of multimodal presentations for both public and private devices is described.
Adapting Multimodal Dialog for the Elderly
Christian Müller, Rainer Wasinger
ABIS Workshop on Personalization for the Mobile World, 2002, pp. 31-34.
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper, we outline the design of a multimodal interface for a mobile pedestrian navigation system developed within the project COLLATE. The aim of the interface is to adapt to different resource limitations of the user. It takes into account the cognitive load of the user as well as the age. We present an approach on how special acoustic models for elderly speakers can improve speech recognition quality and at the same time provide an information source for user modeling. Three different presentation strategies are presented: unimodal (speech only, graphics only), redundant (speech and graphics providing the same information), and concurrent (minimally overlapped speech and graphics).