|
|
||||
|
Address:
Saarland University
Building E 1 1
, Room 118
|
Projects |
Back to Top |
Publications |
Back to Top |
A Framework for Auditory Displays in Intelligent Environments
Ralf Jung
Proceedings of International Conference on Intelligent Environments 2010, July 18- July 21, 2010, Kuala Lumpur, Malaysia
show abstract
In this paper, a novel framework for Auditory Displays is presented that provides methods to notify persons in instrumented environments individually. The used non-speech audio cues are unnoticeable for others and they have no disturbing effect on attendees. On the symbolic level, the notification signals represent events and can be seamlessly embedded in an ambient soundscape running in the background of the listener’s attention. The type of notification depends on the user’s preferences as well as on his current situation and location.
Konsum und Handel zwischen digitalem Marketing, gläsernem Kunden und elektronischer Produktinformation
Ralf Jung and Gesche Roy
Loccumer Protokolle: "Chancen nutzen, Risiken minimieren! Unser zukünftiger Umgang mit allgegenwärtigen Informations- und Kommunikationstechnologien" (to appear)
show abstract
Die Informations- und Kommunikationstechnologie macht rasante Fortschritte. Mittlerweile sind die Geräte in der Lage, Unmengen von Daten zu erfassen, zu speichern und zu verwenden. Wenn überall und jederzeit Daten zu unterschiedlichsten Aktivitäten erfasst werden können, wenn eine technisch vermittelte Kommunikation zu jeder Zeit und an jedem Ort möglich ist und weite Bereiche unserer Infrastruktur automatisch gesteuert werden, hat das weit reichende Konsequenzen für die Arbeits- und Lebenswelt, die auf der Tagung unter dem Stichwort „Anytime, Anywhere Communication and Computing (AACC)“ diskutiert werden.
Non-Intrusive Audio Notification in Emotion Classified Background Music
Ralf Jung
Proceedings of International Conference on Acoustics 2010, April 19- 23, 2010, Baltimore, USA
The Shopping Experience of Tomorrow: Human-Centered and Resource-Adaptive
Wolfgang Wahlster, Michael Feld, Patrick Gebhard, Dominikus Heckmann, Ralf Jung, Michael Kruppa, Michael Schmitz, Lübomira Spassova and Rainer Wasinger
Matthew Crocker and Joerg Siekmann (eds). Resource-Adaptive Cognitive Processes. Cognitive Technologies Series. Springer Verlag Berlin, 2010, pp. 205-237
Innovative Retail Laboratory - Investigating Future Shopping Technologies
Antonio Krüger, Lübomira Spassova and Ralf Jung
it - Information Technology, Volume 52, Issue 2, Oldenbourg Verlag, pp. 114-118
show abstract
The Innovative Retail Laboratory (IRL) is an application-oriented research laboratory of the German Research Center for Artificial Intelligence (DFKI) run in collaboration with the German retailer GLOBUS SB-Warenhaus Holding in St. Wendel. In this living lab, we conduct research in a wide range of different domains all connected to intelligent shopping consultants, which range from a virtual assistant responsible for matters of dieting and allergies, over a digital sommelier, to personalized cross and up selling, smart items with digital product memories as a further development of the RFID technology, indoor positioning and navigation as well as new logistics concepts, to see if they are suitable for everyday life and useful for customers. New ways of customer interaction are developed and tested for implementation. The range varies from personalized shopping assistants to “talking” products and intelligent shopping carts, which plan and show the way through the store according to your shopping list. Furthermore they can give advice on what to buy for the recipes you have in mind, they compare products, point out special offers in a personalized way and give additional information about the products. However, the concepts and technologies that regard the self-service store of the future as a place for shopping are not IRL´s only focus. The relation between the store and its customers begins way before the shopping trip itself takes place. It starts with an individual shopping preparation and a personalized presentation of offers at home and will be continued afterwards through advice that is given about purchased goods and information about their use.
Ambiente Audionotifikation - Ein System zur kontext-sensitiven Integration von nicht-intrusiven Notifikationssignalen in emotionsklassifizierten Soundscapes
Ralf Jung
PhD Thesis, FR Informatik, Saarbrücken, Germany: Saarland University, 2009
[BibTeX]
show abstract
Besides the visual information presentation, the auditory modality is the most
common used modality in the area of Human-Computer Interaction. Audio signals
are generally used for warnings and acoustic feedback. Especially in environments
with many people, such signals often affect intrusively and distractive because of
their differentness compared to the natural sound environment.
In this thesis, the novel approach of Ambient Audionotification is presented that provides methods to notify persons individually. The used audio cues are unnoticeable
for others and they have no disturbing effect on attendees. On the symbolic level, the
novel Notification Instruments represent events and can be seamlessly embedded in
an ambient soundscape.
A novel notification hierarchy with three signal classes is introduced to realize a personalized and a context-aware notification method.
An analysis of musicpsychological models of emotion and an investigation of music
parameters that are well-known from musicology lead to a classification model for
soundscapes based on their emotional expression.
The effectiveness of the novel notification signals and the plausibility of the soundscape classification methods are confirmed by empirical studies.
A New Approach to Design and Evaluate Ambient Systems for Instrumented Environments
Ralf Jung and Tim Schwartz
Proceedings of International Conference on Intelligent Environments 2008, July 21- July 22, 2008, Seattle, USA
[BibTeX]
show abstract
In this paper we raise the question whether we can measure
the ambience of a system that is integrated in an existing
environment. This paper describes a new approach for de-
signing and developing ambient systems. Other than the
traditional software development concepts, we concentrate
on the challenges of ambient designs. First, we give a mo-
tivation why it would be interesting to measure ambience
followed by some ideas how it could look like. By trying to
find a formula to rate the “level of ambience”, we identify a
few factors that seem to be important for ambient systems.
We think that having such a formula would be of great help
for developing, designing and comparing different concepts
of systems.
In the second part, we introduce the Ambience Design Cy-
cle which consists of four designing stages that could assist
designers in the developing process. Both parts should be
seen as food for thought of how to design ambient systems.
Take your Smart Music with you and be up to date
Ralf Jung
Proceedings of International Conference on Intelligent Environments 2008, July 21- July 22, 2008, Seattle, USA
[BibTeX]
show abstract
We present a user adaptive ambient audio notification ser-
vice for multi-user environments connected to a user mod-
eling service. The location adaptive system works unobtru-
sively by embedding non-speech audio cues, in the form of
natural instruments, in aesthetical self composed music.
First we introduce the ambient notification system for intel-
ligent environments followed by the identification of exten-
sion properties for the implemented user model ontology to
get the personalized ambient audio notification service.
Information Transfer Efficiency of Peripheral Audio Cues
Ralf Jung
Proceedings of International Conference on Intelligent Environments 2008, July 21- July 22, 2008, Seattle, USA
[BibTeX]
show abstract
Transmitting basic information with non-speech audio cues
is often afflicted with some disadvantages because of the
differentness of the signals compared to the environmental
noises.
In this paper we present an evaluation of our ambient au-
dio notification approach that uses instruments included in
specially arranged aesthetical background music. First, we
give a short introduction to non-speech audio cues and audi-
tive perception. The study includes findings of the notifica-
tion effectiveness and the recognition delay of notification
instruments and compares it to a traditional audio cue.
Smart Sound Environments: Merging Intentional Soundscapes, Non-Speech Audio Cues and Ambient Intelligence
Ralf Jung
Proceedings of International Conference on Acoustics 2008, June 29- July 04, 2008, Paris, France
[BibTeX]
show abstract
We introduce an intelligent audio notification system for multi-user environments that provides users with information about events (e.g. important emails) in a more discreet and non-distracting way.
The peripheral awareness of individual-related events is done by using non-speech audio cues which can be seamlessly integrated into artificial background soundscapes.
These ambient soundscapes are self-composed with respect to well-known perceptual constraints like auditive Gestalt laws as well as music psychological findings.
To follow a hierarchical approach for the notification sounds we use notification instruments, ambient noises and traditional alert signals that are grouped by their level of intrusiveness.
Since the notification system also follows a human-centered approach it takes parameters like user preferences, his/her current position in the environment and the type of event into consideration to decide which notification is the appropriate at this time.
In the paper, we will describe the architecture of the personalized ambient audio notification
service, compositional constraints as well as some findings of a user study in which we tested successfully the efficiency of our system with 25 subjects.
Ambience for Auditory Displays: Embedded Musical Instruments as Peripheral Audio Cues
Ralf Jung
Proceedings of International Conference on Auditory Display (ICAD 2008), June 24 - June 27, 2008, Paris, France
[BibTeX]
show abstract
From alarm signals and data sonification to multimodal interfaces, auditory displays are omnipresent
in our everyday life and they become more and more popular. But there are some challenges we have to meet
because of the differentness of the auditory sense compared to the visual sense. Usually, audio notification signals
are limited to simple warning cues and system feedback that are in most cases intrusive be- cause they differ
from the environmental noise. That has the effect that people present in the room could be distracted from their
current tasks because they cannot “close their ears.” To prevent the disturbing effect of traditional notification
signals we developed the novel concept of non-speech audio notification embedded in ambient soundscapes to
provide multi-user notification in a more discreet and non-disturbing way. Instead of using well-known non-
speech cues like auditory icons and earcons, we decided to compose and record peripheral soundscapes and
notification instruments by ourselves towards a more aesthetic approach. In this paper, we give an overview
of our location-aware system with two applications (PAAN, AeMN) and sketch a real life scenario in a wine
department of a supermarket. We will also present findings from a user study and provide a small collection of
notification instruments and soundscapes as audio samples.
A Location-Adaptive Human-Centered Audio Email Notification Service for Multi-User Environments
Ralf Jung, Tim Schwartz
Proceedings of HCI International 2007, July 22-27, 2007, Beijing, P.R. China
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper, we introduce an application for a discreet notification
of mobile persons in a multi-user environment. In particular we use the current
user position to provide a personalized email notification with non-speech audio
cues embedded in aesthetic background music. The notification is done in a
peripheral way to avoid distraction of other people in the surrounding.
Peripheral Notification With Customized Embedded Audio Cues
Ralf Jung, Tim Schwartz
Proceedings of the 13th International Conference on Auditory Display (ICAD), June 26-29, 2007, Montréal, Canada
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
Peripheral notification services allow users to monitor information
with less distraction of attendees in their surrounding. In the majority
of cases, the information is provided by visual displays that
often have several disadvantages, e.g. the lack of privacy or the
user is locally bounded to the surrounding of the display.
In this paper, we introduce an approach for a discreet notification
of persons in multi-user environments. In particular, we use
the current user position to provide a personalized and locationaware
notification service with non-speech audio cues embedded
in aesthetic background music. Thereby we enriched the music,
and especially the notification audio cues, with functionality to in-
fluence the perception and to control the attention of the listeners.
These functional pieces of music should stay in the peripheral
background to avoid too much attention.
The used ambient soundscapes and the set of corresponding
notification instruments were composed and recorded by ourselves.
The development process including compositional constraints with
respect to auditive perception and emotional effects raised by music
will also be introduced in this paper as well as the nomadic
event notification service which includes our indoor positioning
system for mobile devices.
A Development Cycle for Ambient System Design
Tim Schwartz, Ralf Jung
International Workshop on Modelling and Designing User Assistence in Intelligent Environments (MODIE'06), Espoo, Finland, 2006
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
This paper describes a design development cycle for ambient systems. Other than the traditional software development concepts, we concentrate on the challenges of ambient designs. First we introduce the Ambient Development Cycle which consists of four designing stages. By trying to find a formula to rate the ``level of ambience", we identify a few factors that seem to be important for ambient systems. We think that having such a formula would be of great help for developing, designing and comparing different concepts of systems.
A Hierarchical Approach for Seamless Audio Notification in Multi-User Environments
Ralf Jung
International Workshop on THE PRESENT AND FUTURE OF RECOMMENDER SYSTEMS (Recommenders'06), Bilbao, Spain, 2006
Ambient Audio Notification with Personalized Music
Ralf Jung, Dominik Heckmann
Workshop on Ubiquitous User Modeling (UbiqUM'06), Riva del Garda, Italy, 2006, pp. 16-18
[ DOWNLOAD NOTE ]
[BibTeX]
show abstract
In this paper we present a user adaptive approach for an ambient audio notification
application for multi-user environments. We provide a user centralized
notification system working unobtrusively by embedding audio cues in an
ambient soundscape by connecting the u2m.org user modeling service.
First we introduce the ambient notification system for intelligent environments followed by the identification of extension properties for the user model on\-to\-logy to get an ambient user adaptive notification service. This short paper should be seen as work in progress that addresses the current research field combining ubiquitous computing and user modeling.
Effectiveness of User Notification in Ambient Soundscapes
Ralf Jung, Andreas Butz
Proceedings of the workshop on Auditory Displays for Mobile Context-Aware Systems at Pervasive 2005, 8-13 May, 2005, Munich, Germany
show abstract
In this paper we present an ambient audio notification system for multi-user environments. It provides unobtrusive notification by embedding audio cues in an ambient soundscape consisting of specially arranged pieces of music. The audio cues are distinct either in their instrumentation or in their rhythmic pattern and complement a musical core of the soundscape. To test the e ectiveness of our system we conducted a study with 25 subjects and compared notification e ectiveness and reaction speed between our approach and salient notification sounds which were not embedded into the soundscape. We present the key findings and some implications following from the evaluation of our study.
Seamless User Notification in Ambient Soundscapes (IUI 2005)
Andreas Butz , Ralf Jung
Proceedings of IUI 2005, January 10-13, 2005, San Diego, California, USA
[ DOWNLOAD NOTE ]
show abstract
We describe a method for notifying users through auditory cues embedded in an ambient soundscape in the environment. It uses pieces of music which are composed in such a way, that particular instruments or motifs can be added or omitted without losing the aesthetic quality of the overall composition. This allows for very subtle modifications in the soundscape which are only noticed by those users who have chosen this particular instrument or motif as their notification instrument before. As a side effect, the soundscape itself can be used to subtly influence the mood of users. The method has been implemented in a prototype, which we briefly discuss. The prototype is implemented using a spatial audio framework and can hence notify users from particular directions.
Ambiente Klanglandschaften in instrumentierten Umgebungen
Ralf Jung
Diplomarbeit, Fachbereich Informatik, Universität des Saarlandes, 2004
Lectures |
Back to Top |
Advised Student Projects |
Back to Top |