Nonspeech Audio Interfaces

Problem
Typical human-computer interfaces have a great deal of information to convey. Most information is conveyed explicitely, such as functions available in a pull-down menu or an error message in a pop-up dialogue. Guidelines for presenting these kinds of explicit information are available in numerous HCI textbooks. In contrast, less is known about techniques for presenting information implicitely, especially if this information should be presented in the "background" without requiring direct attention.

Other media e.g., movies, books, even buildings, are designed to convey layers of information implicitely. You can ascertain the genre of a book by its size, weight and cover design. The background soundtrack of a movie informs the audience of impending danger. The formality of a building is inherent in its architectural design and decoration.

The goal of this project is to explore providing implicit information in human-computer interfaces via nonspeech auditory cues. Why should we do this? To make interfaces more comprehensible, for example, is this part of the interface a typical part of the novice experience or have you likely wandered off course. To make interfaces more effective, from providing simple cues to confirm user actions to conveying invisible modes and background processes. And to make interfaces more engaging. Why audio? Nonspeech audio is an ideal media for conveying information in the background of a likely visually cluttered interface.

Project Tasks

Read these papers concerned with using nonspeech audio in human-computer interfaces:

• Desiging Audio Aura by Mynatt et al (CHI '98) uses auditory cues triggered by movements in physical space to provide awareness of email and colleagues' presence and activities.
• Auditory Icons in Large-Scale Collaborative Environments by Gaver and Smith (INTERACT '90) describes using sounds to support a collaborative task over multiple visual displays.
• The design of sonically-enhanced widgets by Brewster ('98) describes using musical sounds to increase performance with typical GUI controls.

Choose a scenario to drive your project. For your scenario, informally evaluate the use of sound in a commercial piece of software that uses sound extensively (I'll have suggestions). (I can't, however, promise to obtain any piece of software so pick something you have access to, or come talk to me).

• Educational software for kids.
• Computer games (recreational). (Riven is a good example here)
• Your suggestion here.

Write a report (~7 pages) detailing:

• Your assessment of the research papers, the approaches presented and applications explored.
• How sound was used well in the software you evaluated.
• Specific suggestions, as well as general techniques, for future uses of sound that could be incorporated into the software.

Deliverables

• Meet with Dr. Mynatt to discuss readings and scenario choice.
• Report (~7 pages).
• Demonstration of software including discussion of good uses of sound as well as places for future use.