Environment Management for Augmented Environments

Introduction

This project is part of the User Interfaces for Augmented Environments project set. Please read that page for an introduction to this research.

Project

The goal of this project is to think about how to assist the user in managing the possibly huge amount of dynamically changing information in an Augmented Environment. Of particular interest is how such information is managed when a user is wearing headworn displays (either auditory or visual), as the presence of these displays makes it impractical for the user to manage all of the information in their space explicitely. Consider the following:

• The 2D desktop controlled by a window system is a static display space consisting of small, fixed set of display devices, whereas an augmented environment is dynamic; devices and users can come and go from the space, such as those carried/worn by users
• Windows on the 2D desktop are usually explicitly manipulated by the user, whereas users cannot explicitly control information in an augmented environment; since the presentation of information on some devices (such as head-worn displays) may be tied to rapidly changing context (such as the user?s location and direction of gaze), users could spend a significant portion of their time managing information if the system does not actively assist them.
• The 2D desktop can be ignored when necessary by simply turning away from the displays, whereas an augmented environment cannot be ignored quite so easily; ambient displays run continuously, users cannot ?turn away from? head-worn displays, and information may be contained on dozens, or even hundreds, of devices that surround the user.

These factors seems to point toward a system that actively assists the user in managing the information on their displays, in contrast to the lifeless 2D desktop displays in common use today that require users to explicitely open, close and re-position windows.

Here is what you need to do.

1. Read the papers listed below. The first provides an overview of 2D GUI Software, the second provides a discussion of what context is and how it can be used, and the final three are examples systems that deliver part of what we envision augmented environments will be capable of
2. Define the issues that should be address by a UI software architecture for augmented environments (meet with Dr. MacIntyre to discuss this).
3. Meet with Dr. MacIntyre regularly to discuss your emerging ideas.
4. Propose a design for a software infrastructure, and discuss how it does (or does not) address the needs of augmented environments.

Background

• Augmented Environments Lab web page
• The following papers:
  • "UIMSs, Toolkits, Interface Builders," Brad A. Myers (pdf)
  • "The Context Toolkit: Aiding the Development of Context-Enabled Applications," Daniel Salber, Anind K. Dey and Gregory D. Abowd. (pdf)
  • Butz, A., Hollerer, T., Feiner, S., MacIntyre, B., and Beshers, C. ``Enveloping Users and Computers in a Collaborative 3D Augmented Reality.'' In International Workshop on Augmented Reality, 1999, San Francisco, CA. (pdf)
  • MacIntyre, B. and Mynatt, E.D. ``Augmenting Intelligent Environments: Augmented Reality as an Interface to Intelligent Environments.'' In AAAI 1998 Spring Symposium Series, Intelligent Environments Symposium, March 23-25, 1998, Stanford University, CA. (pdf)
• Some knowledge of, or practical experience with, GUI software would be useful, as would some basic AI knowledge

Deliverables

• Meet with Dr. MacIntyre a few times to discuss the approach you are interested in pursuing
• Write a 3-5 page Report addressing the following issues:
  • Give a brief overview of your approach to solving this problem
  • Propose a high-level design for an architecture, discuss its advantages and shortcomings. For example, how will it work in the context of multiple users, rapidly changing data or rapidly moving users?
• Note: this is an unsolved problem, so we are looking for creative approaches that show promise, not complete solutions.

Evaluation

Based on the report turned in to the sponsor of the project by the due date.