Due at varying times CS 6751 - Human-Computer Interaction Winter 1999

Group Project: Interface Evaluation and Design

Outline

Quick access to the sections of this document:

Project Overview

This quarter you will undertake a group project (3-4 people) to evaluate some computing-related task/problem, to develop interface design alternatives for the task/problem, to implement a prototype of your design, and to evaluate your design. This project should provide you with hands-on experience with the tasks that interface designers face every day. Most importantly, the topic of the project will be some real-world problem that matters to some individuals. Each project will have real "clients" that you must communicate with and learn from. We will be providing you with a list of possible projects to choose from. It is your responsibility to contact the clients for each project. They will not come to you.

Each project group will be graded as a team, that is, each person receives the same grade. I will poll team members, however, to make sure that all members are contributing. Lack of participation may precipitate an individual reduction of grade. Within the team, you must negotiate on how much and what each person will contribute. Think carefully about your team members: Where do people live and what hours do they work? Where will you meet? What skills do the different individuals bring to the group (computing, programming, design, evaluation, statistics, etc.)? I would strongly encourage you to form a heterogeneous team full of individuals with varying skills.

Project Report Book

Each part of the project will include a deliverable report. This report will be placed on the WWW and should be written in HTML. Each team should have a "home" page which includes: 1) a brief (paragraph) description of the problem/task; 2) the team members; 3) Links to the reports for project parts 1-3 (no report is needed for part 0). The format of the reports for the individual parts is up to you, but it should be professionally prepared, expressive, grammatically sound, illustrative of your efforts and process, and easy to view and understand. A good design effort can easily be hampered by a poor communication of what was done. We will help you get space for your pages and get this all set up.

Part 0 - Topic

Due January 14
This first part of the project is relatively simple. You must list the members of your team and identify the problem that you will be working on.

Part 1 - Understanding the Problem

Due January 28
The key goal of this first substantive part of the project is to deeply understand that problem that you are addressing, its set of pertinent users, and the issues and constraints that are involved in the problem. If the task has an existing system/interface, you should perform an interpretive evaluation of that system to help you learn more about it. Most important is identify important characteristics of the problem that will influence your subsequent design.

In class we will discuss different techniques for acquiring this kind of information. Feel free to utilize the techniques that you feel are most appropriate to the particular task you are examining. Your report and deliverable for this part should deeply examine the problem of study. Who are the potential users? What tasks do they seek to perform? What functionality should the system provide? Basically, you are setting up a set of constraints for your subsequent design. What criteria should be used to judge if your design is a success or not?

More specifically, you should develop the following items in this part, and you should communicate them through your report:

Part 2 - Design Alternatives

Due February 16
The key goal of part 2 of the project is to use the knowledge gained in part 1, as well as that from class, to develop a new interface design, or better yet, a few interface design alternatives for your problem. Further, you must provide a set of initial usability specifications for your system and a plan for usability testing of it.

In this part of the project you only need to provide mock-ups, storyboards, and sketches of your interface designs. That is, you should provide pencil-and-paper or electronic images of the interface at various stages; You do not need to build a working prototype. Your design sketches should be sufficiently detailed for a potential user to provide useful feedback about the design, however. Along with your design mock-ups, you should provide a brief narrative walk-through of how the system will work. Perhaps most importantly, you should also include your justifications for why design decisions were made, and what you consider to be the realtive strengths and weaknesses of your different designs.

Accompanying your designs should be a set of usability specifications for the system. What are your objectives through the design? For example, if you are working on a calendar manager, you might specify time limits in which you expect a user to be able to schedule or modify an appointment, or a maximum number of errors that you expect to occur. Basically, you should list a set of criteria by which your interface can be evaluated.

Finally, this part of the project should include an initial evaluation plan for the system. Suppose that your interface is implemented through a prototype. What kinds of benchmark tasks would you have users perform to help evaluate the interface? What kind of subjective questionnaire would you deploy to have a user critique the interface? You will need to actually carry out some of this evaluation in part 3, so you should do your best to set it up now.

Your project report should include all the explanatory material mentioned above as well as all the design sketches, drafts, storyboards, etc., that you generated. If some of your sketches are on apper, we will provide you with access to a scanner to scan in these images. Make sure that your report adequately reflects the design process that your group undertook.

We will utilize one full class day as a poster session at the end of this part of the project. Each group will post some of their design ideas on a poster in class. Everyone will then circulate and interact with the designers. The idea here is that each group can use this opportunity to get feedback about their design ideas and to iteratively refine their design as they head into part 3 of the project.

Part 3 - System Prototype and Evaluation

Due March 11
In the final part of the project, your group will implement a working system prototype of your interface, and you will conduct initial usability evaluations of it. You can use any available graphical user interface builder tool that you would like, for example, Hypercard, Visual Basic, UIMX, Macromedia Director, etc. You should be able to get much of the interface functionality working, but clearly you will not be able to implement all back-end application functionality. You should be able to build and connect to enough of the application functionality to be able to conduct an initial usability evaluation with the benchmark tasks you proposed in the previous part.

After your prototype is (somewhat) working, you should run a few usability studies of the system on prospective users. These users will probably be your client(s) and maybe other students from class. Your studies should simply be a carrying-out of the usability plan that your put forward in part 2. Give the users a few simple benchmark tasks and have them interact with your interface. Deploy a questionnaire to get their subjective feedback.

Your write-up for this part should include a description of your system prototype. You can include screen dumps to help explain it. Also include a description of the results of your usability studies. What conclusions can you draw from the studies? What aspects of your design "worked" and what failed to meet your specifications? If you had more time to work on the design, what would you now change and improve? Remember, no designer ever gets a system "just right." We will reward teams who honestly and carefully assess their design and who clearly provide a plan for its improvement.

Project Presentation

March 10
The design project will culminate in a session in which each group presents their system to the class and to your clients. Please set aside the evening of Wednesday March 10th from 6-9 pm. Each group will be expected to give a professional 15-20 minute summary and walk-through of their design and prototype. It is important that you do a good job communicating all your efforts for the quarter. You want to make sure that your objectives in the project are discussed, your system is clearly presented, and that your design process is communicated.