Cook's Collage

Cooking is a physical activity that is subject to distractions and interruptions. Mistakes are costly but, for the most part, are not life-threatening. The process is made up of specific activities (e.g. add a cup of flour) but rote cooking from a recipe is not the norm. Hence a predictive system (e.g. "next do this") could often be wrong, but a capture system (e.g. "here's what you've been doing") could aid a cook in remembering specific past actions.

The cook's collage provides a visual summary of recent cooking activity along a kitchen countertop. The current design emphasizes the temporal order of cooking events. Visual snapshots are arranged as a series of panels similar to a comic strip, ending with the most recent action in a highlighted (green) border. Repeated steps are annotated with their corresponding number count and preceded with slim vertical gray bars (i.e. visual elipses). Figure 1 shows a screenshot of the cook's collage display as a cook prepares a punch recipe.

Using a "wizard-of-oz" technique, a human operator simulates the intelligence for the cook's collage system by hand picking images from the streaming live video feed as shown in figure 2. We transfer the wizard experiences to later automate this tracking procedure.

people
Quan T. Tran [quantt@cc]
Elizabeth D. Mynatt [mynatt@cc]
Wendy A. Rogers [wendy@]

project alumni
Gina Calcaterra
Julian Sanchez
Jessica Paradise Elliott
Jenny Cheung [.pdf]
Maianh Phung [.pdf]
Joanna Leidy [.pdf]
Mahmudul Jilani

funding
This project started Spring 2001, and was funded by the Aware Home Research Initiative and Broadband Institute at Georgia Tech until its completion in 2006.

publications
Tran, Q., Calcaterra, G., Mynatt, E. "Using Memory Aid to Build Memory Independence." Proceedings of HCII: Human Computer Interaction International, 2007, 959-965. [pdf]

Tran, Q., Mynatt, E., Rogers, W. "Memory for Actions: Designing a Cognitive Augmentation System." In Abstract Proceedings of CAC: Cognitive Aging Conference, 2006. [pdf]

Sanchez, J., Calcaterra, G., Tran, Q. "Automation in the Home: the Development of an Appropriate System Representation and its Effects on Reliance." Proceedings of HFES: Human Factors Engineering Society, 2005. [pdf]

Tran, Q., Calcaterra, G., Mynatt, E. "How an Older and a Younger Adult Adopted a Cooking Memory Aid." Proceedings of HCII: Human Computer Interaction International 2005, CD-ROM. [pdf]

Tran, Q., Calcaterra, G., Mynatt, E. "Cook's Collage: Deja Vu Display for a Home Kitchen." Proceedings of HOIT: Home-Oriented Informatics and Telematics, 2005, 15-32. [pdf]

Tran, Q., Mynatt, E. (2003). "What Was I Cooking? Towards Deja Vu Displays of Everyday Memory." Georgia Institute of Technology Technical Report GIT-GVU-TR-03-33. [pdf]

Tran, Q., Mynatt, E. (2002). "Cook's collage: Two exploratory designs." Position paper for the Technologies for Families workshop at CHI 2002. [pdf]

in the press (selected)
Dembo, P. "What's Cooking" in CNN Special Projects: New Explorers. September 17, 2004. [avi]

Greene, K. "Inside the Home of the Future." In The Wall Street Journal, Feb 23, 2004.

Baard, M. "Helping Cooks Unsalt their Game." In Wired News, October 8, 2002.

Ackerman, E. "Geeks World Fair Celebrated." In The Mercury News, March 12, 2001.