From aaai97-owner@cc.gatech.edu Tue Mar  4 02:24:40 1997
Date: Mon, 3 Mar 1997 06:47:27 -0500 (EST)
From: arkin@cc.gatech.edu (Ronald Arkin)
Message-Id: <199703031147.GAA23948@arkin.cc.gatech.edu>
To: aaai97@cc.gatech.edu
Subject: Final Rules - Home Vacuum Event
Cc: arkin@cc.gatech.edu
Sender: owner-aaai97@cc.gatech.edu
Precedence: bulk
Status: RO
AAAI-97 Mobile Robot Competition Event 3: Home Vacuum
Here are the final rules for the vacuuming contest. Please send
comments/questions to me (bonasso@aio.jsc.nasa.gov) with
copies to Erann gat@robotics.Jpl.Nasa.Gov, and Sebastian
thrun+@heaven.learning.cs.cmu.edu. 
======
General
The point of this contest is to explore the usefulness of intelligence
in a task that appears to only require essentially unskilled labor --
simple household vacuuming. We believe that unlike vacuuming in
the service industry (factories, warehouses, etc.) home vacuuming
will require sensate intelligence to deal with the humans in an
everyday environment. For the AAAI contest, vacuuming robots
ought to be short on vacuum mechanisms and long on intelligence.
That is to say, simple suction, storage, and disposal devices are
sufficient for these tasks, but the robots will probably have to
make reasoned trade-offs among subtasks in real time to achieve
a high score. 
Objectives:
1) To show the value of intelligent robotics in a rudimentary
service task .
2) To let competitors measure the usefulness of their approach to
robot intelligence.
3) To have fun.
Scenario
We have a three room house (kitchen, family room, den) with a
short hallway connecting the rooms. A smart vacuuming robot sits
at a charging/disposal station in the hallway where it can see
humans going in and out of the rooms (in the contest, charging a
waning battery should not be required, but depositing trash will).
Periodically, because of the activities of the human family living
there, messes appear in the rooms, and sometimes in the hallway.
The robot's task is to keep the floors vacuumed with minimum
interruption of the activities of the human family living there. As
such it is to vacuum on demand, when it knows a room might
possibly be messy and on a periodic basis.
Environment:
The rooms will be setup using materials similar to last year's
competition. (The figure below is a sample layout; the actual
layout will be determined shortly before the competition and maps
will be released to all competitors upon their arrival). The door
openings to the rooms may be opened or "closed" (blocked).
Each room will have a set of office furniture: desks, tables, and/or
chairs of the kind used last year. We are looking into couches and
TV stands. Robots are not expected to vacuum under furniture.
    -------------
    |           |
    |           |
    |    K      |
    |           | A 15' hallway with one 12'x 12' 
    |           | and 2 8'x10' rooms (3' doors).
    |           |
    |           |
  ----        -----------------
   R
  --------       ------       -
  |               |           |
  |               |           |
  |      L        |    D      |
  |               |           |
  |               |           |
  |               |           |
  |               |           |
  |               |------------
  -----------------
Periodically humans will come and go in the rooms. As they do,
they may or may not leave "messes". The "messes" will consist of
circular piles of paper confetti between 12" and 18" in diameter.
Sometimes a human (possibly a teenager) may leave a mess in the
hallway. There may be more than one mess in a room.
The vacuuming robots will be restricted to carry no more than
two messes worth of trash before they must "deposit" the trash at
the deposit site. Simply releasing the confetti at the deposit
coordinates is sufficient to constitute a deposit. 
Allowable Environmental Engineering:
     Bar-codes may be used to mark the room doors at a 5 pt
     penalty for each phase described below 
     Marking humans incurs a 2 - 10 pt penalty per human. 
     Marking messes incurs a 5 - 10 pt penalty per mess. 
(Judges will determine the amount of penalty, depending on how
much marking is done)
Virtual Manipulation:
     Robots that can't vacuum must drive over the messes and
     must delay at each mess for 30 seconds. Humans may
     clean up a mess if the robot clearly went over all of it. If the
     robot only covered some of the mess, humans are only
     allowed to remove that part of the mess. Of course in
     phase 3 the robot should move to the nearest wall while
     the human is there. 
     Robots that cannot deposit trash must move over the
     designated deposit site and delay for 15 seconds for each
     deposit. 
The Tasks:
Phase 1. "Once A Week" Vacuuming.
(First day trials). All the rooms are to be cleaned once a week. In
this phase, the robots will start at the disposal station, clean the
each room by vacuuming the entire area of the room, and return
to the disposal point. If messes are present (there may be from
zero to two messes in each room), the robot must return to
deposit the trash after every two messes. No humans will be
present for this phase. There will be no messes in the hallway for
this phase.
Scoring.
1) Fastest time (all three rooms must have been entered
(doorway cleared) at least once to qualify for fastest time):
     1st place -- 20 pts. 
     2nd place -- 10 pts 
     3rd place -- 5 pts. 
Max. score -- 20.
2) Clean rooms:
     ((per cent of room covered) x 10 )/room 
     ((per cent of mess cleaned up) x 10 )/mess 
     10 pts/(return for deposit) 
Max. score (three rooms and 2 messes/room):
13 x 10 = 30
+6 x 10 = 60
+3 x 10 = 30
-------------
         120.
3) Penalties: Navigation -- 5 pt penalty for each physical item
bumped or hit.
4) Bonuses:
     Innovative vacuum device -- 10 pts 
     Innovative deposit device -- 10 pts 
Max. score possible for Phase 1: 160 pts
Phase 2: "Tidy Up."
(Second Day Trials). The robot starts at the disposal station.
Humans will periodically enter and leave the rooms (possibly
leaving messes). It's the robot's job is to keep the rooms clean of
messes. Robots must not enter a room when a human is present
(during this phase, humans will not enter a room while a robot is
cleaning). During a given 15 minute run, humans will be present in
each room for 1 minute out of every 5, except for the family room
which will be occupied 3 minutes out of every 5. Robots may
clean messes in the hallway while humans are present there.
The house is laid out such that the family room is immediately
visible to visitors from the front entrance. Thus, to the family, a
clean family room is twice as important any other room being
clean. 
Scoring.
1) Messes cleaned in 15 minutes (i.e., a mess is cleaned when at
least 80 per cent of the mess has been vacuumed):
     Kitchen, hallway and den: 25 x number of messes 
     Family room: 50 x number of messes 
Max. score:
(Max. of 2 messes per room/hallway)
 6 x 25 = 125
+2 x 50 = 100
--------------
          225
2) Penalties:
     Navigation - 5 pt penalty for each physical item bumped or
     hit. 
     Avoiding humans - 10 pt penalty for each human touched 
Phase 3: "Clean my room".
(Third Day Trials). The robot starts at the disposal station. A
human will come into the hallway and indicate to the robot that a
room needs to be cleaned. The robot will then move to the room,
clean any messes there and return to base to deposit the trash.
While the robot is cleaning the room, one or more humans will
enter. The robot must not clean while a human is in the room, but
must move to the nearest wall and wait until the human leaves.
Scoring.
1) Detecting and interpreting human indication of messy room.
Max. score -- 25.
2) Clean rooms:
     ((per cent of mess cleaned up) x 10 )/mess 
     10 pts/(return for deposit) 
Max. score
  3 messes x 10 = 30
2 deposits x 10 = 20
                  --
                  50
3) Ability to stop vacuuming and retreat when human is present in
the room - 25 pts. 
4) Innovative human-robot communication -- 50 pts. We will
reward natural communication that does not involve physically
touching the robot or keyboard or mouse. E.g., gesturing, or
acquiring and tracking.
Max. score possible for Phase 3: 150.
5) Penalties:
     Navigation - 5 pt penalty for each physical item bumped or
     hit. 
     Avoiding humans - 10 pt penalty for each human touched 
Maximum possible contest score = 535 pts.