The "Wizard of Oz" Agent Experiment
Adapted from David Maulsby's Turvy experiment
[in Watch What I Do, Allen Cypher, ed. MIT Press 1993].
Task: Reformat a Bibliography
Lieberman, H., The One True Path to Intelligent Agents,
International Conference on Buzzwords and Hype, Tahiti, 1996.
[Lieberman 96] The One True Path to Intelligent Agents,
Int. Conf. on Buzzwords and Hype, Tahiti, (1996).
Methodology
- User performs task once
- "Thinking aloud": goals and methods
- Agent (secretly) constructs description of actions
- In terms of simple "implementable" operations
- Agent offers help
- Agent performs help according to action description
- Agent gives user feedback
- Agent accepts advice from user
Here's what some of the class members did: