Principal Investigator Howard Shrobe
Co-investigator Kimberle Koile
This goal of this project is to integrate speech into the existing sketching system, ASSIST. ASSIST is a project of the Design Rationale Group. This work is intended to create a multi-modal environment in which mutual disambiguation of the input modes will help identify the user's intentions.
In the future, the infrastructure in the Intelligent Room could add other modalities that would assist in the recognition of the users intentions. While sketching and talking, users also gesture at parts of the drawing to identify certain parts of the sketch or to indicate actions. The Intelligent Room could provide this data which would aid in the identification of the user's intentions and in disambiguation. EWall graph showing person interaction.