A Two-Headed Architecture for Intelligent Multimedia Man-Machine Interaction

In this paper a two-headed architecture designed for handling intelligent multimedia manmachine interaction is described. In this work we are mainly interested in interactions that may consist only of natural language sentences and graphical actions and events (multimodal interactions). The architecture is extended from Lopes [Lop91] and is composed of two decisione centers (heads): an interactional and a reectional one. The interactional decision center is responsible for the interaction with the user and consists of a handler that activates the adequate low-level executive modules (input interpreters, planners and executive generators of planned actions) that perform the desired actions and use and update the context of interaction. The reectional module is responsible for detecting faults and deadlocks in a interaction and for propagating solutions that will lead to their repair. It also consists of a handler and of executive modules that use the interactional context as object as..