Bretan, Ivan and Karlgren, Jussi (1994) Synergy Effects in Natural Language-Based Multimodal Interaction. [SICS Report]
We discuss the synergetic effects that can be obtained in an integrated multimodal interface framework comprising on one hand a visual language-based modality and on the other natural language analysis and generation components. Besides a visual language with high expressive power, the framework includes a cross-modal translation mechanism which enables mutual illumination of interface language syntax and semantics. Special attention has been payed to how to address problems with robustness and pragmatics through unconventional methods which aim to enable user control of the discourse management process.
|Item Type:||SICS Report|
|Uncontrolled Keywords:||Multimodal interaction, Natural language interfaces|
|Deposited By:||Vicki Carleson|
|Deposited On:||22 Oct 2007|
|Last Modified:||18 Nov 2009 16:00|
Repository Staff Only: item control page