|
|
|
|
Adaptive multimodal natural language generation
Speech, prosody & corpus-based methods
Multimodality, cognition and evaluation
Publications
Workshops
Introduction
IMOGEN (Interactive Multimodal Output GENeration), was a project within the NWO research programme on Interactive
Multimodal Information Extraction (IMIX), which involved research on speech recognition, language analysis,
question answering, and dialogue management. The various IMIX projects integrated
their research in a common demonstrator: a multimodal question
answering (QA) system in the medical domain.| In the IMOGEN project, which ran from 2003-2008, we worked on multimodal information-presentation,
focussing on the combination of language, speech and graphics.
Improving output generation appears to be an important step in
developing the next generation of QA systems that will provide more
than just short, textual answers to users' queries. We therefore studied different
aspects of information presentation aimed at improving the output
quality of QA systems, including multimodality, improved speech prosody
and language generation, as well as adaptivity. Experimental evaluation was an integral component of the project. IMOGEN was a cooperation between Tilburg University and the University of Twente. Our research team consisted of:
| NEW: The "IMIX book"!  |