Introduction
Adaptive multimodal natural
language generation
Speech, prosody &
corpus-based methods
Multimodality, cognition and
evaluation
Publications
Workshops
|
Publications
2011
- Hooijdonk, C.M.J., van, W. Bosma, E.
Krahmer, A. Maes and M.
Theune. Experiments
in
multimodal information presentation. In A. van den
Bosch and G. Bouma (eds.),
Interactive
Multi-modal Question-Answering, Springer Verlag Berlin-Heidelberg, pp.
89-115. © Springer
- Bosma, W., E. Marsi,
E.
Krahmer and M. Theune. Text-to-text
generation for question answering. In A. van den
Bosch and G. Bouma
(eds.), Interactive Multi-modal Question-Answering, Springer
Verlag Berlin-Heidelberg, pp. 117-145. © Springer
2008
- Bosma, W. Discourse
Oriented Summarization. PhD thesis, University of Twente, The
Netherlands.
- Bosma, W., M. Theune, C. van Hooijdonk, E. Krahmer
and A. Maes. Illustrating
answers: an evaluation of automatically retrieved illustrations of
answers to medical questions. In the Proceedings of
the AISB
Symposium on Multimodal Output Generation (MOG 2008), 3-4 April 2008,
Aberdeen, UK. pp. 34-41.
- Hooijdonk, C.M.J. van. Explorations in Multimodal
Information Presentation. PhD thesis, Tilburg University, The
Netherlands.
- Hooijdonk, C.M.J. van, E. Krahmer, A.Maes, M. Theune
and W. Bosma. Production
and evaluation of (multimodal) answers to medical questions.
In the Proceedings of the EARLI SIG2 - 2008 Conference on Comprehension
of Text and Graphics, Tilburg, The Netherlands, August 27-29, 2008, pp.
72-76.
- Hooijdonk, C.M.J. van and E. Krahmer. Information
modalities for procedural instructions: the influence of text, static
and dynamic visuals on learning and executing RSI exercises. IEEE
Transactions on Professional Communication, 51(1), pp. 50-62.
- Theune, M., I. van der Sluis, Y. Bachvarova and E.
André (eds.) Proceedings
of the AISB 2008 Symposium on Multimodal Output Generation (MOG 2008).
Society for the Study of
Artificial Intelligence and the Simulation of Behaviour, 3-4 April
2008, Aberdeen, Scotland.
2007
- Bosma, W. and C. Callison-Burgh. Paraphrase
substitution for recognizing textual entailment.
In Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard,
D.W., de Rijke, M., Stempfhuber, M.
(eds.), Evaluation of Multilingual and Multi-modal Information
Retrieval . 7th Workshop of the Cross-Language Evaluation Forum, CLEF
2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers.
LNCS 4730, Springer.
- Hooijdonk, C.M.J. van, E. Krahmer, A. Maes, M. Theune
and
W. Bosma. Towards
automatic generation of multimodal answers to medical questions: a
cognitive engineering approach. In the Proceedings of the
Workshop on
Multimodal Output Generation (MOG 2007), CTIT Workshop Proceedings WP
07-01, 25-26 January 2007, Aberdeen, Scotland, pp. 93-104.
- Hooijdonk, C.M.J., van, E. Commandeur, R. Cozijn, E.
Krahmer and E. Marsi. The
online evaluation of speech synthesis using eye movements. In
the
Proceedings of the 6th ISCA Workshop on Speech Synthesis,
22-24 August 2007, Bonn, Germany.
- Hooijdonk, C.M.J., van, E. Commandeur, R. Cozijn, E.
Krahmer and E. Marsi. Using
eye movements for online evaluation of speech synthesis. In
the
Proceedings of Interspeech 2007, 27-31 August 2007, Antwerp, Belgium.
- Hooijdonk, C. van, J. de Vos, E. Krahmer, F. Maes, M.
Theune and W. Bosma. On
the role of visuals in multimodal answers to medical questions.
In the Proceedings of the 2007 Conference of the IEEE
Professional Communication Society (IPCC), 30 September -
3 October 2007, Seattle, USA.
- Marsi, E., E. Krahmer and W. Bosma. Dependency-based paraphrasing for
recognizing textual entailment.
In the Proceedings of the ACL 2007 Workshop on Textual Entailment and
Paraphrasing, 28-29 June 2007, Prague, Czech Republic, pp. 83–88.
- Marsi, E. and F. van Rooden. Expressing
uncertainty with a talking head in a multimodal question-answering
system. In the Proceedings of the Workshop on
Multimodal Output Generation (MOG 2007), CTIT Workshop Proceedings WP
07-01, 25-26 January 2007, Aberdeen, Scotland, pp. 105-116.
- Nivre, J., J. Hall, J. Nilsson, A. Chanev, G.
Eryigit, S. Kübler, S. Marinov and E. Marsi. MaltParser: A
language-independent system for data-driven dependency parsing.
Natural Language Engineering, 13(2), pp 95-135.
- Sluis, I van der, and E. Krahmer. Generating
Multimodal
References. Discourse Processes, 44(3), pp. 145-174.
- Sluis, I. van der, M. Theune, E. Reiter and E.
Krahmer (eds.). Proceedings
of the Workshop on Multimodal Output Generation (MOG 2007),
CTIT Workshop Proceedings WP 07-01, 25-26 January 2007, Aberdeen,
Scotland.
- Theune, M., B. van Schooten, R. op den Akker, W.
Bosma, D.
Hofs, A. Nijholt, E. Krahmer, C. van Hooijdonk and E. Marsi. Questions,
pictures, answers: introducing pictures in question-answering systems.
ACTAS-1 of X Symposio Internacional de Comunicacion Social, Centro de
Linguistica Aplicade, L. Ruiz Miyarez, A. Munoz Alvarado & C.
Alvarez Moreno (eds.), ISBN 959-7174-08-1, Santiago de Cuba, 22-26
January 2007, Centro de Linguistica Aplicada, Santiago de Cuba, pp.
450-463.
- Vroomen, J., M. Swerts and E. Krahmer (eds.), Proceedings
of the International Conference on Auditory-Visual Speech Processing
(AVSP 2007), 31 August – 3 September 2007,
Hilvarenbeek, The Netherlands.
2006
- Bosma, W. Query-based
extracting: how to support the answer? Proceedings of DUC
2006, June 8-9, 2006, New York City, NY, USA, pp. 202-208.
- Buchholz, S. and E. Marsi. CoNLL-X
Shared Task on Multilingual Dependency Parsing. In:
Proceedings of the Tenth Conference on Computational Natural Language
Learning (CoNLL-X), New York City, pp.149-164.
- Hooijdonk, C.M.J., van and E. Krahmer. De invloed van
unimodale en multimodale instructies op de effectiviteit van
RSI-preventieoefeningen. Tijdschrift voor Taalbeheersing
28(2), September 2006.
- Hooijdonk, C.M.J., van, A. Maes and N. Ummelen. "I
have been here before": An investigation into spatial verbalizations in
hypertext navigation. Information Design Journal 14(1), pp.
5-19.
- Marsi, E., E. Krahmer, W. Bosma and M. Theune. Normalized alignment of dependency trees for
detecting textual entailment. Second PASCAL Recognizing
Textual Entailment Challenge, April 10-12, 2006, Venice, Italy, pp.
56-61.
- Theune, M., E. Krahmer, W. Bosma, E. Marsi en C. van
Hooijdonk. Mag het ietsje meer
zijn? Antwoordpresentatie in een QA-systeem
DIXIT, tijdschrift over toegepaste taal- en spraaktechnologie (Dutch
magazine on applied language and speech technology), 4(1), June 2006,
pp. 12-15.
2005
- Bosma, W. Query-based
summarization using Rhetorical Structure
Theory. Proceedings of CLIN 2004, Leiden, The
Netherlands, pp. 29-44.
- Bosma, W. Extending
answers using discourse structure.
Proceedings of the RANLP Workshop on Crossing Barriers in Text
Summarization Research, 24 September 2005, Borovets, Bulgaria, pp. 2-9.
- Bosma, W. Image
retrieval supports multimedia authoring.
Proceedings of the ICMI Workshop on Multimodal Interaction for the
visualization and exploration of scientific data, 3 October 2005,
Trento, Italy, pp. 89-94.
- Hielkema, F., M. Theune, and P. Hendriks. Generating
ellipsis
using discourse structures. Proceedings of the ESSLLI
Workshop on
Cross-Modular Approaches to Ellipsis, 8-12 August 2005, Edinburgh,
Scotland, pp. 37-44.
- Hooijdonk, C.M.J., van, A. Maes, and N. Ummelen. Using
thinking
aloud data to characterize cognitive tasks in hypertext.
Proceedings of
the IEEE Professional Communication Society, International Professional
Communication Conference, 10 - 13 July 2005, Limerick, Ireland, pp.
546-553.
- Krahmer, E and M. Swerts. How
children and adults perceive
uncertainty in audiovisual speech. Language and Speech,
48(1): 29-54.
- Marsi, E. and E. Krahmer. Explorations
in sentence fusion.
Proceedings of the 10th European Workshop on Natural Language
Generation, 8-10 August 2005, Aberdeen, Scotland, pp. 109-117.
- Marsi, E. and E. Krahmer. Classification
of semantic relations by humans and
machines. Proceedings of the ACL 2005 Workshop on Empirical
Modeling of
Semantic Equivalence and Entailment, 20 June 2005, Ann Arbor, Michigan,
pp. 1-6.
- Swerts, M. and E. Krahmer. Audiovisual
prosody and feeling of knowing. Journal of Memory and
Language, 53(1): 81-94.
2004
- Hooijdonk, C.M.J. van, A. Maes, and N. Ummelen. Users'
representation of spatial information on web sites.
Proceedings of
European Association for Research and Learning and Instruction, Special
Interest Group Comprehension of Text and Graphics: Basic and Applied
Issues, Valencia, Spain: EARLI SIG, pp. 243-247.
- Marsi, E. Optionality
in evaluating prosody prediction.
Proceedings of 5th ISCA Speech Synthesis Research Workshop, Pittsburgh,
USA, pp. 13-18.
- van der Sluis, I. and E. Krahmer. Evaluating
multimodal NLG
using production experiments. Proceedings of the 4th
International
Conference on Language Resources and Evaluation (LREC), May 26-28,
Lisbon, Portugal, pp. 209-212.
- van der Sluis, I. and Krahmer, E. The
influence of target size
and distance on the production of speech and gesture in multimodal
referring expressions. Proceedings of the International
Conference on
Spoken Language Processing (ICSLP), October 4-8, Jeju, Korea, pp.
1005-1008.
|