1 Overview of multimodal and QA dialogue systems; dialogue managers; dialogue system architectures

LATEST UPDATE: January 13, 2006

1.1 Dialogue systems and projects

Overview | Links | Similar list of links | Overview with links

Surveys and evaluations: [Degerstedt and Johansson, 2003], [Flycht-Eriksson, 1999], [Gruenstein, 2002], [Krahmer, 2001], [Traum and Nakatani, 1999], [Traum and Andersen, 1999], [Grosz et al., 1996], DISC surveys: [Luz, 1999] [Dybkjaer and Failenschmid, 1999], COMIC surveys: [Catizone et al., 2002]

In Twente we have various experience with (multimodal) dialogue systems.

Schisma dialogue system (now part of the virtual music centre)
Jacob, an instruction agent
VR navigation assistance agent. [Hofs et al., 2003]
Speechmania-based spoken dialogue systems

More dialogue systems:

Collagen [Sidner, 2002]
VERBMOBIL [Krum et al., 2005]
Jaspis [Turunen, 2004]
Queen's Communicator [Chu et al., 2005].
HCA (H. C. Andersen) project [Bernsen and Dybkjaer, 2005], part of the NICE project.
DISC project: dialogue systems best practice guide. Methodology: [Bernsen and Dybkjaer, 1999]; Surveys [Luz, 1999], [Dybkjaer and Failenschmid, 1999]
aTTemps, information providing dialogue system in meteorological domain [Villarejo et al., 2003]
TRINDI project; the framework is called TrindiKit, with a dialogue move engine called S-DIME [Larsson, 1998], apparently aka DME. Related systems: GoDiS, later renamed to IBiS. IBiS is described in detail in [Larsson, 2002]. DiaView [Wallentin, 2004], uses the GoDiS rules. Related to TRINDI is SIRIDUS ([Amores and Quesada, 2000]).
PLUS, Pragmatics based Language Understanding System [Jokinen, 1994]. PLUS is a dialogue system that models goals and intentions (pragmatics). It was applied on a Yellow Pages domain.
LIMSI/CNRS dialogue system. [Hurault-Plantet and Balkanski, 1998]
WITAS, multimodal dialogue with autonomous robot, [Lemon et al., 2001], Recipe (programming language) [Gruenstein, 2002]
TRAINS/TRIPS (TRAINS91, 93, 95, 96) (dialogue state survey: [Traum and Andersen, 1999]). TRAINS is followed up by TRIPS
Sundial. [Eckert and McGlashan, 1993]
Galaxy, Galaxy II (framework); Galaxy Communicator; applications: JUPITER and others
CSLU toolkit
SpeechBuilder (framework) [Polifroni and Chung, 2002] [Polifroni and Chung, 2002]
ARISE [Sturm et al., 1999]
BASURDE
ATIS
ITC-irst spoken dialogue system and its follow-up ([Azzini et al., 2001]).
Godot, dialogue + robot
DARPA Communicator
CMU Communicator + source
SesaME, PER, ATLAS [Pakucs, 2002] [Melin, 2001]
LINDA, LINLIN, MALIN (the Linköping frameworks) [Dahlbäck and Jönsson, 1998], [Jönsson, 1991], (applications: BirdQuest [Andén et al., 2004] [Flycht-Eriksson, 2003], NokiaTV [Johansson, 2001]). (survey of LINLIN and MALIN: [Flycht-Eriksson, 2001])
Ypa [Webb et al., 1999], Sparkle
MagiCster: Embodied Believable Agents
VODIS [Pouteau et al., 1997]
Ovis, Ovis2
HOMEY (information dialogue system in clinical domain)
INTERACT
FASiL [Dolfing et al., 2005]
NL-SIIUE or SIIUE-NL. [Abreu et al., 2003]

1.2 QA systems and dialogue systems in the QA / information providing domain

QA competitions.

Trec 1...Trec 13 (Trec 2004). Trec 10 has a "context task", which involves followup questions [Voorhees, 2001] [Voorhees, 2003]. (see also [Chai and Jin, 2004], [Oh et al., 2001] [Inui et al., 2003]).
Qac1..3 (Japanese). All have a followup question task, much the same as Trec 10. [Fukumoto et al., 2004a], [Fukumoto et al., 2004b], [Kato et al., 2004a], [Kato et al., 2004b] (QUACIAD).

Online QA systems

Finding online QA systems was a nice opportunity to try them out. If possible I used the systems as engines for further search, feeding questions about QA systems into the systems themselves. This produced varying results, usually disappointing. In fact, only AskJeeves performed better than typing the question in Google. Most of these systems are open-domain search-engine like, and do not support dialogue.

List from AnswerBus

AskJeeves (commercial). Gives the best results.
AnswerBus (Univ. Michigan)
START (MIT)
Brainboost (commercial)
IONaut (Steve Abney and Michael Collins)
QuASM uses a limited domain; seems to be broken.
Wondir (commercial)

Other QA systems

QUANTUM (participated in context task); [Winikoff and Kosseim, 2004] discusses question rewriting versus searching within previous documents
SHAPAQUA ([Buchholz and Daelemans, 2001])

Dialogue systems for QA and providing information. A list

Portuguese legal document IR dialogue system [Quaresma and Rodrigues, 2003]
Nara Institute system [Inui et al., 2003]
De Boni system; [De Boni and Manandhar, 2004] is a treatise on using searching within previous documents for fuq.
RitsQA; [Fukumoto et al., 2004c] discusses fuq sentence rewriting strategy.
LCC-QAS [Harabagiu et al., 2001] QA system that participated in Trec10 context task.
IMIX [Akker et al., 2005]
Kyoto system [Komatani et al., 2005] [Misu and Kawahara, 2005]
Ritel [Galibert et al., 2005] what method?
Webtalk [Feng et al., 2005]
NTT system (SPIQA?); [Denecke and Yasuda, 2005] and [Denecke and Tsukada, 2005] propose using SVM for generating system prompts; [Hori et al., 2003] proposes generating system prompts using dependency graph of question.
MIRACLE [Stein et al., 1998]
TVGuide
AdFilm
HITIQUA: complex non-precise questions. [Small et al., 2003] proposes system clarification using document topics. [Wacholder et al., 2004] discusses evaluation.
Ariadne: data driven (generalisation of slot filling using feature structures). (apparent ancestor: [Denecke and Waibel, 1999]).
AMITIES
EES, PEA [Moore, 1989]. Uses expert system techniques for system clarification and user fuq.

1.3 Multimodal systems

bibliography; overviews: [Navarretta, 2001], [Raisamo, 1999], COMIC survey [Vuurpijl et al., 2002]

Systems with multimodal output:

PITA (dutch)
VICO
OLGA
IPA, Intelligent Procedure Assistant, LARRI, etc. (slides)

Systems with multimodal input and output:

BIRON (robot) [Toptsis et al., 2005]
Delft MMI group's system: [Rothkrantz et al., 2004].
CAIP center's system [Shaikh et al., 1997]
COMIC. Surveys: [Catizone et al., 2002] [Vuurpijl et al., 2002] [Poller, 2002]
Ulysse - navigation assistant
EVI3D [Touraine et al., 2002]
DISCIPLE [Samuel et al., 1998]
DenK (dutch project) [Beun et al., 2004]. [Kievit et al., 2001]. Followed up by MATIS, Multimodal Access to Transaction and Information Services, dialogue manager B, see also Huub Prüst's page
iMap. [Kettebekov and Sharma, 2001]
SmartKom [Wahlster et al., 2001b] [Wahlster et al., 2001a] [Pfleger et al., 2003] (evaluation method PROMISE, [Beringer et al., 2002]). (ancestor VerbMobil [Reithinger and Klesen, 1997]).
WAXHOLM, followed up by GULAN [Gustafson et al., 1998] (educational system illustrating dialogue system development) and August and [Boye et al., 1999] (?), followed up by AdApt [Gustafson et al., 2002] [Hjalmarsson, 2005]. (AdApt is a multimodal information providing system in the housing domain that represents the search task explicitly)
QuickSet [Johnston et al., 1997], [Oviatt, 1999] / STAMP. Followed up by MATCH - multimodal access to city help. [Ehlen et al., 2002] [Johnston et al., 2001].
Virtual Reality Aircraft Maintenance Training Prototype
LingWear (article)
Portable Voice Assistant (BBN) (article)
UI on the fly
CARTOON paper
INTERFACE (helper for human-human VR interaction)

1.4 Conferences and journals

IJCAI Workshops on knowledge and reasoning in practical dialogue systems
SIGDIAL
Eurospeech
DiaBruck
ICSLP
COLING
NMI: Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems

1.5 People

L�on Rothkrantz
Niels Ole Bernsen
Arne Jönsson
Gert Veldhuijzen van Zanten
Martine Hurault-Plantet
Harry Bunt. [Bunt, 1996] [Bunt, 2000a] [Bunt and van der Sloot, 1996]
Dan Bohus
Staffan Larsson
Curry I Guinn
Alex Gruenstein
Marilyn Walker
David Traum, Carl Andersen
Johan Boye, Mats Wirèn
Botond Pakucs
C�cile Tiberghien Balkanski
Joseph Polifroni
Jean-Claude Martin (multimodality)
Stephanie Buisine (multimodality)

1.6 Miscellaneous literature

Knowledge, ontology

[Beun et al., 2004], [Flycht-Eriksson, 2003], [Bunt, 2003]

Semantic context, reference resolution

[Chai and Jin, 2004], [Pineda and Garza, 2000], [Kennedy and Boguraev, 1996], [Preiss et al., 2004]

Machine learning and dialogue

[Lendvai et al., 2003], [Lendvai and Maruster, 2003]

Studies of dialogue, multimodal dialogue, monologue/dialogue structure, etc.

[Muller and Prévot, 2003], [Oviatt and Olsen, 1994], [Purver et al., 2001], [Ryan, 2001], [Samuel et al., 1998], [Traum, 2000], [Moore and Pollack, 1992] (RST), [Bunt, 2000b] (DIT), [Gabsdil, 2003] (clarification)

Dialogue coding and annotation

[Sikorski and Allen, 1997], [Delisle et al., 2003], [Grönqvist, 2002], [Hennoste et al., 2003]

Bibliography

Abreu et al., 2003: [LOCAL COPY] [Google]
Abreu, S., Quaresma, P., Quintano, L., and Rodrigues, I. P. (2003).
A dialogue manager for accessing databases.
In EJC 2003, pages 210-219.
Akker et al., 2005: [LOCAL COPY] [Google]
Akker, R. o. d., Bunt, H., Keizer, S., and Schooten, B. v. (2005).
From question answering to spoken dialogue: towards an information search assistant for interactive multimodal information extraction.
In Interspeech 2005, pages 2793-2796.
Amores and Quesada, 2000: [LOCAL COPY] [URL: overcite.lcs.mit.edu/amores00dialogue.html] [Google]
Amores, J. G. and Quesada, J. F. (2000).
Dialogue moves in natural command languages.
Technical report, SRI International, Cambridge.
Siridus deliverable D1.1.
Andén et al., 2004: [LOCAL COPY] [Google]
Andén, F., Degerstedt, L., Flycht-Eriksson, A., Jonsson, A., Merkel, M., and Norberg, S. (2004).
Experiences from combining dialogue system development with information access techniques.
In New Directions in Question Answering. AAAI/MIT Press.
Azzini et al., 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/azzini01first.html] [Google]
Azzini, I., Falavigna, D., Gretter, R., Lanzola, G., and Orlandi, M. (2001).
First steps toward an adaptive spoken dialogue system in medical domain.
In EUROSPEECH 2001.
Beringer et al., 2002: [LOCAL COPY] [Google]
Beringer, N., Kartal, U., Louka, K., Schiel, F., and Türk, U. (2002).
Promise - a procedure for multimodal interactive system evaluation.
Technical Report NR-23, DFKI GmbH.
Bernsen and Dybkjaer, 1999: [LOCAL COPY] [Google]
Bernsen, N. O. and Dybkjaer, L. (1999).
DISC dialogue engineering best practice methodology.
Technical Report D3.8a, DISC, Esprit Long-term Research Concerted Action No. 24823.
Bernsen and Dybkjaer, 2005: [LOCAL COPY] [Google]
Bernsen, N. O. and Dybkjaer, L. (2005).
User evaluation of conversational agent h. c. andersen.
In Interspeech 2005, pages 2473-2476.
Beun et al., 2004: [LOCAL COPY] [Google]
Beun, R.-J., van Eijk, R. M., and Prust, H. (2004).
Ontological feedback in multiagent systems.
In AAMAS '04: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, pages 110-117, Washington, DC, USA. IEEE Computer Society.
Boye et al., 1999: [LOCAL COPY] [URL: citeseer.ist.psu.edu/boye99languageprocessing.html] [Google]
Boye, J., Wiren, M., Rayner, M., Lewin, I., Carter, D., and Becket, R. (1999).
Language-processing strategies and mixed-initiative dialogues.
In Proceedings of IJCAI-99 Workshop on Knowledge and Reasoning in Practical Dialogue Systems.
Buchholz and Daelemans, 2001: [LOCAL COPY] [Google]
Buchholz, S. and Daelemans, W. (2001).
Complex answers: A case study using a WWW question answering system.
Natural Language Engineering, Special Issue on Question Answering.
Bunt, 2000a: [LOCAL COPY] [URL: citeseer.ist.psu.edu/bunt00dialogue.html] [Google]
Bunt, H. (2000a).
Dialogue pragmatics and context specification, volume 1 of Studies in Computational Pragmatics, pages 81-150.
Benjamins.
Bunt, 2000b: [LOCAL COPY] [Google]
Bunt, H. (2000b).
Non-problems and social obligations in human-computer conversation.
In Proceedings of the 3rd International Workshop on Human-Computer Conversation.
Bunt and van der Sloot, 1996: [LOCAL COPY] [URL: citeseer.ist.psu.edu/254079.html] [Google]
Bunt, H. and van der Sloot, K. (1996).
Parsing as dynamic interpretation of feature structures.
In Bunt, H. and Tomita, M., editors, Recent Advances in Parsing Technology. Kluwer Academic Publishers, Dordrecht.
Bunt, 1996: [LOCAL COPY] [URL: citeseer.ist.psu.edu/bunt97dynamic.html] [Google]
Bunt, H. C. (1996).
Dynamic interpretation and dialogue theory.
In Taylor, M. M., Néel, F., , and Bouwhuis, D. G., editors, The Structure of Multimodal Dialogue, Volume 2. John Benjamins, Amsterdam.
Bunt, 2003: [LOCAL COPY] [Google]
Bunt, H. C. (2003).
Underspecification in semantic representations: Which technique for what purpose?
In Proceedings of the Fifth International Workshop on Computational Semantics (IWCS-5), pages 37-54.
Catizone et al., 2002: [LOCAL COPY] [Google]
Catizone, R., Setzer, A., and Wilks, Y. (2002).
State of the art in dialogue management.
Technical Report D5.1, COMIC project (IST02001-32311).
Chai and Jin, 2004: [LOCAL COPY] [Google]
Chai, J. Y. and Jin, R. (2004).
Discourse structure for context question answering.
In HLT-NAACL QA workshop 2004.
Chu et al., 2005: [LOCAL COPY] [Google]
Chu, S.-W., O'Neill, I., Hanna, P., and McTear, M. (2005).
An approach to multi-strategy dialogue management.
In Interspeech 2005, pages 865-868.
Dahlbäck and Jönsson, 1998: [LOCAL COPY] [URL: citeseer.ist.psu.edu/dahlback98coding.html] [Google]
Dahlbäck, N. and Jönsson, A. (1998).
A coding manual for the linköping dialogue model.
Unpublished.
De Boni and Manandhar, 2004: [LOCAL COPY] [Google]
De Boni, M. and Manandhar, S. (2004).
Implementing clarification dialogues in open domain question answering.
Journal of Natural Language Engineering.
accepted for publication.
Degerstedt and Johansson, 2003: [LOCAL COPY] [Google]
Degerstedt, L. and Johansson, P. (2003).
Evolutionary development of phase-based dialogue systems.
In Proceedings of the 8th Scandinavian Conference on Artificial Intelligence, pages 59-67.
Delisle et al., 2003: [LOCAL COPY] [Google]
Delisle, S., Moulin, B., and Copeck, T. (2003).
Surface-marker-based dialog modelling: A progress report on the MAREDI project.
Natural Language Engineering, 9(4).
Denecke and Tsukada, 2005: [LOCAL COPY] [Google]
Denecke, M. and Tsukada, H. (2005).
Instance-based generation for interactive restricted domain question answering systems.
In IJCNLP, pages 486-497.
Denecke and Waibel, 1999: [LOCAL COPY] [URL: citeseer.ist.psu.edu/denecke99integrating.html] [Google]
Denecke, M. and Waibel, A. (1999).
Integrating knowledge sources for the specification of a task-oriented dialogue system.
In Alexandersson, J., editor, Proceedings of the IJCAI-99 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, pages 33-40, Murray Hill, New Jersey. International Joint Conference on Artificial Intelligence.
Denecke and Yasuda, 2005: [LOCAL COPY] [Google]
Denecke, M. and Yasuda, N. (2005).
Does this answer your question? towards dialogue management for restricted domain question answering systems.
In Interspeech 2005.
Dolfing et al., 2005: [LOCAL COPY] [URL: www.reitter-it-media.de/compling/papers/dolfing2005fasilcorpora.pdf] [Google]
Dolfing, H., Reitter, D., Almeida, L., Beires, N., Cody, M., Gomes, R., Robinson, K., and Zielinski, R. (2005).
The FASiL speech and multimodal corpora.
In INTER/EUROSPEECH 2005.
Dybkjaer and Failenschmid, 1999: [LOCAL COPY] [Google]
Dybkjaer, L. and Failenschmid, K. (1999).
State-of-the-art survey of existing human factors tools.
Technical Report D2.7b, DISC, Esprit Long-term Research Concerted Action No. 24823.
Eckert and McGlashan, 1993: [LOCAL COPY] [URL: citeseer.ist.psu.edu/eckert93managing.html] [Google]
Eckert, W. and McGlashan, S. (1993).
Managing Spoken Dialogues for Information Services.
In EUROSPEECH, pages 1653-1656, Berlin, Germany.
Ehlen et al., 2002: [LOCAL COPY] [URL: citeseer.ist.psu.edu/ehlen02collecting.html] [Google]
Ehlen, P., Johnston, M., and Vasireddy, G. (2002).
Collecting mobile multimodal data for MATCH.
In Proceedings of ICSLP.
Feng et al., 2005: [LOCAL COPY] [Google]
Feng, J., Reddy, S., and Sara�lar, M. (2005).
Webtalk: mining websites for interactively answering questions.
In Interspeech 2005, pages 2485-2488.
Flycht-Eriksson, 1999: [LOCAL COPY] [URL: citeseer.ist.psu.edu/328028.html] [Google]
Flycht-Eriksson, A. (1999).
A survey of knowledge sources in dialogue systems.
In Alexandersson, J., editor, Proceedings of the IJCAI-99 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, pages 41-48, Murray Hill, New Jersey. International Joint Conference on Artificial Intelligence.
Flycht-Eriksson, 2001: [LOCAL COPY] [Google]
Flycht-Eriksson, A. (2001).
Domain Knowledge Management in Information-providing Dialogue Systems.
PhD thesis, Linköping University.
Flycht-Eriksson, 2003: [LOCAL COPY] [Google]
Flycht-Eriksson, A. (2003).
Design of ontologies for dialogue interaction and information extraction.
In Proceedings of IJCAI'03 workshop on Knowledge and reasoning in practical dialogue systems.
Fukumoto et al., 2004a: [LOCAL COPY] [Google]
Fukumoto, J., Kato, T., and Masui, F. (2004a).
An evaluation of question answering challenge (QAC-1).
In Working notes of the Third NTCIR Workshop Meeting.
Fukumoto et al., 2004b: [LOCAL COPY] [Google]
Fukumoto, J., Kato, T., and Masui, F. (2004b).
Question answering challenge for five ranked answers and list answers - overview of NTCIR4 QAC2 subtask 1 and 2.
In Working notes of the Fourth NTCIR Workshop Meeting.
Fukumoto et al., 2004c: [LOCAL COPY] [Google]
Fukumoto, J., Niwa, T., Itoigawa, M., and Matsuda, M. (2004c).
RitsQA: List answer detection and context task with ellipses handling.
In Working notes of the Fourth NTCIR Workshop Meeting, pages 310-314.
Gabsdil, 2003: [LOCAL COPY] [Google]
Gabsdil, M. (2003).
Clarification in spoken dialogue systems.
In Proceedings of the 2003 AAAI Spring Symposium Workshop on Natural Language Generation in Spoken and Written Dialogue, pages 28-35.
Galibert et al., 2005: [LOCAL COPY] [Google]
Galibert, O., Illouz, G., and Rosset, S. (2005).
Ritel: an open-domain, human-computer dialog system.
In Interspeech 2005, pages 909-912.
Grönqvist, 2002: [LOCAL COPY] [URL: www.gslt.hum.gu.se/ leifg/gslt/doc/dialog.pdf] [Google]
Grönqvist, L. (2002).
Dialogue act coding and modalities.
online.
GSLT Course paper, Dialogue Systems 1.
Grosz et al., 1996: [LOCAL COPY] [Google]
Grosz, B., Scott, D., Kamp, H., Cohen, P., and Giachin, E. (1996).
Discourse and dialogue.
In Cole, R., Mariani, J., Uszkoreit, H., Zaenen, A., and Zue, V., editors, Survey of the State of the Art of Human Language Technology, chapter 6. Cambridge University Press, Cambridge, MA.
Gruenstein, 2002: [LOCAL COPY] [URL: citeseer.ist.psu.edu/gruenstein02conversational.html] [Google]
Gruenstein, A. (2002).
Conversational interfaces: A domain-independent architecture for task-oriented dialogues.
Master's thesis, Stanford university.
Gustafson et al., 2002: [LOCAL COPY] [Google]
Gustafson, J., Bell, L., Boye, J., Edlund, J., and Wirén, M. (2002).
Constraint manipulation and visualization in a multimodal dialogue system.
In Dybkjaer, L., André, E., Minker, W., and Heisterkamp, P., editors, Proceedings of the ISCA Tutorial and Research Workshop on Multi-Modal Dialogue in Mobile Environments.
Gustafson et al., 1998: [LOCAL COPY] [Google]
Gustafson, J., Elmberg, P., Carlson, R., and Jönsson, A. (1998).
An educational dialogue system with a user controllable dialogue manager.
In Proceedings of ICSLP 98.
Harabagiu et al., 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/article/harabagiu01answering.html] [Google]
Harabagiu, S. M., Moldovan, D. I., Pasca, M., Surdeanu, M., Mihalcea, R., Girju, R., Rus, V., Lactusu, F., Morarescu, P., and Bunescu, R. C. (2001).
Answering complex, list and context questions with LCC's question-answering server.
In Text REtrieval Conference.
Hennoste et al., 2003: [LOCAL COPY] [URL: citeseer.ist.psu.edu/647930.html] [Google]
Hennoste, T., Koit, M., Rääbis, A., Strandson, K., Valdisoo, M., and Vutt, E. (2003).
Developing a typology of dialogue acts: Some boundary problems.
Hjalmarsson, 2005: [LOCAL COPY] [Google]
Hjalmarsson, A. (2005).
Towards user modelling in conversational dialogue systems: a qualitative study of the dynamics of dialogue parameters.
In Interspeech 2005, pages 869-872.
Hofs et al., 2003: [LOCAL COPY] [Google]
Hofs, D. H. W., op den Akker, H. J. A., and Nijholt, A. (2003).
A generic architecture and dialogue model for multimodal interaction.
In Nordic Symposium on Multimodal Communication, pages 79-92.
Hori et al., 2003: [LOCAL COPY] [Google]
Hori, C., Hori, T., Isozaki, H., Maeda, E., Katagiri, S., and Furui, S. (2003).
Deriving disambiguous queries in a spoken interactive ODQA system.
In Proc. ICASSP, volume 1, pages 624-627.
Hurault-Plantet and Balkanski, 1998: [LOCAL COPY] [Google]
Hurault-Plantet, M. and Balkanski, C. T. (1998).
Communication and manipulation acts in a collaborative dialogue model.
In Cooperative Multimodal Communication 98, pages 125-139.
Inui et al., 2003: [LOCAL COPY] [Google]
Inui, K., Yamashita, A., and Matsumoto, Y. (2003).
Dialogue management for language-based information seeking.
In Proc. First International Workshop on Language Understanding and Agents for Real World Interaction, pages 32-38.
Johansson, 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/johansson02iterative.html] [Google]
Johansson, P. (2001).
Iterative development of an information-providing dialogue system.
In 7th ERCIM workshop on Interfaces for All.
Johnston et al., 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/johnston01match.html] [Google]
Johnston, M., Bangalore, S., and Vasireddy, G. (2001).
MATCH: Multimodal access to city help.
In Automatic Speech Recognition and Understanding Workshop.
Johnston et al., 1997: [LOCAL COPY] [URL: citeseer.ist.psu.edu/johnston97unificationbased.html] [Google]
Johnston, M., Cohen, P. R., McGee, D., Oviatt, S. L., Pittman, J. A., and Smith, I. (1997).
Unification-based multimodal integration.
In Cohen, P. R. and Wahlster, W., editors, Proceedings of the Thirty-Fifth Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics, pages 281-288, Somerset, New Jersey. Association for Computational Linguistics.
Jokinen, 1994: [LOCAL COPY] [Google]
Jokinen, K. (1994).
Response planning in information-seeking Dialogues.
Doctor of philosophy, University of Manchester Institute of Science and Technology.
Jönsson, 1991: [LOCAL COPY] [Google]
Jönsson, A. (1991).
A dialogue manager using initiative-response units and distributed control.
In EACL91: the 5th Conference of the European Chapter of the ACL, pages 233-238.
Kato et al., 2004a: [LOCAL COPY] [Google]
Kato, T., Fukumoto, J., and Masui, F. (2004a).
Question answering challenge for information access dialogue - overview of NTCIR4 QAC2 subtask 3.
In Working notes of the Fourth NTCIR Workshop Meeting.
Kato et al., 2004b: [LOCAL COPY] [Google]
Kato, T., Fukumoto, J., Masui, F., and Kando, N. (2004b).
Handling information access dialogue through QA technologies - a novel challenge for open-domain question answering.
In Proceedings of the Workshop on Pragmatics of Question Answering at HLT-NAACL 2004, pages 70-77.
Kennedy and Boguraev, 1996: [LOCAL COPY] [Google]
Kennedy, C. and Boguraev, B. (1996).
Anaphora in a wider context: Tracking discourse referents.
In Proceedings of the 12th European Conference on Artificial Intelligence (ECAI-96), pages 582-586.
Kettebekov and Sharma, 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/kettebekov01toward.html] [Google]
Kettebekov, S. and Sharma, R. (2001).
Toward natural gesture/speech control of a large display.
In EHCI 01, pages 221-234.
Kievit et al., 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/article/kievit01multimodal.html] [Google]
Kievit, L., Piwek, P., Beun, R.-J., and Bunt, H. (2001).
Multimodal cooperative resolution of referential expressions in the DenK system.
Lecture Notes in Computer Science, 2155:197-??
Komatani et al., 2005: [LOCAL COPY] [Google]
Komatani, K., Kanda, N., Ogata, T., and Okuno, H. G. (2005).
Contextual constraints based on dialogue models in database search task for spoken dialogue systems.
In Interspeech 2005, pages 877-880.
Krahmer, 2001: [LOCAL COPY] [Google]
Krahmer, E. (2001).
The science and art of voice interfaces.
report written for Philips Research Eindhoven, Netherlands.
Krum et al., 2005: [LOCAL COPY] [Google]
Krum, U., Holzapfel, H., and Waibel, A. (2005).
Clarification questions to improve dialogue flow and speech recognition in spoken dialogue systems.
In Interspeech 2005, pages 3417-3420.
Larsson, 1998: [LOCAL COPY] [URL: citeseer.ist.psu.edu/larsson98coding.html] [Google]
Larsson, S. (1998).
Coding schemas for dialogue moves.
Technical Report S-DIME project, Göteborg university.
Larsson, 2002: [LOCAL COPY] [Google]
Larsson, S. (2002).
Issue-based dialogue management.
PhD thesis, Göteborg University.
Lemon et al., 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/lemon01witas.html] [Google]
Lemon, O., Bracy, A., Gruenstein, A., and Peters, S. (2001).
The WITAS multi-modal dialogue system I.
In 7th European Conference on Speech Communication and Technology (EuroSpeech).
Lendvai and Maruster, 2003: [LOCAL COPY] [Google]
Lendvai, P. and Maruster, L. (2003).
Process discovery for evaluating dialogue strategies.
In Proceedings of the ISCA Workshop on Error Handling in Spoken Dialogue Systems, pages 119-122.
Lendvai et al., 2003: [LOCAL COPY] [Google]
Lendvai, P., van den Bosch, A., and Krahmer, E. (2003).
Machine learning for shallow interpretation of user utterances in spoken dialogue systems.
In Proceedings of the EACL-03 Workshop on Dialogue Systems: Interaction, Adaptation and Styles of Management.
Luz, 1999: [LOCAL COPY] [Google]
Luz, S. (1999).
State-of-the-art survey of dialogue management tools.
Technical Report D2.7a, DISC, Esprit Long-term Research Concerted Action No. 24823.
Melin, 2001: [LOCAL COPY] [URL: citeseer.ist.psu.edu/melin01atlas.html] [Google]
Melin, H. (2001).
ATLAS: A generic software platform for speech technology based applications.
Technical Report TMH-QPSR 1/2001, KTH.
Misu and Kawahara, 2005: [LOCAL COPY] [Google]
Misu, T. and Kawahara, T. (2005).
Dialogue strategy to clarify user's queries for document retrieval system with speech interface.
In Interspeech 2005, pages 637-640.
Moore, 1989: [LOCAL COPY] [Google]
Moore, J. D. (1989).
Responding to `Huh?': Answering vaguely-articulated follow-up questions.
In Proceedings of the Conference on Human Factors in Computing Systems.
Moore and Pollack, 1992: [LOCAL COPY] [URL: citeseer.ist.psu.edu/article/moore92problem.html] [Google]
Moore, J. D. and Pollack, M. E. (1992).
A problem for RST: The need for multi-level discourse analysis.
Computational Linguistics, 18(4):537-544.
Muller and Prévot, 2003: [LOCAL COPY] [Google]
Muller, P. and Prévot, L. (2003).
An empirical study of acknowledgement structures.
In DiaBruck 2003.
Navarretta, 2001: [LOCAL COPY] [Google]
Navarretta, C. (2001).
Exploiting Recent Research on Dialogue to Model Verbal Communication in Staging, pages 250-270.
Oh et al., 2001: [LOCAL COPY] [Google]
Oh, J.-H., Lee, K.-S., Chang, D.-S., Seo, C. W., and Choi, K.-S. (2001).
Trec-10 experiments at kaist: Batch filtering and question answering.
In TREC.
Oviatt, 1999: [LOCAL COPY] [URL: citeseer.ist.psu.edu/oviatt99mutual.html] [Google]
Oviatt, S. L. (1999).
Mutual disambiguation of recognition errors in a multimodel architecture.
In CHI, pages 576-583.
Oviatt and Olsen, 1994: [LOCAL COPY] [URL: citeseer.ist.psu.edu/oviatt94integration.html] [Google]
Oviatt, S. L. and Olsen, E. (1994).
Integration themes in multimodal human-computer interaction.
In Proceedings of the ICSLP, pages 551-554.
Pakucs, 2002: [LOCAL COPY] [URL: citeseer.ist.psu.edu/pakucs02voicexmlbased.html] [Google]
Pakucs, B. (2002).
Voicexml-based dynamic plug and play dialogue management for mobile environments.
In Proceedings of ISCA T&R Workshop on Multi-Modal Dialogue in Mobile Environments.
Pfleger et al., 2003: [LOCAL COPY] [Google]
Pfleger, N., Engel, R., and Alexandersson, J. (2003).
Robust multimodal discourse processing.
In DiaBruck 2003.
Pineda and Garza, 2000: [LOCAL COPY] [Google]
Pineda, L. and Garza, G. (2000).
A model for multimodal reference resolution.
Comput. Linguist., 26(2):139-193.
Polifroni and Chung, 2002: [LOCAL COPY] [URL: citeseer.ist.psu.edu/polifroni02promoting.html] [Google]
Polifroni, J. and Chung, G. (2002).
Promoting portability in dialogue management.
In ICSLP 2002.
Poller, 2002: [LOCAL COPY] [Google]
Poller, P. (2002).
Overview of the state of the art in system architectures.
Technical Report D1.1, COMIC project (IST02001-32311).
Pouteau et al., 1997: [LOCAL COPY] [URL: citeseer.ist.psu.edu/pouteau97robust.html] [Google]
Pouteau, X., Krahmer, E., and Landsbergen, J. (1997).
Robust spoken dialogue management for driver information systems.
In Proc. Eurospeech '97, pages 2207-2210, Rhodes, Greece.
Preiss et al., 2004: [LOCAL COPY] [Google]
Preiss, J., Gasperin, C., and Briscoe, T. (2004).
Can anaphoric definite descriptions be replaced by pronouns?
In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC '04).
Purver et al., 2001: [LOCAL COPY] [Google]
Purver, M., Ginzburg, J., and Healey, P. (2001).
On the means for clarification in dialogue.
In Proceedings of the 2nd ACL SIGdial Workshop on Discourse and Dialogue, pages 116-125. Association for Computational Linguistics.
Quaresma and Rodrigues, 2003: [Google]
Quaresma, P. and Rodrigues, I. (2003).
Using dialogues to access semantic knowledge in a web legal ir system.
In Proc. of the 16th Annual Conference on Legal Knowledge and Information Systems (JURIX�03), pages 9-16.
Raisamo, 1999: [LOCAL COPY] [Google]
Raisamo, R. (1999).
Multimodal human-computer interaction: a constructive and empirical study.
Master's thesis, university of Tampere.
Reithinger and Klesen, 1997: [LOCAL COPY] [URL: verbmobil.dfki.de/dialog/] [Google]
Reithinger, N. and Klesen, M. (1997).
Dialogue act classification using language models.
In Proceedings of EuroSpeech-97, pages 2235-2238, Rhodes.
Rothkrantz et al., 2004: [LOCAL COPY] [Google]
Rothkrantz, L. J. M., Wiggers, P., Flippo, F., Woei-A-Jin, D., and van Vark, R. (2004).
Multimodal dialog management.
In Proceedings of Text, Speech and Dialogues 2004.
Ryan, 2001: [LOCAL COPY] [Google]
Ryan, S. (2001).
A syntactic and semantic analysis of dialogue.
Master's thesis, University of Dublin, Department of Computer Science.
Samuel et al., 1998: [LOCAL COPY] [URL: citeseer.ist.psu.edu/samuel98dialogue.html] [Google]
Samuel, K., Carberry, S., and Vijay-Shanker, K. (1998).
Dialogue act tagging with transformation-based learning.
In COLING-ACL, pages 1150-1156.
Shaikh et al., 1997: [LOCAL COPY] [URL: citeseer.ist.psu.edu/article/shaikh97architecture.html] [Google]
Shaikh, A., Juth, S., Medl, A., Marsic, I., Kulikowski, C., and Flanagan, J. (1997).
An architecture for multimodal information fusion.
In Proceedings of the Workshop on Perceptual User Interfaces, pages 91 - 93.
Sidner, 2002: [LOCAL COPY] [Google]
Sidner, C. L. (2002).
Building spoken language collaborative interface agents.
Technical report, Mitsubishi electric research labs.
Sikorski and Allen, 1997: [LOCAL COPY] [URL: citeseer.ist.psu.edu/sikorski97scheme.html] [Google]
Sikorski, T. and Allen, J. (1997).
A scheme for annotating problem solving actions in dialogue.
In Traum, D., editor, Working Notes: AAAI Fall Symposium on Communicative Action in Humans and Machines, pages 83-89, Menlo Park, California. American Association for Artificial Intelligence.
Small et al., 2003: [LOCAL COPY] [Google]
Small, S., Liu, T., Shimizu, N., and Strzalkowski, T. (2003).
HITIQA: an interactive question answering system: A preliminary report.
In Proceedings of the ACL 2003 Workshop on Multilingual Summarization and Question Answering.
Stein et al., 1998: [LOCAL COPY] [Google]
Stein, A., Gulla, J. A., M�ller, A., and Thiel, U. (1998).
Abductive dialogue planning for concept-based multimedia information retrieval, pages 129-148.
Sturm et al., 1999: [LOCAL COPY] [Google]
Sturm, J., Os, E. d., and Boves, L. (1999).
Issues in spoken dialogue systems: experiences with the dutch ARISE system.
In ESCA tutorial and research workshop: interactive dialogue in multimodal systems.
Toptsis et al., 2005: [LOCAL COPY] [Google]
Toptsis, I., Haasch, A., H�wel, S., Fritsch, J., and Fink, G. (2005).
Modality integration and dialog management for a robotic assistant.
In Proc. European Conf. on Speech Communication and Technology.
Touraine et al., 2002: [LOCAL COPY] [URL: www.eg.org/EG/DL/WS/EGVE02/p159-168-touraine.pdf] [Google]
Touraine, D., Bourdot, P., Bellik, Y., and Bolot, L. (2002).
A framework to manage multimodal fusion of events for advanced interactions within virtual environments.
In Eighth Eurographics Workshop on Virtual Environments, pages 159-168. Eurographics Association.
Traum and Andersen, 1999: [LOCAL COPY] [URL: citeseer.ist.psu.edu/article/traum99representations.html] [Google]
Traum, D. and Andersen, C. (1999).
Representations of dialogue state for domain and task independent meta-dialogue.
In Alexandersson, J., editor, Proceedings of the IJCAI-99 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, pages 113-120, Murray Hill, New Jersey. International Joint Conference on Artificial Intelligence.
Traum, 2000: [LOCAL COPY] [URL: citeseer.ist.psu.edu/article/traum00questions.html] [Google]
Traum, D. R. (2000).
20 questions for dialogue act taxonomies.
Journal of Semantics, 17(1):7-30.
Traum and Nakatani, 1999: [LOCAL COPY] [URL: citeseer.ist.psu.edu/traum98twolevel.html] [Google]
Traum, D. R. and Nakatani, C. H. (1999).
A two-level approach to coding dialogue for discourse structure: Activities of the 1998 DRI working group on higher-level structures.
In Walker, M., editor, Towards Standards and Tools for Discourse Tagging: Proceedings of the Workshop, pages 101-108. Association for Computational Linguistics, Somerset, New Jersey.
Turunen, 2004: [LOCAL COPY] [Google]
Turunen, M. (2004).
Jaspis - A Spoken Dialogue Architecture and its Applications.
PhD thesis, Tampere University, Dept. of Information Studies, Finland.
Villarejo et al., 2003: [LOCAL COPY] [Google]
Villarejo, L., Castell, N., and Hernando, J. (2003).
Dialogue management in an automatic meteorological information system.
In IEA/AIE 2003, pages 495-504.
Voorhees, 2001: [LOCAL COPY] [URL: trec.nist.gov/pubs/trec10/papers/overview_10.pdf] [Google]
Voorhees, E. M. (2001).
Overview of TREC 2001.
In TREC.
Voorhees, 2003: [LOCAL COPY] [URL: trec.nist.gov/pubs/trec12/papers/OVERVIEW.12.pdf] [Google]
Voorhees, E. M. (2003).
Overview of TREC 2003.
In TREC.
Vuurpijl et al., 2002: [LOCAL COPY] [Google]
Vuurpijl, L., Bosch, L. t., Ruiter, J. P. d., Rossignol, S., Boves, L., Engel, R., and Pfleger, N. (2002).
Overview of the state of the art in fusion of speech and pen input.
Technical Report D4.1, COMIC project (IST02001-32311).
Wacholder et al., 2004: [LOCAL COPY] [Google]
Wacholder, N., Small, S., Bai, B., Kelly, D., Rittman, R., Ryan, S., Salkin, R., Song, P., Sun, Y., Ting, L., Kantor, P., and Strazalkowski, T. (2004).
Designing a realistic evaluation of an end-to-end interactive question answering system.
In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC '04).
Wahlster et al., 2001a: [LOCAL COPY] [Google]
Wahlster, W., Reithinger, N., and Blocher, A. (2001a).
Smartkom: Multimodal communication with a life-like character.
Technical Report NR-05, DFKI GmbH.
Wahlster et al., 2001b: [LOCAL COPY] [Google]
Wahlster, W., Reithinger, N., and Blocher, A. (2001b).
Smartkom: Towards multimodal dialogues with anthropomorphic interface agents.
Technical Report NR-15, DFKI GmbH.
Wallentin, 2004: [LOCAL COPY] [Google]
Wallentin, A. (2004).
DiaView: a dialogue system for video conferencing.
Master's thesis, G�teborg University.
Webb et al., 1999: [LOCAL COPY] [URL: citeseer.ist.psu.edu/webb99natural.html] [Google]
Webb, N., De Roeck, A., Kruschwitz, U., Scott, P., Steel, S., and Turner, R. (1999).
Natural Language Engineering: Slot-Filling in the YPA.
In Proceedings of the Workshop on Natural Language Interfaces, Dialogue and Partner Modelling (at the Fachtagung für Künstliche Intelligenz KI'99), Bonn, Germany.
Winikoff and Kosseim, 2004: [LOCAL COPY] [Google]
Winikoff, S. and Kosseim, L. (2004).
Is context actually helpful? preliminary experiments in contextual question answering.
In Proceedings of the Workshop Computational Linguistics in the North-East (CLiNE 2004), pages 64-66, Montreal, Canada. CLiNE 2004.

Boris van Schooten 2006-01-13