Magnini, Bernardo and Romagnoli, Simone and Vallin, Alessandro and Herrera, Jesús and Peñas, Anselmo and Peinado, Víctor and Verdejo, Felisa and de Rijke, Maarten (2004) Creating the DISEQuA corpus: a test set for multilingual question answering. In : Comparative Evaluation of Multilingual Information Access Systems: 4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003, Revised Selected Papers. Lecture Notes in Computer Science, 3237 . Springer-Verlag, Berlin, pp. 487-500. ISBN 3 540 24017 9
Official URL: http://www.clef-campaign.org/2003/WN_web/37.pdf
This paper describes the procedure adopted by the three coordinators of the CLEF 2003 question answering track (ITC-irst, UNED and ILLC) to create the question set for the monolingual tasks. Despite the few resources available, the three groups managed to formulate and verify a large pool of original questions in three different languages: Dutch, Italian and Spanish. Part of these queries was translated into English and shared between the three coordinating groups. A second cross-verification was then conducted in order to identify the queries that had an answer in all three monolingual document collections. The result of the joint efforts was the creation of the DISEQuA (Dutch Italian Spanish English Questions and Answers) corpus, a useful and reusable resource that is freely available for the research community. We report on the different stages of the corpus creation, from the monolingual kernels to the multilingual extension.
|Item Type:||Book Section|
Artículo de los organizadores del CLEF 2003.
|Uncontrolled Keywords:||Multilingual test set development; Desarrollo de corpus de prueba multilingue; Question answering; Pregunta respuesta; CLEF 2003|
|Subjects:||Sciences > Computer science > Artificial intelligence|
|Deposited On:||03 Apr 2006|
|Last Modified:||06 Feb 2014 07:44|
Repository Staff Only: item control page